2024-09-13T19:19:29.688 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T19:19:29.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T19:19:29.787 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7904078' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-qa-rgw-squid-65651 sha1: 24ee2aeecf070bf47d80960334abd82047ad2def owner: scheduled_cbodley@teuthology priority: 90 repo: https://github.com/ceph/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9887 sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a sleep_before_teardown: 0 suite: rgw suite_branch: wip-qa-rgw-squid-65651 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 24ee2aeecf070bf47d80960334abd82047ad2def targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHAyZTEahqhvc1K6nsv+7LP5O0KHXzxGifeUEsf6DsQZvcFv7MxgtrAy7FCieHG9rpF/sdQqhEBrqxS6wpxQ6c= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIpNePanuKaqLrETB3ikdVAfMeoI6v5fcj8FwwrUoup9oFQD5LDVL42d/sWP/1V6dJPPJr+f66ZDW/5bXNGTCFg= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_16:28:49 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T19:19:29.787 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa; will attempt to use it 2024-09-13T19:19:29.788 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa/tasks 2024-09-13T19:19:29.788 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T19:19:29.789 INFO:teuthology.task.internal:Checking packages... 2024-09-13T19:19:29.810 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7741f7f9ee20524f89b8f61d1609b32fb3b1570a' 2024-09-13T19:19:29.810 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T19:19:29.810 INFO:teuthology.packaging:ref: None 2024-09-13T19:19:29.810 INFO:teuthology.packaging:tag: None 2024-09-13T19:19:29.810 INFO:teuthology.packaging:branch: squid 2024-09-13T19:19:29.810 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:19:29.811 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-13T19:19:30.041 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:19:30.046 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T19:19:30.052 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T19:19:30.052 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T19:19:30.132 INFO:teuthology.task.internal:Saving configuration 2024-09-13T19:19:30.144 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T19:19:30.150 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T19:19:30.181 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 19:13:56.544071', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID7Z+SEgyFKObPRgUUfoICV9hu2JR4Bev+K9dxE+BsdV'} 2024-09-13T19:19:30.216 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 19:13:56.542665', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINuAMPfnzT3qoK2MhLTMAiMIWvTNuk9qEI3B7hbnhKe6'} 2024-09-13T19:19:30.216 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T19:19:30.222 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-13T19:19:30.223 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T19:19:30.223 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T19:19:30.325 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f420756d2d0>, signals=[15]) 2024-09-13T19:19:30.325 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T19:19:30.368 INFO:teuthology.task.internal:Opening connections... 2024-09-13T19:19:30.368 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T19:19:30.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:19:30.479 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:19:30.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:19:30.564 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T19:19:30.570 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-13T19:19:30.576 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-13T19:19:30.576 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="22.04" 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=jammy 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T19:19:30.622 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=jammy 2024-09-13T19:19:30.623 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-13T19:19:30.648 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-13T19:19:30.653 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-13T19:19:30.653 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-13T19:19:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T19:19:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Ubuntu" 2024-09-13T19:19:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="22.04" 2024-09-13T19:19:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T19:19:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_CODENAME=jammy 2024-09-13T19:19:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:ID=ubuntu 2024-09-13T19:19:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE=debian 2024-09-13T19:19:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T19:19:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T19:19:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T19:19:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T19:19:30.700 INFO:teuthology.orchestra.run.smithi144.stdout:UBUNTU_CODENAME=jammy 2024-09-13T19:19:30.700 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-13T19:19:30.731 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T19:19:30.742 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T19:19:30.802 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T19:19:30.803 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-13T19:19:30.805 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-13T19:19:30.809 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T19:19:30.821 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T19:19:30.821 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-13T19:19:30.851 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-13T19:19:30.858 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T19:19:30.924 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T19:19:30.938 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T19:19:30.938 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T19:19:30.939 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T19:19:30.939 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T19:19:30.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:19:30.944 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-13T19:19:30.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:19:30.945 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-13T19:19:30.990 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-56-generic 2024-09-13T19:19:30.990 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.15.0-56-generic 2024-09-13T19:19:30.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2024-09-13T19:19:30.991 INFO:teuthology.orchestra.run.smithi144.stdout:5.15.0-56-generic 2024-09-13T19:19:30.992 INFO:teuthology.task.kernel:Running kernel on smithi144: 5.15.0-56-generic 2024-09-13T19:19:30.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get clean 2024-09-13T19:19:31.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-09-13T19:19:31.145 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2024-09-13T19:19:31.256 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T19:19:31.294 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T19:19:31.294 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T19:19:31.294 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T19:19:31.296 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T19:19:31.361 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T19:19:31.366 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T19:19:31.377 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T19:19:31.501 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T19:19:31.533 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T19:19:31.563 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T19:19:31.597 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T19:19:31.600 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T19:19:31.601 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T19:19:31.604 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T19:19:31.620 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T19:19:31.621 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T19:19:31.625 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T19:19:31.625 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T19:19:31.631 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T19:19:31.636 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T19:19:31.639 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T19:19:31.640 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T19:19:31.641 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T19:19:31.641 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T19:19:31.642 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T19:19:31.643 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T19:19:31.643 INFO:teuthology.orchestra.run.smithi144.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T19:19:31.652 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T19:19:31.662 INFO:teuthology.orchestra.run.smithi144.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T19:19:31.668 INFO:teuthology.orchestra.run.smithi144.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T19:19:31.668 INFO:teuthology.orchestra.run.smithi144.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T19:19:31.669 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T19:19:31.669 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T19:19:31.669 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T19:19:31.670 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T19:19:31.670 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T19:19:31.670 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T19:19:31.671 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T19:19:31.671 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T19:19:31.671 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T19:19:31.672 INFO:teuthology.orchestra.run.smithi144.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T19:19:31.672 INFO:teuthology.orchestra.run.smithi144.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T19:19:31.678 INFO:teuthology.orchestra.run.smithi144.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T19:19:31.686 INFO:teuthology.orchestra.run.smithi144.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T19:19:31.687 INFO:teuthology.orchestra.run.smithi144.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T19:19:31.688 INFO:teuthology.orchestra.run.smithi144.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T19:19:31.691 INFO:teuthology.orchestra.run.smithi144.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T19:19:31.714 INFO:teuthology.orchestra.run.smithi144.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T19:19:31.714 INFO:teuthology.orchestra.run.smithi144.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T19:19:31.714 INFO:teuthology.orchestra.run.smithi144.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T19:19:31.717 INFO:teuthology.orchestra.run.smithi144.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T19:19:31.717 INFO:teuthology.orchestra.run.smithi144.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T19:19:31.717 INFO:teuthology.orchestra.run.smithi144.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T19:19:31.733 INFO:teuthology.orchestra.run.smithi144.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T19:19:31.737 INFO:teuthology.orchestra.run.smithi144.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T19:19:31.737 INFO:teuthology.orchestra.run.smithi144.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T19:19:31.744 INFO:teuthology.orchestra.run.smithi144.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T19:19:31.753 INFO:teuthology.orchestra.run.smithi144.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T19:19:31.754 INFO:teuthology.orchestra.run.smithi144.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T19:19:31.755 INFO:teuthology.orchestra.run.smithi144.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T19:19:31.755 INFO:teuthology.orchestra.run.smithi144.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T19:19:31.755 INFO:teuthology.orchestra.run.smithi144.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T19:19:31.767 INFO:teuthology.orchestra.run.smithi144.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T19:19:31.768 INFO:teuthology.orchestra.run.smithi144.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T19:19:31.768 INFO:teuthology.orchestra.run.smithi144.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T19:19:31.768 INFO:teuthology.orchestra.run.smithi144.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T19:19:31.784 INFO:teuthology.orchestra.run.smithi144.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T19:19:31.784 INFO:teuthology.orchestra.run.smithi144.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T19:19:31.785 INFO:teuthology.orchestra.run.smithi144.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T19:19:31.785 INFO:teuthology.orchestra.run.smithi144.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T19:19:31.785 INFO:teuthology.orchestra.run.smithi144.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T19:19:31.823 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T19:19:32.107 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T19:19:32.279 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T19:19:32.292 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T19:19:32.293 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T19:19:32.294 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T19:19:32.381 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T19:19:32.389 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T19:19:32.389 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T19:19:32.415 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T19:19:32.439 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T19:19:32.444 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T19:19:32.445 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T19:19:32.445 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T19:19:32.446 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T19:19:32.525 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T19:19:37.926 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 16.0 MB in 2s (7,382 kB/s) 2024-09-13T19:19:38.190 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 16.0 MB in 2s (7,239 kB/s) 2024-09-13T19:19:39.419 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-13T19:19:39.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T19:19:39.493 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-13T19:19:39.596 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-13T19:19:39.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T19:19:39.668 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-13T19:19:39.681 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-09-13T19:19:39.681 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-09-13T19:19:39.850 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T19:19:39.851 INFO:teuthology.orchestra.run.smithi144.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T19:19:39.851 INFO:teuthology.orchestra.run.smithi144.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T19:19:39.851 INFO:teuthology.orchestra.run.smithi144.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T19:19:39.851 INFO:teuthology.orchestra.run.smithi144.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T19:19:39.851 INFO:teuthology.orchestra.run.smithi144.stdout: python2.7-minimal 2024-09-13T19:19:39.851 INFO:teuthology.orchestra.run.smithi144.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T19:19:39.853 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2024-09-13T19:19:39.853 INFO:teuthology.orchestra.run.smithi144.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T19:19:39.853 INFO:teuthology.orchestra.run.smithi144.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T19:19:39.853 INFO:teuthology.orchestra.run.smithi144.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T19:19:39.854 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2024-09-13T19:19:39.854 INFO:teuthology.orchestra.run.smithi144.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T19:19:39.854 INFO:teuthology.orchestra.run.smithi144.stdout:Recommended packages: 2024-09-13T19:19:39.855 INFO:teuthology.orchestra.run.smithi144.stdout: thermald 2024-09-13T19:19:39.857 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-09-13T19:19:39.857 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-09-13T19:19:39.901 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2024-09-13T19:19:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T19:19:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T19:19:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T19:19:39.902 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages will be upgraded: 2024-09-13T19:19:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T19:19:40.029 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T19:19:40.030 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T19:19:40.030 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T19:19:40.030 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T19:19:40.030 INFO:teuthology.orchestra.run.smithi018.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T19:19:40.030 INFO:teuthology.orchestra.run.smithi018.stdout: python2.7-minimal 2024-09-13T19:19:40.030 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T19:19:40.031 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-09-13T19:19:40.032 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T19:19:40.032 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T19:19:40.032 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T19:19:40.033 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-09-13T19:19:40.033 INFO:teuthology.orchestra.run.smithi018.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T19:19:40.033 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2024-09-13T19:19:40.033 INFO:teuthology.orchestra.run.smithi018.stdout: thermald 2024-09-13T19:19:40.079 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-09-13T19:19:40.079 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T19:19:40.079 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T19:19:40.080 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T19:19:40.081 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2024-09-13T19:19:40.081 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T19:19:40.082 INFO:teuthology.orchestra.run.smithi144.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T19:19:40.082 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 113 MB of archives. 2024-09-13T19:19:40.082 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T19:19:40.082 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T19:19:40.131 INFO:teuthology.orchestra.run.smithi018.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T19:19:40.132 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 113 MB of archives. 2024-09-13T19:19:40.132 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T19:19:40.132 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T19:19:40.528 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T19:19:40.625 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T19:19:41.462 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T19:19:41.463 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T19:19:41.463 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T19:19:41.516 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T19:19:41.601 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T19:19:41.693 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T19:19:41.865 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T19:19:42.111 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 113 MB in 2s (70.4 MB/s) 2024-09-13T19:19:42.268 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T19:19:44.040 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T19:19:44.040 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T19:19:44.041 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T19:19:44.274 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T19:19:44.278 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T19:19:44.374 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T19:19:44.451 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T19:19:44.507 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:19:44.851 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-13T19:19:45.023 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T19:19:46.532 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T19:19:46.554 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T19:19:46.646 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:19:47.082 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T19:19:47.087 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T19:19:47.093 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T19:19:47.115 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T19:19:47.168 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:19:47.220 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:19:49.672 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T19:19:49.692 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T19:19:49.782 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:19:50.275 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T19:19:50.295 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T19:19:50.358 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:19:54.009 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T19:19:54.109 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T19:19:54.434 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T19:19:54.555 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T19:19:54.866 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T19:19:54.888 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T19:19:54.932 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T19:19:56.868 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T19:19:57.037 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T19:19:57.386 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T19:19:57.662 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T19:19:57.968 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T19:19:57.990 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T19:19:58.026 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T19:20:00.476 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T19:20:00.513 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T19:20:00.823 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:03.593 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T19:20:03.717 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T19:20:04.043 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T19:20:04.181 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:04.203 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T19:20:04.240 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T19:20:04.277 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:04.298 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T19:20:04.418 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:05.778 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T19:20:05.778 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T19:20:05.778 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T19:20:05.778 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T19:20:05.930 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:07.847 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:08.110 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T19:20:08.257 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T19:20:08.641 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T19:20:08.796 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:08.913 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T19:20:09.033 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:09.274 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T19:20:09.399 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T19:20:09.526 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:09.593 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T19:20:09.594 INFO:teuthology.orchestra.run.smithi018.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T19:20:10.396 INFO:teuthology.orchestra.run.smithi144.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T19:20:10.396 INFO:teuthology.orchestra.run.smithi144.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T19:20:10.397 INFO:teuthology.orchestra.run.smithi144.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T19:20:10.397 INFO:teuthology.orchestra.run.smithi144.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T19:20:10.569 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:12.029 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:13.771 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T19:20:13.931 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T19:20:14.057 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T19:20:14.148 INFO:teuthology.orchestra.run.smithi144.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T19:20:14.148 INFO:teuthology.orchestra.run.smithi144.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T19:20:24.362 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T19:20:24.362 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub' 2024-09-13T19:20:24.373 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T19:20:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:Generating grub configuration file ... 2024-09-13T19:20:24.675 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T19:20:24.694 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T19:20:25.000 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T19:20:25.006 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T19:20:25.085 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T19:20:25.090 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T19:20:25.252 INFO:teuthology.orchestra.run.smithi018.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T19:20:25.253 INFO:teuthology.orchestra.run.smithi018.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T19:20:25.253 INFO:teuthology.orchestra.run.smithi018.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T19:20:25.291 INFO:teuthology.orchestra.run.smithi018.stdout:done 2024-09-13T19:20:25.751 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2024-09-13T19:20:25.774 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2024-09-13T19:20:25.774 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2024-09-13T19:20:25.774 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2024-09-13T19:20:25.774 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2024-09-13T19:20:25.774 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 21 2024-09-13T19:20:25.774 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T19:20:25.774 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2024-09-13T19:20:25.775 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2024-09-13T19:20:25.775 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.15.0.121.121 2024-09-13T19:20:25.775 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T19:20:25.775 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T19:20:25.775 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2024-09-13T19:20:25.775 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2024-09-13T19:20:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2024-09-13T19:20:25.775 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2024-09-13T19:20:25.775 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T19:20:25.775 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T19:20:25.776 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T19:20:25.776 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T19:20:25.776 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T19:20:25.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2024-09-13T19:20:25.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-09-13T19:20:26.181 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T19:20:26.181 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T19:20:26.244 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T19:20:26.326 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T19:20:27.650 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-13T19:20:27.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T19:20:27.725 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-13T19:20:27.915 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-09-13T19:20:27.917 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-09-13T19:20:28.090 INFO:teuthology.orchestra.run.smithi018.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T19:20:28.091 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T19:20:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T19:20:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T19:20:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T19:20:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T19:20:28.091 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T19:20:28.091 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T19:20:28.133 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T19:20:28.135 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2024-09-13T19:20:28.150 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2024-09-13T19:20:28.150 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2024-09-13T19:20:28.150 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2024-09-13T19:20:28.150 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 21 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.15.0.121.121 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2024-09-13T19:20:28.151 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2024-09-13T19:20:28.152 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-13T19:20:28.198 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.rwocGyLMDJ 2024-09-13T19:20:28.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub/grub.cfg /tmp/tmp.rwocGyLMDJ 2024-09-13T19:20:28.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.rwocGyLMDJ 2024-09-13T19:20:28.366 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.rwocGyLMDJ is 10KB 2024-09-13T19:20:28.379 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.rwocGyLMDJ 2024-09-13T19:20:28.384 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T19:20:28.428 INFO:teuthology.orchestra.run.smithi144.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T19:20:28.428 INFO:teuthology.orchestra.run.smithi144.stdout:Sourcing file `/etc/default/grub' 2024-09-13T19:20:28.438 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:20:28.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T19:20:28.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T19:20:28.446 INFO:teuthology.orchestra.run.smithi144.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T19:20:28.463 INFO:teuthology.orchestra.run.smithi144.stdout:Generating grub configuration file ... 2024-09-13T19:20:28.506 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T19:20:28.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo update-grub 2024-09-13T19:20:28.757 INFO:teuthology.orchestra.run.smithi144.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T19:20:28.777 INFO:teuthology.orchestra.run.smithi144.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T19:20:29.134 INFO:teuthology.orchestra.run.smithi144.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T19:20:29.139 INFO:teuthology.orchestra.run.smithi144.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T19:20:29.208 INFO:teuthology.orchestra.run.smithi144.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T19:20:29.214 INFO:teuthology.orchestra.run.smithi144.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T19:20:29.399 INFO:teuthology.orchestra.run.smithi144.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T19:20:29.399 INFO:teuthology.orchestra.run.smithi144.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T19:20:29.400 INFO:teuthology.orchestra.run.smithi144.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T19:20:29.433 INFO:teuthology.orchestra.run.smithi144.stdout:done 2024-09-13T19:20:29.775 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub' 2024-09-13T19:20:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T19:20:29.779 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-13T19:20:29.944 DEBUG:teuthology.orchestra.run.smithi144:> dpkg -s linux-image-generic 2024-09-13T19:20:29.972 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T19:20:29.978 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T19:20:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Package: linux-image-generic 2024-09-13T19:20:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Status: install ok installed 2024-09-13T19:20:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Priority: optional 2024-09-13T19:20:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Section: kernel 2024-09-13T19:20:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Installed-Size: 21 2024-09-13T19:20:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T19:20:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: amd64 2024-09-13T19:20:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:Source: linux-meta 2024-09-13T19:20:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:Version: 5.15.0.121.121 2024-09-13T19:20:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T19:20:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T19:20:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:Recommends: thermald 2024-09-13T19:20:30.011 INFO:teuthology.orchestra.run.smithi144.stdout:Description: Generic Linux kernel image 2024-09-13T19:20:30.011 INFO:teuthology.orchestra.run.smithi144.stdout: This package will always depend on the latest generic kernel image 2024-09-13T19:20:30.011 INFO:teuthology.orchestra.run.smithi144.stdout: available. 2024-09-13T19:20:30.011 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T19:20:30.011 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T19:20:30.011 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T19:20:30.012 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-13T19:20:30.012 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T19:20:30.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get clean 2024-09-13T19:20:30.174 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2024-09-13T19:20:30.240 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T19:20:30.245 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T19:20:30.286 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T19:20:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T19:20:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T19:20:30.294 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T19:20:30.311 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T19:20:30.406 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T19:20:30.419 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T19:20:30.419 INFO:teuthology.orchestra.run.smithi018.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T19:20:30.419 INFO:teuthology.orchestra.run.smithi018.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T19:20:30.435 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-13T19:20:30.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-13T19:20:31.665 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-13T19:20:31.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T19:20:31.743 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-13T19:20:31.952 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-09-13T19:20:31.953 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-09-13T19:20:32.132 INFO:teuthology.orchestra.run.smithi144.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T19:20:32.132 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T19:20:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T19:20:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T19:20:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T19:20:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T19:20:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T19:20:32.133 INFO:teuthology.orchestra.run.smithi144.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T19:20:32.173 INFO:teuthology.orchestra.run.smithi144.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T19:20:32.174 DEBUG:teuthology.orchestra.run.smithi144:> dpkg -s linux-image-generic 2024-09-13T19:20:32.187 INFO:teuthology.orchestra.run.smithi144.stdout:Package: linux-image-generic 2024-09-13T19:20:32.187 INFO:teuthology.orchestra.run.smithi144.stdout:Status: install ok installed 2024-09-13T19:20:32.187 INFO:teuthology.orchestra.run.smithi144.stdout:Priority: optional 2024-09-13T19:20:32.187 INFO:teuthology.orchestra.run.smithi144.stdout:Section: kernel 2024-09-13T19:20:32.187 INFO:teuthology.orchestra.run.smithi144.stdout:Installed-Size: 21 2024-09-13T19:20:32.187 INFO:teuthology.orchestra.run.smithi144.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T19:20:32.187 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: amd64 2024-09-13T19:20:32.187 INFO:teuthology.orchestra.run.smithi144.stdout:Source: linux-meta 2024-09-13T19:20:32.188 INFO:teuthology.orchestra.run.smithi144.stdout:Version: 5.15.0.121.121 2024-09-13T19:20:32.188 INFO:teuthology.orchestra.run.smithi144.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T19:20:32.188 INFO:teuthology.orchestra.run.smithi144.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T19:20:32.188 INFO:teuthology.orchestra.run.smithi144.stdout:Recommends: thermald 2024-09-13T19:20:32.188 INFO:teuthology.orchestra.run.smithi144.stdout:Description: Generic Linux kernel image 2024-09-13T19:20:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: This package will always depend on the latest generic kernel image 2024-09-13T19:20:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: available. 2024-09-13T19:20:32.188 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-09-13T19:20:32.235 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.q52AthTBW2 2024-09-13T19:20:32.235 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub/grub.cfg /tmp/tmp.q52AthTBW2 2024-09-13T19:20:32.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.q52AthTBW2 2024-09-13T19:20:32.410 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.q52AthTBW2 is 10KB 2024-09-13T19:20:32.422 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.q52AthTBW2 2024-09-13T19:20:32.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T19:20:32.483 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:20:32.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T19:20:32.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T19:20:32.548 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T19:20:32.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo update-grub 2024-09-13T19:20:33.937 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub' 2024-09-13T19:20:33.938 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T19:20:33.944 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-09-13T19:20:34.143 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T19:20:34.150 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T19:20:34.426 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T19:20:34.433 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T19:20:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T19:20:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T19:20:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T19:20:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T19:20:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T19:20:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-09-13T19:20:34.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2024-09-13T19:21:00.463 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T19:21:00.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T19:21:00.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:21:04.621 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-13T19:21:04.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T19:21:04.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:21:18.909 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-09-13T19:21:23.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-09-13T19:21:27.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T19:21:27.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:21:32.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T19:21:32.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:21:35.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-09-13T19:21:47.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T19:21:47.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:22:05.505 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-09-13T19:22:20.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T19:22:20.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:22:20.864 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-13T19:22:21.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T19:22:21.545 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-121-generic"... 2024-09-13T19:22:21.546 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-13T19:22:21.596 INFO:teuthology.orchestra.run.smithi144.stdout:5.15.0-121-generic 2024-09-13T19:22:21.596 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T19:22:21.596 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T19:22:21.596 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T19:22:22.597 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-13T19:22:22.597 DEBUG:teuthology.orchestra.run.smithi144:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T19:22:22.768 INFO:teuthology.orchestra.run.smithi144.stdout:ttyS1 2024-09-13T19:22:22.789 DEBUG:teuthology.parallel:result is None 2024-09-13T19:22:27.941 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T19:22:39.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T19:22:39.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:22:40.219 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-13T19:22:40.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T19:22:40.874 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T19:22:40.874 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-13T19:22:40.921 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-121-generic 2024-09-13T19:22:40.921 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T19:22:40.921 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T19:22:40.921 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T19:22:41.922 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T19:22:41.922 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T19:22:42.013 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2024-09-13T19:22:42.035 DEBUG:teuthology.parallel:result is None 2024-09-13T19:22:42.035 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T19:22:42.043 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T19:22:42.043 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T19:22:42.045 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T19:22:42.051 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T19:22:42.092 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T19:22:42.101 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T19:22:42.102 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T19:22:42.104 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T19:22:42.120 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T19:22:42.127 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T19:22:42.127 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T19:22:42.155 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T19:22:42.176 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T19:22:42.179 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T19:22:42.184 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T19:22:42.187 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T19:22:42.189 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T19:22:42.197 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T19:22:42.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T19:22:42.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T19:22:42.244 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T19:22:42.255 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T19:22:42.255 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T19:22:42.286 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T19:22:42.292 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T19:22:42.338 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T19:22:42.386 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:22:42.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T19:22:42.455 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T19:22:42.461 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T19:22:42.508 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:22:42.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T19:22:42.578 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-13T19:22:42.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-13T19:22:42.650 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T19:22:42.657 INFO:teuthology.task.internal:Starting timer... 2024-09-13T19:22:42.657 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T19:22:42.726 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T19:22:42.816 DEBUG:teuthology.task.selinux:Excluding smithi018: OS 'ubuntu' does not support SELinux 2024-09-13T19:22:42.816 DEBUG:teuthology.task.selinux:Excluding smithi144: OS 'ubuntu' does not support SELinux 2024-09-13T19:22:42.816 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T19:22:42.816 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T19:22:42.817 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T19:22:42.817 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T19:22:42.826 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T19:22:42.838 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T19:22:42.839 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T19:30:22.712 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2024-09-13T19:30:22.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T19:30:22.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:30:22.812 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-13T19:30:22.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-13T19:30:22.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T19:30:22.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:30:23.006 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-13T19:30:23.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-13T19:30:23.089 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T19:30:23.099 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T19:30:23.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T19:30:23.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:30:23.103 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T19:30:23.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:30:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T19:30:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Command line: ntpd -gq 2024-09-13T19:30:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: ---------------------------------------------------- 2024-09-13T19:30:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T19:30:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T19:30:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: corporation. Support and training for ntp-4 are 2024-09-13T19:30:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: available at https://www.nwtime.org/support 2024-09-13T19:30:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: ---------------------------------------------------- 2024-09-13T19:30:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: proto: precision = 0.048 usec (-24) 2024-09-13T19:30:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: basedate set to 2022-02-04 2024-09-13T19:30:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: gps base set to 2022-02-06 (week 2196) 2024-09-13T19:30:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T19:30:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T19:30:23.135 INFO:teuthology.orchestra.run.smithi018.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T19:30:23.135 INFO:teuthology.orchestra.run.smithi018.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T19:30:23.136 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T19:30:23.136 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T19:30:23.136 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T19:30:23.136 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Listen normally on 3 ens1f0 172.21.15.18:123 2024-09-13T19:30:23.136 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Listen normally on 4 lo [::1]:123 2024-09-13T19:30:23.136 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1362%4]:123 2024-09-13T19:30:23.136 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:23 ntpd[18399]: Listening on routing socket on fd #22 for interface updates 2024-09-13T19:30:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T19:30:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Command line: ntpd -gq 2024-09-13T19:30:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: ---------------------------------------------------- 2024-09-13T19:30:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T19:30:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T19:30:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: corporation. Support and training for ntp-4 are 2024-09-13T19:30:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: available at https://www.nwtime.org/support 2024-09-13T19:30:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: ---------------------------------------------------- 2024-09-13T19:30:23.156 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: proto: precision = 0.048 usec (-24) 2024-09-13T19:30:23.156 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: basedate set to 2022-02-04 2024-09-13T19:30:23.156 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: gps base set to 2022-02-06 (week 2196) 2024-09-13T19:30:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T19:30:23.157 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T19:30:23.157 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T19:30:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T19:30:23.158 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T19:30:23.158 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T19:30:23.158 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T19:30:23.158 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Listen normally on 3 enp3s0f1 172.21.15.144:123 2024-09-13T19:30:23.158 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Listen normally on 4 lo [::1]:123 2024-09-13T19:30:23.159 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f5f%5]:123 2024-09-13T19:30:23.159 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:23 ntpd[18453]: Listening on routing socket on fd #22 for interface updates 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:24 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:24.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:24.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:24 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:25 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:25 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:25 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:25 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:25.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:25 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:25.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:25 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:25 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:25 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:25 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:25 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:25 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:25 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:26.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:26.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:26.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:26.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:26 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:26 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:27.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:27 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:27.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:27 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:27.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:27 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:27.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:27 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:27.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:27 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:27.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:27 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:27.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:27 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:27.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:27 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:27.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:27 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:27.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:27 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:27.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:27 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:27.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:27 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:27.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:27 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:27.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:27 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:28.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:28 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:28 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:29.133 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:29 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:29.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:29 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:29.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:29 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:29.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:29 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:29.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:29 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:29.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:29 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:29 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:29 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:29 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:29 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:29 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:29 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stdout:13 Sep 19:30:30 ntpd[18399]: ntpd: time slew -0.003448 s 2024-09-13T19:30:30.134 INFO:teuthology.orchestra.run.smithi018.stdout:ntpd: time slew -0.003448s 2024-09-13T19:30:30.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T19:30:30.135 INFO:teuthology.orchestra.run.smithi018.stderr:13 Sep 19:30:30 ntpd[18399]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T19:30:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:30:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:30:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:30:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:30:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:13 Sep 19:30:30 ntpd[18453]: ntpd: time slew +0.000337 s 2024-09-13T19:30:30.157 INFO:teuthology.orchestra.run.smithi144.stdout:ntpd: time slew +0.000337s 2024-09-13T19:30:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T19:30:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:13 Sep 19:30:30 ntpd[18453]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T19:30:30.180 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T19:30:30.180 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2024-09-13T19:30:30.180 INFO:teuthology.orchestra.run.smithi018.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:30:30.181 INFO:teuthology.orchestra.run.smithi018.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:30:30.181 INFO:teuthology.orchestra.run.smithi018.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:30:30.181 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:30:30.278 INFO:teuthology.orchestra.run.smithi144.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T19:30:30.279 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================== 2024-09-13T19:30:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:30:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:30:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:30:30.279 INFO:teuthology.orchestra.run.smithi144.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:30:30.280 INFO:teuthology.run_tasks:Running task install... 2024-09-13T19:30:30.288 DEBUG:teuthology.task.install:project ceph 2024-09-13T19:30:30.288 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-13T19:30:30.288 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T19:30:30.288 INFO:teuthology.task.install:Using flavor: default 2024-09-13T19:30:30.294 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T19:30:30.294 INFO:teuthology.task.install:extra packages: [] 2024-09-13T19:30:30.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-key list | grep Ceph 2024-09-13T19:30:30.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-key list | grep Ceph 2024-09-13T19:30:30.358 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T19:30:30.382 INFO:teuthology.orchestra.run.smithi144.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T19:30:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T19:30:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T19:30:30.390 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T19:30:30.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:30:30.411 INFO:teuthology.orchestra.run.smithi144.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T19:30:30.411 INFO:teuthology.orchestra.run.smithi144.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T19:30:30.411 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T19:30:30.412 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:30:30.542 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default/ 2024-09-13T19:30:30.543 INFO:teuthology.task.install.deb:Package version is 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:30:30.562 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default/ 2024-09-13T19:30:30.562 INFO:teuthology.task.install.deb:Package version is 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:30:30.719 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:30:30.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T19:30:30.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-09-13T19:30:30.746 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:30:30.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T19:30:30.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2024-09-13T19:30:30.909 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T19:30:30.919 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T19:30:30.928 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T19:30:30.929 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T19:30:30.936 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T19:30:30.940 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T19:30:30.957 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T19:30:31.031 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T19:30:31.047 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T19:30:31.066 INFO:teuthology.orchestra.run.smithi144.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T19:30:31.090 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T19:30:31.109 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T19:30:31.138 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T19:30:31.154 INFO:teuthology.orchestra.run.smithi144.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T19:30:31.179 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T19:30:31.190 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-13T19:30:31.226 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-13T19:30:31.231 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T19:30:31.300 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 29.0 kB in 0s (76.7 kB/s) 2024-09-13T19:30:31.306 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 29.0 kB in 0s (79.5 kB/s) 2024-09-13T19:30:32.287 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-13T19:30:32.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-322-g7741f7f9-1jammy cephadm=19.1.1-322-g7741f7f9-1jammy ceph-mds=19.1.1-322-g7741f7f9-1jammy ceph-mgr=19.1.1-322-g7741f7f9-1jammy ceph-common=19.1.1-322-g7741f7f9-1jammy ceph-fuse=19.1.1-322-g7741f7f9-1jammy ceph-test=19.1.1-322-g7741f7f9-1jammy ceph-volume=19.1.1-322-g7741f7f9-1jammy radosgw=19.1.1-322-g7741f7f9-1jammy python3-rados=19.1.1-322-g7741f7f9-1jammy python3-rgw=19.1.1-322-g7741f7f9-1jammy python3-cephfs=19.1.1-322-g7741f7f9-1jammy python3-rbd=19.1.1-322-g7741f7f9-1jammy libcephfs2=19.1.1-322-g7741f7f9-1jammy libcephfs-dev=19.1.1-322-g7741f7f9-1jammy librados2=19.1.1-322-g7741f7f9-1jammy librbd1=19.1.1-322-g7741f7f9-1jammy rbd-fuse=19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:30:32.335 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-13T19:30:32.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-322-g7741f7f9-1jammy cephadm=19.1.1-322-g7741f7f9-1jammy ceph-mds=19.1.1-322-g7741f7f9-1jammy ceph-mgr=19.1.1-322-g7741f7f9-1jammy ceph-common=19.1.1-322-g7741f7f9-1jammy ceph-fuse=19.1.1-322-g7741f7f9-1jammy ceph-test=19.1.1-322-g7741f7f9-1jammy ceph-volume=19.1.1-322-g7741f7f9-1jammy radosgw=19.1.1-322-g7741f7f9-1jammy python3-rados=19.1.1-322-g7741f7f9-1jammy python3-rgw=19.1.1-322-g7741f7f9-1jammy python3-cephfs=19.1.1-322-g7741f7f9-1jammy python3-rbd=19.1.1-322-g7741f7f9-1jammy libcephfs2=19.1.1-322-g7741f7f9-1jammy libcephfs-dev=19.1.1-322-g7741f7f9-1jammy librados2=19.1.1-322-g7741f7f9-1jammy librbd1=19.1.1-322-g7741f7f9-1jammy rbd-fuse=19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:30:32.371 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-13T19:30:32.417 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-13T19:30:32.581 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-09-13T19:30:32.582 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-09-13T19:30:32.631 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-09-13T19:30:32.631 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-09-13T19:30:32.794 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T19:30:32.794 INFO:teuthology.orchestra.run.smithi144.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T19:30:32.794 INFO:teuthology.orchestra.run.smithi144.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T19:30:32.794 INFO:teuthology.orchestra.run.smithi144.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T19:30:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T19:30:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T19:30:32.795 INFO:teuthology.orchestra.run.smithi144.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T19:30:32.796 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2024-09-13T19:30:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T19:30:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T19:30:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T19:30:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T19:30:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T19:30:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T19:30:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T19:30:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T19:30:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T19:30:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T19:30:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T19:30:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet zip 2024-09-13T19:30:32.799 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2024-09-13T19:30:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T19:30:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T19:30:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T19:30:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T19:30:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T19:30:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T19:30:32.800 INFO:teuthology.orchestra.run.smithi144.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T19:30:32.800 INFO:teuthology.orchestra.run.smithi144.stdout:Recommended packages: 2024-09-13T19:30:32.800 INFO:teuthology.orchestra.run.smithi144.stdout: btrfs-tools 2024-09-13T19:30:32.850 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T19:30:32.851 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T19:30:32.851 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T19:30:32.851 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T19:30:32.851 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T19:30:32.851 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T19:30:32.851 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T19:30:32.852 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-09-13T19:30:32.852 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T19:30:32.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T19:30:32.853 INFO:teuthology.orchestra.run.smithi018.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T19:30:32.853 INFO:teuthology.orchestra.run.smithi018.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T19:30:32.854 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T19:30:32.854 INFO:teuthology.orchestra.run.smithi018.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T19:30:32.854 INFO:teuthology.orchestra.run.smithi018.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T19:30:32.854 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T19:30:32.854 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T19:30:32.854 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T19:30:32.855 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet zip 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T19:30:32.856 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2024-09-13T19:30:32.857 INFO:teuthology.orchestra.run.smithi018.stdout: btrfs-tools 2024-09-13T19:30:32.905 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2024-09-13T19:30:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T19:30:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T19:30:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T19:30:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T19:30:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T19:30:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T19:30:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T19:30:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T19:30:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T19:30:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T19:30:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T19:30:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T19:30:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T19:30:32.966 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-09-13T19:30:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T19:30:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T19:30:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T19:30:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T19:30:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T19:30:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T19:30:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T19:30:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T19:30:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T19:30:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T19:30:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T19:30:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T19:30:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T19:30:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T19:30:33.031 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T19:30:33.031 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 181 MB of archives. 2024-09-13T19:30:33.031 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T19:30:33.031 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T19:30:33.096 INFO:teuthology.orchestra.run.smithi144.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T19:30:33.097 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 181 MB of archives. 2024-09-13T19:30:33.097 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T19:30:33.097 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T19:30:33.120 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T19:30:33.122 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T19:30:33.140 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T19:30:33.194 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T19:30:33.197 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T19:30:33.206 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T19:30:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T19:30:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T19:30:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T19:30:33.219 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T19:30:33.221 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T19:30:33.223 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T19:30:33.226 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T19:30:33.231 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T19:30:33.233 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T19:30:33.235 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T19:30:33.237 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T19:30:33.248 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T19:30:33.249 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T19:30:33.249 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T19:30:33.250 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T19:30:33.250 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T19:30:33.250 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T19:30:33.266 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T19:30:33.266 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T19:30:33.266 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T19:30:33.269 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T19:30:33.269 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-322-g7741f7f9-1jammy [3,591 kB] 2024-09-13T19:30:33.283 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T19:30:33.284 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T19:30:33.284 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T19:30:33.285 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T19:30:33.285 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T19:30:33.286 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T19:30:33.300 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T19:30:33.301 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T19:30:33.302 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T19:30:33.307 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T19:30:33.317 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T19:30:33.318 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T19:30:33.318 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T19:30:33.320 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T19:30:33.322 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T19:30:33.322 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T19:30:33.334 INFO:teuthology.orchestra.run.smithi018.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T19:30:33.335 INFO:teuthology.orchestra.run.smithi018.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T19:30:33.337 INFO:teuthology.orchestra.run.smithi018.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T19:30:33.338 INFO:teuthology.orchestra.run.smithi018.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T19:30:33.339 INFO:teuthology.orchestra.run.smithi018.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-322-g7741f7f9-1jammy [3,591 kB] 2024-09-13T19:30:33.352 INFO:teuthology.orchestra.run.smithi018.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T19:30:33.354 INFO:teuthology.orchestra.run.smithi018.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T19:30:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T19:30:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T19:30:33.411 INFO:teuthology.orchestra.run.smithi018.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T19:30:33.411 INFO:teuthology.orchestra.run.smithi018.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T19:30:33.412 INFO:teuthology.orchestra.run.smithi018.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T19:30:33.430 INFO:teuthology.orchestra.run.smithi018.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T19:30:33.432 INFO:teuthology.orchestra.run.smithi018.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T19:30:33.432 INFO:teuthology.orchestra.run.smithi018.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T19:30:33.447 INFO:teuthology.orchestra.run.smithi018.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T19:30:33.447 INFO:teuthology.orchestra.run.smithi018.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T19:30:33.453 INFO:teuthology.orchestra.run.smithi018.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T19:30:33.453 INFO:teuthology.orchestra.run.smithi018.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T19:30:33.454 INFO:teuthology.orchestra.run.smithi018.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T19:30:33.454 INFO:teuthology.orchestra.run.smithi018.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T19:30:33.470 INFO:teuthology.orchestra.run.smithi018.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T19:30:33.471 INFO:teuthology.orchestra.run.smithi018.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T19:30:33.473 INFO:teuthology.orchestra.run.smithi018.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T19:30:33.475 INFO:teuthology.orchestra.run.smithi018.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T19:30:33.476 INFO:teuthology.orchestra.run.smithi018.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T19:30:33.477 INFO:teuthology.orchestra.run.smithi018.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T19:30:33.488 INFO:teuthology.orchestra.run.smithi018.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T19:30:33.490 INFO:teuthology.orchestra.run.smithi018.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T19:30:33.490 INFO:teuthology.orchestra.run.smithi018.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T19:30:33.491 INFO:teuthology.orchestra.run.smithi018.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T19:30:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T19:30:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T19:30:33.508 INFO:teuthology.orchestra.run.smithi018.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T19:30:33.508 INFO:teuthology.orchestra.run.smithi018.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T19:30:33.508 INFO:teuthology.orchestra.run.smithi018.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T19:30:33.509 INFO:teuthology.orchestra.run.smithi018.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T19:30:33.517 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T19:30:33.522 INFO:teuthology.orchestra.run.smithi018.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T19:30:33.523 INFO:teuthology.orchestra.run.smithi018.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T19:30:33.529 INFO:teuthology.orchestra.run.smithi018.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T19:30:33.529 INFO:teuthology.orchestra.run.smithi018.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T19:30:33.529 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T19:30:33.539 INFO:teuthology.orchestra.run.smithi018.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T19:30:33.541 INFO:teuthology.orchestra.run.smithi018.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T19:30:33.541 INFO:teuthology.orchestra.run.smithi018.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T19:30:33.610 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T19:30:33.840 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T19:30:33.851 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T19:30:33.881 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T19:30:33.890 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T19:30:33.890 INFO:teuthology.orchestra.run.smithi144.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T19:30:33.892 INFO:teuthology.orchestra.run.smithi144.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T19:30:33.910 INFO:teuthology.orchestra.run.smithi144.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T19:30:33.915 INFO:teuthology.orchestra.run.smithi144.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T19:30:33.919 INFO:teuthology.orchestra.run.smithi144.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T19:30:33.922 INFO:teuthology.orchestra.run.smithi144.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T19:30:34.004 INFO:teuthology.orchestra.run.smithi144.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T19:30:34.008 INFO:teuthology.orchestra.run.smithi144.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T19:30:34.012 INFO:teuthology.orchestra.run.smithi144.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T19:30:34.016 INFO:teuthology.orchestra.run.smithi144.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T19:30:34.017 INFO:teuthology.orchestra.run.smithi144.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T19:30:34.018 INFO:teuthology.orchestra.run.smithi144.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T19:30:34.019 INFO:teuthology.orchestra.run.smithi144.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T19:30:34.020 INFO:teuthology.orchestra.run.smithi144.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T19:30:34.021 INFO:teuthology.orchestra.run.smithi144.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T19:30:34.086 INFO:teuthology.orchestra.run.smithi144.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T19:30:34.104 INFO:teuthology.orchestra.run.smithi144.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T19:30:34.104 INFO:teuthology.orchestra.run.smithi144.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T19:30:34.105 INFO:teuthology.orchestra.run.smithi144.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T19:30:34.110 INFO:teuthology.orchestra.run.smithi144.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T19:30:34.111 INFO:teuthology.orchestra.run.smithi144.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T19:30:34.146 INFO:teuthology.orchestra.run.smithi144.stdout:Get:31 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-322-g7741f7f9-1jammy [3,243 kB] 2024-09-13T19:30:34.168 INFO:teuthology.orchestra.run.smithi144.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T19:30:34.168 INFO:teuthology.orchestra.run.smithi144.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T19:30:34.170 INFO:teuthology.orchestra.run.smithi144.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T19:30:34.171 INFO:teuthology.orchestra.run.smithi144.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T19:30:34.249 INFO:teuthology.orchestra.run.smithi144.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T19:30:34.251 INFO:teuthology.orchestra.run.smithi144.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T19:30:34.253 INFO:teuthology.orchestra.run.smithi144.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T19:30:34.254 INFO:teuthology.orchestra.run.smithi144.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T19:30:34.265 INFO:teuthology.orchestra.run.smithi144.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T19:30:34.330 INFO:teuthology.orchestra.run.smithi144.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T19:30:34.331 INFO:teuthology.orchestra.run.smithi144.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T19:30:34.332 INFO:teuthology.orchestra.run.smithi144.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T19:30:34.335 INFO:teuthology.orchestra.run.smithi144.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T19:30:34.339 INFO:teuthology.orchestra.run.smithi144.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T19:30:34.412 INFO:teuthology.orchestra.run.smithi144.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T19:30:34.414 INFO:teuthology.orchestra.run.smithi144.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T19:30:34.416 INFO:teuthology.orchestra.run.smithi144.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T19:30:34.421 INFO:teuthology.orchestra.run.smithi144.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T19:30:34.422 INFO:teuthology.orchestra.run.smithi144.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T19:30:34.494 INFO:teuthology.orchestra.run.smithi144.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T19:30:34.498 INFO:teuthology.orchestra.run.smithi144.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T19:30:34.662 INFO:teuthology.orchestra.run.smithi144.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T19:30:34.664 INFO:teuthology.orchestra.run.smithi144.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T19:30:34.667 INFO:teuthology.orchestra.run.smithi144.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T19:30:34.668 INFO:teuthology.orchestra.run.smithi144.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T19:30:34.670 INFO:teuthology.orchestra.run.smithi144.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T19:30:34.691 INFO:teuthology.orchestra.run.smithi018.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-322-g7741f7f9-1jammy [3,243 kB] 2024-09-13T19:30:34.699 INFO:teuthology.orchestra.run.smithi144.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-322-g7741f7f9-1jammy [719 kB] 2024-09-13T19:30:34.706 INFO:teuthology.orchestra.run.smithi144.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T19:30:34.709 INFO:teuthology.orchestra.run.smithi144.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T19:30:34.709 INFO:teuthology.orchestra.run.smithi144.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T19:30:34.768 INFO:teuthology.orchestra.run.smithi144.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T19:30:34.769 INFO:teuthology.orchestra.run.smithi144.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T19:30:34.829 INFO:teuthology.orchestra.run.smithi144.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T19:30:34.830 INFO:teuthology.orchestra.run.smithi144.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T19:30:34.831 INFO:teuthology.orchestra.run.smithi144.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T19:30:34.833 INFO:teuthology.orchestra.run.smithi144.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T19:30:34.833 INFO:teuthology.orchestra.run.smithi144.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T19:30:34.834 INFO:teuthology.orchestra.run.smithi144.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T19:30:34.841 INFO:teuthology.orchestra.run.smithi144.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T19:30:34.845 INFO:teuthology.orchestra.run.smithi144.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-322-g7741f7f9-1jammy [357 kB] 2024-09-13T19:30:34.911 INFO:teuthology.orchestra.run.smithi144.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T19:30:34.914 INFO:teuthology.orchestra.run.smithi144.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T19:30:34.916 INFO:teuthology.orchestra.run.smithi144.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T19:30:34.920 INFO:teuthology.orchestra.run.smithi144.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-322-g7741f7f9-1jammy [32.8 kB] 2024-09-13T19:30:34.921 INFO:teuthology.orchestra.run.smithi144.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-322-g7741f7f9-1jammy [180 kB] 2024-09-13T19:30:34.986 INFO:teuthology.orchestra.run.smithi144.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-322-g7741f7f9-1jammy [67.8 kB] 2024-09-13T19:30:34.989 INFO:teuthology.orchestra.run.smithi144.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-322-g7741f7f9-1jammy [333 kB] 2024-09-13T19:30:34.992 INFO:teuthology.orchestra.run.smithi144.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T19:30:34.999 INFO:teuthology.orchestra.run.smithi144.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T19:30:35.001 INFO:teuthology.orchestra.run.smithi144.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T19:30:35.003 INFO:teuthology.orchestra.run.smithi144.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T19:30:35.014 INFO:teuthology.orchestra.run.smithi144.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T19:30:35.016 INFO:teuthology.orchestra.run.smithi144.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T19:30:35.023 INFO:teuthology.orchestra.run.smithi144.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T19:30:35.044 INFO:teuthology.orchestra.run.smithi144.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-322-g7741f7f9-1jammy [6,874 kB] 2024-09-13T19:30:35.074 INFO:teuthology.orchestra.run.smithi144.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T19:30:35.075 INFO:teuthology.orchestra.run.smithi144.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T19:30:35.076 INFO:teuthology.orchestra.run.smithi144.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T19:30:35.156 INFO:teuthology.orchestra.run.smithi144.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T19:30:35.158 INFO:teuthology.orchestra.run.smithi144.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T19:30:35.177 INFO:teuthology.orchestra.run.smithi144.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T19:30:35.178 INFO:teuthology.orchestra.run.smithi144.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T19:30:35.179 INFO:teuthology.orchestra.run.smithi144.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T19:30:35.185 INFO:teuthology.orchestra.run.smithi144.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T19:30:35.186 INFO:teuthology.orchestra.run.smithi144.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T19:30:35.645 INFO:teuthology.orchestra.run.smithi018.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-322-g7741f7f9-1jammy [719 kB] 2024-09-13T19:30:35.779 INFO:teuthology.orchestra.run.smithi018.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-322-g7741f7f9-1jammy [357 kB] 2024-09-13T19:30:35.824 INFO:teuthology.orchestra.run.smithi018.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-322-g7741f7f9-1jammy [32.8 kB] 2024-09-13T19:30:35.825 INFO:teuthology.orchestra.run.smithi018.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-322-g7741f7f9-1jammy [180 kB] 2024-09-13T19:30:35.859 INFO:teuthology.orchestra.run.smithi018.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-322-g7741f7f9-1jammy [67.8 kB] 2024-09-13T19:30:35.861 INFO:teuthology.orchestra.run.smithi018.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-322-g7741f7f9-1jammy [333 kB] 2024-09-13T19:30:35.910 INFO:teuthology.orchestra.run.smithi018.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-322-g7741f7f9-1jammy [6,874 kB] 2024-09-13T19:30:35.961 INFO:teuthology.orchestra.run.smithi144.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-322-g7741f7f9-1jammy [112 kB] 2024-09-13T19:30:35.993 INFO:teuthology.orchestra.run.smithi144.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-322-g7741f7f9-1jammy [472 kB] 2024-09-13T19:30:36.041 INFO:teuthology.orchestra.run.smithi144.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-322-g7741f7f9-1jammy [25.9 MB] 2024-09-13T19:30:36.910 INFO:teuthology.orchestra.run.smithi018.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-322-g7741f7f9-1jammy [112 kB] 2024-09-13T19:30:36.936 INFO:teuthology.orchestra.run.smithi018.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-322-g7741f7f9-1jammy [472 kB] 2024-09-13T19:30:36.999 INFO:teuthology.orchestra.run.smithi018.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-322-g7741f7f9-1jammy [25.9 MB] 2024-09-13T19:30:38.222 INFO:teuthology.orchestra.run.smithi144.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-322-g7741f7f9-1jammy [5,145 kB] 2024-09-13T19:30:38.489 INFO:teuthology.orchestra.run.smithi144.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-322-g7741f7f9-1jammy [245 kB] 2024-09-13T19:30:38.518 INFO:teuthology.orchestra.run.smithi144.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-322-g7741f7f9-1jammy [124 kB] 2024-09-13T19:30:38.521 INFO:teuthology.orchestra.run.smithi144.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-322-g7741f7f9-1jammy [1,555 kB] 2024-09-13T19:30:38.656 INFO:teuthology.orchestra.run.smithi144.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-322-g7741f7f9-1jammy [6,143 kB] 2024-09-13T19:30:39.125 INFO:teuthology.orchestra.run.smithi144.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-322-g7741f7f9-1jammy [22.8 MB] 2024-09-13T19:30:40.346 INFO:teuthology.orchestra.run.smithi018.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-322-g7741f7f9-1jammy [5,145 kB] 2024-09-13T19:30:40.891 INFO:teuthology.orchestra.run.smithi018.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-322-g7741f7f9-1jammy [245 kB] 2024-09-13T19:30:40.898 INFO:teuthology.orchestra.run.smithi018.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-322-g7741f7f9-1jammy [124 kB] 2024-09-13T19:30:40.915 INFO:teuthology.orchestra.run.smithi018.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-322-g7741f7f9-1jammy [1,555 kB] 2024-09-13T19:30:41.040 INFO:teuthology.orchestra.run.smithi018.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-322-g7741f7f9-1jammy [6,143 kB] 2024-09-13T19:30:41.104 INFO:teuthology.orchestra.run.smithi144.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-322-g7741f7f9-1jammy [14.1 kB] 2024-09-13T19:30:41.104 INFO:teuthology.orchestra.run.smithi144.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-322-g7741f7f9-1jammy [877 kB] 2024-09-13T19:30:41.142 INFO:teuthology.orchestra.run.smithi144.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-322-g7741f7f9-1jammy [2,462 kB] 2024-09-13T19:30:41.250 INFO:teuthology.orchestra.run.smithi144.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-322-g7741f7f9-1jammy [794 kB] 2024-09-13T19:30:41.293 INFO:teuthology.orchestra.run.smithi144.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-322-g7741f7f9-1jammy [152 kB] 2024-09-13T19:30:41.318 INFO:teuthology.orchestra.run.smithi144.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-322-g7741f7f9-1jammy [2,275 kB] 2024-09-13T19:30:41.411 INFO:teuthology.orchestra.run.smithi144.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-322-g7741f7f9-1jammy [8,625 kB] 2024-09-13T19:30:41.563 INFO:teuthology.orchestra.run.smithi018.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-322-g7741f7f9-1jammy [22.8 MB] 2024-09-13T19:30:41.814 INFO:teuthology.orchestra.run.smithi144.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-322-g7741f7f9-1jammy [14.2 kB] 2024-09-13T19:30:41.814 INFO:teuthology.orchestra.run.smithi144.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-322-g7741f7f9-1jammy [51.4 MB] 2024-09-13T19:30:43.190 INFO:teuthology.orchestra.run.smithi018.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-322-g7741f7f9-1jammy [14.1 kB] 2024-09-13T19:30:43.190 INFO:teuthology.orchestra.run.smithi018.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-322-g7741f7f9-1jammy [877 kB] 2024-09-13T19:30:43.208 INFO:teuthology.orchestra.run.smithi018.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-322-g7741f7f9-1jammy [2,462 kB] 2024-09-13T19:30:43.320 INFO:teuthology.orchestra.run.smithi018.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-322-g7741f7f9-1jammy [794 kB] 2024-09-13T19:30:43.367 INFO:teuthology.orchestra.run.smithi018.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-322-g7741f7f9-1jammy [152 kB] 2024-09-13T19:30:43.386 INFO:teuthology.orchestra.run.smithi018.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-322-g7741f7f9-1jammy [2,275 kB] 2024-09-13T19:30:43.528 INFO:teuthology.orchestra.run.smithi018.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-322-g7741f7f9-1jammy [8,625 kB] 2024-09-13T19:30:44.001 INFO:teuthology.orchestra.run.smithi018.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-322-g7741f7f9-1jammy [14.2 kB] 2024-09-13T19:30:44.002 INFO:teuthology.orchestra.run.smithi018.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-322-g7741f7f9-1jammy [51.4 MB] 2024-09-13T19:30:44.343 INFO:teuthology.orchestra.run.smithi144.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-322-g7741f7f9-1jammy [130 kB] 2024-09-13T19:30:44.346 INFO:teuthology.orchestra.run.smithi144.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-322-g7741f7f9-1jammy [39.0 kB] 2024-09-13T19:30:44.347 INFO:teuthology.orchestra.run.smithi144.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-322-g7741f7f9-1jammy [13.6 MB] 2024-09-13T19:30:44.784 INFO:teuthology.orchestra.run.smithi144.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-322-g7741f7f9-1jammy [91.5 kB] 2024-09-13T19:30:45.353 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 181 MB in 12s (15.2 MB/s) 2024-09-13T19:30:45.481 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T19:30:45.538 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T19:30:45.543 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T19:30:45.613 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T19:30:45.925 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T19:30:45.951 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T19:30:45.992 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T19:30:46.329 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T19:30:46.355 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T19:30:46.395 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T19:30:46.698 INFO:teuthology.orchestra.run.smithi018.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-322-g7741f7f9-1jammy [130 kB] 2024-09-13T19:30:46.700 INFO:teuthology.orchestra.run.smithi018.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-322-g7741f7f9-1jammy [39.0 kB] 2024-09-13T19:30:46.701 INFO:teuthology.orchestra.run.smithi018.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-322-g7741f7f9-1jammy [13.6 MB] 2024-09-13T19:30:46.849 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T19:30:46.876 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:30:46.932 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:30:47.182 INFO:teuthology.orchestra.run.smithi018.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-322-g7741f7f9-1jammy [91.5 kB] 2024-09-13T19:30:47.352 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T19:30:47.379 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:30:47.418 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:30:47.747 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T19:30:47.773 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:30:47.778 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 181 MB in 14s (12.7 MB/s) 2024-09-13T19:30:47.813 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:30:48.063 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T19:30:48.166 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T19:30:48.168 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T19:30:48.173 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T19:30:48.192 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T19:30:48.233 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T19:30:48.270 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T19:30:48.561 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librados2. 2024-09-13T19:30:48.587 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../007-librados2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:48.590 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T19:30:48.617 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T19:30:48.627 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librados2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:48.657 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T19:30:48.926 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T19:30:48.953 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T19:30:48.993 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T19:30:49.030 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librbd1. 2024-09-13T19:30:49.056 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../008-librbd1_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:49.097 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librbd1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:49.446 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T19:30:49.473 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:30:49.521 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:30:49.541 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T19:30:49.568 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:49.608 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libcephfs2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:49.874 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T19:30:49.877 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rados. 2024-09-13T19:30:49.893 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../010-python3-rados_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:49.901 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:30:49.932 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:30:49.935 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rados (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:50.238 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T19:30:50.265 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:30:50.269 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T19:30:50.296 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:30:50.296 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-ceph-argparse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:50.335 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:30:50.541 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T19:30:50.556 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:50.599 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cephfs (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:50.822 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T19:30:50.849 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T19:30:50.897 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T19:30:50.952 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T19:30:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:30:51.019 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:51.166 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librados2. 2024-09-13T19:30:51.193 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../007-librados2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:51.224 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librados2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:51.589 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T19:30:51.615 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T19:30:51.655 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T19:30:51.660 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librbd1. 2024-09-13T19:30:51.687 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../008-librbd1_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:51.727 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librbd1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:51.983 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T19:30:52.009 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T19:30:52.049 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T19:30:52.213 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T19:30:52.240 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:52.280 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:52.319 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T19:30:52.334 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:52.377 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rbd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:52.565 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rados. 2024-09-13T19:30:52.581 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../010-python3-rados_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:52.623 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rados (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:52.681 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T19:30:52.707 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T19:30:52.747 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T19:30:53.008 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T19:30:53.035 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T19:30:53.074 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T19:30:53.085 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T19:30:53.111 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:30:53.143 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-argparse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:53.378 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T19:30:53.395 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T19:30:53.404 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T19:30:53.411 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:53.444 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T19:30:53.453 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cephfs (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:53.765 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T19:30:53.781 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package lua5.1. 2024-09-13T19:30:53.791 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:30:53.807 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T19:30:53.831 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:53.847 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T19:30:54.134 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T19:30:54.161 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T19:30:54.200 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package lua-any. 2024-09-13T19:30:54.201 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T19:30:54.216 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T19:30:54.259 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T19:30:54.512 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T19:30:54.520 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package zip. 2024-09-13T19:30:54.539 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T19:30:54.546 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T19:30:54.586 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T19:30:54.587 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T19:30:54.822 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T19:30:54.838 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:54.865 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package unzip. 2024-09-13T19:30:54.872 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rbd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:54.891 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T19:30:54.923 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T19:30:55.200 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T19:30:55.227 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T19:30:55.267 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T19:30:55.318 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package luarocks. 2024-09-13T19:30:55.345 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T19:30:55.385 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T19:30:55.544 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T19:30:55.571 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T19:30:55.610 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T19:30:55.760 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librgw2. 2024-09-13T19:30:55.786 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../025-librgw2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:55.826 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librgw2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:55.939 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T19:30:55.966 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T19:30:56.005 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T19:30:56.300 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua5.1. 2024-09-13T19:30:56.327 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T19:30:56.358 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T19:30:56.395 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T19:30:56.422 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:56.462 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:56.678 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-any. 2024-09-13T19:30:56.705 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T19:30:56.744 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T19:30:56.824 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T19:30:56.850 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T19:30:56.890 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T19:30:57.007 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package zip. 2024-09-13T19:30:57.055 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T19:30:57.064 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T19:30:57.187 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T19:30:57.213 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:57.251 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libradosstriper1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:57.365 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package unzip. 2024-09-13T19:30:57.393 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T19:30:57.427 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T19:30:57.688 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-common. 2024-09-13T19:30:57.715 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../029-ceph-common_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:57.755 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:57.795 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package luarocks. 2024-09-13T19:30:57.822 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T19:30:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T19:30:58.253 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librgw2. 2024-09-13T19:30:58.280 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../025-librgw2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:58.319 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librgw2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:58.905 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T19:30:58.932 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:58.971 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:59.152 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-base. 2024-09-13T19:30:59.178 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../030-ceph-base_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:59.227 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-base (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:59.282 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T19:30:59.310 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T19:30:59.341 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T19:30:59.652 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T19:30:59.679 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:30:59.718 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libradosstriper1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:30:59.798 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T19:30:59.824 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T19:30:59.864 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T19:31:00.134 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T19:31:00.138 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-common. 2024-09-13T19:31:00.160 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T19:31:00.166 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../029-ceph-common_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T19:31:00.205 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:00.520 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T19:31:00.546 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T19:31:00.587 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T19:31:00.890 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T19:31:00.916 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T19:31:00.956 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T19:31:01.259 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T19:31:01.285 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T19:31:01.325 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T19:31:01.595 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T19:31:01.622 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T19:31:01.662 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T19:31:01.710 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-base. 2024-09-13T19:31:01.737 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../030-ceph-base_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:01.786 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-base (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:02.181 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-portend. 2024-09-13T19:31:02.208 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T19:31:02.248 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T19:31:02.364 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T19:31:02.391 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T19:31:02.430 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T19:31:02.551 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T19:31:02.577 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T19:31:02.617 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T19:31:02.700 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T19:31:02.727 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T19:31:02.758 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T19:31:02.879 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T19:31:02.894 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T19:31:02.929 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T19:31:03.052 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T19:31:03.068 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T19:31:03.111 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T19:31:03.257 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T19:31:03.284 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T19:31:03.324 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T19:31:03.610 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T19:31:03.614 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T19:31:03.625 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T19:31:03.641 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T19:31:03.669 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T19:31:03.680 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T19:31:03.947 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T19:31:03.966 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T19:31:03.973 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T19:31:03.993 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T19:31:04.013 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T19:31:04.033 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T19:31:04.302 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T19:31:04.329 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T19:31:04.333 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-mako. 2024-09-13T19:31:04.359 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T19:31:04.360 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T19:31:04.399 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T19:31:04.646 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-portend. 2024-09-13T19:31:04.673 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T19:31:04.713 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T19:31:04.728 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T19:31:04.754 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T19:31:04.819 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T19:31:05.016 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T19:31:05.043 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T19:31:05.080 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T19:31:05.082 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T19:31:05.095 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T19:31:05.130 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T19:31:05.385 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T19:31:05.391 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-webob. 2024-09-13T19:31:05.412 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T19:31:05.418 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T19:31:05.451 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T19:31:05.458 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T19:31:05.811 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T19:31:05.813 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T19:31:05.838 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T19:31:05.840 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T19:31:05.880 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T19:31:05.881 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T19:31:06.900 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T19:31:06.927 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T19:31:06.966 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T19:31:07.115 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T19:31:07.142 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T19:31:07.181 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T19:31:07.244 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T19:31:07.271 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T19:31:07.336 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T19:31:07.451 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-paste. 2024-09-13T19:31:07.477 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T19:31:07.509 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T19:31:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-mako. 2024-09-13T19:31:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T19:31:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T19:31:07.863 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T19:31:07.890 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T19:31:07.929 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T19:31:07.994 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T19:31:08.021 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T19:31:08.060 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T19:31:08.215 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T19:31:08.242 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T19:31:08.282 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T19:31:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T19:31:08.365 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T19:31:08.404 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T19:31:08.601 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T19:31:08.628 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T19:31:08.668 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T19:31:08.749 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webob. 2024-09-13T19:31:08.776 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T19:31:08.816 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T19:31:08.988 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T19:31:09.014 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T19:31:09.055 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T19:31:09.186 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T19:31:09.212 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T19:31:09.255 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T19:31:09.418 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T19:31:09.444 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T19:31:09.484 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T19:31:09.563 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T19:31:09.590 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T19:31:09.632 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T19:31:09.787 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-idna. 2024-09-13T19:31:09.814 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T19:31:09.845 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T19:31:09.933 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-paste. 2024-09-13T19:31:09.960 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T19:31:10.000 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T19:31:10.165 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T19:31:10.192 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T19:31:10.231 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T19:31:10.319 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T19:31:10.335 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T19:31:10.377 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T19:31:10.551 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-requests. 2024-09-13T19:31:10.578 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T19:31:10.618 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T19:31:10.672 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T19:31:10.699 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T19:31:10.738 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T19:31:10.929 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T19:31:10.956 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T19:31:10.996 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T19:31:11.000 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T19:31:11.027 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T19:31:11.067 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T19:31:11.291 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T19:31:11.306 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:11.349 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-modules-core (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:11.386 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T19:31:11.413 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T19:31:11.453 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T19:31:11.654 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T19:31:11.669 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:11.712 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:11.824 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T19:31:11.852 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T19:31:11.891 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T19:31:12.065 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T19:31:12.092 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T19:31:12.132 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T19:31:12.210 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-idna. 2024-09-13T19:31:12.237 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T19:31:12.277 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T19:31:12.434 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T19:31:12.461 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T19:31:12.501 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T19:31:12.572 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T19:31:12.599 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T19:31:12.630 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T19:31:12.787 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T19:31:12.814 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:12.845 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:12.925 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests. 2024-09-13T19:31:12.952 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T19:31:12.983 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T19:31:13.215 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T19:31:13.242 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:13.278 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T19:31:13.282 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mon (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:13.305 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T19:31:13.344 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T19:31:13.614 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T19:31:13.630 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:13.664 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-modules-core (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:13.894 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T19:31:13.920 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:13.960 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-osd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:14.202 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T19:31:14.230 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:14.269 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:14.580 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T19:31:14.607 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T19:31:14.646 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T19:31:14.949 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T19:31:14.977 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T19:31:14.982 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph. 2024-09-13T19:31:14.997 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../066-ceph_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:15.024 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T19:31:15.040 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:15.294 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T19:31:15.321 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:15.360 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:15.368 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T19:31:15.395 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:15.435 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T19:31:15.783 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:15.821 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mon (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:15.838 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T19:31:15.865 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:15.905 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mds (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:16.274 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package cephadm. 2024-09-13T19:31:16.301 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../069-cephadm_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:16.332 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:16.542 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T19:31:16.570 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:16.608 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-osd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:16.660 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T19:31:16.687 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T19:31:16.727 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T19:31:17.030 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T19:31:17.056 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T19:31:17.105 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T19:31:17.595 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph. 2024-09-13T19:31:17.611 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../066-ceph_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:17.645 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:17.964 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T19:31:17.991 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:18.030 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:18.326 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-babel. 2024-09-13T19:31:18.353 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T19:31:18.392 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T19:31:18.393 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T19:31:18.420 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:18.459 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mds (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:18.721 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T19:31:18.736 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T19:31:18.779 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T19:31:18.870 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephadm. 2024-09-13T19:31:18.898 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../069-cephadm_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:18.936 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:19.158 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T19:31:19.184 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:19.223 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T19:31:19.223 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:19.250 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T19:31:19.289 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T19:31:19.575 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T19:31:19.577 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T19:31:19.592 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T19:31:19.604 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T19:31:19.625 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T19:31:19.643 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T19:31:19.955 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-routes. 2024-09-13T19:31:19.982 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T19:31:20.021 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T19:31:20.316 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T19:31:20.343 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:20.374 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-dashboard (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:20.630 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-babel. 2024-09-13T19:31:20.648 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T19:31:20.688 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T19:31:21.016 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T19:31:21.044 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T19:31:21.083 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T19:31:21.436 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T19:31:21.463 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:21.502 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:21.596 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T19:31:21.623 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T19:31:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T19:31:21.814 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T19:31:21.841 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T19:31:21.880 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T19:31:22.133 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T19:31:22.160 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T19:31:22.191 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T19:31:22.200 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-routes. 2024-09-13T19:31:22.228 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T19:31:22.267 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T19:31:22.512 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T19:31:22.538 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T19:31:22.569 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T19:31:22.603 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T19:31:22.631 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:22.695 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-dashboard (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:22.914 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T19:31:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T19:31:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T19:31:23.739 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T19:31:23.768 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:23.867 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T19:31:23.883 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T19:31:23.891 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:23.925 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T19:31:24.612 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T19:31:24.639 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T19:31:24.678 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T19:31:24.853 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T19:31:24.881 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T19:31:24.920 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T19:31:25.031 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T19:31:25.048 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T19:31:25.090 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T19:31:25.223 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T19:31:25.250 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T19:31:25.289 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T19:31:25.385 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T19:31:25.413 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T19:31:25.451 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T19:31:25.601 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T19:31:25.617 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T19:31:25.651 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T19:31:25.912 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T19:31:25.939 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T19:31:25.970 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T19:31:26.093 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T19:31:26.121 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:26.236 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:26.291 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T19:31:26.318 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T19:31:26.358 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T19:31:26.678 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T19:31:26.705 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T19:31:26.744 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T19:31:27.040 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T19:31:27.066 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T19:31:27.105 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T19:31:27.148 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T19:31:27.170 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T19:31:27.223 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T19:31:27.567 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T19:31:27.587 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T19:31:27.594 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T19:31:27.615 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T19:31:27.625 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T19:31:27.710 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T19:31:28.022 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T19:31:28.314 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T19:31:28.315 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:28.315 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T19:31:28.315 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T19:31:28.331 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:28.376 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T19:31:28.403 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T19:31:28.441 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T19:31:28.659 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T19:31:28.686 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T19:31:28.725 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T19:31:28.761 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T19:31:28.788 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T19:31:28.827 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T19:31:29.070 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T19:31:29.097 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T19:31:29.136 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T19:31:29.148 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T19:31:29.176 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T19:31:29.214 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T19:31:29.356 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package jq. 2024-09-13T19:31:29.372 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T19:31:29.406 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T19:31:29.525 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T19:31:29.554 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T19:31:29.609 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T19:31:29.658 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package socat. 2024-09-13T19:31:29.675 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T19:31:29.716 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T19:31:29.895 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T19:31:29.923 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T19:31:29.953 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T19:31:30.061 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T19:31:30.077 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T19:31:30.113 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T19:31:30.474 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-test. 2024-09-13T19:31:30.502 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../097-ceph-test_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:30.541 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-test (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:30.634 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T19:31:30.651 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:30.692 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:31.003 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T19:31:31.031 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T19:31:31.073 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T19:31:31.407 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T19:31:31.435 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T19:31:31.473 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T19:31:31.717 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package jq. 2024-09-13T19:31:31.734 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T19:31:31.767 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T19:31:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package socat. 2024-09-13T19:31:32.023 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T19:31:32.061 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T19:31:32.348 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T19:31:32.365 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T19:31:32.406 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T19:31:32.760 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-test. 2024-09-13T19:31:32.777 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../097-ceph-test_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:32.810 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-test (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:32.837 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T19:31:32.865 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:32.903 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-volume (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:33.299 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T19:31:33.327 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:33.540 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libcephfs-dev (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:33.843 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T19:31:33.871 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T19:31:33.910 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T19:31:34.239 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T19:31:34.267 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T19:31:34.306 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T19:31:34.668 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T19:31:34.696 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T19:31:34.734 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T19:31:35.148 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package pkg-config. 2024-09-13T19:31:35.176 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T19:31:35.206 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T19:31:35.365 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T19:31:35.393 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:31:35.431 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-volume (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:35.451 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T19:31:35.479 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T19:31:35.517 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T19:31:35.710 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T19:31:35.727 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:35.768 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs-dev (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:35.962 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T19:31:35.990 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T19:31:36.029 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T19:31:36.079 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T19:31:36.108 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T19:31:36.146 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T19:31:36.290 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T19:31:36.318 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T19:31:36.348 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T19:31:36.476 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T19:31:36.504 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T19:31:36.542 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T19:31:36.643 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T19:31:36.671 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T19:31:36.710 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T19:31:36.904 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T19:31:36.932 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T19:31:36.971 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T19:31:37.021 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T19:31:37.049 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T19:31:37.104 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T19:31:37.384 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package pkg-config. 2024-09-13T19:31:37.413 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T19:31:37.433 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-py. 2024-09-13T19:31:37.451 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T19:31:37.460 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T19:31:37.499 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T19:31:37.689 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T19:31:37.704 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T19:31:37.737 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T19:31:37.819 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T19:31:37.847 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T19:31:37.886 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T19:31:38.140 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T19:31:38.157 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T19:31:38.190 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T19:31:38.365 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T19:31:38.393 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T19:31:38.431 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T19:31:38.493 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T19:31:38.521 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T19:31:38.559 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T19:31:38.735 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-toml. 2024-09-13T19:31:38.762 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T19:31:38.793 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T19:31:38.896 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T19:31:38.925 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T19:31:38.962 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T19:31:39.071 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T19:31:39.098 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T19:31:39.137 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T19:31:39.282 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T19:31:39.311 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T19:31:39.357 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T19:31:39.466 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T19:31:39.482 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T19:31:39.516 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T19:31:39.693 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-py. 2024-09-13T19:31:39.721 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T19:31:39.768 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T19:31:39.769 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T19:31:39.784 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T19:31:39.818 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T19:31:40.105 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T19:31:40.134 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T19:31:40.171 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T19:31:40.531 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package radosgw. 2024-09-13T19:31:40.561 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../116-radosgw_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:40.597 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking radosgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:40.659 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T19:31:40.688 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T19:31:40.725 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T19:31:40.962 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-toml. 2024-09-13T19:31:40.990 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T19:31:41.028 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T19:31:41.331 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T19:31:41.359 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T19:31:41.392 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T19:31:41.397 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T19:31:41.408 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:41.450 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking rbd-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:41.709 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T19:31:41.738 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T19:31:41.763 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T19:31:41.776 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T19:31:42.022 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T19:31:42.070 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T19:31:42.087 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T19:31:42.128 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T19:31:42.156 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T19:31:42.415 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T19:31:42.768 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T19:31:42.782 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package radosgw. 2024-09-13T19:31:42.811 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../116-radosgw_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:42.848 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking radosgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:43.193 INFO:teuthology.orchestra.run.smithi144.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T19:31:43.266 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:43.644 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T19:31:43.661 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:31:43.701 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking rbd-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:43.791 INFO:teuthology.orchestra.run.smithi144.stdout:Adding system user cephadm....done 2024-09-13T19:31:43.947 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T19:31:43.999 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T19:31:44.232 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T19:31:44.373 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T19:31:44.492 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T19:31:44.499 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T19:31:44.634 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T19:31:44.766 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T19:31:44.894 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T19:31:45.114 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T19:31:45.145 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T19:31:45.271 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T19:31:45.522 INFO:teuthology.orchestra.run.smithi018.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T19:31:45.581 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T19:31:45.601 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:45.933 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T19:31:46.134 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user cephadm....done 2024-09-13T19:31:46.193 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T19:31:46.292 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T19:31:46.461 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T19:31:46.569 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T19:31:46.720 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T19:31:46.837 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T19:31:46.963 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T19:31:46.972 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T19:31:47.223 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T19:31:47.230 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T19:31:47.465 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-ceph-argparse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:47.507 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T19:31:47.608 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T19:31:47.833 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T19:31:47.902 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T19:31:47.959 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T19:31:48.085 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T19:31:48.211 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T19:31:48.261 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T19:31:48.462 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T19:31:48.504 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T19:31:48.780 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T19:31:48.803 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T19:31:48.862 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T19:31:49.057 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T19:31:49.191 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T19:31:49.300 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T19:31:49.308 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T19:31:49.576 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T19:31:49.668 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T19:31:49.794 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T19:31:49.935 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-argparse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:50.054 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T19:31:50.203 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T19:31:50.305 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T19:31:50.329 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T19:31:50.455 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T19:31:50.581 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T19:31:50.606 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T19:31:50.716 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T19:31:50.840 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T19:31:51.330 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T19:31:51.364 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T19:31:51.401 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T19:31:51.410 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T19:31:51.536 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T19:31:51.652 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T19:31:51.778 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T19:31:51.905 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T19:31:52.275 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T19:31:52.276 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T19:31:52.276 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T19:31:52.306 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T19:31:52.566 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T19:31:52.607 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T19:31:52.849 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T19:31:52.942 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T19:31:53.068 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T19:31:53.243 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T19:31:53.544 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T19:31:53.779 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T19:31:53.870 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T19:31:54.021 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T19:31:54.130 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T19:31:54.147 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T19:31:54.256 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:54.273 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T19:31:54.557 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T19:31:54.574 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T19:31:54.867 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T19:31:54.976 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T19:31:55.218 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T19:31:55.604 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T19:31:55.972 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T19:31:56.073 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T19:31:56.283 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:31:56.323 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T19:31:56.417 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T19:31:56.574 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T19:31:56.677 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T19:31:56.683 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:31:56.803 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T19:31:56.904 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T19:31:57.002 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T19:31:57.180 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T19:31:57.344 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T19:31:57.440 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T19:31:57.683 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:31:57.809 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T19:31:58.110 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T19:31:58.369 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T19:31:58.608 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T19:31:58.621 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T19:31:58.857 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T19:31:58.869 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:31:58.978 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T19:31:59.133 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T19:31:59.237 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T19:31:59.364 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T19:31:59.393 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T19:31:59.489 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T19:31:59.518 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T19:31:59.799 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T19:31:59.803 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T19:31:59.904 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T19:32:00.050 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T19:32:00.180 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T19:32:00.301 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:32:00.428 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T19:32:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T19:32:00.716 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T19:32:00.720 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T19:32:00.842 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T19:32:00.968 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T19:32:00.980 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T19:32:01.058 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T19:32:01.273 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T19:32:01.320 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T19:32:01.437 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T19:32:01.524 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T19:32:01.775 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T19:32:01.814 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T19:32:02.043 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T19:32:02.057 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T19:32:02.144 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T19:32:02.208 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T19:32:02.428 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T19:32:02.467 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:32:02.538 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T19:32:02.593 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T19:32:02.839 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T19:32:02.911 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T19:32:03.140 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T19:32:03.204 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T19:32:03.383 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T19:32:03.463 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T19:32:03.509 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T19:32:03.564 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T19:32:03.635 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T19:32:03.725 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T19:32:03.841 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T19:32:03.995 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T19:32:04.121 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T19:32:04.125 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T19:32:04.514 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T19:32:04.745 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T19:32:04.782 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T19:32:04.883 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T19:32:05.122 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T19:32:05.176 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:32:05.302 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T19:32:05.398 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T19:32:05.628 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T19:32:05.768 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T19:32:05.894 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librados2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:05.954 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T19:32:06.003 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libsqlite3-mod-ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:06.112 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T19:32:06.239 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T19:32:06.364 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T19:32:06.432 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libcephfs2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:06.558 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libradosstriper1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:06.632 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T19:32:06.684 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T19:32:06.917 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T19:32:06.969 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librbd1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:07.104 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-modules-core (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:07.212 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:07.262 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T19:32:07.409 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T19:32:07.409 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T19:32:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T19:32:07.930 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libcephfs-dev (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:07.948 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T19:32:08.123 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rados (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:08.258 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librgw2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:08.293 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T19:32:08.384 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T19:32:08.419 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librados2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:08.545 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libsqlite3-mod-ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:08.696 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T19:32:09.040 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:09.166 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libradosstriper1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:09.301 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T19:32:09.594 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librbd1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:09.621 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rbd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:09.695 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-modules-core (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:09.731 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up rbd-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:09.821 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:09.857 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:09.983 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cephfs (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:10.043 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T19:32:10.043 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T19:32:10.109 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:10.506 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs-dev (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:10.632 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rados (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:10.660 INFO:teuthology.orchestra.run.smithi144.stdout:Adding group ceph....done 2024-09-13T19:32:10.758 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librgw2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:10.884 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T19:32:11.062 INFO:teuthology.orchestra.run.smithi144.stdout:Adding system user ceph....done 2024-09-13T19:32:11.197 INFO:teuthology.orchestra.run.smithi144.stdout:Setting system user ceph properties....done 2024-09-13T19:32:11.211 INFO:teuthology.orchestra.run.smithi144.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T19:32:11.348 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T19:32:11.696 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T19:32:12.079 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rbd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:12.169 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-test (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:12.205 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up rbd-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:12.278 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up radosgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:12.331 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cephfs (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:12.617 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:12.744 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:32:12.744 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:32:13.152 INFO:teuthology.orchestra.run.smithi018.stdout:Adding group ceph....done 2024-09-13T19:32:13.214 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-base (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:13.512 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user ceph....done 2024-09-13T19:32:13.554 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T19:32:13.679 INFO:teuthology.orchestra.run.smithi018.stdout:Setting system user ceph properties....done 2024-09-13T19:32:13.694 INFO:teuthology.orchestra.run.smithi018.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T19:32:13.837 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T19:32:14.117 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mds (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:14.168 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T19:32:14.427 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T19:32:14.427 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T19:32:14.634 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-test (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:14.760 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up radosgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:14.910 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:15.210 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:32:15.210 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:32:15.416 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T19:32:15.416 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T19:32:15.679 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-base (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:15.921 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-osd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:16.016 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T19:32:16.215 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T19:32:16.215 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T19:32:16.682 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mds (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:16.697 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-k8sevents (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:16.849 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:16.932 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T19:32:16.932 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T19:32:17.025 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mon (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:17.235 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T19:32:17.235 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T19:32:17.391 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:17.631 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T19:32:17.631 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T19:32:17.701 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:17.844 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:17.970 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-dashboard (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:18.109 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-osd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:18.120 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-volume (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:18.362 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T19:32:18.362 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T19:32:18.482 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T19:32:18.583 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T19:32:18.727 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T19:32:18.869 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-k8sevents (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:18.995 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:19.146 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mon (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:19.375 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T19:32:19.375 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T19:32:19.635 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T19:32:19.814 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:19.965 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:20.091 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-dashboard (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:20.226 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-volume (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:32:20.384 INFO:teuthology.orchestra.run.smithi144.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T19:32:20.391 DEBUG:teuthology.parallel:result is None 2024-09-13T19:32:20.737 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T19:32:20.847 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T19:32:20.982 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T19:32:22.142 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T19:32:22.815 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T19:32:22.821 DEBUG:teuthology.parallel:result is None 2024-09-13T19:32:22.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:32:22.980 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-query -W -f '${Version}' ceph 2024-09-13T19:32:23.000 INFO:teuthology.orchestra.run.smithi018.stdout:19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:32:23.000 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:32:23.000 INFO:teuthology.task.install:The correct ceph version 19.1.1-322-g7741f7f9-1jammy is installed. 2024-09-13T19:32:23.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:32:23.154 DEBUG:teuthology.orchestra.run.smithi144:> dpkg-query -W -f '${Version}' ceph 2024-09-13T19:32:23.174 INFO:teuthology.orchestra.run.smithi144.stdout:19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:32:23.175 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:32:23.175 INFO:teuthology.task.install:The correct ceph version 19.1.1-322-g7741f7f9-1jammy is installed. 2024-09-13T19:32:23.177 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T19:32:23.177 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:23.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T19:32:23.192 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:23.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T19:32:23.230 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T19:32:23.230 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:23.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T19:32:23.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T19:32:23.305 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:23.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T19:32:23.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T19:32:23.377 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T19:32:23.377 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:23.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T19:32:23.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T19:32:23.444 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:23.445 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T19:32:23.457 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T19:32:23.518 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T19:32:23.518 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:23.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T19:32:23.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T19:32:23.589 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:23.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T19:32:23.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T19:32:23.657 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T19:32:23.740 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T19:32:23.740 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-09-13T19:32:23.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2024-09-13T19:32:23.756 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T19:32:23.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T19:32:23.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T19:32:23.814 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T19:32:23.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T19:32:23.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T19:32:23.877 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T19:32:23.877 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T19:32:23.878 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7904078', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-qa-rgw-squid-65651', 'sha1': '24ee2aeecf070bf47d80960334abd82047ad2def'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9887, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-qa-rgw-squid-65651', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '24ee2aeecf070bf47d80960334abd82047ad2def', 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHAyZTEahqhvc1K6nsv+7LP5O0KHXzxGifeUEsf6DsQZvcFv7MxgtrAy7FCieHG9rpF/sdQqhEBrqxS6wpxQ6c=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIpNePanuKaqLrETB3ikdVAfMeoI6v5fcj8FwwrUoup9oFQD5LDVL42d/sWP/1V6dJPPJr+f66ZDW/5bXNGTCFg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_16:28:49', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T19:32:23.878 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T19:32:23.914 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T19:32:23.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T19:32:23.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T19:32:23.974 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:23.975 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T19:32:24.021 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T19:32:24.021 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-13T19:32:24.069 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T19:32:24.069 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:32:24.069 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-13T19:32:24.069 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:32:24.069 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 19:26:47.938900216 +0000 2024-09-13T19:32:24.069 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 19:26:47.674902574 +0000 2024-09-13T19:32:24.069 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 19:26:47.674902574 +0000 2024-09-13T19:32:24.069 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-13T19:32:24.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T19:32:24.123 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-13T19:32:24.124 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-13T19:32:24.124 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000311512 s, 1.6 MB/s 2024-09-13T19:32:24.125 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T19:32:24.174 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-13T19:32:24.225 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T19:32:24.225 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:32:24.225 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-09-13T19:32:24.225 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:32:24.225 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 19:26:48.418895928 +0000 2024-09-13T19:32:24.225 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 19:26:48.158898251 +0000 2024-09-13T19:32:24.225 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 19:26:48.158898251 +0000 2024-09-13T19:32:24.225 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-13T19:32:24.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T19:32:24.279 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-13T19:32:24.279 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-13T19:32:24.279 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000308827 s, 1.7 MB/s 2024-09-13T19:32:24.281 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T19:32:24.330 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-13T19:32:24.377 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T19:32:24.377 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:32:24.377 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-13T19:32:24.377 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:32:24.377 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 19:26:48.914891498 +0000 2024-09-13T19:32:24.377 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 19:26:48.666893713 +0000 2024-09-13T19:32:24.377 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 19:26:48.666893713 +0000 2024-09-13T19:32:24.377 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-13T19:32:24.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T19:32:24.431 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-13T19:32:24.431 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-13T19:32:24.431 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000238573 s, 2.1 MB/s 2024-09-13T19:32:24.432 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T19:32:24.482 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-13T19:32:24.529 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T19:32:24.529 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:32:24.529 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-09-13T19:32:24.529 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:32:24.529 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-13 19:26:49.378887354 +0000 2024-09-13T19:32:24.529 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-13 19:26:49.134889533 +0000 2024-09-13T19:32:24.529 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-13 19:26:49.134889533 +0000 2024-09-13T19:32:24.529 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-13T19:32:24.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T19:32:24.583 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-13T19:32:24.583 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-13T19:32:24.583 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000263662 s, 1.9 MB/s 2024-09-13T19:32:24.585 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T19:32:24.635 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T19:32:24.635 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:24.635 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T19:32:24.641 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T19:32:24.641 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-13T19:32:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T19:32:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:32:24.690 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-13T19:32:24.690 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:32:24.690 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-13 19:26:44.645914028 +0000 2024-09-13T19:32:24.690 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-13 19:26:44.397916242 +0000 2024-09-13T19:32:24.690 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-13 19:26:44.397916242 +0000 2024-09-13T19:32:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2024-09-13T19:32:24.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T19:32:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-13T19:32:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-13T19:32:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000454119 s, 1.1 MB/s 2024-09-13T19:32:24.746 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T19:32:24.795 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-13T19:32:24.842 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T19:32:24.842 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:32:24.842 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-09-13T19:32:24.842 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:32:24.843 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-13 19:26:45.145909560 +0000 2024-09-13T19:32:24.843 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-13 19:26:44.877911955 +0000 2024-09-13T19:32:24.843 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-13 19:26:44.877911955 +0000 2024-09-13T19:32:24.843 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2024-09-13T19:32:24.843 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T19:32:24.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-13T19:32:24.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-13T19:32:24.895 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00044904 s, 1.1 MB/s 2024-09-13T19:32:24.897 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T19:32:24.947 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-13T19:32:24.993 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T19:32:24.993 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:32:24.993 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-13T19:32:24.994 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:32:24.994 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-13 19:26:45.661904950 +0000 2024-09-13T19:32:24.994 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-13 19:26:45.393907345 +0000 2024-09-13T19:32:24.994 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-13 19:26:45.393907345 +0000 2024-09-13T19:32:24.994 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2024-09-13T19:32:24.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T19:32:25.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-13T19:32:25.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-13T19:32:25.048 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000372914 s, 1.4 MB/s 2024-09-13T19:32:25.049 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T19:32:25.103 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-13T19:32:25.150 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T19:32:25.150 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:32:25.150 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-09-13T19:32:25.150 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:32:25.150 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-13 19:26:46.169900412 +0000 2024-09-13T19:32:25.150 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-13 19:26:45.905902771 +0000 2024-09-13T19:32:25.150 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-13 19:26:45.905902771 +0000 2024-09-13T19:32:25.150 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2024-09-13T19:32:25.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T19:32:25.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-13T19:32:25.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-13T19:32:25.204 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000409203 s, 1.3 MB/s 2024-09-13T19:32:25.205 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T19:32:25.255 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:32:25.255 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T19:32:25.255 INFO:tasks.ceph:Generating config... 2024-09-13T19:32:25.256 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T19:32:25.256 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-13T19:32:25.256 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-13T19:32:25.256 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-13T19:32:25.257 INFO:tasks.ceph:[client] setuser = ceph 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T19:32:25.257 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T19:32:25.258 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T19:32:25.258 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T19:32:25.258 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T19:32:25.258 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T19:32:25.258 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T19:32:25.258 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T19:32:25.258 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T19:32:25.258 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T19:32:25.258 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T19:32:25.258 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T19:32:25.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T19:32:25.295 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T19:32:25.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T19:32:25.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:32:25.445 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18')] 2024-09-13T19:32:25.445 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-13T19:32:25.446 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:25.446 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T19:32:25.493 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:25.573 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:32:25.573 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid b2385e7c-a71a-4af5-b7af-4c90a204f1ea 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:fsid b2385e7c-a71a-4af5-b7af-4c90a204f1ea 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-09-13T19:32:25.569907+0000 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-13T19:32:25.569907+0000 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-13T19:32:25.574 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T19:32:25.576 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T19:32:25.626 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b2385e7c-a71a-4af5-b7af-4c90a204f1ea... 2024-09-13T19:32:25.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T19:32:25.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T19:32:25.703 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-09-13T19:32:25.703 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-09-13T19:32:25.704 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-09-13T19:32:25.705 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.706 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = 172.21.15.18 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = b2385e7c-a71a-4af5-b7af-4c90a204f1ea 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-09-13T19:32:25.707 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-09-13T19:32:25.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: debug objclass = 20 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = bitmap 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-09-13T19:32:25.709 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-09-13T19:32:25.710 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:32:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-09-13T19:32:25.712 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: rgw gc obj min wait = 15 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: debug rgw = 20 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: setgroup = ceph 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: setuser = ceph 2024-09-13T19:32:25.713 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-09-13T19:32:25.714 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-13T19:32:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-09-13T19:32:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T19:32:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-09-13T19:32:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.714 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.715 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T19:32:25.716 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = 172.21.15.18 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = b2385e7c-a71a-4af5-b7af-4c90a204f1ea 2024-09-13T19:32:25.717 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-09-13T19:32:25.718 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.719 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: debug objclass = 20 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: bdev async discard = True 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: bdev enable discard = True 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore allocator = bitmap 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 1/20 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 1/20 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 4/10 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T19:32:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-13T19:32:25.721 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-09-13T19:32:25.722 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T19:32:25.723 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-09-13T19:32:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-09-13T19:32:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-09-13T19:32:25.724 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:25.724 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: rgw gc obj min wait = 15 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: debug rgw = 20 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: setgroup = ceph 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout: setuser = ceph 2024-09-13T19:32:25.725 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-09-13T19:32:25.727 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T19:32:25.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T19:32:25.825 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T19:32:25.825 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:25.825 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T19:32:25.830 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:25.830 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T19:32:25.880 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T19:32:25.880 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:25.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T19:32:25.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:32:25.947 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:25.947 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:26.000 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:32:26.000 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:26.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T19:32:26.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:32:26.024 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:26.024 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:26.074 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T19:32:26.074 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T19:32:26.074 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T19:32:26.159 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T19:32:26.179 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T19:32:26.179 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T19:32:26.180 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T19:32:26.254 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T19:32:26.265 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T19:32:26.265 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T19:32:26.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T19:32:26.280 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T19:32:26.280 INFO:tasks.ceph:role: osd.0 2024-09-13T19:32:26.280 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T19:32:26.280 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T19:32:26.337 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:32:26.337 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:32:26.337 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:32:26.338 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T19:32:26.338 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:32:26.338 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:32:26.338 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:32:26.338 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T19:32:26.338 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:32:26.338 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:32:26.362 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-13T19:32:26.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-13T19:32:26.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T19:32:26.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T19:32:26.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:32:26.477 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T19:32:26.478 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:26.578+0000 7fbd2584a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T19:32:26.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:26.578+0000 7fbd2584a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T19:32:26.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:26.578+0000 7fbd2584a7c0 -1 bdev(0x558af17a9800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T19:32:26.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:26.578+0000 7fbd2584a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T19:32:29.960 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T19:32:29.974 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T19:32:29.987 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:32:29.987 INFO:tasks.ceph:role: osd.1 2024-09-13T19:32:29.988 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:32:29.988 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T19:32:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:32:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:32:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:32:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T19:32:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:32:30.052 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:32:30.053 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:32:30.053 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T19:32:30.053 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:32:30.053 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:32:30.512 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-13T19:32:30.514 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-13T19:32:30.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-13T19:32:30.603 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T19:32:30.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:32:30.613 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T19:32:30.613 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T19:32:30.667 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:32:30.667 INFO:tasks.ceph:role: osd.2 2024-09-13T19:32:30.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:32:30.667 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T19:32:30.727 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:32:30.728 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:32:31.193 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-13T19:32:31.195 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-13T19:32:31.196 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-13T19:32:31.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T19:32:31.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:32:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T19:32:31.364 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T19:32:31.417 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:32:31.417 INFO:tasks.ceph:role: osd.3 2024-09-13T19:32:31.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:32:31.417 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T19:32:31.481 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:32:31.481 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:32:31.481 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:32:31.481 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T19:32:31.481 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:32:31.481 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:32:31.482 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:32:31.482 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T19:32:31.482 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:32:31.482 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:32:31.936 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-13T19:32:31.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-13T19:32:31.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-13T19:32:32.049 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T19:32:32.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:32:32.071 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T19:32:32.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:32.180+0000 7f7b8b6c57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T19:32:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:32.184+0000 7f7b8b6c57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T19:32:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:32.184+0000 7f7b8b6c57c0 -1 bdev(0x558058c79800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T19:32:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:32.184+0000 7f7b8b6c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T19:32:35.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T19:32:35.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:35.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:35.448+0000 7f7a905de7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T19:32:35.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:35.448+0000 7f7a905de7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T19:32:35.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:35.448+0000 7f7a905de7c0 -1 bdev(0x564f54893800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T19:32:35.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:35.448+0000 7f7a905de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T19:32:38.843 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T19:32:38.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:38.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:38.980+0000 7f35475777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T19:32:38.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:38.984+0000 7f35475777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T19:32:38.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:38.984+0000 7f35475777c0 -1 bdev(0x563dbf8a1800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T19:32:38.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:38.984+0000 7f35475777c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T19:32:42.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T19:32:42.214 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T19:32:42.215 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:42.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T19:32:42.230 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:42.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T19:32:42.268 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:42.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T19:32:42.324 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:42.324 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T19:32:42.376 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:42.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T19:32:42.432 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:42.433 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T19:32:42.482 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T19:32:42.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T19:32:42.496 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-09-13T19:32:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBKk+RmXSmbIhAAYyJ1oWYy7hvxqvlwDyKwnw== 2024-09-13T19:32:42.496 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-09-13T19:32:42.496 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBKk+Rm/ZWKCRAA+weUfoKONorOX643dfIm8Q== 2024-09-13T19:32:42.497 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-09-13T19:32:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBQk+Rm1UoGCxAAcVJopjEFusipib7TWtes5g== 2024-09-13T19:32:42.497 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-09-13T19:32:42.497 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBTk+Rmq+3qGhAAGGvTOdo+ICIhd7/Lb2yoeg== 2024-09-13T19:32:42.497 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-09-13T19:32:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBWk+RmLGu8OhAAD4oiSk1UAeoEq4QyzvS8aQ== 2024-09-13T19:32:42.498 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-13T19:32:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBKk+Rml8M5DxAAJoBhCOnv30rzDF6Kb2j4eA== 2024-09-13T19:32:42.500 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:32:42.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T19:32:42.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:32:42.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:32:42.802 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:32:42.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T19:32:42.972 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T19:32:42.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T19:32:43.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T19:32:43.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T19:32:43.128 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:32:43.180 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T19:32:43.180 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T19:32:43.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T19:32:43.225 INFO:tasks.ceph.mon.a:Started 2024-09-13T19:32:43.225 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T19:32:43.225 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T19:32:43.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T19:32:43.228 INFO:tasks.ceph.mgr.x:Started 2024-09-13T19:32:43.228 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T19:32:43.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T19:32:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29d1676640 1 Processor -- start 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29d1676640 1 -- start start 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29d1676640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 0x7f29cc131d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29d1676640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29cc12c6e0 con 0x7f29cc12c8e0 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29d1676640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f29cc071d10 con 0x7f29cc12f920 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29caffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f29cc12c8e0 0x7f29cc12ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60146/0 (socket says 172.21.15.18:60146) 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29caffd640 1 -- 172.21.15.18:0/3548385079 learned_addr learned my addr 172.21.15.18:0/3548385079 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29ca7fc640 1 --2- 172.21.15.18:0/3548385079 >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 0x7f29cc131d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29ca7fc640 1 -- 172.21.15.18:0/3548385079 >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 msgr2=0x7f29cc131d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29ca7fc640 1 -- 172.21.15.18:0/3548385079 >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 msgr2=0x7f29cc131d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29ca7fc640 1 --2- 172.21.15.18:0/3548385079 >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 0x7f29cc131d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T19:32:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.346+0000 7f29ca7fc640 1 --2- 172.21.15.18:0/3548385079 >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 0x7f29cc131d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T19:32:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523578600 0 0) 0x7f29cc12c6e0 con 0x7f29cc12c8e0 2024-09-13T19:32:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29b4003530 con 0x7f29cc12c8e0 2024-09-13T19:32:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 88137592 0 0) 0x7f29b4003530 con 0x7f29cc12c8e0 2024-09-13T19:32:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 msgr2=0x7f29cc131d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T19:32:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 --2- 172.21.15.18:0/3548385079 >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 0x7f29cc131d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc06beb0 con 0x7f29cc12c8e0 2024-09-13T19:32:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2539373995 0 0) 0x7f29bc0015b0 con 0x7f29cc12c8e0 2024-09-13T19:32:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 >> v1:172.21.15.18:6789/0 conn(0x7f29cc12c8e0 legacy=0x7f29cc12ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 --2- 172.21.15.18:0/3548385079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29b4004490 con 0x7f29b40039c0 2024-09-13T19:32:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.366+0000 7f29caffd640 1 --2- 172.21.15.18:0/3548385079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.370+0000 7f29caffd640 1 -- 172.21.15.18:0/3548385079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b4003530 con 0x7f29b40039c0 2024-09-13T19:32:43.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.506+0000 7f29caffd640 1 --2- 172.21.15.18:0/3548385079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29b4003dc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c110 tx=0x7f29bc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a73dc7f8f53aa33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:43.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.506+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29bc007c90 con 0x7f29b40039c0 2024-09-13T19:32:43.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.506+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc0a9070 con 0x7f29b40039c0 2024-09-13T19:32:43.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.506+0000 7f29c9ffb640 1 -- 172.21.15.18:0/3548385079 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29bc0a5ca0 con 0x7f29b40039c0 2024-09-13T19:32:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 -- 172.21.15.18:0/3548385079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 msgr2=0x7f29b4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 --2- 172.21.15.18:0/3548385079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29b4003dc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c110 tx=0x7f29bc01cca0 comp rx=0 tx=0).stop 2024-09-13T19:32:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 -- 172.21.15.18:0/3548385079 shutdown_connections 2024-09-13T19:32:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 --2- 172.21.15.18:0/3548385079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29b4003dc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 --2- 172.21.15.18:0/3548385079 >> v2:172.21.15.18:3300/0 conn(0x7f29cc12f920 0x7f29cc131d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:43.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 -- 172.21.15.18:0/3548385079 >> 172.21.15.18:0/3548385079 conn(0x7f29cc09aa70 msgr2=0x7f29cc09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:43.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 -- 172.21.15.18:0/3548385079 shutdown_connections 2024-09-13T19:32:43.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 -- 172.21.15.18:0/3548385079 wait complete. 2024-09-13T19:32:43.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 Processor -- start 2024-09-13T19:32:43.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.510+0000 7f29d1676640 1 -- start start 2024-09-13T19:32:43.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29d1676640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29cc097640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:43.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29d1676640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc134c80 con 0x7f29b40039c0 2024-09-13T19:32:43.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29caffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29cc097640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:43.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29caffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29cc097640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48678/0 (socket says 172.21.15.18:48678) 2024-09-13T19:32:43.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29caffd640 1 -- 172.21.15.18:0/3962109169 learned_addr learned my addr 172.21.15.18:0/3962109169 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:32:43.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29caffd640 1 -- 172.21.15.18:0/3962109169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc1261e0 con 0x7f29b40039c0 2024-09-13T19:32:43.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29caffd640 1 --2- 172.21.15.18:0/3962109169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29cc097640 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0198b0 tx=0x7f29b4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:43.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29b37fe640 1 -- 172.21.15.18:0/3962109169 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29bc0bd070 con 0x7f29b40039c0 2024-09-13T19:32:43.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29b37fe640 1 -- 172.21.15.18:0/3962109169 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc001070 con 0x7f29b40039c0 2024-09-13T19:32:43.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29b37fe640 1 -- 172.21.15.18:0/3962109169 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29bc001570 con 0x7f29b40039c0 2024-09-13T19:32:43.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29cc1244b0 con 0x7f29b40039c0 2024-09-13T19:32:43.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29cc1255a0 con 0x7f29b40039c0 2024-09-13T19:32:43.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29b37fe640 1 -- 172.21.15.18:0/3962109169 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29bc0c0070 con 0x7f29b40039c0 2024-09-13T19:32:43.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29b37fe640 1 -- 172.21.15.18:0/3962109169 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f29bc0b5070 con 0x7f29b40039c0 2024-09-13T19:32:43.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.514+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29cc072f50 con 0x7f29b40039c0 2024-09-13T19:32:43.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.518+0000 7f29b37fe640 1 -- 172.21.15.18:0/3962109169 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f29bc0c7070 con 0x7f29b40039c0 2024-09-13T19:32:43.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.582+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f29cc074a40 con 0x7f29b40039c0 2024-09-13T19:32:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.586+0000 7f29b37fe640 1 -- 172.21.15.18:0/3962109169 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f29cc1261e0 con 0x7f29b40039c0 2024-09-13T19:32:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-13T19:32:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.586+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 msgr2=0x7f29cc097640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.586+0000 7f29d1676640 1 --2- 172.21.15.18:0/3962109169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29cc097640 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0198b0 tx=0x7f29b4005840 comp rx=0 tx=0).stop 2024-09-13T19:32:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.586+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 shutdown_connections 2024-09-13T19:32:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.586+0000 7f29d1676640 1 --2- 172.21.15.18:0/3962109169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29b40039c0 0x7f29cc097640 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.586+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 >> 172.21.15.18:0/3962109169 conn(0x7f29cc09aa70 msgr2=0x7f29cc12a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.586+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 shutdown_connections 2024-09-13T19:32:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:43.586+0000 7f29d1676640 1 -- 172.21.15.18:0/3962109169 wait complete. 2024-09-13T19:32:43.612 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T19:32:43.612 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T19:32:43.612 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-13T19:32:43.612 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T19:32:43.623 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:43.624 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T19:32:43.638 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:43.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T19:32:43.693 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-13T19:32:43.693 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T19:32:43.735 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:43.732+0000 7fcb2f18f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T19:32:43.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new feb640dc-8e82-4932-aff2-4b0b5448f785 0 2024-09-13T19:32:43.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9dcf7b640 1 Processor -- start 2024-09-13T19:32:43.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9dcf7b640 1 -- start start 2024-09-13T19:32:43.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9dcf7b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d8115df0 0x7fa9d81161d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:43.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9dcf7b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d8110960 con 0x7fa9d810fda0 2024-09-13T19:32:43.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9dcf7b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d8110b30 con 0x7fa9d8115df0 2024-09-13T19:32:43.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9d659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d8115df0 0x7fa9d81161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:43.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9d659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d8115df0 0x7fa9d81161d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39024/0 (socket says 172.21.15.144:39024) 2024-09-13T19:32:43.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9d659c640 1 -- 172.21.15.144:0/1984170222 learned_addr learned my addr 172.21.15.144:0/1984170222 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:32:43.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9d5d9b640 1 --1- 172.21.15.144:0/1984170222 >> v1:172.21.15.18:6789/0 conn(0x7fa9d810fda0 0x7fa9d8110250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:41066/0 (socket says 172.21.15.144:41066) 2024-09-13T19:32:43.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9d659c640 1 -- 172.21.15.144:0/1984170222 >> v1:172.21.15.18:6789/0 conn(0x7fa9d810fda0 legacy=0x7fa9d8110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:43.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.908+0000 7fa9d659c640 1 -- 172.21.15.144:0/1984170222 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d811ca80 con 0x7fa9d8115df0 2024-09-13T19:32:43.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9d659c640 1 --2- 172.21.15.144:0/1984170222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d8115df0 0x7fa9d81161d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009e50 tx=0x7fa9d001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4e234d48a9ae53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:43.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9d559a640 1 -- 172.21.15.144:0/1984170222 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d0009200 con 0x7fa9d8115df0 2024-09-13T19:32:43.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9d559a640 1 -- 172.21.15.144:0/1984170222 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d00a5770 con 0x7fa9d8115df0 2024-09-13T19:32:43.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9d559a640 1 -- 172.21.15.144:0/1984170222 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d00a5a70 con 0x7fa9d8115df0 2024-09-13T19:32:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1984170222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d8115df0 msgr2=0x7fa9d81161d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9dcf7b640 1 --2- 172.21.15.144:0/1984170222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d8115df0 0x7fa9d81161d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009e50 tx=0x7fa9d001ca10 comp rx=0 tx=0).stop 2024-09-13T19:32:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1984170222 shutdown_connections 2024-09-13T19:32:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9dcf7b640 1 --2- 172.21.15.144:0/1984170222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d8115df0 0x7fa9d81161d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1984170222 >> 172.21.15.144:0/1984170222 conn(0x7fa9d8071310 msgr2=0x7fa9d8073730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1984170222 shutdown_connections 2024-09-13T19:32:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1984170222 wait complete. 2024-09-13T19:32:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.912+0000 7fa9dcf7b640 1 Processor -- start 2024-09-13T19:32:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9dcf7b640 1 -- start start 2024-09-13T19:32:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9dcf7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d810fda0 0x7fa9d81acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9dcf7b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d811c640 con 0x7fa9d810fda0 2024-09-13T19:32:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9d659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d810fda0 0x7fa9d81acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9d659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d810fda0 0x7fa9d81acdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39028/0 (socket says 172.21.15.144:39028) 2024-09-13T19:32:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9d659c640 1 -- 172.21.15.144:0/1181160622 learned_addr learned my addr 172.21.15.144:0/1181160622 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:32:43.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9d659c640 1 -- 172.21.15.144:0/1181160622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d81ad390 con 0x7fa9d810fda0 2024-09-13T19:32:43.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9d659c640 1 --2- 172.21.15.144:0/1181160622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d810fda0 0x7fa9d81acdc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9d001a640 tx=0x7fa9d00197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:43.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9c6ffd640 1 -- 172.21.15.144:0/1181160622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d00bc020 con 0x7fa9d810fda0 2024-09-13T19:32:43.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d81ad5c0 con 0x7fa9d810fda0 2024-09-13T19:32:43.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9c6ffd640 1 -- 172.21.15.144:0/1181160622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d0007980 con 0x7fa9d810fda0 2024-09-13T19:32:43.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9c6ffd640 1 -- 172.21.15.144:0/1181160622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d0007c60 con 0x7fa9d810fda0 2024-09-13T19:32:43.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d81a6ee0 con 0x7fa9d810fda0 2024-09-13T19:32:43.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9c6ffd640 1 -- 172.21.15.144:0/1181160622 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa9d00bf020 con 0x7fa9d810fda0 2024-09-13T19:32:43.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9c6ffd640 1 -- 172.21.15.144:0/1181160622 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa9d00b6530 con 0x7fa9d810fda0 2024-09-13T19:32:43.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.916+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d8115df0 con 0x7fa9d810fda0 2024-09-13T19:32:43.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.924+0000 7fa9c6ffd640 1 -- 172.21.15.144:0/1181160622 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa9d00c6030 con 0x7fa9d810fda0 2024-09-13T19:32:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.992+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd new", "uuid": "feb640dc-8e82-4932-aff2-4b0b5448f785", "id": 0} v 0) -- 0x7fa9d8115fc0 con 0x7fa9d810fda0 2024-09-13T19:32:43.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.996+0000 7fa9c6ffd640 1 -- 172.21.15.144:0/1181160622 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "feb640dc-8e82-4932-aff2-4b0b5448f785", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa9d0016600 con 0x7fa9d810fda0 2024-09-13T19:32:43.998 INFO:teuthology.orchestra.run.smithi144.stdout:0 2024-09-13T19:32:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.996+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d810fda0 msgr2=0x7fa9d81acdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.996+0000 7fa9dcf7b640 1 --2- 172.21.15.144:0/1181160622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d810fda0 0x7fa9d81acdc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9d001a640 tx=0x7fa9d00197b0 comp rx=0 tx=0).stop 2024-09-13T19:32:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.996+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 shutdown_connections 2024-09-13T19:32:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.996+0000 7fa9dcf7b640 1 --2- 172.21.15.144:0/1181160622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d810fda0 0x7fa9d81acdc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.996+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 >> 172.21.15.144:0/1181160622 conn(0x7fa9d8071310 msgr2=0x7fa9d8118ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.996+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 shutdown_connections 2024-09-13T19:32:44.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:43.996+0000 7fa9dcf7b640 1 -- 172.21.15.144:0/1181160622 wait complete. 2024-09-13T19:32:44.016 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 43d97a8c-e558-4aaf-8184-0c7b26a1fa50 1 2024-09-13T19:32:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f78171dd640 1 Processor -- start 2024-09-13T19:32:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f78171dd640 1 -- start start 2024-09-13T19:32:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f78171dd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7810114bf0 0x7f7810114fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:44.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f78171dd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7810115660 con 0x7f781006c4e0 2024-09-13T19:32:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f78171dd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f781006d060 con 0x7f7810114bf0 2024-09-13T19:32:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f7814f79640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7810114bf0 0x7f7810114fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:44.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f7814f79640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7810114bf0 0x7f7810114fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39040/0 (socket says 172.21.15.144:39040) 2024-09-13T19:32:44.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f7814f79640 1 -- 172.21.15.144:0/1841805655 learned_addr learned my addr 172.21.15.144:0/1841805655 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:32:44.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f7814f79640 1 -- 172.21.15.144:0/1841805655 >> v1:172.21.15.18:6789/0 conn(0x7f781006c4e0 legacy=0x7f781006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.120+0000 7f7814f79640 1 -- 172.21.15.144:0/1841805655 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781006d210 con 0x7f7810114bf0 2024-09-13T19:32:44.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f7814f79640 1 --2- 172.21.15.144:0/1841805655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7810114bf0 0x7f7810114fd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78000097f0 tx=0x7f780001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3589424db69bcec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f780f7fe640 1 -- 172.21.15.144:0/1841805655 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78000ab580 con 0x7f7810114bf0 2024-09-13T19:32:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f780f7fe640 1 -- 172.21.15.144:0/1841805655 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78000b0070 con 0x7f7810114bf0 2024-09-13T19:32:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f780f7fe640 1 -- 172.21.15.144:0/1841805655 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78000ab870 con 0x7f7810114bf0 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f78171dd640 1 -- 172.21.15.144:0/1841805655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7810114bf0 msgr2=0x7f7810114fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f78171dd640 1 --2- 172.21.15.144:0/1841805655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7810114bf0 0x7f7810114fd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78000097f0 tx=0x7f780001c430 comp rx=0 tx=0).stop 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f78171dd640 1 -- 172.21.15.144:0/1841805655 shutdown_connections 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f78171dd640 1 --2- 172.21.15.144:0/1841805655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7810114bf0 0x7f7810114fd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f78171dd640 1 -- 172.21.15.144:0/1841805655 >> 172.21.15.144:0/1841805655 conn(0x7f781006fff0 msgr2=0x7f7810072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f78171dd640 1 -- 172.21.15.144:0/1841805655 shutdown_connections 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.124+0000 7f78171dd640 1 -- 172.21.15.144:0/1841805655 wait complete. 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f78171dd640 1 Processor -- start 2024-09-13T19:32:44.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f78171dd640 1 -- start start 2024-09-13T19:32:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f78171dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f781006c4e0 0x7f78101acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f78171dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f781011e6b0 con 0x7f781006c4e0 2024-09-13T19:32:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f7814f79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f781006c4e0 0x7f78101acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f7814f79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f781006c4e0 0x7f78101acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39048/0 (socket says 172.21.15.144:39048) 2024-09-13T19:32:44.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f7814f79640 1 -- 172.21.15.144:0/1286184570 learned_addr learned my addr 172.21.15.144:0/1286184570 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:32:44.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f7814f79640 1 -- 172.21.15.144:0/1286184570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78101ad310 con 0x7f781006c4e0 2024-09-13T19:32:44.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f7814f79640 1 --2- 172.21.15.144:0/1286184570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f781006c4e0 0x7f78101acd40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f78000ad040 tx=0x7f780001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f780d7fa640 1 -- 172.21.15.144:0/1286184570 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78000aa7f0 con 0x7f781006c4e0 2024-09-13T19:32:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78101ad540 con 0x7f781006c4e0 2024-09-13T19:32:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f780d7fa640 1 -- 172.21.15.144:0/1286184570 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78000aa990 con 0x7f781006c4e0 2024-09-13T19:32:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f780d7fa640 1 -- 172.21.15.144:0/1286184570 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78000aac70 con 0x7f781006c4e0 2024-09-13T19:32:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78101a6de0 con 0x7f781006c4e0 2024-09-13T19:32:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f780d7fa640 1 -- 172.21.15.144:0/1286184570 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f78000c77d0 con 0x7f781006c4e0 2024-09-13T19:32:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f780d7fa640 1 -- 172.21.15.144:0/1286184570 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f78000be940 con 0x7f781006c4e0 2024-09-13T19:32:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.128+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7810115050 con 0x7f781006c4e0 2024-09-13T19:32:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.136+0000 7f780d7fa640 1 -- 172.21.15.144:0/1286184570 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f78000de2d0 con 0x7f781006c4e0 2024-09-13T19:32:44.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.204+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43d97a8c-e558-4aaf-8184-0c7b26a1fa50", "id": 1} v 0) -- 0x7f7810114bf0 con 0x7f781006c4e0 2024-09-13T19:32:44.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.208+0000 7f780d7fa640 1 -- 172.21.15.144:0/1286184570 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43d97a8c-e558-4aaf-8184-0c7b26a1fa50", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f78000cc020 con 0x7f781006c4e0 2024-09-13T19:32:44.209 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-13T19:32:44.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.208+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f781006c4e0 msgr2=0x7f78101acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.208+0000 7f78171dd640 1 --2- 172.21.15.144:0/1286184570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f781006c4e0 0x7f78101acd40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f78000ad040 tx=0x7f780001ac70 comp rx=0 tx=0).stop 2024-09-13T19:32:44.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.208+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 shutdown_connections 2024-09-13T19:32:44.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.208+0000 7f78171dd640 1 --2- 172.21.15.144:0/1286184570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f781006c4e0 0x7f78101acd40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.208+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 >> 172.21.15.144:0/1286184570 conn(0x7f781006fff0 msgr2=0x7f7810113720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:44.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.208+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 shutdown_connections 2024-09-13T19:32:44.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.208+0000 7f78171dd640 1 -- 172.21.15.144:0/1286184570 wait complete. 2024-09-13T19:32:44.228 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new a2b1ed4d-6f98-45a6-88b7-e7a345f7037f 2 2024-09-13T19:32:44.273 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:44.272+0000 7fcb2f18f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T19:32:44.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.340+0000 7fad8d51d640 1 Processor -- start 2024-09-13T19:32:44.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.340+0000 7fad8d51d640 1 -- start start 2024-09-13T19:32:44.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.340+0000 7fad8d51d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad88114c60 0x7fad88115040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:44.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.340+0000 7fad8d51d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad88115610 con 0x7fad8806c4e0 2024-09-13T19:32:44.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.340+0000 7fad8d51d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fad8806d080 con 0x7fad88114c60 2024-09-13T19:32:44.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.340+0000 7fad86ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad88114c60 0x7fad88115040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:44.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.340+0000 7fad7ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fad8806c4e0 0x7fad8806c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:41072/0 (socket says 172.21.15.144:41072) 2024-09-13T19:32:44.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.340+0000 7fad7ffff640 1 -- 172.21.15.144:0/1743207678 learned_addr learned my addr 172.21.15.144:0/1743207678 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:32:44.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad86ffd640 1 -- 172.21.15.144:0/1743207678 >> v1:172.21.15.18:6789/0 conn(0x7fad8806c4e0 legacy=0x7fad8806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad86ffd640 1 -- 172.21.15.144:0/1743207678 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8806d230 con 0x7fad88114c60 2024-09-13T19:32:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad86ffd640 1 --2- 172.21.15.144:0/1743207678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad88114c60 0x7fad88115040 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fad78009740 tx=0x7fad7801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee11b1c55f1939ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad867fc640 1 -- 172.21.15.144:0/1743207678 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad780b1070 con 0x7fad88114c60 2024-09-13T19:32:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad867fc640 1 -- 172.21.15.144:0/1743207678 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad780ac520 con 0x7fad88114c60 2024-09-13T19:32:44.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad867fc640 1 -- 172.21.15.144:0/1743207678 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad780ac820 con 0x7fad88114c60 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad8d51d640 1 -- 172.21.15.144:0/1743207678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad88114c60 msgr2=0x7fad88115040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad8d51d640 1 --2- 172.21.15.144:0/1743207678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad88114c60 0x7fad88115040 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fad78009740 tx=0x7fad7801c370 comp rx=0 tx=0).stop 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad8d51d640 1 -- 172.21.15.144:0/1743207678 shutdown_connections 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad8d51d640 1 --2- 172.21.15.144:0/1743207678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad88114c60 0x7fad88115040 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad8d51d640 1 -- 172.21.15.144:0/1743207678 >> 172.21.15.144:0/1743207678 conn(0x7fad8806fff0 msgr2=0x7fad88072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad8d51d640 1 -- 172.21.15.144:0/1743207678 shutdown_connections 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.344+0000 7fad8d51d640 1 -- 172.21.15.144:0/1743207678 wait complete. 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad8d51d640 1 Processor -- start 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad8d51d640 1 -- start start 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad8d51d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8806c4e0 0x7fad881acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:44.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad8d51d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad8811e6c0 con 0x7fad8806c4e0 2024-09-13T19:32:44.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8806c4e0 0x7fad881acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:44.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8806c4e0 0x7fad881acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39060/0 (socket says 172.21.15.144:39060) 2024-09-13T19:32:44.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad86ffd640 1 -- 172.21.15.144:0/880509379 learned_addr learned my addr 172.21.15.144:0/880509379 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:32:44.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad86ffd640 1 -- 172.21.15.144:0/880509379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad881ad2e0 con 0x7fad8806c4e0 2024-09-13T19:32:44.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad86ffd640 1 --2- 172.21.15.144:0/880509379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8806c4e0 0x7fad881acd10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad780af040 tx=0x7fad7801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:44.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad7f7fe640 1 -- 172.21.15.144:0/880509379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad780b1050 con 0x7fad8806c4e0 2024-09-13T19:32:44.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad881ad510 con 0x7fad8806c4e0 2024-09-13T19:32:44.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad7f7fe640 1 -- 172.21.15.144:0/880509379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad780b2040 con 0x7fad8806c4e0 2024-09-13T19:32:44.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad7f7fe640 1 -- 172.21.15.144:0/880509379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad780aba40 con 0x7fad8806c4e0 2024-09-13T19:32:44.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad881a6db0 con 0x7fad8806c4e0 2024-09-13T19:32:44.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad7f7fe640 1 -- 172.21.15.144:0/880509379 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fad780bf030 con 0x7fad8806c4e0 2024-09-13T19:32:44.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad7f7fe640 1 -- 172.21.15.144:0/880509379 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fad780bd070 con 0x7fad8806c4e0 2024-09-13T19:32:44.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.348+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad881150c0 con 0x7fad8806c4e0 2024-09-13T19:32:44.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.356+0000 7fad7f7fe640 1 -- 172.21.15.144:0/880509379 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fad780c6060 con 0x7fad8806c4e0 2024-09-13T19:32:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.424+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a2b1ed4d-6f98-45a6-88b7-e7a345f7037f", "id": 2} v 0) -- 0x7fad88114c60 con 0x7fad8806c4e0 2024-09-13T19:32:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.428+0000 7fad7f7fe640 1 -- 172.21.15.144:0/880509379 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2b1ed4d-6f98-45a6-88b7-e7a345f7037f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fad780a9070 con 0x7fad8806c4e0 2024-09-13T19:32:44.430 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-13T19:32:44.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.428+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8806c4e0 msgr2=0x7fad881acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.428+0000 7fad8d51d640 1 --2- 172.21.15.144:0/880509379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8806c4e0 0x7fad881acd10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad780af040 tx=0x7fad7801abb0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.428+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 shutdown_connections 2024-09-13T19:32:44.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.428+0000 7fad8d51d640 1 --2- 172.21.15.144:0/880509379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8806c4e0 0x7fad881acd10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.428+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 >> 172.21.15.144:0/880509379 conn(0x7fad8806fff0 msgr2=0x7fad88113760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:44.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.428+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 shutdown_connections 2024-09-13T19:32:44.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.428+0000 7fad8d51d640 1 -- 172.21.15.144:0/880509379 wait complete. 2024-09-13T19:32:44.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new cab5ee78-fc3c-4b70-8dd5-028dc09b863f 3 2024-09-13T19:32:44.479 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:44.476+0000 7fcb2f18f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T19:32:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b221c8640 1 Processor -- start 2024-09-13T19:32:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b221c8640 1 -- start start 2024-09-13T19:32:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b221c8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1b1c112010 0x7f1b1c1123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b221c8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1c112ab0 con 0x7f1b1c117c60 2024-09-13T19:32:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b221c8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1c118820 con 0x7f1b1c112010 2024-09-13T19:32:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b1b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1b1c112010 0x7f1b1c1123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:44.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b1b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1b1c112010 0x7f1b1c1123f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39062/0 (socket says 172.21.15.144:39062) 2024-09-13T19:32:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b1b7fe640 1 -- 172.21.15.144:0/2476425729 learned_addr learned my addr 172.21.15.144:0/2476425729 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:32:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b1affd640 1 --1- 172.21.15.144:0/2476425729 >> v1:172.21.15.18:6789/0 conn(0x7f1b1c117c60 0x7f1b1c118110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:41076/0 (socket says 172.21.15.144:41076) 2024-09-13T19:32:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b1b7fe640 1 -- 172.21.15.144:0/2476425729 >> v1:172.21.15.18:6789/0 conn(0x7f1b1c117c60 legacy=0x7f1b1c118110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.560+0000 7f1b1b7fe640 1 -- 172.21.15.144:0/2476425729 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c1189d0 con 0x7f1b1c112010 2024-09-13T19:32:44.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b1b7fe640 1 --2- 172.21.15.144:0/2476425729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1123f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0097f0 tx=0x7f1b0c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a873d949f9bcb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:44.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b1a7fc640 1 -- 172.21.15.144:0/2476425729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b0c0b0070 con 0x7f1b1c112010 2024-09-13T19:32:44.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b1a7fc640 1 -- 172.21.15.144:0/2476425729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c0ab530 con 0x7f1b1c112010 2024-09-13T19:32:44.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b1a7fc640 1 -- 172.21.15.144:0/2476425729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b0c0ab830 con 0x7f1b1c112010 2024-09-13T19:32:44.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 -- 172.21.15.144:0/2476425729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 msgr2=0x7f1b1c1123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 --2- 172.21.15.144:0/2476425729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1123f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0097f0 tx=0x7f1b0c01c430 comp rx=0 tx=0).stop 2024-09-13T19:32:44.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 -- 172.21.15.144:0/2476425729 shutdown_connections 2024-09-13T19:32:44.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 --2- 172.21.15.144:0/2476425729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1123f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 -- 172.21.15.144:0/2476425729 >> 172.21.15.144:0/2476425729 conn(0x7f1b1c06e660 msgr2=0x7f1b1c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 -- 172.21.15.144:0/2476425729 shutdown_connections 2024-09-13T19:32:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 -- 172.21.15.144:0/2476425729 wait complete. 2024-09-13T19:32:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 Processor -- start 2024-09-13T19:32:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.564+0000 7f1b221c8640 1 -- start start 2024-09-13T19:32:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b221c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b221c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c120950 con 0x7f1b1c112010 2024-09-13T19:32:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39072/0 (socket says 172.21.15.144:39072) 2024-09-13T19:32:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b1b7fe640 1 -- 172.21.15.144:0/686084748 learned_addr learned my addr 172.21.15.144:0/686084748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:32:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b1b7fe640 1 -- 172.21.15.144:0/686084748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c1af600 con 0x7f1b1c112010 2024-09-13T19:32:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b1b7fe640 1 --2- 172.21.15.144:0/686084748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1af030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c01a060 tx=0x7f1b0c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b03fff640 1 -- 172.21.15.144:0/686084748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b0c0b0040 con 0x7f1b1c112010 2024-09-13T19:32:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1c1af890 con 0x7f1b1c112010 2024-09-13T19:32:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b03fff640 1 -- 172.21.15.144:0/686084748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c0aa6d0 con 0x7f1b1c112010 2024-09-13T19:32:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b03fff640 1 -- 172.21.15.144:0/686084748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b0c0aa9b0 con 0x7f1b1c112010 2024-09-13T19:32:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1c1a92a0 con 0x7f1b1c112010 2024-09-13T19:32:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b03fff640 1 -- 172.21.15.144:0/686084748 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b0c0aab50 con 0x7f1b1c112010 2024-09-13T19:32:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b03fff640 1 -- 172.21.15.144:0/686084748 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1b0c0b4dd0 con 0x7f1b1c112010 2024-09-13T19:32:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.568+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b1c112470 con 0x7f1b1c112010 2024-09-13T19:32:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.576+0000 7f1b03fff640 1 -- 172.21.15.144:0/686084748 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1b0c0160b0 con 0x7f1b1c112010 2024-09-13T19:32:44.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cab5ee78-fc3c-4b70-8dd5-028dc09b863f", "id": 3} v 0) -- 0x7f1b1c1afa60 con 0x7f1b1c112010 2024-09-13T19:32:44.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b03fff640 1 -- 172.21.15.144:0/686084748 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cab5ee78-fc3c-4b70-8dd5-028dc09b863f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1b0c0b4430 con 0x7f1b1c112010 2024-09-13T19:32:44.643 INFO:teuthology.orchestra.run.smithi144.stdout:3 2024-09-13T19:32:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 msgr2=0x7f1b1c1af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b221c8640 1 --2- 172.21.15.144:0/686084748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1af030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c01a060 tx=0x7f1b0c0191d0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 shutdown_connections 2024-09-13T19:32:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b221c8640 1 --2- 172.21.15.144:0/686084748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b1c112010 0x7f1b1c1af030 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 >> 172.21.15.144:0/686084748 conn(0x7f1b1c06e660 msgr2=0x7f1b1c115e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:44.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 shutdown_connections 2024-09-13T19:32:44.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:32:44.640+0000 7f1b221c8640 1 -- 172.21.15.144:0/686084748 wait complete. 2024-09-13T19:32:44.659 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T19:32:44.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T19:32:44.661 INFO:tasks.ceph.osd.0:Started 2024-09-13T19:32:44.661 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T19:32:44.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T19:32:44.702 INFO:tasks.ceph.osd.1:Started 2024-09-13T19:32:44.702 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T19:32:44.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T19:32:44.705 INFO:tasks.ceph.osd.2:Started 2024-09-13T19:32:44.705 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T19:32:44.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T19:32:44.707 INFO:tasks.ceph.osd.3:Started 2024-09-13T19:32:44.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:32:44.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.822+0000 7f2fbe832640 1 Processor -- start 2024-09-13T19:32:44.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.822+0000 7f2fbe832640 1 -- start start 2024-09-13T19:32:44.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.822+0000 7f2fbe832640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2fb812f390 0x7f2fb8133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:44.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.822+0000 7f2fbe832640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb80984f0 con 0x7f2fb812e760 2024-09-13T19:32:44.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.822+0000 7f2fbe832640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb8098dc0 con 0x7f2fb812f390 2024-09-13T19:32:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb77fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2fb812f390 0x7f2fb8133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb7fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2fb812e760 0x7f2fb812ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60164/0 (socket says 172.21.15.18:60164) 2024-09-13T19:32:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb7fff640 1 -- 172.21.15.18:0/2541015910 learned_addr learned my addr 172.21.15.18:0/2541015910 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:32:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb77fe640 1 -- 172.21.15.18:0/2541015910 >> v1:172.21.15.18:6789/0 conn(0x7f2fb812e760 legacy=0x7f2fb812ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb77fe640 1 -- 172.21.15.18:0/2541015910 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb80981a0 con 0x7f2fb812f390 2024-09-13T19:32:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb6ffd640 1 -- 172.21.15.18:0/2541015910 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3282479275 0 0) 0x7f2fb80984f0 con 0x7f2fb812e760 2024-09-13T19:32:44.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb77fe640 1 --2- 172.21.15.18:0/2541015910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812f390 0x7f2fb8133a80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009740 tx=0x7f2fa801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1b1d985dff0cec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:44.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb6ffd640 1 -- 172.21.15.18:0/2541015910 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fa80b1070 con 0x7f2fb812f390 2024-09-13T19:32:44.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb6ffd640 1 -- 172.21.15.18:0/2541015910 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa80ac570 con 0x7f2fb812f390 2024-09-13T19:32:44.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fb6ffd640 1 -- 172.21.15.18:0/2541015910 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fa80ac870 con 0x7f2fb812f390 2024-09-13T19:32:44.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fbe832640 1 -- 172.21.15.18:0/2541015910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812f390 msgr2=0x7f2fb8133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fbe832640 1 --2- 172.21.15.18:0/2541015910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812f390 0x7f2fb8133a80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009740 tx=0x7f2fa801c400 comp rx=0 tx=0).stop 2024-09-13T19:32:44.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fbe832640 1 -- 172.21.15.18:0/2541015910 shutdown_connections 2024-09-13T19:32:44.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fbe832640 1 --2- 172.21.15.18:0/2541015910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812f390 0x7f2fb8133a80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fbe832640 1 -- 172.21.15.18:0/2541015910 >> 172.21.15.18:0/2541015910 conn(0x7f2fb80a10a0 msgr2=0x7f2fb80a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:44.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fbe832640 1 -- 172.21.15.18:0/2541015910 shutdown_connections 2024-09-13T19:32:44.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.826+0000 7f2fbe832640 1 -- 172.21.15.18:0/2541015910 wait complete. 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fbe832640 1 Processor -- start 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fbe832640 1 -- start start 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fbe832640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812e760 0x7f2fb812fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fbe832640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb8136b70 con 0x7f2fb812e760 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812e760 0x7f2fb812fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812e760 0x7f2fb812fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48712/0 (socket says 172.21.15.18:48712) 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb7fff640 1 -- 172.21.15.18:0/1717516721 learned_addr learned my addr 172.21.15.18:0/1717516721 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb7fff640 1 -- 172.21.15.18:0/1717516721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb8131f30 con 0x7f2fb812e760 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb7fff640 1 --2- 172.21.15.18:0/1717516721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812e760 0x7f2fb812fae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c420 tx=0x7f2fac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb4ff9640 1 -- 172.21.15.18:0/1717516721 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fac018070 con 0x7f2fb812e760 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb4ff9640 1 -- 172.21.15.18:0/1717516721 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fac0074d0 con 0x7f2fb812e760 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb81323f0 con 0x7f2fb812e760 2024-09-13T19:32:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb4ff9640 1 -- 172.21.15.18:0/1717516721 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fac004960 con 0x7f2fb812e760 2024-09-13T19:32:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb8130020 con 0x7f2fb812e760 2024-09-13T19:32:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb4ff9640 1 -- 172.21.15.18:0/1717516721 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2fac01b070 con 0x7f2fb812e760 2024-09-13T19:32:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fb4ff9640 1 -- 172.21.15.18:0/1717516721 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2fac01c8c0 con 0x7f2fb812e760 2024-09-13T19:32:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.830+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb8132a20 con 0x7f2fb812e760 2024-09-13T19:32:44.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.834+0000 7f2fb4ff9640 1 -- 172.21.15.18:0/1717516721 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2fac022020 con 0x7f2fb812e760 2024-09-13T19:32:44.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.890+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fb812ec80 con 0x7f2fb812e760 2024-09-13T19:32:44.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.890+0000 7f2fb4ff9640 1 -- 172.21.15.18:0/1717516721 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f2fac01cb90 con 0x7f2fb812e760 2024-09-13T19:32:44.900 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:32:44.900 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"fsid":"b2385e7c-a71a-4af5-b7af-4c90a204f1ea","created":"2024-09-13T19:32:43.365033+0000","modified":"2024-09-13T19:32:44.638174+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:32:44.638174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"feb640dc-8e82-4932-aff2-4b0b5448f785","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43d97a8c-e558-4aaf-8184-0c7b26a1fa50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2b1ed4d-6f98-45a6-88b7-e7a345f7037f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cab5ee78-fc3c-4b70-8dd5-028dc09b863f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:32:44.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.894+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812e760 msgr2=0x7f2fb812fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:44.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.894+0000 7f2fbe832640 1 --2- 172.21.15.18:0/1717516721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812e760 0x7f2fb812fae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c420 tx=0x7f2fac00c8e0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.894+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 shutdown_connections 2024-09-13T19:32:44.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.894+0000 7f2fbe832640 1 --2- 172.21.15.18:0/1717516721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fb812e760 0x7f2fb812fae0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:44.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.894+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 >> 172.21.15.18:0/1717516721 conn(0x7f2fb80a10a0 msgr2=0x7f2fb8128080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:44.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.894+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 shutdown_connections 2024-09-13T19:32:44.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:44.894+0000 7f2fbe832640 1 -- 172.21.15.18:0/1717516721 wait complete. 2024-09-13T19:32:44.917 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T19:32:44.918 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T19:32:45.061 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.060+0000 7fcb2f18f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T19:32:45.115 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.112+0000 7fcb2f18f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T19:32:45.168 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.164+0000 7fcb2f18f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T19:32:45.244 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.240+0000 7fcb2f18f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T19:32:45.296 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.292+0000 7fcb2f18f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T19:32:45.322 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:32:45.373 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.372+0000 7fcb2f18f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T19:32:45.425 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.424+0000 7fcb2f18f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T19:32:45.444 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fcf111640 1 Processor -- start 2024-09-13T19:32:45.444 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fcf111640 1 -- start start 2024-09-13T19:32:45.445 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fcf111640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5fc8131810 0x7f5fc8133c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:45.445 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fcf111640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc8098270 con 0x7f5fc8097780 2024-09-13T19:32:45.445 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fcf111640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc809af60 con 0x7f5fc8131810 2024-09-13T19:32:45.445 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fc7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5fc8131810 0x7f5fc8133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:45.445 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fccead640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5fc8097780 0x7f5fc8097b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60172/0 (socket says 172.21.15.18:60172) 2024-09-13T19:32:45.445 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fccead640 1 -- 172.21.15.18:0/2256627582 learned_addr learned my addr 172.21.15.18:0/2256627582 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:32:45.445 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2256627582 >> v1:172.21.15.18:6789/0 conn(0x7f5fc8097780 legacy=0x7f5fc8097b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:45.446 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2256627582 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc809b440 con 0x7f5fc8131810 2024-09-13T19:32:45.447 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fc7fff640 1 --2- 172.21.15.18:0/2256627582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8131810 0x7f5fc8133c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009740 tx=0x7f5fb801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61190bf4e25d3e04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:45.447 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fc77fe640 1 -- 172.21.15.18:0/2256627582 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fb80b1070 con 0x7f5fc8131810 2024-09-13T19:32:45.447 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fc77fe640 1 -- 172.21.15.18:0/2256627582 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb80ac520 con 0x7f5fc8131810 2024-09-13T19:32:45.447 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.438+0000 7f5fc77fe640 1 -- 172.21.15.18:0/2256627582 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fb80ac820 con 0x7f5fc8131810 2024-09-13T19:32:45.448 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- 172.21.15.18:0/2256627582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8131810 msgr2=0x7f5fc8133c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:45.448 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 --2- 172.21.15.18:0/2256627582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8131810 0x7f5fc8133c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009740 tx=0x7f5fb801c370 comp rx=0 tx=0).stop 2024-09-13T19:32:45.448 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- 172.21.15.18:0/2256627582 shutdown_connections 2024-09-13T19:32:45.448 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 --2- 172.21.15.18:0/2256627582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8131810 0x7f5fc8133c00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:45.448 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- 172.21.15.18:0/2256627582 >> 172.21.15.18:0/2256627582 conn(0x7f5fc80a0fd0 msgr2=0x7f5fc80a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:45.448 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- 172.21.15.18:0/2256627582 shutdown_connections 2024-09-13T19:32:45.448 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- 172.21.15.18:0/2256627582 wait complete. 2024-09-13T19:32:45.449 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 Processor -- start 2024-09-13T19:32:45.449 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- start start 2024-09-13T19:32:45.449 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8097780 0x7f5fc80709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:45.450 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc8136ae0 con 0x7f5fc8097780 2024-09-13T19:32:45.450 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fccead640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8097780 0x7f5fc80709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:45.450 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fccead640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8097780 0x7f5fc80709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48726/0 (socket says 172.21.15.18:48726) 2024-09-13T19:32:45.450 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fccead640 1 -- 172.21.15.18:0/3945419097 learned_addr learned my addr 172.21.15.18:0/3945419097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:32:45.450 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fccead640 1 -- 172.21.15.18:0/3945419097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc8073930 con 0x7f5fc8097780 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fccead640 1 --2- 172.21.15.18:0/3945419097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8097780 0x7f5fc80709a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000cb20 tx=0x7f5fb000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fc57fa640 1 -- 172.21.15.18:0/3945419097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fb0017070 con 0x7f5fc8097780 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fc57fa640 1 -- 172.21.15.18:0/3945419097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb000abf0 con 0x7f5fc8097780 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc8072520 con 0x7f5fc8097780 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fc57fa640 1 -- 172.21.15.18:0/3945419097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fb0012400 con 0x7f5fc8097780 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc8070ee0 con 0x7f5fc8097780 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc8097be0 con 0x7f5fc8097780 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fc57fa640 1 -- 172.21.15.18:0/3945419097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5fb001a070 con 0x7f5fc8097780 2024-09-13T19:32:45.451 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.442+0000 7f5fc57fa640 1 -- 172.21.15.18:0/3945419097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5fb001cd00 con 0x7f5fc8097780 2024-09-13T19:32:45.453 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.446+0000 7f5fc57fa640 1 -- 172.21.15.18:0/3945419097 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5fb001c7f0 con 0x7f5fc8097780 2024-09-13T19:32:45.513 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fc8075770 con 0x7f5fc8097780 2024-09-13T19:32:45.513 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fc57fa640 1 -- 172.21.15.18:0/3945419097 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f5fb001c9d0 con 0x7f5fc8097780 2024-09-13T19:32:45.514 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-13T19:32:45.514 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":6,"fsid":"b2385e7c-a71a-4af5-b7af-4c90a204f1ea","created":"2024-09-13T19:32:43.365033+0000","modified":"2024-09-13T19:32:44.638174+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:32:44.638174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"feb640dc-8e82-4932-aff2-4b0b5448f785","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43d97a8c-e558-4aaf-8184-0c7b26a1fa50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2b1ed4d-6f98-45a6-88b7-e7a345f7037f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cab5ee78-fc3c-4b70-8dd5-028dc09b863f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:32:45.514 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8097780 msgr2=0x7f5fc80709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:45.515 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fcf111640 1 --2- 172.21.15.18:0/3945419097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8097780 0x7f5fc80709a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000cb20 tx=0x7f5fb000a060 comp rx=0 tx=0).stop 2024-09-13T19:32:45.515 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 shutdown_connections 2024-09-13T19:32:45.515 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fcf111640 1 --2- 172.21.15.18:0/3945419097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fc8097780 0x7f5fc80709a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:45.515 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 >> 172.21.15.18:0/3945419097 conn(0x7f5fc80a0fd0 msgr2=0x7f5fc809b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:45.515 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 shutdown_connections 2024-09-13T19:32:45.515 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:45.506+0000 7f5fcf111640 1 -- 172.21.15.18:0/3945419097 wait complete. 2024-09-13T19:32:45.530 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T19:32:45.575 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.572+0000 7fcb2f18f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T19:32:45.636 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:45.632+0000 7fcb2f18f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T19:32:46.250 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-13T19:32:46.242+0000 7fba4b7617c0 -1 Falling back to public interface 2024-09-13T19:32:46.387 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-13T19:32:46.384+0000 7fa8afc657c0 -1 Falling back to public interface 2024-09-13T19:32:46.454 INFO:tasks.ceph.mgr.x.smithi144.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T19:32:46.454 INFO:tasks.ceph.mgr.x.smithi144.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T19:32:46.454 INFO:tasks.ceph.mgr.x.smithi144.stderr: from numpy import show_config as show_numpy_config 2024-09-13T19:32:46.513 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:46.512+0000 7fcb2f18f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T19:32:46.519 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-13T19:32:46.516+0000 7f42115cb7c0 -1 Falling back to public interface 2024-09-13T19:32:46.610 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-13T19:32:46.608+0000 7f492a1617c0 -1 Falling back to public interface 2024-09-13T19:32:46.690 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:46.688+0000 7fcb2f18f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T19:32:46.863 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:46.860+0000 7fcb2f18f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T19:32:46.934 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:46.932+0000 7fcb2f18f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T19:32:47.081 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:47.080+0000 7fcb2f18f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T19:32:47.692 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:47.688+0000 7fcb2f18f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T19:32:47.767 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:47.764+0000 7fcb2f18f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T19:32:47.948 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:47.944+0000 7fcb2f18f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T19:32:48.021 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:48.020+0000 7fcb2f18f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T19:32:48.311 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:48.308+0000 7fcb2f18f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T19:32:48.372 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:48.368+0000 7fcb2f18f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T19:32:49.403 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-13T19:32:49.400+0000 7fcad5dc8640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T19:32:50.575 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-13T19:32:50.566+0000 7fba4b7617c0 -1 osd.0 0 log_to_monitors true 2024-09-13T19:32:50.880 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-13T19:32:50.876+0000 7fa8afc657c0 -1 osd.3 0 log_to_monitors true 2024-09-13T19:32:50.892 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-13T19:32:50.888+0000 7f492a1617c0 -1 osd.2 0 log_to_monitors true 2024-09-13T19:32:50.988 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-13T19:32:50.984+0000 7f42115cb7c0 -1 osd.1 0 log_to_monitors true 2024-09-13T19:32:51.934 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:32:52.060 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa817291640 1 Processor -- start 2024-09-13T19:32:52.060 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa817291640 1 -- start start 2024-09-13T19:32:52.061 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa817291640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa810093470 0x7fa810093850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:52.061 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa817291640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa810096130 con 0x7fa810128f50 2024-09-13T19:32:52.062 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa817291640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa810096760 con 0x7fa810093470 2024-09-13T19:32:52.062 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa81502d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa810093470 0x7fa810093850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:52.062 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa81482c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa810128f50 0x7fa8101293c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51382/0 (socket says 172.21.15.18:51382) 2024-09-13T19:32:52.062 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa81482c640 1 -- 172.21.15.18:0/1134568189 learned_addr learned my addr 172.21.15.18:0/1134568189 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:32:52.062 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa807fff640 1 -- 172.21.15.18:0/1134568189 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224181071 0 0) 0x7fa810096130 con 0x7fa810128f50 2024-09-13T19:32:52.062 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa807fff640 1 -- 172.21.15.18:0/1134568189 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7fc003530 con 0x7fa810128f50 2024-09-13T19:32:52.062 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa81502d640 1 -- 172.21.15.18:0/1134568189 >> v1:172.21.15.18:6789/0 conn(0x7fa810128f50 legacy=0x7fa8101293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:52.062 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.054+0000 7fa81502d640 1 -- 172.21.15.18:0/1134568189 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa810098be0 con 0x7fa810093470 2024-09-13T19:32:52.065 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa81502d640 1 --2- 172.21.15.18:0/1134568189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa810093850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009770 tx=0x7fa80c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc87422fb60cf73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:52.065 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa807fff640 1 -- 172.21.15.18:0/1134568189 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa80c0b0070 con 0x7fa810093470 2024-09-13T19:32:52.065 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa807fff640 1 -- 172.21.15.18:0/1134568189 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80c0ab530 con 0x7fa810093470 2024-09-13T19:32:52.066 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa807fff640 1 -- 172.21.15.18:0/1134568189 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa80c0ab810 con 0x7fa810093470 2024-09-13T19:32:52.066 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 -- 172.21.15.18:0/1134568189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 msgr2=0x7fa810093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:52.066 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 --2- 172.21.15.18:0/1134568189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa810093850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009770 tx=0x7fa80c01c370 comp rx=0 tx=0).stop 2024-09-13T19:32:52.067 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 -- 172.21.15.18:0/1134568189 shutdown_connections 2024-09-13T19:32:52.067 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 --2- 172.21.15.18:0/1134568189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa810093850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:52.067 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 -- 172.21.15.18:0/1134568189 >> 172.21.15.18:0/1134568189 conn(0x7fa810099c40 msgr2=0x7fa81009a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:52.067 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 -- 172.21.15.18:0/1134568189 shutdown_connections 2024-09-13T19:32:52.067 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 -- 172.21.15.18:0/1134568189 wait complete. 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 Processor -- start 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 -- start start 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa8101c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa817291640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa810135160 con 0x7fa810093470 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa81502d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa8101c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa81502d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa8101c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42294/0 (socket says 172.21.15.18:42294) 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.058+0000 7fa81502d640 1 -- 172.21.15.18:0/3056096528 learned_addr learned my addr 172.21.15.18:0/3056096528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa81502d640 1 -- 172.21.15.18:0/3056096528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa810122f40 con 0x7fa810093470 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa81502d640 1 --2- 172.21.15.18:0/3056096528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa8101c4470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa80c019fa0 tx=0x7fa80c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa805ffb640 1 -- 172.21.15.18:0/3056096528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa80c0b0050 con 0x7fa810093470 2024-09-13T19:32:52.069 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa805ffb640 1 -- 172.21.15.18:0/3056096528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80c0b1040 con 0x7fa810093470 2024-09-13T19:32:52.070 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa805ffb640 1 -- 172.21.15.18:0/3056096528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa80c0b5760 con 0x7fa810093470 2024-09-13T19:32:52.070 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa810131f70 con 0x7fa810093470 2024-09-13T19:32:52.070 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa810123380 con 0x7fa810093470 2024-09-13T19:32:52.071 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa805ffb640 1 -- 172.21.15.18:0/3056096528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7fa80c0be030 con 0x7fa810093470 2024-09-13T19:32:52.071 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa810093850 con 0x7fa810093470 2024-09-13T19:32:52.071 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa805ffb640 1 --2- 172.21.15.18:0/3056096528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa7f4035d20 0x7fa7f40381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:52.071 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa805ffb640 1 -- 172.21.15.18:0/3056096528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1339+0+0 (secure 0 0 0) 0x7fa80c0bc070 con 0x7fa810093470 2024-09-13T19:32:52.071 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa81482c640 1 --2- 172.21.15.18:0/3056096528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa7f4035d20 0x7fa7f40381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:52.071 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.062+0000 7fa81482c640 1 --2- 172.21.15.18:0/3056096528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa7f4035d20 0x7fa7f40381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa800000f70 tx=0x7fa8000010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:52.083 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.074+0000 7fa805ffb640 1 -- 172.21.15.18:0/3056096528 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa80c0e8080 con 0x7fa810093470 2024-09-13T19:32:52.254 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.246+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa810097210 con 0x7fa810093470 2024-09-13T19:32:52.254 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.246+0000 7fa805ffb640 1 -- 172.21.15.18:0/3056096528 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4153 (secure 0 0 0) 0x7fa80c0c5060 con 0x7fa810093470 2024-09-13T19:32:52.254 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-13T19:32:52.255 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":7,"fsid":"b2385e7c-a71a-4af5-b7af-4c90a204f1ea","created":"2024-09-13T19:32:43.365033+0000","modified":"2024-09-13T19:32:51.443766+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:32:44.638174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"feb640dc-8e82-4932-aff2-4b0b5448f785","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43d97a8c-e558-4aaf-8184-0c7b26a1fa50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2b1ed4d-6f98-45a6-88b7-e7a345f7037f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cab5ee78-fc3c-4b70-8dd5-028dc09b863f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa7f4035d20 msgr2=0x7fa7f40381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 --2- 172.21.15.18:0/3056096528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa7f4035d20 0x7fa7f40381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa800000f70 tx=0x7fa8000010b0 comp rx=0 tx=0).stop 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 msgr2=0x7fa8101c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 --2- 172.21.15.18:0/3056096528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa8101c4470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa80c019fa0 tx=0x7fa80c01abb0 comp rx=0 tx=0).stop 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 shutdown_connections 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 --2- 172.21.15.18:0/3056096528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa7f4035d20 0x7fa7f40381e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 --2- 172.21.15.18:0/3056096528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa810093470 0x7fa8101c4470 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 >> 172.21.15.18:0/3056096528 conn(0x7fa810099c40 msgr2=0x7fa81012ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 shutdown_connections 2024-09-13T19:32:52.257 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:52.250+0000 7fa817291640 1 -- 172.21.15.18:0/3056096528 wait complete. 2024-09-13T19:32:52.273 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T19:32:53.239 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-13T19:32:53.230+0000 7fba46ee7640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T19:32:53.256 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-13T19:32:53.250+0000 7fba3f52e640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:32:54.243 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-13T19:32:54.240+0000 7f492691c640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T19:32:54.249 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-13T19:32:54.248+0000 7f420dd86640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T19:32:54.263 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-13T19:32:54.260+0000 7fa8ab3eb640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T19:32:54.273 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-13T19:32:54.272+0000 7f491df2e640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:32:54.277 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-13T19:32:54.276+0000 7f4205398640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:32:54.289 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-13T19:32:54.288+0000 7fa8a3a32640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:32:58.677 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:32:58.795 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.786+0000 7feda270d640 1 Processor -- start 2024-09-13T19:32:58.795 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.786+0000 7feda270d640 1 -- start start 2024-09-13T19:32:58.796 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.786+0000 7feda270d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fed9c097780 0x7fed9c097b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:58.796 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.786+0000 7feda270d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed9c09b440 con 0x7fed9c12e500 2024-09-13T19:32:58.796 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.786+0000 7feda270d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fed9c09af60 con 0x7fed9c097780 2024-09-13T19:32:58.796 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fed9c097780 0x7fed9c097b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:58.796 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fed9c12e500 0x7fed9c12e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51388/0 (socket says 172.21.15.18:51388) 2024-09-13T19:32:58.796 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9b7fe640 1 -- 172.21.15.18:0/2891452823 learned_addr learned my addr 172.21.15.18:0/2891452823 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:32:58.796 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9bfff640 1 -- 172.21.15.18:0/2891452823 >> v1:172.21.15.18:6789/0 conn(0x7fed9c12e500 legacy=0x7fed9c12e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:58.797 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9bfff640 1 -- 172.21.15.18:0/2891452823 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c098650 con 0x7fed9c097780 2024-09-13T19:32:58.798 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9bfff640 1 --2- 172.21.15.18:0/2891452823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c097b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009740 tx=0x7fed8c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98e99bbfbe65f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:58.798 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9affd640 1 -- 172.21.15.18:0/2891452823 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed8c0b0070 con 0x7fed9c097780 2024-09-13T19:32:58.799 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9affd640 1 -- 172.21.15.18:0/2891452823 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c0ab530 con 0x7fed9c097780 2024-09-13T19:32:58.799 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7fed9affd640 1 -- 172.21.15.18:0/2891452823 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed8c0ab830 con 0x7fed9c097780 2024-09-13T19:32:58.799 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7feda270d640 1 -- 172.21.15.18:0/2891452823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 msgr2=0x7fed9c097b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:58.799 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7feda270d640 1 --2- 172.21.15.18:0/2891452823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c097b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009740 tx=0x7fed8c01c400 comp rx=0 tx=0).stop 2024-09-13T19:32:58.800 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7feda270d640 1 -- 172.21.15.18:0/2891452823 shutdown_connections 2024-09-13T19:32:58.800 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7feda270d640 1 --2- 172.21.15.18:0/2891452823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c097b60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:58.800 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7feda270d640 1 -- 172.21.15.18:0/2891452823 >> 172.21.15.18:0/2891452823 conn(0x7fed9c0a0fd0 msgr2=0x7fed9c0a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:58.800 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7feda270d640 1 -- 172.21.15.18:0/2891452823 shutdown_connections 2024-09-13T19:32:58.800 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.790+0000 7feda270d640 1 -- 172.21.15.18:0/2891452823 wait complete. 2024-09-13T19:32:58.802 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7feda270d640 1 Processor -- start 2024-09-13T19:32:58.802 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7feda270d640 1 -- start start 2024-09-13T19:32:58.802 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7feda270d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c1c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:58.802 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7feda270d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c1371d0 con 0x7fed9c097780 2024-09-13T19:32:58.803 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed9bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c1c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:58.803 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed9bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c1c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42310/0 (socket says 172.21.15.18:42310) 2024-09-13T19:32:58.804 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed9bfff640 1 -- 172.21.15.18:0/1814555454 learned_addr learned my addr 172.21.15.18:0/1814555454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:32:58.804 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed9bfff640 1 -- 172.21.15.18:0/1814555454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c12ad80 con 0x7fed9c097780 2024-09-13T19:32:58.804 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed9bfff640 1 --2- 172.21.15.18:0/1814555454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c1c64e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0ae040 tx=0x7fed8c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:58.804 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed98ff9640 1 -- 172.21.15.18:0/1814555454 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed8c0b0050 con 0x7fed9c097780 2024-09-13T19:32:58.804 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed98ff9640 1 -- 172.21.15.18:0/1814555454 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c0b1040 con 0x7fed9c097780 2024-09-13T19:32:58.804 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c12ba10 con 0x7fed9c097780 2024-09-13T19:32:58.804 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed98ff9640 1 -- 172.21.15.18:0/1814555454 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed8c0b5740 con 0x7fed9c097780 2024-09-13T19:32:58.804 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c1c6bf0 con 0x7fed9c097780 2024-09-13T19:32:58.805 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9c097be0 con 0x7fed9c097780 2024-09-13T19:32:58.805 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed98ff9640 1 -- 172.21.15.18:0/1814555454 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7fed8c0be030 con 0x7fed9c097780 2024-09-13T19:32:58.805 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed98ff9640 1 --2- 172.21.15.18:0/1814555454 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fed88035d20 0x7fed880381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:58.805 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed98ff9640 1 -- 172.21.15.18:0/1814555454 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fed8c0bc070 con 0x7fed9c097780 2024-09-13T19:32:58.806 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.794+0000 7fed9b7fe640 1 --2- 172.21.15.18:0/1814555454 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fed88035d20 0x7fed880381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:58.806 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.798+0000 7fed9b7fe640 1 --2- 172.21.15.18:0/1814555454 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fed88035d20 0x7fed880381e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed90005890 tx=0x7fed90007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:58.808 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.802+0000 7fed98ff9640 1 -- 172.21.15.18:0/1814555454 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed8c0c5020 con 0x7fed9c097780 2024-09-13T19:32:58.972 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.966+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed9c12a8e0 con 0x7fed9c097780 2024-09-13T19:32:58.974 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.966+0000 7fed98ff9640 1 -- 172.21.15.18:0/1814555454 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8014 (secure 0 0 0) 0x7fed8c015ff0 con 0x7fed9c097780 2024-09-13T19:32:58.974 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-13T19:32:58.974 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":13,"fsid":"b2385e7c-a71a-4af5-b7af-4c90a204f1ea","created":"2024-09-13T19:32:43.365033+0000","modified":"2024-09-13T19:32:58.480520+0000","last_up_change":"2024-09-13T19:32:55.261550+0000","last_in_change":"2024-09-13T19:32:44.638174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:32:56.473851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"feb640dc-8e82-4932-aff2-4b0b5448f785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6801","nonce":2700511246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6803","nonce":2700511246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6807","nonce":2700511246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6805","nonce":2700511246}]},"public_addr":"172.21.15.18:6801/2700511246","cluster_addr":"172.21.15.18:6803/2700511246","heartbeat_back_addr":"172.21.15.18:6807/2700511246","heartbeat_front_addr":"172.21.15.18:6805/2700511246","state":["exists","up"]},{"osd":1,"uuid":"43d97a8c-e558-4aaf-8184-0c7b26a1fa50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6809","nonce":3556169889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6811","nonce":3556169889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6815","nonce":3556169889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6813","nonce":3556169889}]},"public_addr":"172.21.15.144:6809/3556169889","cluster_addr":"172.21.15.144:6811/3556169889","heartbeat_back_addr":"172.21.15.144:6815/3556169889","heartbeat_front_addr":"172.21.15.144:6813/3556169889","state":["exists","up"]},{"osd":2,"uuid":"a2b1ed4d-6f98-45a6-88b7-e7a345f7037f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6817","nonce":2341760841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6819","nonce":2341760841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6823","nonce":2341760841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6821","nonce":2341760841}]},"public_addr":"172.21.15.144:6817/2341760841","cluster_addr":"172.21.15.144:6819/2341760841","heartbeat_back_addr":"172.21.15.144:6823/2341760841","heartbeat_front_addr":"172.21.15.144:6821/2341760841","state":["exists","up"]},{"osd":3,"uuid":"cab5ee78-fc3c-4b70-8dd5-028dc09b863f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6801","nonce":1157716661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6803","nonce":1157716661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6807","nonce":1157716661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6805","nonce":1157716661}]},"public_addr":"172.21.15.144:6801/1157716661","cluster_addr":"172.21.15.144:6803/1157716661","heartbeat_back_addr":"172.21.15.144:6807/1157716661","heartbeat_front_addr":"172.21.15.144:6805/1157716661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.557790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.952068+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.944160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.871505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:32:58.976 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fed88035d20 msgr2=0x7fed880381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:58.976 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 --2- 172.21.15.18:0/1814555454 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fed88035d20 0x7fed880381e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed90005890 tx=0x7fed90007a90 comp rx=0 tx=0).stop 2024-09-13T19:32:58.976 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 msgr2=0x7fed9c1c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:58.976 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 --2- 172.21.15.18:0/1814555454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c1c64e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0ae040 tx=0x7fed8c0191a0 comp rx=0 tx=0).stop 2024-09-13T19:32:58.977 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 shutdown_connections 2024-09-13T19:32:58.977 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 --2- 172.21.15.18:0/1814555454 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fed88035d20 0x7fed880381e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:58.977 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 --2- 172.21.15.18:0/1814555454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed9c097780 0x7fed9c1c64e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:58.977 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 >> 172.21.15.18:0/1814555454 conn(0x7fed9c0a0fd0 msgr2=0x7fed9c09d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:58.977 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 shutdown_connections 2024-09-13T19:32:58.977 INFO:teuthology.misc.health.smithi018.stderr:2024-09-13T19:32:58.970+0000 7feda270d640 1 -- 172.21.15.18:0/1814555454 wait complete. 2024-09-13T19:32:58.992 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T19:32:58.992 INFO:tasks.ceph:Creating RBD pool 2024-09-13T19:32:58.992 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T19:32:59.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b97d1640 1 Processor -- start 2024-09-13T19:32:59.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b97d1640 1 -- start start 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b97d1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f63b412e6f0 0x7f63b412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b97d1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b4098d50 con 0x7f63b412f1c0 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b97d1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f63b406eba0 con 0x7f63b412e6f0 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f63b412e6f0 0x7f63b412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b27fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f63b412f1c0 0x7f63b412b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51394/0 (socket says 172.21.15.18:51394) 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b27fc640 1 -- 172.21.15.18:0/2248672173 learned_addr learned my addr 172.21.15.18:0/2248672173 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b2ffd640 1 -- 172.21.15.18:0/2248672173 >> v1:172.21.15.18:6789/0 conn(0x7f63b412f1c0 legacy=0x7f63b412b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b2ffd640 1 -- 172.21.15.18:0/2248672173 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b406ed60 con 0x7f63b412e6f0 2024-09-13T19:32:59.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.114+0000 7f63b1ffb640 1 -- 172.21.15.18:0/2248672173 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643926102 0 0) 0x7f639c001120 con 0x7f63b412f1c0 2024-09-13T19:32:59.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b2ffd640 1 --2- 172.21.15.18:0/2248672173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b412ec80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009d90 tx=0x7f63a401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bca25e1f9d1f77c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:59.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b1ffb640 1 -- 172.21.15.18:0/2248672173 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a40a6560 con 0x7f63b412e6f0 2024-09-13T19:32:59.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b1ffb640 1 -- 172.21.15.18:0/2248672173 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a40a6700 con 0x7f63b412e6f0 2024-09-13T19:32:59.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b1ffb640 1 -- 172.21.15.18:0/2248672173 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a40a6a00 con 0x7f63b412e6f0 2024-09-13T19:32:59.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 -- 172.21.15.18:0/2248672173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 msgr2=0x7f63b412ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:59.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 --2- 172.21.15.18:0/2248672173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b412ec80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009d90 tx=0x7f63a401c8c0 comp rx=0 tx=0).stop 2024-09-13T19:32:59.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 -- 172.21.15.18:0/2248672173 shutdown_connections 2024-09-13T19:32:59.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 --2- 172.21.15.18:0/2248672173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b412ec80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:59.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 -- 172.21.15.18:0/2248672173 >> 172.21.15.18:0/2248672173 conn(0x7f63b40a1030 msgr2=0x7f63b40a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:59.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 -- 172.21.15.18:0/2248672173 shutdown_connections 2024-09-13T19:32:59.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 -- 172.21.15.18:0/2248672173 wait complete. 2024-09-13T19:32:59.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 Processor -- start 2024-09-13T19:32:59.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 -- start start 2024-09-13T19:32:59.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b4130ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:59.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b97d1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4137610 con 0x7f63b412e6f0 2024-09-13T19:32:59.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b4130ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:59.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b4130ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42340/0 (socket says 172.21.15.18:42340) 2024-09-13T19:32:59.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b2ffd640 1 -- 172.21.15.18:0/3128004633 learned_addr learned my addr 172.21.15.18:0/3128004633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:32:59.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b2ffd640 1 -- 172.21.15.18:0/3128004633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b4133f30 con 0x7f63b412e6f0 2024-09-13T19:32:59.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.118+0000 7f63b2ffd640 1 --2- 172.21.15.18:0/3128004633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b4130ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63a401a4f0 tx=0x7f63a4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3128004633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a40a7750 con 0x7f63b412e6f0 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3128004633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a40c0070 con 0x7f63b412e6f0 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b4131020 con 0x7f63b412e6f0 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3128004633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63a40a7a20 con 0x7f63b412e6f0 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b41314e0 con 0x7f63b412e6f0 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b4131be0 con 0x7f63b412e6f0 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3128004633 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f63a40a7bc0 con 0x7f63b412e6f0 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63ab7fe640 1 --2- 172.21.15.18:0/3128004633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6394035d20 0x7f63940381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:59.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3128004633 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f63a40e39a0 con 0x7f63b412e6f0 2024-09-13T19:32:59.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63b27fc640 1 --2- 172.21.15.18:0/3128004633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6394035d20 0x7f63940381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:59.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.122+0000 7f63b27fc640 1 --2- 172.21.15.18:0/3128004633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6394035d20 0x7f63940381e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f639c000c10 tx=0x7f639c001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:59.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.126+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3128004633 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63a40ac030 con 0x7f63b412e6f0 2024-09-13T19:32:59.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.290+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f63b412ec80 con 0x7f63b412e6f0 2024-09-13T19:32:59.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.490+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3128004633 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f63a40c5c60 con 0x7f63b412e6f0 2024-09-13T19:32:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.490+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3128004633 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f63a4016540 con 0x7f63b412e6f0 2024-09-13T19:32:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'rbd' created 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6394035d20 msgr2=0x7f63940381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 --2- 172.21.15.18:0/3128004633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6394035d20 0x7f63940381e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f639c000c10 tx=0x7f639c001320 comp rx=0 tx=0).stop 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 msgr2=0x7f63b4130ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 --2- 172.21.15.18:0/3128004633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b4130ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63a401a4f0 tx=0x7f63a4019660 comp rx=0 tx=0).stop 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 shutdown_connections 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 --2- 172.21.15.18:0/3128004633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6394035d20 0x7f63940381e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 --2- 172.21.15.18:0/3128004633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b412e6f0 0x7f63b4130ae0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 >> 172.21.15.18:0/3128004633 conn(0x7f63b40a1030 msgr2=0x7f63b409b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:59.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 shutdown_connections 2024-09-13T19:32:59.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.494+0000 7f63b97d1640 1 -- 172.21.15.18:0/3128004633 wait complete. 2024-09-13T19:32:59.525 DEBUG:teuthology.orchestra.run.smithi018:> rbd --cluster ceph pool init rbd 2024-09-13T19:32:59.589 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:32:59.590 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:32:59.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.582+0000 7f223cc05f80 1 Processor -- start 2024-09-13T19:32:59.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.582+0000 7f223cc05f80 1 -- start start 2024-09-13T19:32:59.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.582+0000 7f223cc05f80 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5581a4408230 0x5581a4408610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:59.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.582+0000 7f223cc05f80 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5581a41fdea0 con 0x5581a4408f40 2024-09-13T19:32:59.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.582+0000 7f223cc05f80 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5581a41f2e20 con 0x5581a4408230 2024-09-13T19:32:59.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.582+0000 7f223af18640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5581a4408f40 0x5581a4409320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51404/0 (socket says 172.21.15.18:51404) 2024-09-13T19:32:59.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.582+0000 7f223af18640 1 -- 172.21.15.18:0/1007984357 learned_addr learned my addr 172.21.15.18:0/1007984357 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:32:59.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223b719640 1 --2- 172.21.15.18:0/1007984357 >> v2:172.21.15.18:3300/0 conn(0x5581a4408230 0x5581a4408610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:59.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223b719640 1 -- 172.21.15.18:0/1007984357 >> v1:172.21.15.18:6789/0 conn(0x5581a4408f40 legacy=0x5581a4409320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:59.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223b719640 1 -- 172.21.15.18:0/1007984357 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a41e4180 con 0x5581a4408230 2024-09-13T19:32:59.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223b719640 1 --2- 172.21.15.18:0/1007984357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a4408610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f222c00a480 tx=0x7f222c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c7f2babf033691 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:59.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223a717640 1 -- 172.21.15.18:0/1007984357 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f222c0af070 con 0x5581a4408230 2024-09-13T19:32:59.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223a717640 1 -- 172.21.15.18:0/1007984357 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c0aa530 con 0x5581a4408230 2024-09-13T19:32:59.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223a717640 1 -- 172.21.15.18:0/1007984357 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f222c0aa830 con 0x5581a4408230 2024-09-13T19:32:59.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223cc05f80 1 -- 172.21.15.18:0/1007984357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 msgr2=0x5581a4408610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:32:59.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223cc05f80 1 --2- 172.21.15.18:0/1007984357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a4408610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f222c00a480 tx=0x7f222c01b280 comp rx=0 tx=0).stop 2024-09-13T19:32:59.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223cc05f80 1 -- 172.21.15.18:0/1007984357 shutdown_connections 2024-09-13T19:32:59.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223cc05f80 1 --2- 172.21.15.18:0/1007984357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a4408610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:32:59.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223cc05f80 1 -- 172.21.15.18:0/1007984357 >> 172.21.15.18:0/1007984357 conn(0x5581a437bd00 msgr2=0x5581a4376040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:32:59.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223cc05f80 1 -- 172.21.15.18:0/1007984357 shutdown_connections 2024-09-13T19:32:59.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.586+0000 7f223cc05f80 1 -- 172.21.15.18:0/1007984357 wait complete. 2024-09-13T19:32:59.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223cc05f80 1 Processor -- start 2024-09-13T19:32:59.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223cc05f80 1 -- start start 2024-09-13T19:32:59.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223cc05f80 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a43f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:59.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223cc05f80 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5581a4249800 con 0x5581a4408230 2024-09-13T19:32:59.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223b719640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a43f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:59.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223b719640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a43f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42358/0 (socket says 172.21.15.18:42358) 2024-09-13T19:32:59.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223b719640 1 -- 172.21.15.18:0/3375248230 learned_addr learned my addr 172.21.15.18:0/3375248230 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:32:59.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223b719640 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a41ce990 con 0x5581a4408230 2024-09-13T19:32:59.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223b719640 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a43f6070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f222c0ad040 tx=0x7f222c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:32:59.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f222c0b9020 con 0x5581a4408230 2024-09-13T19:32:59.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c0b55a0 con 0x5581a4408230 2024-09-13T19:32:59.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581a43f7180 con 0x5581a4408230 2024-09-13T19:32:59.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f222c0af040 con 0x5581a4408230 2024-09-13T19:32:59.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a43f91f0 con 0x5581a4408230 2024-09-13T19:32:59.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f222c0bc020 con 0x5581a4408230 2024-09-13T19:32:59.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f222b7fe640 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22200346a0 0x7f2220036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:32:59.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f222c0e2300 con 0x5581a4408230 2024-09-13T19:32:59.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.590+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x5581a43f7df0 con 0x5581a4408230 2024-09-13T19:32:59.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.594+0000 7f223af18640 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22200346a0 0x7f2220036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:32:59.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:32:59.594+0000 7f223af18640 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22200346a0 0x7f2220036b60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2230000f70 tx=0x7f22300012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:00.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.498+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7f222c0c3030 con 0x5581a4408230 2024-09-13T19:33:00.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.498+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f222c0aa530 con 0x5581a4408230 2024-09-13T19:33:00.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.498+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f222c0b43d0 con 0x5581a4408230 2024-09-13T19:33:00.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.498+0000 7f2239f16640 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f2218002af0 con 0x5581a4408230 2024-09-13T19:33:00.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.502+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f222c0bd780 con 0x5581a4408230 2024-09-13T19:33:00.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.502+0000 7f223cc05f80 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5581a4408f40 0x5581a441b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:00.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.502+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x5581a441ffb0 con 0x5581a4408f40 2024-09-13T19:33:00.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.502+0000 7f223c97b640 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5581a4408f40 0x5581a441b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:00.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.502+0000 7f223c97b640 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5581a4408f40 0x5581a441b650 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:00.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.510+0000 7f223c97b640 1 -- 172.21.15.18:0/3375248230 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f223400a4d0 con 0x5581a4408f40 2024-09-13T19:33:00.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.518+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x5581a44716f0 con 0x5581a4408f40 2024-09-13T19:33:00.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.518+0000 7f223c97b640 1 -- 172.21.15.18:0/3375248230 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f223400a4d0 con 0x5581a4408f40 2024-09-13T19:33:00.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.518+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x5581a4470800 con 0x5581a4408f40 2024-09-13T19:33:00.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.518+0000 7f223c97b640 1 -- 172.21.15.18:0/3375248230 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f223400a4d0 con 0x5581a4408f40 2024-09-13T19:33:00.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:00.518+0000 7f2239715640 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f221c001f10 con 0x5581a4408230 2024-09-13T19:33:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:01.506+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7f222c0d5070 con 0x5581a4408230 2024-09-13T19:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:01.506+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f222003a1a0 con 0x5581a4408230 2024-09-13T19:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:01.506+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f222c0bd9e0 con 0x5581a4408230 2024-09-13T19:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:01.506+0000 7f2239f16640 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f2218005690 con 0x5581a4408f40 2024-09-13T19:33:01.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:01.514+0000 7f223c97b640 1 -- 172.21.15.18:0/3375248230 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f223400a4d0 con 0x5581a4408f40 2024-09-13T19:33:01.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:01.514+0000 7f2239715640 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f221c003360 con 0x5581a4408230 2024-09-13T19:33:02.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.510+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f222c0de020 con 0x5581a4408230 2024-09-13T19:33:02.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.510+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f222003a420 con 0x5581a4408230 2024-09-13T19:33:02.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.510+0000 7f222b7fe640 1 -- 172.21.15.18:0/3375248230 <== mon.0 v2:172.21.15.18:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f222c0bd3b0 con 0x5581a4408230 2024-09-13T19:33:02.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.510+0000 7f2239f16640 1 -- 172.21.15.18:0/3375248230 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f2218005a30 con 0x5581a4408f40 2024-09-13T19:33:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223c97b640 1 -- 172.21.15.18:0/3375248230 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f223400a4d0 con 0x5581a4408f40 2024-09-13T19:33:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5581a4408f40 msgr2=0x5581a441b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5581a4408f40 0x5581a441b650 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22200346a0 msgr2=0x7f2220036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22200346a0 0x7f2220036b60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2230000f70 tx=0x7f22300012c0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 msgr2=0x5581a43f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a43f6070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f222c0ad040 tx=0x7f222c018020 comp rx=0 tx=0).stop 2024-09-13T19:33:02.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 shutdown_connections 2024-09-13T19:33:02.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5581a4408f40 0x5581a441b650 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22200346a0 0x7f2220036b60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 --2- 172.21.15.18:0/3375248230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5581a4408230 0x5581a43f6070 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 >> 172.21.15.18:0/3375248230 conn(0x5581a437bd00 msgr2=0x5581a4379f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:02.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.518+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 shutdown_connections 2024-09-13T19:33:02.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.522+0000 7f223cc05f80 1 -- 172.21.15.18:0/3375248230 wait complete. 2024-09-13T19:33:02.536 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T19:33:02.536 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T19:33:02.537 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T19:33:02.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T19:33:02.537 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T19:33:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1131157640 1 Processor -- start 2024-09-13T19:33:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1131157640 1 -- start start 2024-09-13T19:33:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1131157640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f112c06d0e0 0x7f112c06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1131157640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112c071c10 con 0x7f112c06da00 2024-09-13T19:33:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1131157640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f112c072230 con 0x7f112c06d0e0 2024-09-13T19:33:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f112a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f112c06da00 0x7f112c12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43650/0 (socket says 172.21.15.18:43650) 2024-09-13T19:33:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f112a59c640 1 -- 172.21.15.18:0/3918846322 learned_addr learned my addr 172.21.15.18:0/3918846322 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f112ad9d640 1 --2- 172.21.15.18:0/3918846322 >> v2:172.21.15.18:3300/0 conn(0x7f112c06d0e0 0x7f112c06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1129d9b640 1 -- 172.21.15.18:0/3918846322 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033428757 0 0) 0x7f112c071c10 con 0x7f112c06da00 2024-09-13T19:33:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1129d9b640 1 -- 172.21.15.18:0/3918846322 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1114003530 con 0x7f112c06da00 2024-09-13T19:33:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f112ad9d640 1 -- 172.21.15.18:0/3918846322 >> v1:172.21.15.18:6789/0 conn(0x7f112c06da00 legacy=0x7f112c12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f112ad9d640 1 -- 172.21.15.18:0/3918846322 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c0709e0 con 0x7f112c06d0e0 2024-09-13T19:33:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f112ad9d640 1 --2- 172.21.15.18:0/3918846322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c06d4c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f111c009740 tx=0x7f111c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57cb4f6a6aa3049 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1129d9b640 1 -- 172.21.15.18:0/3918846322 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f111c0b0070 con 0x7f112c06d0e0 2024-09-13T19:33:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1129d9b640 1 -- 172.21.15.18:0/3918846322 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111c0ab530 con 0x7f112c06d0e0 2024-09-13T19:33:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.662+0000 7f1129d9b640 1 -- 172.21.15.18:0/3918846322 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f111c0ab810 con 0x7f112c06d0e0 2024-09-13T19:33:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- 172.21.15.18:0/3918846322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 msgr2=0x7f112c06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 --2- 172.21.15.18:0/3918846322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c06d4c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f111c009740 tx=0x7f111c01c370 comp rx=0 tx=0).stop 2024-09-13T19:33:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- 172.21.15.18:0/3918846322 shutdown_connections 2024-09-13T19:33:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 --2- 172.21.15.18:0/3918846322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c06d4c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- 172.21.15.18:0/3918846322 >> 172.21.15.18:0/3918846322 conn(0x7f112c099a50 msgr2=0x7f112c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- 172.21.15.18:0/3918846322 shutdown_connections 2024-09-13T19:33:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- 172.21.15.18:0/3918846322 wait complete. 2024-09-13T19:33:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 Processor -- start 2024-09-13T19:33:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- start start 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c129a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f112c134e80 con 0x7f112c06d0e0 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f112ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c129a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f112ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c129a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44432/0 (socket says 172.21.15.18:44432) 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f112ad9d640 1 -- 172.21.15.18:0/931043894 learned_addr learned my addr 172.21.15.18:0/931043894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f112ad9d640 1 -- 172.21.15.18:0/931043894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c08b450 con 0x7f112c06d0e0 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f112ad9d640 1 --2- 172.21.15.18:0/931043894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c129a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f111c018f80 tx=0x7f111c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f11137fe640 1 -- 172.21.15.18:0/931043894 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f111c0b9020 con 0x7f112c06d0e0 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f11137fe640 1 -- 172.21.15.18:0/931043894 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111c0ab6e0 con 0x7f112c06d0e0 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112c072710 con 0x7f112c06d0e0 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f11137fe640 1 -- 172.21.15.18:0/931043894 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f111c0b0040 con 0x7f112c06d0e0 2024-09-13T19:33:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112c12c1b0 con 0x7f112c06d0e0 2024-09-13T19:33:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f112c06d4c0 con 0x7f112c06d0e0 2024-09-13T19:33:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f11137fe640 1 -- 172.21.15.18:0/931043894 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f111c0bc020 con 0x7f112c06d0e0 2024-09-13T19:33:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.666+0000 7f11137fe640 1 --2- 172.21.15.18:0/931043894 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1118035db0 0x7f1118038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.670+0000 7f11137fe640 1 -- 172.21.15.18:0/931043894 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f111c0e2690 con 0x7f112c06d0e0 2024-09-13T19:33:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.670+0000 7f112a59c640 1 --2- 172.21.15.18:0/931043894 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1118035db0 0x7f1118038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.670+0000 7f112a59c640 1 --2- 172.21.15.18:0/931043894 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1118035db0 0x7f1118038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1120000f70 tx=0x7f11200010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:02.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.674+0000 7f11137fe640 1 -- 172.21.15.18:0/931043894 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f111c0c3030 con 0x7f112c06d0e0 2024-09-13T19:33:02.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.874+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f112c073790 con 0x7f112c06d0e0 2024-09-13T19:33:02.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.878+0000 7f11137fe640 1 -- 172.21.15.18:0/931043894 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84178 (secure 0 0 0) 0x7f112c072710 con 0x7f112c06d0e0 2024-09-13T19:33:02.887 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1118035db0 msgr2=0x7f1118038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 --2- 172.21.15.18:0/931043894 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1118035db0 0x7f1118038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1120000f70 tx=0x7f11200010b0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 msgr2=0x7f112c129a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 --2- 172.21.15.18:0/931043894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c129a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f111c018f80 tx=0x7f111c019110 comp rx=0 tx=0).stop 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 shutdown_connections 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 --2- 172.21.15.18:0/931043894 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1118035db0 0x7f1118038270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 --2- 172.21.15.18:0/931043894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c06d0e0 0x7f112c129a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 >> 172.21.15.18:0/931043894 conn(0x7f112c099a50 msgr2=0x7f112c09aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 shutdown_connections 2024-09-13T19:33:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:02.882+0000 7f1131157640 1 -- 172.21.15.18:0/931043894 wait complete. 2024-09-13T19:33:02.905 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":4073212006},{"type":"v1","addr":"172.21.15.144:6825","nonce":4073212006}]},"active_addr":"172.21.15.144:6825/4073212006","active_change":"2024-09-13T19:32:48.386763+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":72402476}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":4145322381}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":4197266621}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":135669088}]}]} 2024-09-13T19:33:02.907 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T19:33:02.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T19:33:02.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:33:03.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef9115640 1 Processor -- start 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef9115640 1 -- start start 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef9115640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0ef406dbd0 0x7f0ef4131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef9115640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef4071c10 con 0x7f0ef406d0e0 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef9115640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef4072230 con 0x7f0ef406dbd0 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0ef406dbd0 0x7f0ef4131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef2d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0ef406d0e0 0x7f0ef406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43654/0 (socket says 172.21.15.18:43654) 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef2d9d640 1 -- 172.21.15.18:0/3327125198 learned_addr learned my addr 172.21.15.18:0/3327125198 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef259c640 1 -- 172.21.15.18:0/3327125198 >> v1:172.21.15.18:6789/0 conn(0x7f0ef406d0e0 legacy=0x7f0ef406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.010+0000 7f0ef259c640 1 -- 172.21.15.18:0/3327125198 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef40709e0 con 0x7f0ef406dbd0 2024-09-13T19:33:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef259c640 1 --2- 172.21.15.18:0/3327125198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406dbd0 0x7f0ef4131e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009740 tx=0x7f0ee401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33025d3874639374 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef1d9b640 1 -- 172.21.15.18:0/3327125198 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee40b0070 con 0x7f0ef406dbd0 2024-09-13T19:33:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef1d9b640 1 -- 172.21.15.18:0/3327125198 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40ab530 con 0x7f0ef406dbd0 2024-09-13T19:33:03.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef1d9b640 1 -- 172.21.15.18:0/3327125198 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee40ab830 con 0x7f0ef406dbd0 2024-09-13T19:33:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 -- 172.21.15.18:0/3327125198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406dbd0 msgr2=0x7f0ef4131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 --2- 172.21.15.18:0/3327125198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406dbd0 0x7f0ef4131e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009740 tx=0x7f0ee401c370 comp rx=0 tx=0).stop 2024-09-13T19:33:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 -- 172.21.15.18:0/3327125198 shutdown_connections 2024-09-13T19:33:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 --2- 172.21.15.18:0/3327125198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406dbd0 0x7f0ef4131e60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 -- 172.21.15.18:0/3327125198 >> 172.21.15.18:0/3327125198 conn(0x7f0ef4099a50 msgr2=0x7f0ef40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 -- 172.21.15.18:0/3327125198 shutdown_connections 2024-09-13T19:33:03.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 -- 172.21.15.18:0/3327125198 wait complete. 2024-09-13T19:33:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 Processor -- start 2024-09-13T19:33:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 -- start start 2024-09-13T19:33:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406d0e0 0x7f0ef41c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.014+0000 7f0ef9115640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4134d40 con 0x7f0ef406d0e0 2024-09-13T19:33:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406d0e0 0x7f0ef41c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406d0e0 0x7f0ef41c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44440/0 (socket says 172.21.15.18:44440) 2024-09-13T19:33:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef2d9d640 1 -- 172.21.15.18:0/4015085068 learned_addr learned my addr 172.21.15.18:0/4015085068 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef2d9d640 1 -- 172.21.15.18:0/4015085068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef4127b30 con 0x7f0ef406d0e0 2024-09-13T19:33:03.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef2d9d640 1 --2- 172.21.15.18:0/4015085068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406d0e0 0x7f0ef41c4290 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800c480 tx=0x7f0ee800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0edb7fe640 1 -- 172.21.15.18:0/4015085068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee8017070 con 0x7f0ef406d0e0 2024-09-13T19:33:03.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0edb7fe640 1 -- 172.21.15.18:0/4015085068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee8005c20 con 0x7f0ef406d0e0 2024-09-13T19:33:03.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef41274f0 con 0x7f0ef406d0e0 2024-09-13T19:33:03.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0edb7fe640 1 -- 172.21.15.18:0/4015085068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee8007070 con 0x7f0ef406d0e0 2024-09-13T19:33:03.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef4128390 con 0x7f0ef406d0e0 2024-09-13T19:33:03.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0edb7fe640 1 -- 172.21.15.18:0/4015085068 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0ee801a070 con 0x7f0ef406d0e0 2024-09-13T19:33:03.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef406d4c0 con 0x7f0ef406d0e0 2024-09-13T19:33:03.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0edb7fe640 1 --2- 172.21.15.18:0/4015085068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ee0035db0 0x7f0ee0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0edb7fe640 1 -- 172.21.15.18:0/4015085068 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0ee8047990 con 0x7f0ef406d0e0 2024-09-13T19:33:03.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef259c640 1 --2- 172.21.15.18:0/4015085068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ee0035db0 0x7f0ee0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.018+0000 7f0ef259c640 1 --2- 172.21.15.18:0/4015085068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ee0035db0 0x7f0ee0038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40ad000 tx=0x7f0ee40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.022+0000 7f0edb7fe640 1 -- 172.21.15.18:0/4015085068 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ee8007210 con 0x7f0ef406d0e0 2024-09-13T19:33:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.178+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ef4132030 con 0x7f0ef406d0e0 2024-09-13T19:33:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0edb7fe640 1 -- 172.21.15.18:0/4015085068 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9914 (secure 0 0 0) 0x7f0ee801b400 con 0x7f0ef406d0e0 2024-09-13T19:33:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:33:03.189 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"fsid":"b2385e7c-a71a-4af5-b7af-4c90a204f1ea","created":"2024-09-13T19:32:43.365033+0000","modified":"2024-09-13T19:33:02.505813+0000","last_up_change":"2024-09-13T19:32:55.261550+0000","last_in_change":"2024-09-13T19:32:44.638174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:32:56.473851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:32:59.336083+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"feb640dc-8e82-4932-aff2-4b0b5448f785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6801","nonce":2700511246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6803","nonce":2700511246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6807","nonce":2700511246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6805","nonce":2700511246}]},"public_addr":"172.21.15.18:6801/2700511246","cluster_addr":"172.21.15.18:6803/2700511246","heartbeat_back_addr":"172.21.15.18:6807/2700511246","heartbeat_front_addr":"172.21.15.18:6805/2700511246","state":["exists","up"]},{"osd":1,"uuid":"43d97a8c-e558-4aaf-8184-0c7b26a1fa50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6809","nonce":3556169889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6811","nonce":3556169889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6815","nonce":3556169889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6813","nonce":3556169889}]},"public_addr":"172.21.15.144:6809/3556169889","cluster_addr":"172.21.15.144:6811/3556169889","heartbeat_back_addr":"172.21.15.144:6815/3556169889","heartbeat_front_addr":"172.21.15.144:6813/3556169889","state":["exists","up"]},{"osd":2,"uuid":"a2b1ed4d-6f98-45a6-88b7-e7a345f7037f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6817","nonce":2341760841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6819","nonce":2341760841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6823","nonce":2341760841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6821","nonce":2341760841}]},"public_addr":"172.21.15.144:6817/2341760841","cluster_addr":"172.21.15.144:6819/2341760841","heartbeat_back_addr":"172.21.15.144:6823/2341760841","heartbeat_front_addr":"172.21.15.144:6821/2341760841","state":["exists","up"]},{"osd":3,"uuid":"cab5ee78-fc3c-4b70-8dd5-028dc09b863f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6801","nonce":1157716661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6803","nonce":1157716661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6807","nonce":1157716661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6805","nonce":1157716661}]},"public_addr":"172.21.15.144:6801/1157716661","cluster_addr":"172.21.15.144:6803/1157716661","heartbeat_back_addr":"172.21.15.144:6807/1157716661","heartbeat_front_addr":"172.21.15.144:6805/1157716661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.557790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.952068+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.944160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.871505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:33:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ee0035db0 msgr2=0x7f0ee0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 --2- 172.21.15.18:0/4015085068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ee0035db0 0x7f0ee0038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40ad000 tx=0x7f0ee40a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406d0e0 msgr2=0x7f0ef41c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 --2- 172.21.15.18:0/4015085068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406d0e0 0x7f0ef41c4290 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800c480 tx=0x7f0ee800c940 comp rx=0 tx=0).stop 2024-09-13T19:33:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 shutdown_connections 2024-09-13T19:33:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 --2- 172.21.15.18:0/4015085068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ee0035db0 0x7f0ee0038270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 --2- 172.21.15.18:0/4015085068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef406d0e0 0x7f0ef41c4290 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 >> 172.21.15.18:0/4015085068 conn(0x7f0ef4099a50 msgr2=0x7f0ef412aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 shutdown_connections 2024-09-13T19:33:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.182+0000 7f0ef9115640 1 -- 172.21.15.18:0/4015085068 wait complete. 2024-09-13T19:33:03.207 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T19:33:03.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:33:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 Processor -- start 2024-09-13T19:33:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 -- start start 2024-09-13T19:33:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f45f406e1f0 0x7f45f406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f406f750 con 0x7f45f406eb10 2024-09-13T19:33:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f45f4070c10 con 0x7f45f406e1f0 2024-09-13T19:33:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f9a55640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f45f406e1f0 0x7f45f406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f9254640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f45f406eb10 0x7f45f4096080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43666/0 (socket says 172.21.15.18:43666) 2024-09-13T19:33:03.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f9254640 1 -- 172.21.15.18:0/168358345 learned_addr learned my addr 172.21.15.18:0/168358345 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:03.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f9a55640 1 -- 172.21.15.18:0/168358345 >> v1:172.21.15.18:6789/0 conn(0x7f45f406eb10 legacy=0x7f45f4096080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f9a55640 1 -- 172.21.15.18:0/168358345 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f40703f0 con 0x7f45f406e1f0 2024-09-13T19:33:03.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f9a55640 1 --2- 172.21.15.18:0/168358345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f406e5d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009d90 tx=0x7f45f001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceb88de0322ef54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f8a53640 1 -- 172.21.15.18:0/168358345 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00b2070 con 0x7f45f406e1f0 2024-09-13T19:33:03.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f8a53640 1 -- 172.21.15.18:0/168358345 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f00a5660 con 0x7f45f406e1f0 2024-09-13T19:33:03.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45f8a53640 1 -- 172.21.15.18:0/168358345 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00a5960 con 0x7f45f406e1f0 2024-09-13T19:33:03.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 -- 172.21.15.18:0/168358345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 msgr2=0x7f45f406e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 --2- 172.21.15.18:0/168358345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f406e5d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009d90 tx=0x7f45f001c8c0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 -- 172.21.15.18:0/168358345 shutdown_connections 2024-09-13T19:33:03.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 --2- 172.21.15.18:0/168358345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f406e5d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 -- 172.21.15.18:0/168358345 >> 172.21.15.18:0/168358345 conn(0x7f45f4099a50 msgr2=0x7f45f40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 -- 172.21.15.18:0/168358345 shutdown_connections 2024-09-13T19:33:03.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.310+0000 7f45fbcb9640 1 -- 172.21.15.18:0/168358345 wait complete. 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45fbcb9640 1 Processor -- start 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45fbcb9640 1 -- start start 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45fbcb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f412b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45fbcb9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45f406eef0 con 0x7f45f406e1f0 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45f9a55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f412b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45f9a55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f412b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44460/0 (socket says 172.21.15.18:44460) 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45f9a55640 1 -- 172.21.15.18:0/1540818797 learned_addr learned my addr 172.21.15.18:0/1540818797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45f9a55640 1 -- 172.21.15.18:0/1540818797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f412c730 con 0x7f45f406e1f0 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45f9a55640 1 --2- 172.21.15.18:0/1540818797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f412b870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45f00194d0 tx=0x7f45f0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45ea7fc640 1 -- 172.21.15.18:0/1540818797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00bd020 con 0x7f45f406e1f0 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45ea7fc640 1 -- 172.21.15.18:0/1540818797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f00b8470 con 0x7f45f406e1f0 2024-09-13T19:33:03.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f412a750 con 0x7f45f406e1f0 2024-09-13T19:33:03.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45ea7fc640 1 -- 172.21.15.18:0/1540818797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00b2040 con 0x7f45f406e1f0 2024-09-13T19:33:03.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f412bdb0 con 0x7f45f406e1f0 2024-09-13T19:33:03.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f4128f30 con 0x7f45f406e1f0 2024-09-13T19:33:03.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45ea7fc640 1 -- 172.21.15.18:0/1540818797 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f45f00c0020 con 0x7f45f406e1f0 2024-09-13T19:33:03.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45ea7fc640 1 --2- 172.21.15.18:0/1540818797 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f45d8035db0 0x7f45d8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45ea7fc640 1 -- 172.21.15.18:0/1540818797 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f45f00e34d0 con 0x7f45f406e1f0 2024-09-13T19:33:03.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.314+0000 7f45f9254640 1 --2- 172.21.15.18:0/1540818797 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f45d8035db0 0x7f45d8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.318+0000 7f45f9254640 1 --2- 172.21.15.18:0/1540818797 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f45d8035db0 0x7f45d8038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f45e4001610 tx=0x7f45e4007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.318+0000 7f45ea7fc640 1 -- 172.21.15.18:0/1540818797 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45f00c7030 con 0x7f45f406e1f0 2024-09-13T19:33:03.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.482+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45f406e5d0 con 0x7f45f406e1f0 2024-09-13T19:33:03.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.482+0000 7f45ea7fc640 1 -- 172.21.15.18:0/1540818797 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9914 (secure 0 0 0) 0x7f45f0016540 con 0x7f45f406e1f0 2024-09-13T19:33:03.490 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:33:03.490 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"fsid":"b2385e7c-a71a-4af5-b7af-4c90a204f1ea","created":"2024-09-13T19:32:43.365033+0000","modified":"2024-09-13T19:33:02.505813+0000","last_up_change":"2024-09-13T19:32:55.261550+0000","last_in_change":"2024-09-13T19:32:44.638174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:32:56.473851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:32:59.336083+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"feb640dc-8e82-4932-aff2-4b0b5448f785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6801","nonce":2700511246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6803","nonce":2700511246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6807","nonce":2700511246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6805","nonce":2700511246}]},"public_addr":"172.21.15.18:6801/2700511246","cluster_addr":"172.21.15.18:6803/2700511246","heartbeat_back_addr":"172.21.15.18:6807/2700511246","heartbeat_front_addr":"172.21.15.18:6805/2700511246","state":["exists","up"]},{"osd":1,"uuid":"43d97a8c-e558-4aaf-8184-0c7b26a1fa50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6809","nonce":3556169889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6811","nonce":3556169889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6815","nonce":3556169889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6813","nonce":3556169889}]},"public_addr":"172.21.15.144:6809/3556169889","cluster_addr":"172.21.15.144:6811/3556169889","heartbeat_back_addr":"172.21.15.144:6815/3556169889","heartbeat_front_addr":"172.21.15.144:6813/3556169889","state":["exists","up"]},{"osd":2,"uuid":"a2b1ed4d-6f98-45a6-88b7-e7a345f7037f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6817","nonce":2341760841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6819","nonce":2341760841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6823","nonce":2341760841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6821","nonce":2341760841}]},"public_addr":"172.21.15.144:6817/2341760841","cluster_addr":"172.21.15.144:6819/2341760841","heartbeat_back_addr":"172.21.15.144:6823/2341760841","heartbeat_front_addr":"172.21.15.144:6821/2341760841","state":["exists","up"]},{"osd":3,"uuid":"cab5ee78-fc3c-4b70-8dd5-028dc09b863f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6801","nonce":1157716661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6803","nonce":1157716661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6807","nonce":1157716661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6805","nonce":1157716661}]},"public_addr":"172.21.15.144:6801/1157716661","cluster_addr":"172.21.15.144:6803/1157716661","heartbeat_back_addr":"172.21.15.144:6807/1157716661","heartbeat_front_addr":"172.21.15.144:6805/1157716661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.557790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.952068+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.944160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.871505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f45d8035db0 msgr2=0x7f45d8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 --2- 172.21.15.18:0/1540818797 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f45d8035db0 0x7f45d8038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f45e4001610 tx=0x7f45e4007ad0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 msgr2=0x7f45f412b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 --2- 172.21.15.18:0/1540818797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f412b870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45f00194d0 tx=0x7f45f0019660 comp rx=0 tx=0).stop 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 shutdown_connections 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 --2- 172.21.15.18:0/1540818797 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f45d8035db0 0x7f45d8038270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 --2- 172.21.15.18:0/1540818797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406e1f0 0x7f45f412b870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 >> 172.21.15.18:0/1540818797 conn(0x7f45f4099a50 msgr2=0x7f45f409afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 shutdown_connections 2024-09-13T19:33:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.486+0000 7f45fbcb9640 1 -- 172.21.15.18:0/1540818797 wait complete. 2024-09-13T19:33:03.508 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T19:33:03.509 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T19:33:03.509 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T19:33:03.510 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T19:33:03.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.610+0000 7fb989e87640 1 Processor -- start 2024-09-13T19:33:03.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.610+0000 7fb989e87640 1 -- start start 2024-09-13T19:33:03.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.610+0000 7fd7adffe640 1 Processor -- start 2024-09-13T19:33:03.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.610+0000 7fb989e87640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb98412f390 0x7fb984133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.610+0000 7fd7adffe640 1 -- start start 2024-09-13T19:33:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.610+0000 7f27b74d7640 1 Processor -- start 2024-09-13T19:33:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.610+0000 7f27b74d7640 1 -- start start 2024-09-13T19:33:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb982ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb98412f390 0x7fb984133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb982ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb98412f390 0x7fb984133a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44476/0 (socket says 172.21.15.18:44476) 2024-09-13T19:33:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb9837fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb98412e760 0x7fb98412ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43676/0 (socket says 172.21.15.18:43676) 2024-09-13T19:33:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb982ffd640 1 -- 172.21.15.18:0/3605156609 learned_addr learned my addr 172.21.15.18:0/3605156609 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb989e87640 1 -- 172.21.15.18:0/3605156609 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9840984f0 con 0x7fb98412e760 2024-09-13T19:33:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb989e87640 1 -- 172.21.15.18:0/3605156609 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb984098dc0 con 0x7fb98412f390 2024-09-13T19:33:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7adffe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd7a806d680 0x7fd7a806da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7adffe640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7a80985e0 con 0x7fd7a806dfa0 2024-09-13T19:33:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb9827fc640 1 -- 172.21.15.18:0/3605156609 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211805683 0 0) 0x7fb9840984f0 con 0x7fb98412e760 2024-09-13T19:33:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb9827fc640 1 -- 172.21.15.18:0/3605156609 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb96c003530 con 0x7fb98412e760 2024-09-13T19:33:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb982ffd640 1 -- 172.21.15.18:0/3605156609 >> v1:172.21.15.18:6789/0 conn(0x7fb98412e760 legacy=0x7fb98412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb982ffd640 1 -- 172.21.15.18:0/3605156609 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9840981a0 con 0x7fb98412f390 2024-09-13T19:33:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b74d7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f27b0091e20 0x7f27b0137f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b74d7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b0093490 con 0x7f27b0091330 2024-09-13T19:33:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b74d7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f27b0093ab0 con 0x7f27b0091e20 2024-09-13T19:33:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7adffe640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a8098a20 con 0x7fd7a806d680 2024-09-13T19:33:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b5273640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f27b0091330 0x7f27b0091710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43700/0 (socket says 172.21.15.18:43700) 2024-09-13T19:33:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b5273640 1 -- 172.21.15.18:0/2504990303 learned_addr learned my addr 172.21.15.18:0/2504990303 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b4a72640 1 --2- 172.21.15.18:0/2504990303 >> v2:172.21.15.18:3300/0 conn(0x7f27b0091e20 0x7f27b0137f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd79ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd7a806dfa0 0x7fd7a812e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43692/0 (socket says 172.21.15.18:43692) 2024-09-13T19:33:03.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd79ffff640 1 -- 172.21.15.18:0/1923780734 learned_addr learned my addr 172.21.15.18:0/1923780734 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:03.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7a77fe640 1 --2- 172.21.15.18:0/1923780734 >> v2:172.21.15.18:3300/0 conn(0x7fd7a806d680 0x7fd7a806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27a7fff640 1 -- 172.21.15.18:0/2504990303 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245155401 0 0) 0x7f27b0093490 con 0x7f27b0091330 2024-09-13T19:33:03.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27a7fff640 1 -- 172.21.15.18:0/2504990303 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f279c003530 con 0x7f27b0091330 2024-09-13T19:33:03.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7a77fe640 1 -- 172.21.15.18:0/1923780734 >> v1:172.21.15.18:6789/0 conn(0x7fd7a806dfa0 legacy=0x7fd7a812e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7a77fe640 1 -- 172.21.15.18:0/1923780734 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a806e3c0 con 0x7fd7a806d680 2024-09-13T19:33:03.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b4a72640 1 -- 172.21.15.18:0/2504990303 >> v1:172.21.15.18:6789/0 conn(0x7f27b0091330 legacy=0x7f27b0091710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b4a72640 1 -- 172.21.15.18:0/2504990303 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b0074ef0 con 0x7f27b0091e20 2024-09-13T19:33:03.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb982ffd640 1 --2- 172.21.15.18:0/3605156609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412f390 0x7fb984133a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9780097f0 tx=0x7fb97801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df04d2fbef5f6618 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7a77fe640 1 --2- 172.21.15.18:0/1923780734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a806da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd798009740 tx=0x7fd79801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31fc4c868e5fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb9827fc640 1 -- 172.21.15.18:0/3605156609 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9780b1070 con 0x7fb98412f390 2024-09-13T19:33:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb9827fc640 1 -- 172.21.15.18:0/3605156609 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9780ac520 con 0x7fb98412f390 2024-09-13T19:33:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fb9827fc640 1 -- 172.21.15.18:0/3605156609 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9780ac820 con 0x7fb98412f390 2024-09-13T19:33:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7a6ffd640 1 -- 172.21.15.18:0/1923780734 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7980b0070 con 0x7fd7a806d680 2024-09-13T19:33:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7a6ffd640 1 -- 172.21.15.18:0/1923780734 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7980ab530 con 0x7fd7a806d680 2024-09-13T19:33:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7fd7a6ffd640 1 -- 172.21.15.18:0/1923780734 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7980ab830 con 0x7fd7a806d680 2024-09-13T19:33:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27b4a72640 1 --2- 172.21.15.18:0/2504990303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091e20 0x7f27b0137f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009740 tx=0x7f27a001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d942c755f955a75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27a7fff640 1 -- 172.21.15.18:0/2504990303 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a00b0070 con 0x7f27b0091e20 2024-09-13T19:33:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27a7fff640 1 -- 172.21.15.18:0/2504990303 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a00ab530 con 0x7f27b0091e20 2024-09-13T19:33:03.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.614+0000 7f27a7fff640 1 -- 172.21.15.18:0/2504990303 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a00ab830 con 0x7f27b0091e20 2024-09-13T19:33:03.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- 172.21.15.18:0/1923780734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 msgr2=0x7fd7a806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1923780734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a806da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd798009740 tx=0x7fd79801c370 comp rx=0 tx=0).stop 2024-09-13T19:33:03.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- 172.21.15.18:0/3605156609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412f390 msgr2=0x7fb984133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 --2- 172.21.15.18:0/3605156609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412f390 0x7fb984133a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9780097f0 tx=0x7fb97801c480 comp rx=0 tx=0).stop 2024-09-13T19:33:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- 172.21.15.18:0/1923780734 shutdown_connections 2024-09-13T19:33:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1923780734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a806da60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- 172.21.15.18:0/1923780734 >> 172.21.15.18:0/1923780734 conn(0x7fd7a809f0b0 msgr2=0x7fd7a809f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- 172.21.15.18:0/1923780734 shutdown_connections 2024-09-13T19:33:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- 172.21.15.18:0/1923780734 wait complete. 2024-09-13T19:33:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 -- 172.21.15.18:0/2504990303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091e20 msgr2=0x7f27b0137f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 --2- 172.21.15.18:0/2504990303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091e20 0x7f27b0137f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009740 tx=0x7f27a001c370 comp rx=0 tx=0).stop 2024-09-13T19:33:03.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- 172.21.15.18:0/3605156609 shutdown_connections 2024-09-13T19:33:03.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 --2- 172.21.15.18:0/3605156609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412f390 0x7fb984133a80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- 172.21.15.18:0/3605156609 >> 172.21.15.18:0/3605156609 conn(0x7fb9840a10a0 msgr2=0x7fb9840a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 -- 172.21.15.18:0/2504990303 shutdown_connections 2024-09-13T19:33:03.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 --2- 172.21.15.18:0/2504990303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091e20 0x7f27b0137f40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 -- 172.21.15.18:0/2504990303 >> 172.21.15.18:0/2504990303 conn(0x7f27b009d4c0 msgr2=0x7f27b009d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- 172.21.15.18:0/3605156609 shutdown_connections 2024-09-13T19:33:03.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- 172.21.15.18:0/3605156609 wait complete. 2024-09-13T19:33:03.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 Processor -- start 2024-09-13T19:33:03.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 -- 172.21.15.18:0/2504990303 shutdown_connections 2024-09-13T19:33:03.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 -- 172.21.15.18:0/2504990303 wait complete. 2024-09-13T19:33:03.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- start start 2024-09-13T19:33:03.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a8130460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8137440 con 0x7fd7a806d680 2024-09-13T19:33:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a8130460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a8130460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44498/0 (socket says 172.21.15.18:44498) 2024-09-13T19:33:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a77fe640 1 -- 172.21.15.18:0/1794129965 learned_addr learned my addr 172.21.15.18:0/1794129965 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 Processor -- start 2024-09-13T19:33:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- start start 2024-09-13T19:33:03.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a77fe640 1 -- 172.21.15.18:0/1794129965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a8133e50 con 0x7fd7a806d680 2024-09-13T19:33:03.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 Processor -- start 2024-09-13T19:33:03.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 -- start start 2024-09-13T19:33:03.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a77fe640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a8130460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7980ae040 tx=0x7fd798019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412e760 0x7fb98412fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb984136b70 con 0x7fb98412e760 2024-09-13T19:33:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb9837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412e760 0x7fb98412fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb9837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412e760 0x7fb98412fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44504/0 (socket says 172.21.15.18:44504) 2024-09-13T19:33:03.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb9837fe640 1 -- 172.21.15.18:0/2184663627 learned_addr learned my addr 172.21.15.18:0/2184663627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a4ff9640 1 -- 172.21.15.18:0/1794129965 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7980b8020 con 0x7fd7a806d680 2024-09-13T19:33:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a4ff9640 1 -- 172.21.15.18:0/1794129965 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7980aa820 con 0x7fd7a806d680 2024-09-13T19:33:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a8133830 con 0x7fd7a806d680 2024-09-13T19:33:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a8133b40 con 0x7fd7a806d680 2024-09-13T19:33:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb9837fe640 1 -- 172.21.15.18:0/2184663627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb984128f50 con 0x7fb98412e760 2024-09-13T19:33:03.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb9837fe640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412e760 0x7fb98412fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb97400c4a0 tx=0x7fb97400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb974018070 con 0x7fb98412e760 2024-09-13T19:33:03.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb974007410 con 0x7fb98412e760 2024-09-13T19:33:03.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9740047f0 con 0x7fb98412e760 2024-09-13T19:33:03.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb984133230 con 0x7fb98412e760 2024-09-13T19:33:03.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9841301d0 con 0x7fb98412e760 2024-09-13T19:33:03.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a4ff9640 1 -- 172.21.15.18:0/1794129965 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7980b0040 con 0x7fd7a806d680 2024-09-13T19:33:03.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a4ff9640 1 -- 172.21.15.18:0/1794129965 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd7980bb020 con 0x7fd7a806d680 2024-09-13T19:33:03.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a4ff9640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd788035e50 0x7fd788038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7fd7a4ff9640 1 -- 172.21.15.18:0/1794129965 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd7980a4e00 con 0x7fd7a806d680 2024-09-13T19:33:03.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091330 0x7f27b0072c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b74d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27b013aeb0 con 0x7f27b0091330 2024-09-13T19:33:03.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b5273640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091330 0x7f27b0072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b5273640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091330 0x7f27b0072c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44508/0 (socket says 172.21.15.18:44508) 2024-09-13T19:33:03.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b5273640 1 -- 172.21.15.18:0/1879651643 learned_addr learned my addr 172.21.15.18:0/1879651643 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b5273640 1 -- 172.21.15.18:0/1879651643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b012ef70 con 0x7f27b0091330 2024-09-13T19:33:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27b5273640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091330 0x7f27b0072c90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c450 tx=0x7f27ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ac017070 con 0x7f27b0091330 2024-09-13T19:33:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ac005c20 con 0x7f27b0091330 2024-09-13T19:33:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.618+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ac007070 con 0x7f27b0091330 2024-09-13T19:33:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b012ead0 con 0x7f27b0091330 2024-09-13T19:33:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b012e250 con 0x7f27b0091330 2024-09-13T19:33:03.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb984130d90 con 0x7fb98412e760 2024-09-13T19:33:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fd79ffff640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd788035e50 0x7fd788038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27b0091710 con 0x7f27b0091330 2024-09-13T19:33:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb97401b070 con 0x7fb98412e760 2024-09-13T19:33:03.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fd79ffff640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd788035e50 0x7fd788038310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd790001610 tx=0x7fd790007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f27ac01a070 con 0x7f27b0091330 2024-09-13T19:33:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fd78c001660 0x7fd78c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd78c006b10 con 0x7fd78c001660 2024-09-13T19:33:03.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27a5ffb640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2794035e50 0x7f2794038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f27ac047a80 con 0x7f27b0091330 2024-09-13T19:33:03.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27a5ffb640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f279403b650 0x7f279403dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27ac013e50 con 0x7f279403b650 2024-09-13T19:33:03.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f27ac049e60 con 0x7f27b0091330 2024-09-13T19:33:03.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fd7a7fff640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fd78c001660 0x7fd78c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb96bfff640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb970035db0 0x7fb970038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb974047b60 con 0x7fb98412e760 2024-09-13T19:33:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb96bfff640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7fb97003b530 0x7fb97003d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb97003e080 con 0x7fb97003b530 2024-09-13T19:33:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb97404c2a0 con 0x7fb98412e760 2024-09-13T19:33:03.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27b4a72640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2794035e50 0x7f2794038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb983fff640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7fb97003b530 0x7fb97003d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb982ffd640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb970035db0 0x7fb970038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27b5a74640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f279403b650 0x7f279403dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb983fff640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7fb97003b530 0x7fb97003d9b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb982ffd640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb970035db0 0x7fb970038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9780ae000 tx=0x7fb9780a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27b4a72640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2794035e50 0x7f2794038310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27a00ad000 tx=0x7f27a00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb97003e080 con 0x7fb97003b530 2024-09-13T19:33:03.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7fd7a7fff640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fd78c001660 0x7fd78c003b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.622+0000 7f27b5a74640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f279403b650 0x7f279403dad0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7fd7a4ff9640 1 -- 172.21.15.18:0/1794129965 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd78c006b10 con 0x7fd78c001660 2024-09-13T19:33:03.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27ac013e50 con 0x7f279403b650 2024-09-13T19:33:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bf417640 1 Processor -- start 2024-09-13T19:33:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bf417640 1 -- start start 2024-09-13T19:33:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bf417640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f46b806ec30 0x7f46b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bf417640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b806c340 con 0x7f46b806e140 2024-09-13T19:33:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bf417640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f46b806c9b0 con 0x7f46b806ec30 2024-09-13T19:33:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bdc14640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f46b806ec30 0x7f46b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bdc14640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f46b806ec30 0x7f46b81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44522/0 (socket says 172.21.15.18:44522) 2024-09-13T19:33:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bdc14640 1 -- 172.21.15.18:0/3807351952 learned_addr learned my addr 172.21.15.18:0/3807351952 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bdc14640 1 -- 172.21.15.18:0/3807351952 >> v1:172.21.15.18:6789/0 conn(0x7f46b806e140 legacy=0x7f46b806e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.626+0000 7f46bdc14640 1 -- 172.21.15.18:0/3807351952 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b806beb0 con 0x7f46b806ec30 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bdc14640 1 --2- 172.21.15.18:0/3807351952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806ec30 0x7f46b81339f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46a80097f0 tx=0x7f46a801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33d6ac03d6528c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bd413640 1 -- 172.21.15.18:0/3807351952 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a80ab540 con 0x7f46b806ec30 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bd413640 1 -- 172.21.15.18:0/3807351952 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a80b0070 con 0x7f46b806ec30 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bd413640 1 -- 172.21.15.18:0/3807351952 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a80ab830 con 0x7f46b806ec30 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bf417640 1 -- 172.21.15.18:0/3807351952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806ec30 msgr2=0x7f46b81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bf417640 1 --2- 172.21.15.18:0/3807351952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806ec30 0x7f46b81339f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46a80097f0 tx=0x7f46a801c3f0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bf417640 1 -- 172.21.15.18:0/3807351952 shutdown_connections 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bf417640 1 --2- 172.21.15.18:0/3807351952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806ec30 0x7f46b81339f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bf417640 1 -- 172.21.15.18:0/3807351952 >> 172.21.15.18:0/3807351952 conn(0x7f46b809a340 msgr2=0x7f46b809a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bf417640 1 -- 172.21.15.18:0/3807351952 shutdown_connections 2024-09-13T19:33:03.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.630+0000 7f46bf417640 1 -- 172.21.15.18:0/3807351952 wait complete. 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46bf417640 1 Processor -- start 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46bf417640 1 -- start start 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46bf417640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806e140 0x7f46b8122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46bf417640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f46b8136960 con 0x7f46b806e140 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46be415640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806e140 0x7f46b8122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46be415640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806e140 0x7f46b8122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44538/0 (socket says 172.21.15.18:44538) 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46be415640 1 -- 172.21.15.18:0/3913518739 learned_addr learned my addr 172.21.15.18:0/3913518739 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46be415640 1 -- 172.21.15.18:0/3913518739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b8097120 con 0x7f46b806e140 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46be415640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806e140 0x7f46b8122900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f46b400c390 tx=0x7f46b4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4017070 con 0x7f46b806e140 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b4005430 con 0x7f46b806e140 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4003770 con 0x7f46b806e140 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46bf417640 1 -- 172.21.15.18:0/3913518739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b8125010 con 0x7f46b806e140 2024-09-13T19:33:03.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46bf417640 1 -- 172.21.15.18:0/3913518739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b8123010 con 0x7f46b806e140 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4694000f90 con 0x7f46b806e140 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46b401a070 con 0x7f46b806e140 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f469c035d60 0x7f469c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f46b4047a90 con 0x7f46b806e140 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7f469c03b4e0 0x7f469c03d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46b4016ec0 con 0x7f469c03b4e0 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.634+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f46b404c2a0 con 0x7f46b806e140 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7f46bdc14640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f469c035d60 0x7f469c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7f46bec16640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7f469c03b4e0 0x7f469c03d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7f46bec16640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7f469c03b4e0 0x7f469c03d960 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7f46bdc14640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f469c035d60 0x7f469c038220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46a80af000 tx=0x7f46a80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46b4016ec0 con 0x7f469c03b4e0 2024-09-13T19:33:03.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb9841325e0 con 0x7fb97003b530 2024-09-13T19:33:03.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7fb96bfff640 1 -- 172.21.15.18:0/2184663627 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb97c00ad10 con 0x7fb97003b530 2024-09-13T19:33:03.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd78c005bf0 con 0x7fd78c001660 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7fb97003b530 msgr2=0x7fb97003d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.638+0000 7fb989e87640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7fb97003b530 0x7fb97003d9b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb970035db0 msgr2=0x7fb970038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb970035db0 0x7fb970038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9780ae000 tx=0x7fb9780a7000 comp rx=0 tx=0).stop 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412e760 msgr2=0x7fb98412fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412e760 0x7fb98412fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb97400c4a0 tx=0x7fb97400c960 comp rx=0 tx=0).stop 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 shutdown_connections 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7fb97003b530 0x7fb97003d9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb970035db0 0x7fb970038270 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9780ae000 tx=0x7fb9780a7000 comp rx=0 tx=0).stop 2024-09-13T19:33:03.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 --2- 172.21.15.18:0/2184663627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb98412e760 0x7fb98412fc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 >> 172.21.15.18:0/2184663627 conn(0x7fb9840a10a0 msgr2=0x7fb9841280b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7a4ff9640 1 -- 172.21.15.18:0/1794129965 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd78c005bf0 con 0x7fd78c001660 2024-09-13T19:33:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fd78c001660 msgr2=0x7fd78c003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fd78c001660 0x7fd78c003b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd788035e50 msgr2=0x7fd788038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd788035e50 0x7fd788038310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd790001610 tx=0x7fd790007ad0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 msgr2=0x7fd7a8130460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a8130460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7980ae040 tx=0x7fd798019110 comp rx=0 tx=0).stop 2024-09-13T19:33:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 shutdown_connections 2024-09-13T19:33:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fd78c001660 0x7fd78c003b20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd788035e50 0x7fd788038310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 --2- 172.21.15.18:0/1794129965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a806d680 0x7fd7a8130460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 >> 172.21.15.18:0/1794129965 conn(0x7fd7a809f0b0 msgr2=0x7fd7a8098d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 shutdown_connections 2024-09-13T19:33:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fd7adffe640 1 -- 172.21.15.18:0/1794129965 wait complete. 2024-09-13T19:33:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27b0091e20 con 0x7f279403b650 2024-09-13T19:33:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27a5ffb640 1 -- 172.21.15.18:0/1879651643 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f27b0091e20 con 0x7f279403b650 2024-09-13T19:33:03.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 shutdown_connections 2024-09-13T19:33:03.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7fb989e87640 1 -- 172.21.15.18:0/2184663627 wait complete. 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f279403b650 msgr2=0x7f279403dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f279403b650 0x7f279403dad0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2794035e50 msgr2=0x7f2794038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2794035e50 0x7f2794038310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27a00ad000 tx=0x7f27a00a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091330 msgr2=0x7f27b0072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091330 0x7f27b0072c90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c450 tx=0x7f27ac00c910 comp rx=0 tx=0).stop 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 shutdown_connections 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f279403b650 0x7f279403dad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2794035e50 0x7f2794038310 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 --2- 172.21.15.18:0/1879651643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b0091330 0x7f27b0072c90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 >> 172.21.15.18:0/1879651643 conn(0x7f27b009d4c0 msgr2=0x7f27b0096cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 shutdown_connections 2024-09-13T19:33:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.642+0000 7f27b74d7640 1 -- 172.21.15.18:0/1879651643 wait complete. 2024-09-13T19:33:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4694002c80 con 0x7f469c03b4e0 2024-09-13T19:33:03.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46aeffd640 1 -- 172.21.15.18:0/3913518739 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4694002c80 con 0x7f469c03b4e0 2024-09-13T19:33:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7f469c03b4e0 msgr2=0x7f469c03d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7f469c03b4e0 0x7f469c03d960 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f469c035d60 msgr2=0x7f469c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f469c035d60 0x7f469c038220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46a80af000 tx=0x7f46a80a7000 comp rx=0 tx=0).stop 2024-09-13T19:33:03.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806e140 msgr2=0x7f46b8122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806e140 0x7f46b8122900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f46b400c390 tx=0x7f46b4001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:03.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 shutdown_connections 2024-09-13T19:33:03.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7f469c03b4e0 0x7f469c03d960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f469c035d60 0x7f469c038220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 --2- 172.21.15.18:0/3913518739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46b806e140 0x7f46b8122900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 >> 172.21.15.18:0/3913518739 conn(0x7f46b809a340 msgr2=0x7f46b8071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 shutdown_connections 2024-09-13T19:33:03.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.654+0000 7f46acff9640 1 -- 172.21.15.18:0/3913518739 wait complete. 2024-09-13T19:33:03.669 INFO:teuthology.orchestra.run.smithi018.stdout:42949672964 2024-09-13T19:33:03.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T19:33:03.672 INFO:teuthology.orchestra.run.smithi018.stdout:38654705668 2024-09-13T19:33:03.672 INFO:teuthology.orchestra.run.smithi018.stdout:42949672965 2024-09-13T19:33:03.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T19:33:03.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T19:33:03.681 INFO:teuthology.orchestra.run.smithi018.stdout:42949672964 2024-09-13T19:33:03.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T19:33:03.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dc4cdf640 1 Processor -- start 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dc4cdf640 1 -- start start 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dc4cdf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2dc012b0a0 0x7f2dc012b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dc4cdf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc00967c0 con 0x7f2dc012bd70 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dc4cdf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc006e610 con 0x7f2dc012b0a0 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dbe59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2dc012b0a0 0x7f2dc012b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dbdd9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2dc012bd70 0x7f2dc012e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43720/0 (socket says 172.21.15.18:43720) 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dbdd9b640 1 -- 172.21.15.18:0/3677553244 learned_addr learned my addr 172.21.15.18:0/3677553244 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dbe59c640 1 -- 172.21.15.18:0/3677553244 >> v1:172.21.15.18:6789/0 conn(0x7f2dc012bd70 legacy=0x7f2dc012e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.766+0000 7f2dbe59c640 1 -- 172.21.15.18:0/3677553244 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc006ee50 con 0x7f2dc012b0a0 2024-09-13T19:33:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dbe59c640 1 --2- 172.21.15.18:0/3677553244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012b830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009740 tx=0x7f2db001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d041946dc1ef287 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dbd59a640 1 -- 172.21.15.18:0/3677553244 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db00b0070 con 0x7f2dc012b0a0 2024-09-13T19:33:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dbd59a640 1 -- 172.21.15.18:0/3677553244 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db00ab530 con 0x7f2dc012b0a0 2024-09-13T19:33:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dbd59a640 1 -- 172.21.15.18:0/3677553244 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db00ab830 con 0x7f2dc012b0a0 2024-09-13T19:33:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3677553244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 msgr2=0x7f2dc012b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 --2- 172.21.15.18:0/3677553244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012b830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009740 tx=0x7f2db001c400 comp rx=0 tx=0).stop 2024-09-13T19:33:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3677553244 shutdown_connections 2024-09-13T19:33:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 --2- 172.21.15.18:0/3677553244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012b830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3677553244 >> 172.21.15.18:0/3677553244 conn(0x7f2dc009f010 msgr2=0x7f2dc009f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3677553244 shutdown_connections 2024-09-13T19:33:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3677553244 wait complete. 2024-09-13T19:33:03.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 Processor -- start 2024-09-13T19:33:03.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 -- start start 2024-09-13T19:33:03.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.770+0000 7f2dc4cdf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc0137380 con 0x7f2dc012b0a0 2024-09-13T19:33:03.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dbe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dbe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44552/0 (socket says 172.21.15.18:44552) 2024-09-13T19:33:03.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dbe59c640 1 -- 172.21.15.18:0/3768287880 learned_addr learned my addr 172.21.15.18:0/3768287880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dbe59c640 1 -- 172.21.15.18:0/3768287880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc0131a50 con 0x7f2dc012b0a0 2024-09-13T19:33:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dbe59c640 1 --2- 172.21.15.18:0/3768287880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012f6a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2db001a030 tx=0x7f2db001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2daeffd640 1 -- 172.21.15.18:0/3768287880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db00b0050 con 0x7f2dc012b0a0 2024-09-13T19:33:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2daeffd640 1 -- 172.21.15.18:0/3768287880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db00b1040 con 0x7f2dc012b0a0 2024-09-13T19:33:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2daeffd640 1 -- 172.21.15.18:0/3768287880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db00b5930 con 0x7f2dc012b0a0 2024-09-13T19:33:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc0128030 con 0x7f2dc012b0a0 2024-09-13T19:33:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc0128d40 con 0x7f2dc012b0a0 2024-09-13T19:33:03.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc012b830 con 0x7f2dc012b0a0 2024-09-13T19:33:03.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2daeffd640 1 -- 172.21.15.18:0/3768287880 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2db00be030 con 0x7f2dc012b0a0 2024-09-13T19:33:03.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2daeffd640 1 --2- 172.21.15.18:0/3768287880 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2da0035db0 0x7f2da0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2daeffd640 1 -- 172.21.15.18:0/3768287880 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f2db00bc070 con 0x7f2dc012b0a0 2024-09-13T19:33:03.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.774+0000 7f2dbdd9b640 1 --2- 172.21.15.18:0/3768287880 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2da0035db0 0x7f2da0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.778+0000 7f2dbdd9b640 1 --2- 172.21.15.18:0/3768287880 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2da0035db0 0x7f2da0038270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005890 tx=0x7f2db4007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.778+0000 7f2daeffd640 1 -- 172.21.15.18:0/3768287880 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2db00c5020 con 0x7f2dc012b0a0 2024-09-13T19:33:03.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a6d182640 1 Processor -- start 2024-09-13T19:33:03.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a6d182640 1 -- start start 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a6d182640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9a68096520 0x7f9a68096900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a6d182640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a68098420 con 0x7f9a68096e40 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a6d182640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9a680989e0 con 0x7f9a68096520 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a6659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9a68096e40 0x7f9a6812c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43724/0 (socket says 172.21.15.18:43724) 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a6659c640 1 -- 172.21.15.18:0/1435371502 learned_addr learned my addr 172.21.15.18:0/1435371502 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a66d9d640 1 --2- 172.21.15.18:0/1435371502 >> v2:172.21.15.18:3300/0 conn(0x7f9a68096520 0x7f9a68096900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a65d9b640 1 -- 172.21.15.18:0/1435371502 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710733482 0 0) 0x7f9a68098420 con 0x7f9a68096e40 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a65d9b640 1 -- 172.21.15.18:0/1435371502 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a50003530 con 0x7f9a68096e40 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a66d9d640 1 -- 172.21.15.18:0/1435371502 >> v1:172.21.15.18:6789/0 conn(0x7f9a68096e40 legacy=0x7f9a6812c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a66d9d640 1 -- 172.21.15.18:0/1435371502 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a680972a0 con 0x7f9a68096520 2024-09-13T19:33:03.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a66d9d640 1 --2- 172.21.15.18:0/1435371502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a68096900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009740 tx=0x7f9a5801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5d441b18d28ece server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a65d9b640 1 -- 172.21.15.18:0/1435371502 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580b0070 con 0x7f9a68096520 2024-09-13T19:33:03.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.826+0000 7f9a65d9b640 1 -- 172.21.15.18:0/1435371502 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580ab530 con 0x7f9a68096520 2024-09-13T19:33:03.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a65d9b640 1 -- 172.21.15.18:0/1435371502 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580ab830 con 0x7f9a68096520 2024-09-13T19:33:03.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- 172.21.15.18:0/1435371502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 msgr2=0x7f9a68096900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 --2- 172.21.15.18:0/1435371502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a68096900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009740 tx=0x7f9a5801c370 comp rx=0 tx=0).stop 2024-09-13T19:33:03.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- 172.21.15.18:0/1435371502 shutdown_connections 2024-09-13T19:33:03.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 --2- 172.21.15.18:0/1435371502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a68096900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- 172.21.15.18:0/1435371502 >> 172.21.15.18:0/1435371502 conn(0x7f9a6809f010 msgr2=0x7f9a6809f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- 172.21.15.18:0/1435371502 shutdown_connections 2024-09-13T19:33:03.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- 172.21.15.18:0/1435371502 wait complete. 2024-09-13T19:33:03.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 Processor -- start 2024-09-13T19:33:03.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- start start 2024-09-13T19:33:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a681c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681352a0 con 0x7f9a68096520 2024-09-13T19:33:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a681c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a681c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44566/0 (socket says 172.21.15.18:44566) 2024-09-13T19:33:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a66d9d640 1 -- 172.21.15.18:0/2086200516 learned_addr learned my addr 172.21.15.18:0/2086200516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a66d9d640 1 -- 172.21.15.18:0/2086200516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a68072530 con 0x7f9a68096520 2024-09-13T19:33:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a66d9d640 1 --2- 172.21.15.18:0/2086200516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a681c47a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a58019fa0 tx=0x7f9a5801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a4f7fe640 1 -- 172.21.15.18:0/2086200516 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580b0050 con 0x7f9a68096520 2024-09-13T19:33:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a4f7fe640 1 -- 172.21.15.18:0/2086200516 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580b1040 con 0x7f9a68096520 2024-09-13T19:33:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a68072e40 con 0x7f9a68096520 2024-09-13T19:33:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a4f7fe640 1 -- 172.21.15.18:0/2086200516 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580b5740 con 0x7f9a68096520 2024-09-13T19:33:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.830+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6812e7e0 con 0x7f9a68096520 2024-09-13T19:33:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.834+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a68096900 con 0x7f9a68096520 2024-09-13T19:33:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.834+0000 7f9a4f7fe640 1 -- 172.21.15.18:0/2086200516 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a580be030 con 0x7f9a68096520 2024-09-13T19:33:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.834+0000 7f9a4f7fe640 1 --2- 172.21.15.18:0/2086200516 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9a54035db0 0x7f9a54038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.834+0000 7f9a4f7fe640 1 -- 172.21.15.18:0/2086200516 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9a580bc070 con 0x7f9a68096520 2024-09-13T19:33:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.834+0000 7f9a6659c640 1 --2- 172.21.15.18:0/2086200516 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9a54035db0 0x7f9a54038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.834+0000 7f9a6659c640 1 --2- 172.21.15.18:0/2086200516 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9a54035db0 0x7f9a54038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c007fd0 tx=0x7f9a5c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.838+0000 7f9a4f7fe640 1 -- 172.21.15.18:0/2086200516 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9a580c5020 con 0x7f9a68096520 2024-09-13T19:33:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.846+0000 7f9d90781640 1 Processor -- start 2024-09-13T19:33:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.846+0000 7f9d90781640 1 -- start start 2024-09-13T19:33:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9d88070d70 0x7f9d88071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8806c6b0 con 0x7f9d8806be20 2024-09-13T19:33:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8806c8d0 con 0x7f9d88070d70 2024-09-13T19:33:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8e51d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9d88070d70 0x7f9d88071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8dd1c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9d8806be20 0x7f9d88122c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43730/0 (socket says 172.21.15.18:43730) 2024-09-13T19:33:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8dd1c640 1 -- 172.21.15.18:0/2827395471 learned_addr learned my addr 172.21.15.18:0/2827395471 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:03.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8e51d640 1 -- 172.21.15.18:0/2827395471 >> v1:172.21.15.18:6789/0 conn(0x7f9d8806be20 legacy=0x7f9d88122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8e51d640 1 -- 172.21.15.18:0/2827395471 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d88071690 con 0x7f9d88070d70 2024-09-13T19:33:03.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8e51d640 1 --2- 172.21.15.18:0/2827395471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d88070d70 0x7f9d88071150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009740 tx=0x7f9d8401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6865bf133e31a7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8d51b640 1 -- 172.21.15.18:0/2827395471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d840b0070 con 0x7f9d88070d70 2024-09-13T19:33:03.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8d51b640 1 -- 172.21.15.18:0/2827395471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d88071b30 con 0x7f9d88070d70 2024-09-13T19:33:03.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 -- 172.21.15.18:0/2827395471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d88070d70 msgr2=0x7f9d88071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d8d51b640 1 -- 172.21.15.18:0/2827395471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d840b0070 con 0x7f9d88070d70 2024-09-13T19:33:03.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 --2- 172.21.15.18:0/2827395471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d88070d70 0x7f9d88071150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009740 tx=0x7f9d8401c370 comp rx=0 tx=0).stop 2024-09-13T19:33:03.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 -- 172.21.15.18:0/2827395471 shutdown_connections 2024-09-13T19:33:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 --2- 172.21.15.18:0/2827395471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d88070d70 0x7f9d88071150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 -- 172.21.15.18:0/2827395471 >> 172.21.15.18:0/2827395471 conn(0x7f9d8809ac70 msgr2=0x7f9d8806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 -- 172.21.15.18:0/2827395471 shutdown_connections 2024-09-13T19:33:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.850+0000 7f9d90781640 1 -- 172.21.15.18:0/2827395471 wait complete. 2024-09-13T19:33:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d90781640 1 Processor -- start 2024-09-13T19:33:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d90781640 1 -- start start 2024-09-13T19:33:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d90781640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d8806be20 0x7f9d88130ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d90781640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d88135490 con 0x7f9d8806be20 2024-09-13T19:33:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d8e51d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d8806be20 0x7f9d88130ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d8e51d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d8806be20 0x7f9d88130ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44594/0 (socket says 172.21.15.18:44594) 2024-09-13T19:33:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d8e51d640 1 -- 172.21.15.18:0/3325368715 learned_addr learned my addr 172.21.15.18:0/3325368715 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d8e51d640 1 -- 172.21.15.18:0/3325368715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8808b4f0 con 0x7f9d8806be20 2024-09-13T19:33:03.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d8e51d640 1 --2- 172.21.15.18:0/3325368715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d8806be20 0x7f9d88130ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d84019fa0 tx=0x7f9d84019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d7effd640 1 -- 172.21.15.18:0/3325368715 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d840b8020 con 0x7f9d8806be20 2024-09-13T19:33:03.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d7effd640 1 -- 172.21.15.18:0/3325368715 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d84003aa0 con 0x7f9d8806be20 2024-09-13T19:33:03.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8808bd80 con 0x7f9d8806be20 2024-09-13T19:33:03.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d7effd640 1 -- 172.21.15.18:0/3325368715 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d840b0040 con 0x7f9d8806be20 2024-09-13T19:33:03.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d881313b0 con 0x7f9d8806be20 2024-09-13T19:33:03.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d7effd640 1 -- 172.21.15.18:0/3325368715 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9d840bb020 con 0x7f9d8806be20 2024-09-13T19:33:03.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8806e5d0 con 0x7f9d8806be20 2024-09-13T19:33:03.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d7effd640 1 --2- 172.21.15.18:0/3325368715 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d6c035db0 0x7f9d6c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d7effd640 1 -- 172.21.15.18:0/3325368715 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9d840e2530 con 0x7f9d8806be20 2024-09-13T19:33:03.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.854+0000 7f9d8dd1c640 1 --2- 172.21.15.18:0/3325368715 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d6c035db0 0x7f9d6c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.858+0000 7f9d8dd1c640 1 --2- 172.21.15.18:0/3325368715 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d6c035db0 0x7f9d6c038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9d78000f70 tx=0x7f9d78007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.866+0000 7f9d7effd640 1 -- 172.21.15.18:0/3325368715 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9d840c2030 con 0x7f9d8806be20 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f1758cc3640 1 Processor -- start 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f1758cc3640 1 -- start start 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f1758cc3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f175412e760 0x7f175412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f1758cc3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17540984f0 con 0x7f175412f1c0 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f1758cc3640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1754098dc0 con 0x7f175412e760 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f1751d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f175412f1c0 0x7f175412b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43734/0 (socket says 172.21.15.18:43734) 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f1751d9b640 1 -- 172.21.15.18:0/3596446970 learned_addr learned my addr 172.21.15.18:0/3596446970 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f175259c640 1 --2- 172.21.15.18:0/3596446970 >> v2:172.21.15.18:3300/0 conn(0x7f175412e760 0x7f175412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f175159a640 1 -- 172.21.15.18:0/3596446970 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435422382 0 0) 0x7f17540984f0 con 0x7f175412f1c0 2024-09-13T19:33:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.870+0000 7f175159a640 1 -- 172.21.15.18:0/3596446970 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f173c003530 con 0x7f175412f1c0 2024-09-13T19:33:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f175259c640 1 -- 172.21.15.18:0/3596446970 >> v1:172.21.15.18:6789/0 conn(0x7f175412f1c0 legacy=0x7f175412b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f175259c640 1 -- 172.21.15.18:0/3596446970 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175412f5a0 con 0x7f175412e760 2024-09-13T19:33:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f175259c640 1 --2- 172.21.15.18:0/3596446970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f175412ec80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1744009740 tx=0x7f174401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e193b9f9cd2559 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f175159a640 1 -- 172.21.15.18:0/3596446970 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17440b0070 con 0x7f175412e760 2024-09-13T19:33:03.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f175159a640 1 -- 172.21.15.18:0/3596446970 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17440ab530 con 0x7f175412e760 2024-09-13T19:33:03.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f175159a640 1 -- 172.21.15.18:0/3596446970 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17440ab830 con 0x7f175412e760 2024-09-13T19:33:03.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 -- 172.21.15.18:0/3596446970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 msgr2=0x7f175412ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 --2- 172.21.15.18:0/3596446970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f175412ec80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1744009740 tx=0x7f174401c400 comp rx=0 tx=0).stop 2024-09-13T19:33:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 -- 172.21.15.18:0/3596446970 shutdown_connections 2024-09-13T19:33:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 --2- 172.21.15.18:0/3596446970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f175412ec80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 -- 172.21.15.18:0/3596446970 >> 172.21.15.18:0/3596446970 conn(0x7f17540a10a0 msgr2=0x7f17540a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 -- 172.21.15.18:0/3596446970 shutdown_connections 2024-09-13T19:33:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 -- 172.21.15.18:0/3596446970 wait complete. 2024-09-13T19:33:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 Processor -- start 2024-09-13T19:33:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.874+0000 7f1758cc3640 1 -- start start 2024-09-13T19:33:03.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1758cc3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f17540972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1758cc3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1754136e30 con 0x7f175412e760 2024-09-13T19:33:03.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f175259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f17540972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f175259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f17540972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44610/0 (socket says 172.21.15.18:44610) 2024-09-13T19:33:03.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f175259c640 1 -- 172.21.15.18:0/408282097 learned_addr learned my addr 172.21.15.18:0/408282097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:03.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f175259c640 1 -- 172.21.15.18:0/408282097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1754132e90 con 0x7f175412e760 2024-09-13T19:33:03.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f175259c640 1 --2- 172.21.15.18:0/408282097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f17540972f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f174401a030 tx=0x7f174401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1742ffd640 1 -- 172.21.15.18:0/408282097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17440b0050 con 0x7f175412e760 2024-09-13T19:33:03.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1742ffd640 1 -- 172.21.15.18:0/408282097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17440b1040 con 0x7f175412e760 2024-09-13T19:33:03.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1742ffd640 1 -- 172.21.15.18:0/408282097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17440b7580 con 0x7f175412e760 2024-09-13T19:33:03.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1754134210 con 0x7f175412e760 2024-09-13T19:33:03.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1754097830 con 0x7f175412e760 2024-09-13T19:33:03.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175412ec80 con 0x7f175412e760 2024-09-13T19:33:03.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1742ffd640 1 -- 172.21.15.18:0/408282097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17440be030 con 0x7f175412e760 2024-09-13T19:33:03.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1742ffd640 1 --2- 172.21.15.18:0/408282097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1734035db0 0x7f1734038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:03.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.878+0000 7f1751d9b640 1 --2- 172.21.15.18:0/408282097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1734035db0 0x7f1734038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:03.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.882+0000 7f1742ffd640 1 -- 172.21.15.18:0/408282097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f17440bc070 con 0x7f175412e760 2024-09-13T19:33:03.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.882+0000 7f1751d9b640 1 --2- 172.21.15.18:0/408282097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1734035db0 0x7f1734038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1748007fd0 tx=0x7f1748007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:03.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.882+0000 7f1742ffd640 1 -- 172.21.15.18:0/408282097 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17440c5020 con 0x7f175412e760 2024-09-13T19:33:03.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2dc00008e0 con 0x7f2dc012b0a0 2024-09-13T19:33:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2daeffd640 1 -- 172.21.15.18:0/3768287880 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2db0015ff0 con 0x7f2dc012b0a0 2024-09-13T19:33:03.981 INFO:teuthology.orchestra.run.smithi018.stdout:42949672963 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2da0035db0 msgr2=0x7f2da0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 --2- 172.21.15.18:0/3768287880 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2da0035db0 0x7f2da0038270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005890 tx=0x7f2db4007a90 comp rx=0 tx=0).stop 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 msgr2=0x7f2dc012f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 --2- 172.21.15.18:0/3768287880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012f6a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2db001a030 tx=0x7f2db001ac40 comp rx=0 tx=0).stop 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 shutdown_connections 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 --2- 172.21.15.18:0/3768287880 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2da0035db0 0x7f2da0038270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 --2- 172.21.15.18:0/3768287880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc012b0a0 0x7f2dc012f6a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 >> 172.21.15.18:0/3768287880 conn(0x7f2dc009f010 msgr2=0x7f2dc0099610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 shutdown_connections 2024-09-13T19:33:03.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:03.974+0000 7f2dc4cdf640 1 -- 172.21.15.18:0/3768287880 wait complete. 2024-09-13T19:33:04.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.1 2024-09-13T19:33:04.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9a68075bf0 con 0x7f9a68096520 2024-09-13T19:33:04.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a4f7fe640 1 -- 172.21.15.18:0/2086200516 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a58015ff0 con 0x7f9a68096520 2024-09-13T19:33:04.033 INFO:teuthology.orchestra.run.smithi018.stdout:38654705667 2024-09-13T19:33:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9a54035db0 msgr2=0x7f9a54038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 --2- 172.21.15.18:0/2086200516 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9a54035db0 0x7f9a54038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c007fd0 tx=0x7f9a5c007980 comp rx=0 tx=0).stop 2024-09-13T19:33:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 msgr2=0x7f9a681c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 --2- 172.21.15.18:0/2086200516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a681c47a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a58019fa0 tx=0x7f9a5801abb0 comp rx=0 tx=0).stop 2024-09-13T19:33:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 shutdown_connections 2024-09-13T19:33:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 --2- 172.21.15.18:0/2086200516 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9a54035db0 0x7f9a54038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 --2- 172.21.15.18:0/2086200516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a68096520 0x7f9a681c47a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:04.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 >> 172.21.15.18:0/2086200516 conn(0x7f9a6809f010 msgr2=0x7f9a68125ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:04.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 shutdown_connections 2024-09-13T19:33:04.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.026+0000 7f9a6d182640 1 -- 172.21.15.18:0/2086200516 wait complete. 2024-09-13T19:33:04.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-09-13T19:33:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1754133d50 con 0x7f175412e760 2024-09-13T19:33:04.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1742ffd640 1 -- 172.21.15.18:0/408282097 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1744015ff0 con 0x7f175412e760 2024-09-13T19:33:04.053 INFO:teuthology.orchestra.run.smithi018.stdout:42949672963 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1734035db0 msgr2=0x7f1734038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 --2- 172.21.15.18:0/408282097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1734035db0 0x7f1734038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1748007fd0 tx=0x7f1748007980 comp rx=0 tx=0).stop 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 msgr2=0x7f17540972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 --2- 172.21.15.18:0/408282097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f17540972f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f174401a030 tx=0x7f174401ac40 comp rx=0 tx=0).stop 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 shutdown_connections 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 --2- 172.21.15.18:0/408282097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1734035db0 0x7f1734038270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 --2- 172.21.15.18:0/408282097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f175412e760 0x7f17540972f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 >> 172.21.15.18:0/408282097 conn(0x7f17540a10a0 msgr2=0x7f1754125d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 shutdown_connections 2024-09-13T19:33:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.046+0000 7f1758cc3640 1 -- 172.21.15.18:0/408282097 wait complete. 2024-09-13T19:33:04.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9d8809b490 con 0x7f9d8806be20 2024-09-13T19:33:04.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d7effd640 1 -- 172.21.15.18:0/3325368715 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d84015ff0 con 0x7f9d8806be20 2024-09-13T19:33:04.062 INFO:teuthology.orchestra.run.smithi018.stdout:42949672964 2024-09-13T19:33:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d6c035db0 msgr2=0x7f9d6c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 --2- 172.21.15.18:0/3325368715 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d6c035db0 0x7f9d6c038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9d78000f70 tx=0x7f9d78007a90 comp rx=0 tx=0).stop 2024-09-13T19:33:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d8806be20 msgr2=0x7f9d88130ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 --2- 172.21.15.18:0/3325368715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d8806be20 0x7f9d88130ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d84019fa0 tx=0x7f9d84019110 comp rx=0 tx=0).stop 2024-09-13T19:33:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 shutdown_connections 2024-09-13T19:33:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 --2- 172.21.15.18:0/3325368715 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d6c035db0 0x7f9d6c038270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 --2- 172.21.15.18:0/3325368715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d8806be20 0x7f9d88130ca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 >> 172.21.15.18:0/3325368715 conn(0x7f9d8809ac70 msgr2=0x7f9d88098570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 shutdown_connections 2024-09-13T19:33:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:04.054+0000 7f9d90781640 1 -- 172.21.15.18:0/3325368715 wait complete. 2024-09-13T19:33:04.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2024-09-13T19:33:04.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.2 2024-09-13T19:33:05.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T19:33:05.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T19:33:05.073 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T19:33:05.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T19:33:05.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f171df61640 1 Processor -- start 2024-09-13T19:33:05.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f171df61640 1 -- start start 2024-09-13T19:33:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f171df61640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f171806bc50 0x7f171806e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f171df61640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171806ca50 con 0x7f171806ed90 2024-09-13T19:33:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f171df61640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f171806c030 con 0x7f171806bc50 2024-09-13T19:33:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f17177fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f171806bc50 0x7f171806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f1716ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f171806ed90 0x7f171812ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43742/0 (socket says 172.21.15.18:43742) 2024-09-13T19:33:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f1716ffd640 1 -- 172.21.15.18:0/2573251821 learned_addr learned my addr 172.21.15.18:0/2573251821 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f17177fe640 1 -- 172.21.15.18:0/2573251821 >> v1:172.21.15.18:6789/0 conn(0x7f171806ed90 legacy=0x7f171812ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.130+0000 7f17177fe640 1 -- 172.21.15.18:0/2573251821 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1718073320 con 0x7f171806bc50 2024-09-13T19:33:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f17177fe640 1 --2- 172.21.15.18:0/2573251821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f171806e850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1708009740 tx=0x7f170801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71067dbf7e3b1409 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f17167fc640 1 -- 172.21.15.18:0/2573251821 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17080b1070 con 0x7f171806bc50 2024-09-13T19:33:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f17167fc640 1 -- 172.21.15.18:0/2573251821 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17080ac570 con 0x7f171806bc50 2024-09-13T19:33:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f17167fc640 1 -- 172.21.15.18:0/2573251821 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17080ac870 con 0x7f171806bc50 2024-09-13T19:33:05.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 -- 172.21.15.18:0/2573251821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 msgr2=0x7f171806e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 --2- 172.21.15.18:0/2573251821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f171806e850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1708009740 tx=0x7f170801c400 comp rx=0 tx=0).stop 2024-09-13T19:33:05.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 -- 172.21.15.18:0/2573251821 shutdown_connections 2024-09-13T19:33:05.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 --2- 172.21.15.18:0/2573251821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f171806e850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 -- 172.21.15.18:0/2573251821 >> 172.21.15.18:0/2573251821 conn(0x7f171809ac70 msgr2=0x7f171806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 -- 172.21.15.18:0/2573251821 shutdown_connections 2024-09-13T19:33:05.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 -- 172.21.15.18:0/2573251821 wait complete. 2024-09-13T19:33:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 Processor -- start 2024-09-13T19:33:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 -- start start 2024-09-13T19:33:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f17181c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f171df61640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1718137160 con 0x7f171806bc50 2024-09-13T19:33:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f17177fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f17181c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f17177fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f17181c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44622/0 (socket says 172.21.15.18:44622) 2024-09-13T19:33:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.134+0000 7f17177fe640 1 -- 172.21.15.18:0/1663160171 learned_addr learned my addr 172.21.15.18:0/1663160171 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f17177fe640 1 -- 172.21.15.18:0/1663160171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1718095b10 con 0x7f171806bc50 2024-09-13T19:33:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f17177fe640 1 --2- 172.21.15.18:0/1663160171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f17181c69a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17080af040 tx=0x7f17080191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f16fffff640 1 -- 172.21.15.18:0/1663160171 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17080b9020 con 0x7f171806bc50 2024-09-13T19:33:05.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f16fffff640 1 -- 172.21.15.18:0/1663160171 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17080aa7c0 con 0x7f171806bc50 2024-09-13T19:33:05.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f16fffff640 1 -- 172.21.15.18:0/1663160171 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17080b1040 con 0x7f171806bc50 2024-09-13T19:33:05.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1718094270 con 0x7f171806bc50 2024-09-13T19:33:05.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17181c6ee0 con 0x7f171806bc50 2024-09-13T19:33:05.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171806e850 con 0x7f171806bc50 2024-09-13T19:33:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f16fffff640 1 -- 172.21.15.18:0/1663160171 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17080bc020 con 0x7f171806bc50 2024-09-13T19:33:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f16fffff640 1 --2- 172.21.15.18:0/1663160171 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1704035db0 0x7f1704038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f16fffff640 1 -- 172.21.15.18:0/1663160171 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f17080e2670 con 0x7f171806bc50 2024-09-13T19:33:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f1716ffd640 1 --2- 172.21.15.18:0/1663160171 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1704035db0 0x7f1704038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.138+0000 7f1716ffd640 1 --2- 172.21.15.18:0/1663160171 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1704035db0 0x7f1704038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f170c001570 tx=0x7f170c007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.146+0000 7f16fffff640 1 -- 172.21.15.18:0/1663160171 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17080c3030 con 0x7f171806bc50 2024-09-13T19:33:05.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.162+0000 7fe90dd5d640 1 Processor -- start 2024-09-13T19:33:05.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.162+0000 7fe90dd5d640 1 -- start start 2024-09-13T19:33:05.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.162+0000 7fe90dd5d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe90812e760 0x7fe90812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe90dd5d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9080984f0 con 0x7fe90812f1c0 2024-09-13T19:33:05.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe90dd5d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe908098dc0 con 0x7fe90812e760 2024-09-13T19:33:05.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe9077fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe90812e760 0x7fe90812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe906ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe90812f1c0 0x7fe90812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43744/0 (socket says 172.21.15.18:43744) 2024-09-13T19:33:05.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe906ffd640 1 -- 172.21.15.18:0/2234337613 learned_addr learned my addr 172.21.15.18:0/2234337613 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:05.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe9077fe640 1 -- 172.21.15.18:0/2234337613 >> v1:172.21.15.18:6789/0 conn(0x7fe90812f1c0 legacy=0x7fe90812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe9067fc640 1 -- 172.21.15.18:0/2234337613 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211572977 0 0) 0x7fe9080984f0 con 0x7fe90812f1c0 2024-09-13T19:33:05.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe9077fe640 1 -- 172.21.15.18:0/2234337613 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90812f5a0 con 0x7fe90812e760 2024-09-13T19:33:05.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe9077fe640 1 --2- 172.21.15.18:0/2234337613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe90812ec80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009740 tx=0x7fe8f801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a5863fbf8efb2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.166+0000 7fe9067fc640 1 -- 172.21.15.18:0/2234337613 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f80b0070 con 0x7fe90812e760 2024-09-13T19:33:05.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe9067fc640 1 -- 172.21.15.18:0/2234337613 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f80ab530 con 0x7fe90812e760 2024-09-13T19:33:05.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe9067fc640 1 -- 172.21.15.18:0/2234337613 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f80ab830 con 0x7fe90812e760 2024-09-13T19:33:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- 172.21.15.18:0/2234337613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 msgr2=0x7fe90812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 --2- 172.21.15.18:0/2234337613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe90812ec80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009740 tx=0x7fe8f801c400 comp rx=0 tx=0).stop 2024-09-13T19:33:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- 172.21.15.18:0/2234337613 shutdown_connections 2024-09-13T19:33:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 --2- 172.21.15.18:0/2234337613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe90812ec80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- 172.21.15.18:0/2234337613 >> 172.21.15.18:0/2234337613 conn(0x7fe9080a10a0 msgr2=0x7fe9080a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- 172.21.15.18:0/2234337613 shutdown_connections 2024-09-13T19:33:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- 172.21.15.18:0/2234337613 wait complete. 2024-09-13T19:33:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 Processor -- start 2024-09-13T19:33:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- start start 2024-09-13T19:33:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe9081309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe908136e30 con 0x7fe90812e760 2024-09-13T19:33:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe9077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe9081309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe9077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe9081309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44628/0 (socket says 172.21.15.18:44628) 2024-09-13T19:33:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe9077fe640 1 -- 172.21.15.18:0/1399489154 learned_addr learned my addr 172.21.15.18:0/1399489154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe9077fe640 1 -- 172.21.15.18:0/1399489154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe908132f70 con 0x7fe90812e760 2024-09-13T19:33:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe9077fe640 1 --2- 172.21.15.18:0/1399489154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe9081309e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8f801a030 tx=0x7fe8f801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe8effff640 1 -- 172.21.15.18:0/1399489154 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f80b0050 con 0x7fe90812e760 2024-09-13T19:33:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe8effff640 1 -- 172.21.15.18:0/1399489154 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f80b1040 con 0x7fe90812e760 2024-09-13T19:33:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe8effff640 1 -- 172.21.15.18:0/1399489154 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f80b5740 con 0x7fe90812e760 2024-09-13T19:33:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe908133430 con 0x7fe90812e760 2024-09-13T19:33:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.170+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe908130f20 con 0x7fe90812e760 2024-09-13T19:33:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.174+0000 7fe8effff640 1 -- 172.21.15.18:0/1399489154 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8f80be030 con 0x7fe90812e760 2024-09-13T19:33:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.174+0000 7fe8effff640 1 --2- 172.21.15.18:0/1399489154 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe8f4035db0 0x7fe8f4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.174+0000 7fe8effff640 1 -- 172.21.15.18:0/1399489154 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe8f80bc070 con 0x7fe90812e760 2024-09-13T19:33:05.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.174+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe908132300 con 0x7fe90812e760 2024-09-13T19:33:05.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.174+0000 7fe906ffd640 1 --2- 172.21.15.18:0/1399489154 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe8f4035db0 0x7fe8f4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.174+0000 7fe906ffd640 1 --2- 172.21.15.18:0/1399489154 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe8f4035db0 0x7fe8f4038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc007fd0 tx=0x7fe8fc007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.182+0000 7fe8effff640 1 -- 172.21.15.18:0/1399489154 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8f80c5020 con 0x7fe90812e760 2024-09-13T19:33:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e71ebc640 1 Processor -- start 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e71ebc640 1 -- start start 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e71ebc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e6c12f390 0x7f2e6c133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e71ebc640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6c0984f0 con 0x7f2e6c12e760 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e71ebc640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6c098dc0 con 0x7f2e6c12f390 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e6affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e6c12f390 0x7f2e6c133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e6b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2e6c12e760 0x7f2e6c12ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43760/0 (socket says 172.21.15.18:43760) 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e6b7fe640 1 -- 172.21.15.18:0/1436912276 learned_addr learned my addr 172.21.15.18:0/1436912276 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e6affd640 1 -- 172.21.15.18:0/1436912276 >> v1:172.21.15.18:6789/0 conn(0x7f2e6c12e760 legacy=0x7f2e6c12ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.206+0000 7f2e6affd640 1 -- 172.21.15.18:0/1436912276 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c0981a0 con 0x7f2e6c12f390 2024-09-13T19:33:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6affd640 1 --2- 172.21.15.18:0/1436912276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12f390 0x7f2e6c133a80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009740 tx=0x7f2e6001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcb5b7c4c9be6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/1436912276 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600b1070 con 0x7f2e6c12f390 2024-09-13T19:33:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/1436912276 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e600ac570 con 0x7f2e6c12f390 2024-09-13T19:33:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6a7fc640 1 -- 172.21.15.18:0/1436912276 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600ac870 con 0x7f2e6c12f390 2024-09-13T19:33:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 -- 172.21.15.18:0/1436912276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12f390 msgr2=0x7f2e6c133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 --2- 172.21.15.18:0/1436912276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12f390 0x7f2e6c133a80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009740 tx=0x7f2e6001c420 comp rx=0 tx=0).stop 2024-09-13T19:33:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 -- 172.21.15.18:0/1436912276 shutdown_connections 2024-09-13T19:33:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 --2- 172.21.15.18:0/1436912276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12f390 0x7f2e6c133a80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 -- 172.21.15.18:0/1436912276 >> 172.21.15.18:0/1436912276 conn(0x7f2e6c0a10a0 msgr2=0x7f2e6c0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 -- 172.21.15.18:0/1436912276 shutdown_connections 2024-09-13T19:33:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 -- 172.21.15.18:0/1436912276 wait complete. 2024-09-13T19:33:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 Processor -- start 2024-09-13T19:33:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 -- start start 2024-09-13T19:33:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12e760 0x7f2e6c096080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c136b70 con 0x7f2e6c12e760 2024-09-13T19:33:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12e760 0x7f2e6c096080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12e760 0x7f2e6c096080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44652/0 (socket says 172.21.15.18:44652) 2024-09-13T19:33:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6b7fe640 1 -- 172.21.15.18:0/2640140246 learned_addr learned my addr 172.21.15.18:0/2640140246 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6b7fe640 1 -- 172.21.15.18:0/2640140246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c131cd0 con 0x7f2e6c12e760 2024-09-13T19:33:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e6b7fe640 1 --2- 172.21.15.18:0/2640140246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12e760 0x7f2e6c096080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00c480 tx=0x7f2e5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e53fff640 1 -- 172.21.15.18:0/2640140246 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5c017070 con 0x7f2e6c12e760 2024-09-13T19:33:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e53fff640 1 -- 172.21.15.18:0/2640140246 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c005c20 con 0x7f2e6c12e760 2024-09-13T19:33:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.210+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6c12b5c0 con 0x7f2e6c12e760 2024-09-13T19:33:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.214+0000 7f2e53fff640 1 -- 172.21.15.18:0/2640140246 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5c007070 con 0x7f2e6c12e760 2024-09-13T19:33:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.214+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6c131640 con 0x7f2e6c12e760 2024-09-13T19:33:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.214+0000 7f2e53fff640 1 -- 172.21.15.18:0/2640140246 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2e5c01a070 con 0x7f2e6c12e760 2024-09-13T19:33:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.214+0000 7f2e53fff640 1 --2- 172.21.15.18:0/2640140246 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e58035d40 0x7f2e58038200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.214+0000 7f2e53fff640 1 -- 172.21.15.18:0/2640140246 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f2e5c04b120 con 0x7f2e6c12e760 2024-09-13T19:33:05.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.214+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6c12ec80 con 0x7f2e6c12e760 2024-09-13T19:33:05.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.214+0000 7f2e6affd640 1 --2- 172.21.15.18:0/2640140246 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e58035d40 0x7f2e58038200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.214+0000 7f2e6affd640 1 --2- 172.21.15.18:0/2640140246 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e58035d40 0x7f2e58038200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e600ae000 tx=0x7f2e60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb697327640 1 Processor -- start 2024-09-13T19:33:05.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7f2e53fff640 1 -- 172.21.15.18:0/2640140246 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e6c131cd0 con 0x7f2e6c12e760 2024-09-13T19:33:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb697327640 1 -- start start 2024-09-13T19:33:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb697327640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb69012ed70 0x7fb69012f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb697327640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69006f8a0 con 0x7fb69012f690 2024-09-13T19:33:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb697327640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb69006eac0 con 0x7fb69012ed70 2024-09-13T19:33:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb6950c3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb69012ed70 0x7fb69012f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb6948c2640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb69012f690 0x7fb69006d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43774/0 (socket says 172.21.15.18:43774) 2024-09-13T19:33:05.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb6948c2640 1 -- 172.21.15.18:0/4273048082 learned_addr learned my addr 172.21.15.18:0/4273048082 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:05.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb6950c3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb69012ed70 0x7fb69012f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44662/0 (socket says 172.21.15.18:44662) 2024-09-13T19:33:05.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb6950c3640 1 -- 172.21.15.18:0/4273048082 >> v1:172.21.15.18:6789/0 conn(0x7fb69012f690 legacy=0x7fb69006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.218+0000 7fb6950c3640 1 -- 172.21.15.18:0/4273048082 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69006fbb0 con 0x7fb69012ed70 2024-09-13T19:33:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb6950c3640 1 --2- 172.21.15.18:0/4273048082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb69012f150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009740 tx=0x7fb68c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beede364ec233b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb687fff640 1 -- 172.21.15.18:0/4273048082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c0ab550 con 0x7fb69012ed70 2024-09-13T19:33:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb687fff640 1 -- 172.21.15.18:0/4273048082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c0b0070 con 0x7fb69012ed70 2024-09-13T19:33:05.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb687fff640 1 -- 172.21.15.18:0/4273048082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c0ab840 con 0x7fb69012ed70 2024-09-13T19:33:05.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb697327640 1 -- 172.21.15.18:0/4273048082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 msgr2=0x7fb69012f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb697327640 1 --2- 172.21.15.18:0/4273048082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb69012f150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009740 tx=0x7fb68c01c400 comp rx=0 tx=0).stop 2024-09-13T19:33:05.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb697327640 1 -- 172.21.15.18:0/4273048082 shutdown_connections 2024-09-13T19:33:05.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb697327640 1 --2- 172.21.15.18:0/4273048082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb69012f150 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb697327640 1 -- 172.21.15.18:0/4273048082 >> 172.21.15.18:0/4273048082 conn(0x7fb69009cd30 msgr2=0x7fb69009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb697327640 1 -- 172.21.15.18:0/4273048082 shutdown_connections 2024-09-13T19:33:05.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.222+0000 7fb697327640 1 -- 172.21.15.18:0/4273048082 wait complete. 2024-09-13T19:33:05.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb697327640 1 Processor -- start 2024-09-13T19:33:05.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb697327640 1 -- start start 2024-09-13T19:33:05.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb697327640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb6901c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb697327640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb69006e420 con 0x7fb69012ed70 2024-09-13T19:33:05.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb6950c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb6901c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb6950c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb6901c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44674/0 (socket says 172.21.15.18:44674) 2024-09-13T19:33:05.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb6950c3640 1 -- 172.21.15.18:0/3671415755 learned_addr learned my addr 172.21.15.18:0/3671415755 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:05.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb6950c3640 1 -- 172.21.15.18:0/3671415755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb690093f80 con 0x7fb69012ed70 2024-09-13T19:33:05.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb6950c3640 1 --2- 172.21.15.18:0/3671415755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb6901c5f90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ad040 tx=0x7fb68c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb685ffb640 1 -- 172.21.15.18:0/3671415755 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c0bf410 con 0x7fb69012ed70 2024-09-13T19:33:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb685ffb640 1 -- 172.21.15.18:0/3671415755 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c0bf5b0 con 0x7fb69012ed70 2024-09-13T19:33:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb685ffb640 1 -- 172.21.15.18:0/3671415755 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c0bf890 con 0x7fb69012ed70 2024-09-13T19:33:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb690094750 con 0x7fb69012ed70 2024-09-13T19:33:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6901c64d0 con 0x7fb69012ed70 2024-09-13T19:33:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb690093ae0 con 0x7fb69012ed70 2024-09-13T19:33:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.226+0000 7fb685ffb640 1 -- 172.21.15.18:0/3671415755 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb68c0bd020 con 0x7fb69012ed70 2024-09-13T19:33:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.230+0000 7fb685ffb640 1 --2- 172.21.15.18:0/3671415755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb674035db0 0x7fb674038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.230+0000 7fb685ffb640 1 -- 172.21.15.18:0/3671415755 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb68c0e2ff0 con 0x7fb69012ed70 2024-09-13T19:33:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.230+0000 7fb6948c2640 1 --2- 172.21.15.18:0/3671415755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb674035db0 0x7fb674038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.230+0000 7fb6948c2640 1 --2- 172.21.15.18:0/3671415755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb674035db0 0x7fb674038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb680000f70 tx=0x7fb680007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.238+0000 7fb685ffb640 1 -- 172.21.15.18:0/3671415755 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb68c016010 con 0x7fb69012ed70 2024-09-13T19:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1718095300 con 0x7f171806bc50 2024-09-13T19:33:05.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f16fffff640 1 -- 172.21.15.18:0/1663160171 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1718095b10 con 0x7f171806bc50 2024-09-13T19:33:05.330 INFO:teuthology.orchestra.run.smithi018.stdout:42949672964 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1704035db0 msgr2=0x7f1704038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 --2- 172.21.15.18:0/1663160171 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1704035db0 0x7f1704038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f170c001570 tx=0x7f170c007ad0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 msgr2=0x7f17181c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 --2- 172.21.15.18:0/1663160171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f17181c69a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17080af040 tx=0x7f17080191a0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 shutdown_connections 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 --2- 172.21.15.18:0/1663160171 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1704035db0 0x7f1704038270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 --2- 172.21.15.18:0/1663160171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f171806bc50 0x7f17181c69a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 >> 172.21.15.18:0/1663160171 conn(0x7f171809ac70 msgr2=0x7f1718134260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 shutdown_connections 2024-09-13T19:33:05.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.322+0000 7f171df61640 1 -- 172.21.15.18:0/1663160171 wait complete. 2024-09-13T19:33:05.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.1 2024-09-13T19:33:05.353 DEBUG:teuthology.parallel:result is None 2024-09-13T19:33:05.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.366+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe90812ec80 con 0x7fe90812e760 2024-09-13T19:33:05.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.366+0000 7fe8effff640 1 -- 172.21.15.18:0/1399489154 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8f8015ff0 con 0x7fe90812e760 2024-09-13T19:33:05.374 INFO:teuthology.orchestra.run.smithi018.stdout:38654705668 2024-09-13T19:33:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe8f4035db0 msgr2=0x7fe8f4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 --2- 172.21.15.18:0/1399489154 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe8f4035db0 0x7fe8f4038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc007fd0 tx=0x7fe8fc007980 comp rx=0 tx=0).stop 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 msgr2=0x7fe9081309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 --2- 172.21.15.18:0/1399489154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe9081309e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8f801a030 tx=0x7fe8f801ac40 comp rx=0 tx=0).stop 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 shutdown_connections 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 --2- 172.21.15.18:0/1399489154 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe8f4035db0 0x7fe8f4038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 --2- 172.21.15.18:0/1399489154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe90812e760 0x7fe9081309e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 >> 172.21.15.18:0/1399489154 conn(0x7fe9080a10a0 msgr2=0x7fe90812c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 shutdown_connections 2024-09-13T19:33:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.370+0000 7fe90dd5d640 1 -- 172.21.15.18:0/1399489154 wait complete. 2024-09-13T19:33:05.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-09-13T19:33:05.391 DEBUG:teuthology.parallel:result is None 2024-09-13T19:33:05.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2e6c06e930 con 0x7f2e6c12e760 2024-09-13T19:33:05.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e53fff640 1 -- 172.21.15.18:0/2640140246 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e5c046630 con 0x7f2e6c12e760 2024-09-13T19:33:05.392 INFO:teuthology.orchestra.run.smithi018.stdout:42949672964 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e58035d40 msgr2=0x7f2e58038200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 --2- 172.21.15.18:0/2640140246 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e58035d40 0x7f2e58038200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e600ae000 tx=0x7f2e60008040 comp rx=0 tx=0).stop 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12e760 msgr2=0x7f2e6c096080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 --2- 172.21.15.18:0/2640140246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12e760 0x7f2e6c096080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00c480 tx=0x7f2e5c00c940 comp rx=0 tx=0).stop 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 shutdown_connections 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 --2- 172.21.15.18:0/2640140246 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e58035d40 0x7f2e58038200 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 --2- 172.21.15.18:0/2640140246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6c12e760 0x7f2e6c096080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 >> 172.21.15.18:0/2640140246 conn(0x7f2e6c0a10a0 msgr2=0x7f2e6c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 shutdown_connections 2024-09-13T19:33:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.386+0000 7f2e71ebc640 1 -- 172.21.15.18:0/2640140246 wait complete. 2024-09-13T19:33:05.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.3 2024-09-13T19:33:05.415 DEBUG:teuthology.parallel:result is None 2024-09-13T19:33:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.422+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb69012f150 con 0x7fb69012ed70 2024-09-13T19:33:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.422+0000 7fb685ffb640 1 -- 172.21.15.18:0/3671415755 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb68c0b5da0 con 0x7fb69012ed70 2024-09-13T19:33:05.430 INFO:teuthology.orchestra.run.smithi018.stdout:42949672965 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb674035db0 msgr2=0x7fb674038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 --2- 172.21.15.18:0/3671415755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb674035db0 0x7fb674038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb680000f70 tx=0x7fb680007a90 comp rx=0 tx=0).stop 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 msgr2=0x7fb6901c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 --2- 172.21.15.18:0/3671415755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb6901c5f90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ad040 tx=0x7fb68c01ac60 comp rx=0 tx=0).stop 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 shutdown_connections 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 --2- 172.21.15.18:0/3671415755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb674035db0 0x7fb674038270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 --2- 172.21.15.18:0/3671415755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb69012ed70 0x7fb6901c5f90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 >> 172.21.15.18:0/3671415755 conn(0x7fb69009cd30 msgr2=0x7fb690099430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 shutdown_connections 2024-09-13T19:33:05.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.426+0000 7fb697327640 1 -- 172.21.15.18:0/3671415755 wait complete. 2024-09-13T19:33:05.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2024-09-13T19:33:05.447 DEBUG:teuthology.parallel:result is None 2024-09-13T19:33:05.447 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T19:33:05.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:33:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f688b09c640 1 Processor -- start 2024-09-13T19:33:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f688b09c640 1 -- start start 2024-09-13T19:33:05.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f688b09c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f688406e1f0 0x7f688406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f688b09c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688406f750 con 0x7f688406eb10 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f688b09c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6884070c10 con 0x7f688406e1f0 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f6883fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f688406eb10 0x7f6884096080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43786/0 (socket says 172.21.15.18:43786) 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f6888e38640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f688406e1f0 0x7f688406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f6883fff640 1 -- 172.21.15.18:0/3220127537 learned_addr learned my addr 172.21.15.18:0/3220127537 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f68837fe640 1 -- 172.21.15.18:0/3220127537 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928450238 0 0) 0x7f688406f750 con 0x7f688406eb10 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f68837fe640 1 -- 172.21.15.18:0/3220127537 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f686c003530 con 0x7f688406eb10 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f6888e38640 1 -- 172.21.15.18:0/3220127537 >> v1:172.21.15.18:6789/0 conn(0x7f688406eb10 legacy=0x7f6884096080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.590+0000 7f6888e38640 1 -- 172.21.15.18:0/3220127537 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68840703f0 con 0x7f688406e1f0 2024-09-13T19:33:05.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f6888e38640 1 --2- 172.21.15.18:0/3220127537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f688406e5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6874009740 tx=0x7f687401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e3d4229f6a5725 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f68837fe640 1 -- 172.21.15.18:0/3220127537 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68740b0070 con 0x7f688406e1f0 2024-09-13T19:33:05.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f68837fe640 1 -- 172.21.15.18:0/3220127537 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68740ab530 con 0x7f688406e1f0 2024-09-13T19:33:05.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f68837fe640 1 -- 172.21.15.18:0/3220127537 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68740ab810 con 0x7f688406e1f0 2024-09-13T19:33:05.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 -- 172.21.15.18:0/3220127537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 msgr2=0x7f688406e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 --2- 172.21.15.18:0/3220127537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f688406e5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6874009740 tx=0x7f687401c370 comp rx=0 tx=0).stop 2024-09-13T19:33:05.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 -- 172.21.15.18:0/3220127537 shutdown_connections 2024-09-13T19:33:05.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 --2- 172.21.15.18:0/3220127537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f688406e5d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 -- 172.21.15.18:0/3220127537 >> 172.21.15.18:0/3220127537 conn(0x7f6884099a50 msgr2=0x7f68840972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 -- 172.21.15.18:0/3220127537 shutdown_connections 2024-09-13T19:33:05.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 -- 172.21.15.18:0/3220127537 wait complete. 2024-09-13T19:33:05.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 Processor -- start 2024-09-13T19:33:05.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 -- start start 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f6884126200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.594+0000 7f688b09c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f688406eef0 con 0x7f688406e1f0 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f6888e38640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f6884126200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f6888e38640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f6884126200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44686/0 (socket says 172.21.15.18:44686) 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f6888e38640 1 -- 172.21.15.18:0/30706067 learned_addr learned my addr 172.21.15.18:0/30706067 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f6888e38640 1 -- 172.21.15.18:0/30706067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68841289f0 con 0x7f688406e1f0 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f6888e38640 1 --2- 172.21.15.18:0/30706067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f6884126200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68740ae040 tx=0x7f687401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f68817fa640 1 -- 172.21.15.18:0/30706067 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68740b0050 con 0x7f688406e1f0 2024-09-13T19:33:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f68817fa640 1 -- 172.21.15.18:0/30706067 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68740b1040 con 0x7f688406e1f0 2024-09-13T19:33:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f68817fa640 1 -- 172.21.15.18:0/30706067 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68740b7580 con 0x7f688406e1f0 2024-09-13T19:33:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6884128eb0 con 0x7f688406e1f0 2024-09-13T19:33:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688412c390 con 0x7f688406e1f0 2024-09-13T19:33:05.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688406e5d0 con 0x7f688406e1f0 2024-09-13T19:33:05.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f68817fa640 1 -- 172.21.15.18:0/30706067 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68740be030 con 0x7f688406e1f0 2024-09-13T19:33:05.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f68817fa640 1 --2- 172.21.15.18:0/30706067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6870035e00 0x7f68700382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f68817fa640 1 -- 172.21.15.18:0/30706067 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f68740bc070 con 0x7f688406e1f0 2024-09-13T19:33:05.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f6883fff640 1 --2- 172.21.15.18:0/30706067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6870035e00 0x7f68700382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.598+0000 7f6883fff640 1 --2- 172.21.15.18:0/30706067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6870035e00 0x7f68700382c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6878000f70 tx=0x7f68780010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.602+0000 7f68817fa640 1 -- 172.21.15.18:0/30706067 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f68740c5020 con 0x7f688406e1f0 2024-09-13T19:33:05.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.754+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6884129190 con 0x7f6870035e00 2024-09-13T19:33:05.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.758+0000 7f68817fa640 1 -- 172.21.15.18:0/30706067 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32250 (secure 0 0 0) 0x7f68780058e0 con 0x7f6870035e00 2024-09-13T19:33:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:33:05.767 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6870035e00 msgr2=0x7f68700382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 --2- 172.21.15.18:0/30706067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6870035e00 0x7f68700382c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6878000f70 tx=0x7f68780010b0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 msgr2=0x7f6884126200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 --2- 172.21.15.18:0/30706067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f6884126200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68740ae040 tx=0x7f687401abb0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 shutdown_connections 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 --2- 172.21.15.18:0/30706067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6870035e00 0x7f68700382c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 --2- 172.21.15.18:0/30706067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688406e1f0 0x7f6884126200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 >> 172.21.15.18:0/30706067 conn(0x7f6884099a50 msgr2=0x7f688409afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 shutdown_connections 2024-09-13T19:33:05.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.762+0000 7f688b09c640 1 -- 172.21.15.18:0/30706067 wait complete. 2024-09-13T19:33:05.784 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-13T19:33:04.402378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114016,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373344,"statfs":{"total":386547056640,"available":386430304256,"internally_reserved":0,"allocated":1785856,"data_stored":1369754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.892055"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.524558+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:33:02.524558+0000","last_peered":"2024-09-13T19:33:02.524558+0000","last_clean":"2024-09-13T19:33:02.524558+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:33:02.524558+0000","last_undegraded":"2024-09-13T19:33:02.524558+0000","last_fullsized":"2024-09-13T19:33:02.524558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:46.024868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523653+0000","last_change":"2024-09-13T19:33:02.523653+0000","last_active":"2024-09-13T19:33:02.523653+0000","last_peered":"2024-09-13T19:33:02.523653+0000","last_clean":"2024-09-13T19:33:02.523653+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:33:02.523653+0000","last_undegraded":"2024-09-13T19:33:02.523653+0000","last_fullsized":"2024-09-13T19:33:02.523653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:42.749511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523738+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:33:02.523738+0000","last_peered":"2024-09-13T19:33:02.523738+0000","last_clean":"2024-09-13T19:33:02.523738+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:33:02.523738+0000","last_undegraded":"2024-09-13T19:33:02.523738+0000","last_fullsized":"2024-09-13T19:33:02.523738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:56.316476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523552+0000","last_change":"2024-09-13T19:33:02.523552+0000","last_active":"2024-09-13T19:33:02.523552+0000","last_peered":"2024-09-13T19:33:02.523552+0000","last_clean":"2024-09-13T19:33:02.523552+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:33:02.523552+0000","last_undegraded":"2024-09-13T19:33:02.523552+0000","last_fullsized":"2024-09-13T19:33:02.523552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:43.683067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.524797+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:33:02.524797+0000","last_peered":"2024-09-13T19:33:02.524797+0000","last_clean":"2024-09-13T19:33:02.524797+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:33:02.524797+0000","last_undegraded":"2024-09-13T19:33:02.524797+0000","last_fullsized":"2024-09-13T19:33:02.524797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:14.144438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.800896+0000","last_change":"2024-09-13T19:33:02.801369+0000","last_active":"2024-09-13T19:33:02.800896+0000","last_peered":"2024-09-13T19:33:02.800896+0000","last_clean":"2024-09-13T19:33:02.800896+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:33:02.800896+0000","last_undegraded":"2024-09-13T19:33:02.800896+0000","last_fullsized":"2024-09-13T19:33:02.800896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:34.016598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523035+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:33:02.523035+0000","last_peered":"2024-09-13T19:33:02.523035+0000","last_clean":"2024-09-13T19:33:02.523035+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:33:02.523035+0000","last_undegraded":"2024-09-13T19:33:02.523035+0000","last_fullsized":"2024-09-13T19:33:02.523035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523124+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:33:02.523124+0000","last_peered":"2024-09-13T19:33:02.523124+0000","last_clean":"2024-09-13T19:33:02.523124+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:33:02.523124+0000","last_undegraded":"2024-09-13T19:33:02.523124+0000","last_fullsized":"2024-09-13T19:33:02.523124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:41.432070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.518273+0000","last_change":"2024-09-13T19:32:57.877961+0000","last_active":"2024-09-13T19:33:02.518273+0000","last_peered":"2024-09-13T19:33:02.518273+0000","last_clean":"2024-09-13T19:33:02.518273+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:33:02.518273+0000","last_undegraded":"2024-09-13T19:33:02.518273+0000","last_fullsized":"2024-09-13T19:33:02.518273+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_clean_scrub_stamp":"2024-09-13T19:32:56.474648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672964,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":47264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":637613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":637613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":47264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:33:05.785 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:33:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d30cf0640 1 Processor -- start 2024-09-13T19:33:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d30cf0640 1 -- start start 2024-09-13T19:33:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d30cf0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9d2c06f340 0x7f9d2c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d30cf0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2c06beb0 con 0x7f9d2c06e850 2024-09-13T19:33:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d30cf0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2c070050 con 0x7f9d2c06f340 2024-09-13T19:33:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d2a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9d2c06e850 0x7f9d2c06ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43798/0 (socket says 172.21.15.18:43798) 2024-09-13T19:33:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d2a59c640 1 -- 172.21.15.18:0/2008011737 learned_addr learned my addr 172.21.15.18:0/2008011737 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d29d9b640 1 --2- 172.21.15.18:0/2008011737 >> v2:172.21.15.18:3300/0 conn(0x7f9d2c06f340 0x7f9d2c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d2959a640 1 -- 172.21.15.18:0/2008011737 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738049903 0 0) 0x7f9d2c06beb0 con 0x7f9d2c06e850 2024-09-13T19:33:05.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d2959a640 1 -- 172.21.15.18:0/2008011737 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d14003530 con 0x7f9d2c06e850 2024-09-13T19:33:05.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d29d9b640 1 -- 172.21.15.18:0/2008011737 >> v1:172.21.15.18:6789/0 conn(0x7f9d2c06e850 legacy=0x7f9d2c06ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d29d9b640 1 -- 172.21.15.18:0/2008011737 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c06fd40 con 0x7f9d2c06f340 2024-09-13T19:33:05.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d29d9b640 1 --2- 172.21.15.18:0/2008011737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06f340 0x7f9d2c133f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009740 tx=0x7f9d2001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc348d694bc9579 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d2959a640 1 -- 172.21.15.18:0/2008011737 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d200b0070 con 0x7f9d2c06f340 2024-09-13T19:33:05.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d2959a640 1 -- 172.21.15.18:0/2008011737 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d200ab530 con 0x7f9d2c06f340 2024-09-13T19:33:05.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.898+0000 7f9d2959a640 1 -- 172.21.15.18:0/2008011737 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d200ab830 con 0x7f9d2c06f340 2024-09-13T19:33:05.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- 172.21.15.18:0/2008011737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06f340 msgr2=0x7f9d2c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:05.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 --2- 172.21.15.18:0/2008011737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06f340 0x7f9d2c133f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009740 tx=0x7f9d2001c370 comp rx=0 tx=0).stop 2024-09-13T19:33:05.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- 172.21.15.18:0/2008011737 shutdown_connections 2024-09-13T19:33:05.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 --2- 172.21.15.18:0/2008011737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06f340 0x7f9d2c133f30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:05.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- 172.21.15.18:0/2008011737 >> 172.21.15.18:0/2008011737 conn(0x7f9d2c09ac70 msgr2=0x7f9d2c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:05.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- 172.21.15.18:0/2008011737 shutdown_connections 2024-09-13T19:33:05.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- 172.21.15.18:0/2008011737 wait complete. 2024-09-13T19:33:05.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 Processor -- start 2024-09-13T19:33:05.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- start start 2024-09-13T19:33:05.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06e850 0x7f9d2c1c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c136ea0 con 0x7f9d2c06e850 2024-09-13T19:33:05.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06e850 0x7f9d2c1c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06e850 0x7f9d2c1c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44704/0 (socket says 172.21.15.18:44704) 2024-09-13T19:33:05.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d2a59c640 1 -- 172.21.15.18:0/4190256220 learned_addr learned my addr 172.21.15.18:0/4190256220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:05.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d2a59c640 1 -- 172.21.15.18:0/4190256220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c0969c0 con 0x7f9d2c06e850 2024-09-13T19:33:05.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d2a59c640 1 --2- 172.21.15.18:0/4190256220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06e850 0x7f9d2c1c61b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c450 tx=0x7f9d1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d1affd640 1 -- 172.21.15.18:0/4190256220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c017070 con 0x7f9d2c06e850 2024-09-13T19:33:05.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d1affd640 1 -- 172.21.15.18:0/4190256220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c005c20 con 0x7f9d2c06e850 2024-09-13T19:33:05.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c095de0 con 0x7f9d2c06e850 2024-09-13T19:33:05.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d1affd640 1 -- 172.21.15.18:0/4190256220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c007070 con 0x7f9d2c06e850 2024-09-13T19:33:05.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c1c66f0 con 0x7f9d2c06e850 2024-09-13T19:33:05.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d1affd640 1 -- 172.21.15.18:0/4190256220 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9d1c01a070 con 0x7f9d2c06e850 2024-09-13T19:33:05.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c06ec30 con 0x7f9d2c06e850 2024-09-13T19:33:05.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.902+0000 7f9d1affd640 1 --2- 172.21.15.18:0/4190256220 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d0c035db0 0x7f9d0c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:05.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.906+0000 7f9d1affd640 1 -- 172.21.15.18:0/4190256220 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9d1c0479e0 con 0x7f9d2c06e850 2024-09-13T19:33:05.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.906+0000 7f9d29d9b640 1 --2- 172.21.15.18:0/4190256220 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d0c035db0 0x7f9d0c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:05.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.906+0000 7f9d29d9b640 1 --2- 172.21.15.18:0/4190256220 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d0c035db0 0x7f9d0c038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ad000 tx=0x7f9d200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:05.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:05.910+0000 7f9d1affd640 1 -- 172.21.15.18:0/4190256220 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9d1c012400 con 0x7f9d2c06e850 2024-09-13T19:33:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.066+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d2c095640 con 0x7f9d0c035db0 2024-09-13T19:33:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d1affd640 1 -- 172.21.15.18:0/4190256220 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32250 (secure 0 0 0) 0x7f9d2c095640 con 0x7f9d0c035db0 2024-09-13T19:33:06.079 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:33:06.079 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:33:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d0c035db0 msgr2=0x7f9d0c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 --2- 172.21.15.18:0/4190256220 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d0c035db0 0x7f9d0c038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ad000 tx=0x7f9d200a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06e850 msgr2=0x7f9d2c1c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 --2- 172.21.15.18:0/4190256220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06e850 0x7f9d2c1c61b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c450 tx=0x7f9d1c00c910 comp rx=0 tx=0).stop 2024-09-13T19:33:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 shutdown_connections 2024-09-13T19:33:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 --2- 172.21.15.18:0/4190256220 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9d0c035db0 0x7f9d0c038270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 --2- 172.21.15.18:0/4190256220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d2c06e850 0x7f9d2c1c61b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 >> 172.21.15.18:0/4190256220 conn(0x7f9d2c09ac70 msgr2=0x7f9d2c071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 shutdown_connections 2024-09-13T19:33:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.074+0000 7f9d30cf0640 1 -- 172.21.15.18:0/4190256220 wait complete. 2024-09-13T19:33:06.098 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-13T19:33:04.402378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114016,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373344,"statfs":{"total":386547056640,"available":386430304256,"internally_reserved":0,"allocated":1785856,"data_stored":1369754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.892055"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.524558+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:33:02.524558+0000","last_peered":"2024-09-13T19:33:02.524558+0000","last_clean":"2024-09-13T19:33:02.524558+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:33:02.524558+0000","last_undegraded":"2024-09-13T19:33:02.524558+0000","last_fullsized":"2024-09-13T19:33:02.524558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:46.024868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523653+0000","last_change":"2024-09-13T19:33:02.523653+0000","last_active":"2024-09-13T19:33:02.523653+0000","last_peered":"2024-09-13T19:33:02.523653+0000","last_clean":"2024-09-13T19:33:02.523653+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:33:02.523653+0000","last_undegraded":"2024-09-13T19:33:02.523653+0000","last_fullsized":"2024-09-13T19:33:02.523653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:42.749511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523738+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:33:02.523738+0000","last_peered":"2024-09-13T19:33:02.523738+0000","last_clean":"2024-09-13T19:33:02.523738+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:33:02.523738+0000","last_undegraded":"2024-09-13T19:33:02.523738+0000","last_fullsized":"2024-09-13T19:33:02.523738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:56.316476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523552+0000","last_change":"2024-09-13T19:33:02.523552+0000","last_active":"2024-09-13T19:33:02.523552+0000","last_peered":"2024-09-13T19:33:02.523552+0000","last_clean":"2024-09-13T19:33:02.523552+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:33:02.523552+0000","last_undegraded":"2024-09-13T19:33:02.523552+0000","last_fullsized":"2024-09-13T19:33:02.523552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:43.683067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.524797+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:33:02.524797+0000","last_peered":"2024-09-13T19:33:02.524797+0000","last_clean":"2024-09-13T19:33:02.524797+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:33:02.524797+0000","last_undegraded":"2024-09-13T19:33:02.524797+0000","last_fullsized":"2024-09-13T19:33:02.524797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:14.144438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.800896+0000","last_change":"2024-09-13T19:33:02.801369+0000","last_active":"2024-09-13T19:33:02.800896+0000","last_peered":"2024-09-13T19:33:02.800896+0000","last_clean":"2024-09-13T19:33:02.800896+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:33:02.800896+0000","last_undegraded":"2024-09-13T19:33:02.800896+0000","last_fullsized":"2024-09-13T19:33:02.800896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:34.016598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523035+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:33:02.523035+0000","last_peered":"2024-09-13T19:33:02.523035+0000","last_clean":"2024-09-13T19:33:02.523035+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:33:02.523035+0000","last_undegraded":"2024-09-13T19:33:02.523035+0000","last_fullsized":"2024-09-13T19:33:02.523035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.523124+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:33:02.523124+0000","last_peered":"2024-09-13T19:33:02.523124+0000","last_clean":"2024-09-13T19:33:02.523124+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:33:02.523124+0000","last_undegraded":"2024-09-13T19:33:02.523124+0000","last_fullsized":"2024-09-13T19:33:02.523124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:41.432070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:33:02.518273+0000","last_change":"2024-09-13T19:32:57.877961+0000","last_active":"2024-09-13T19:33:02.518273+0000","last_peered":"2024-09-13T19:33:02.518273+0000","last_clean":"2024-09-13T19:33:02.518273+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:33:02.518273+0000","last_undegraded":"2024-09-13T19:33:02.518273+0000","last_fullsized":"2024-09-13T19:33:02.518273+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_clean_scrub_stamp":"2024-09-13T19:32:56.474648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672964,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":47264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":637613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":637613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":47264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:33:06.098 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T19:33:06.099 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T19:33:06.099 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T19:33:06.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T19:33:06.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c8809640 1 Processor -- start 2024-09-13T19:33:06.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c8809640 1 -- start start 2024-09-13T19:33:06.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c8809640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f13c412f390 0x7f13c4133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c8809640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c40984f0 con 0x7f13c412e760 2024-09-13T19:33:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c8809640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f13c4098dc0 con 0x7f13c412f390 2024-09-13T19:33:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c1d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f13c412f390 0x7f13c4133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c259c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f13c412e760 0x7f13c412ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43812/0 (socket says 172.21.15.18:43812) 2024-09-13T19:33:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c259c640 1 -- 172.21.15.18:0/594346666 learned_addr learned my addr 172.21.15.18:0/594346666 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:33:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c1d9b640 1 -- 172.21.15.18:0/594346666 >> v1:172.21.15.18:6789/0 conn(0x7f13c412e760 legacy=0x7f13c412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.202+0000 7f13c1d9b640 1 -- 172.21.15.18:0/594346666 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c40981a0 con 0x7f13c412f390 2024-09-13T19:33:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c1d9b640 1 --2- 172.21.15.18:0/594346666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412f390 0x7f13c4133a80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009740 tx=0x7f13b801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3080b3cee1379be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c159a640 1 -- 172.21.15.18:0/594346666 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b80b1070 con 0x7f13c412f390 2024-09-13T19:33:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c159a640 1 -- 172.21.15.18:0/594346666 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b80ac570 con 0x7f13c412f390 2024-09-13T19:33:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c159a640 1 -- 172.21.15.18:0/594346666 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b80ac870 con 0x7f13c412f390 2024-09-13T19:33:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- 172.21.15.18:0/594346666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412f390 msgr2=0x7f13c4133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 --2- 172.21.15.18:0/594346666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412f390 0x7f13c4133a80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009740 tx=0x7f13b801c400 comp rx=0 tx=0).stop 2024-09-13T19:33:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- 172.21.15.18:0/594346666 shutdown_connections 2024-09-13T19:33:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 --2- 172.21.15.18:0/594346666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412f390 0x7f13c4133a80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- 172.21.15.18:0/594346666 >> 172.21.15.18:0/594346666 conn(0x7f13c40a10a0 msgr2=0x7f13c40a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- 172.21.15.18:0/594346666 shutdown_connections 2024-09-13T19:33:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- 172.21.15.18:0/594346666 wait complete. 2024-09-13T19:33:06.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 Processor -- start 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- start start 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412e760 0x7f13c40963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4136b70 con 0x7f13c412e760 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412e760 0x7f13c40963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412e760 0x7f13c40963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44724/0 (socket says 172.21.15.18:44724) 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c259c640 1 -- 172.21.15.18:0/3178274284 learned_addr learned my addr 172.21.15.18:0/3178274284 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c259c640 1 -- 172.21.15.18:0/3178274284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c4131730 con 0x7f13c412e760 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c259c640 1 --2- 172.21.15.18:0/3178274284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412e760 0x7f13c40963d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f13b400cb20 tx=0x7f13b400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13b2ffd640 1 -- 172.21.15.18:0/3178274284 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b4017070 con 0x7f13c412e760 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13b2ffd640 1 -- 172.21.15.18:0/3178274284 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b400abf0 con 0x7f13c412e760 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c4128f50 con 0x7f13c412e760 2024-09-13T19:33:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13b2ffd640 1 -- 172.21.15.18:0/3178274284 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b4012400 con 0x7f13c412e760 2024-09-13T19:33:06.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.206+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c4131da0 con 0x7f13c412e760 2024-09-13T19:33:06.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.210+0000 7f13b2ffd640 1 -- 172.21.15.18:0/3178274284 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f13b401a070 con 0x7f13c412e760 2024-09-13T19:33:06.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.210+0000 7f13b2ffd640 1 --2- 172.21.15.18:0/3178274284 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13a4035e00 0x7f13a40382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:06.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.210+0000 7f13b2ffd640 1 -- 172.21.15.18:0/3178274284 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f13b4048480 con 0x7f13c412e760 2024-09-13T19:33:06.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.210+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c412de00 con 0x7f13c412e760 2024-09-13T19:33:06.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.210+0000 7f13c1d9b640 1 --2- 172.21.15.18:0/3178274284 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13a4035e00 0x7f13a40382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:06.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.210+0000 7f13c1d9b640 1 --2- 172.21.15.18:0/3178274284 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13a4035e00 0x7f13a40382c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f13b80ae000 tx=0x7f13b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:06.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.214+0000 7f13b2ffd640 1 -- 172.21.15.18:0/3178274284 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f13c4131730 con 0x7f13c412e760 2024-09-13T19:33:06.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f13c412ec80 con 0x7f13c412e760 2024-09-13T19:33:06.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13b2ffd640 1 -- 172.21.15.18:0/3178274284 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f13b40113a0 con 0x7f13c412e760 2024-09-13T19:33:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:33:06.413 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T19:33:06.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13a4035e00 msgr2=0x7f13a40382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 --2- 172.21.15.18:0/3178274284 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13a4035e00 0x7f13a40382c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f13b80ae000 tx=0x7f13b8008040 comp rx=0 tx=0).stop 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412e760 msgr2=0x7f13c40963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 --2- 172.21.15.18:0/3178274284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412e760 0x7f13c40963d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f13b400cb20 tx=0x7f13b400a060 comp rx=0 tx=0).stop 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 shutdown_connections 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 --2- 172.21.15.18:0/3178274284 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13a4035e00 0x7f13a40382c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 --2- 172.21.15.18:0/3178274284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13c412e760 0x7f13c40963d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 >> 172.21.15.18:0/3178274284 conn(0x7f13c40a10a0 msgr2=0x7f13c40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 shutdown_connections 2024-09-13T19:33:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:33:06.406+0000 7f13c8809640 1 -- 172.21.15.18:0/3178274284 wait complete. 2024-09-13T19:33:06.431 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T19:33:06.432 INFO:teuthology.run_tasks:Running task rgw... 2024-09-13T19:33:06.447 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-13T19:33:06.447 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-13T19:33:06.447 INFO:tasks.rgw:Creating data pools 2024-09-13T19:33:06.447 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-13T19:33:06.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-13T19:33:06.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b585e8640 1 Processor -- start 2024-09-13T19:33:06.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b585e8640 1 -- start start 2024-09-13T19:33:06.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b585e8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b50116050 0x7f3b50113f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:06.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b585e8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b501145b0 con 0x7f3b50115b80 2024-09-13T19:33:06.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b585e8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3b50122cf0 con 0x7f3b50116050 2024-09-13T19:33:06.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b55b83640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b50116050 0x7f3b50113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:06.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b56384640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3b50115b80 0x7f3b50113870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:56390/0 (socket says 172.21.15.144:56390) 2024-09-13T19:33:06.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b56384640 1 -- 172.21.15.144:0/2217537194 learned_addr learned my addr 172.21.15.144:0/2217537194 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:06.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b55b83640 1 -- 172.21.15.144:0/2217537194 >> v1:172.21.15.18:6789/0 conn(0x7f3b50115b80 legacy=0x7f3b50113870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:06.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.580+0000 7f3b55b83640 1 -- 172.21.15.144:0/2217537194 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b50122e70 con 0x7f3b50116050 2024-09-13T19:33:06.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b55b83640 1 --2- 172.21.15.144:0/2217537194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50116050 0x7f3b50113f80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009740 tx=0x7f3b4001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc806288cfadd28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:06.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b55382640 1 -- 172.21.15.144:0/2217537194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b400b1070 con 0x7f3b50116050 2024-09-13T19:33:06.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b55382640 1 -- 172.21.15.144:0/2217537194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b400ac520 con 0x7f3b50116050 2024-09-13T19:33:06.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b55382640 1 -- 172.21.15.144:0/2217537194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b400ac820 con 0x7f3b50116050 2024-09-13T19:33:06.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 -- 172.21.15.144:0/2217537194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50116050 msgr2=0x7f3b50113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:06.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 --2- 172.21.15.144:0/2217537194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50116050 0x7f3b50113f80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009740 tx=0x7f3b4001c370 comp rx=0 tx=0).stop 2024-09-13T19:33:06.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 -- 172.21.15.144:0/2217537194 shutdown_connections 2024-09-13T19:33:06.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 --2- 172.21.15.144:0/2217537194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50116050 0x7f3b50113f80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:06.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 -- 172.21.15.144:0/2217537194 >> 172.21.15.144:0/2217537194 conn(0x7f3b5006f390 msgr2=0x7f3b500717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:06.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 -- 172.21.15.144:0/2217537194 shutdown_connections 2024-09-13T19:33:06.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 -- 172.21.15.144:0/2217537194 wait complete. 2024-09-13T19:33:06.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 Processor -- start 2024-09-13T19:33:06.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 -- start start 2024-09-13T19:33:06.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50115b80 0x7f3b501b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:06.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b585e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b501133a0 con 0x7f3b50115b80 2024-09-13T19:33:06.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b56384640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50115b80 0x7f3b501b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b56384640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50115b80 0x7f3b501b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37174/0 (socket says 172.21.15.144:37174) 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b56384640 1 -- 172.21.15.144:0/2997429081 learned_addr learned my addr 172.21.15.144:0/2997429081 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.584+0000 7f3b56384640 1 -- 172.21.15.144:0/2997429081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b501b3930 con 0x7f3b50115b80 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b56384640 1 --2- 172.21.15.144:0/2997429081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50115b80 0x7f3b501b3360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800ca90 tx=0x7f3b4800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b46ffd640 1 -- 172.21.15.144:0/2997429081 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b48018070 con 0x7f3b50115b80 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b46ffd640 1 -- 172.21.15.144:0/2997429081 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b48004ca0 con 0x7f3b50115b80 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b501b3bc0 con 0x7f3b50115b80 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b46ffd640 1 -- 172.21.15.144:0/2997429081 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b4800aa50 con 0x7f3b50115b80 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b501ad5d0 con 0x7f3b50115b80 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b50113870 con 0x7f3b50115b80 2024-09-13T19:33:06.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b46ffd640 1 -- 172.21.15.144:0/2997429081 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b4801b070 con 0x7f3b50115b80 2024-09-13T19:33:06.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b46ffd640 1 --2- 172.21.15.144:0/2997429081 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3b34035e00 0x7f3b340382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:06.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b46ffd640 1 -- 172.21.15.144:0/2997429081 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f3b480486e0 con 0x7f3b50115b80 2024-09-13T19:33:06.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b55b83640 1 --2- 172.21.15.144:0/2997429081 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3b34035e00 0x7f3b340382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:06.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.588+0000 7f3b55b83640 1 --2- 172.21.15.144:0/2997429081 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3b34035e00 0x7f3b340382c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3b400ae000 tx=0x7f3b40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:06.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.600+0000 7f3b46ffd640 1 -- 172.21.15.144:0/2997429081 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3b48011e80 con 0x7f3b50115b80 2024-09-13T19:33:06.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:06.756+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f3b501b3df0 con 0x7f3b50115b80 2024-09-13T19:33:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.528+0000 7f3b46ffd640 1 -- 172.21.15.144:0/2997429081 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v18) ==== 167+0+0 (secure 0 0 0) 0x7f3b480465c0 con 0x7f3b50115b80 2024-09-13T19:33:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'default.rgw.buckets.data' created 2024-09-13T19:33:07.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3b34035e00 msgr2=0x7f3b340382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:07.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 --2- 172.21.15.144:0/2997429081 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3b34035e00 0x7f3b340382c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3b400ae000 tx=0x7f3b40008040 comp rx=0 tx=0).stop 2024-09-13T19:33:07.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50115b80 msgr2=0x7f3b501b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:07.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 --2- 172.21.15.144:0/2997429081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50115b80 0x7f3b501b3360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800ca90 tx=0x7f3b4800cf50 comp rx=0 tx=0).stop 2024-09-13T19:33:07.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 shutdown_connections 2024-09-13T19:33:07.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 --2- 172.21.15.144:0/2997429081 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3b34035e00 0x7f3b340382c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:07.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 --2- 172.21.15.144:0/2997429081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b50115b80 0x7f3b501b3360 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:07.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 >> 172.21.15.144:0/2997429081 conn(0x7f3b5006f390 msgr2=0x7f3b50110320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:07.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 shutdown_connections 2024-09-13T19:33:07.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.536+0000 7f3b585e8640 1 -- 172.21.15.144:0/2997429081 wait complete. 2024-09-13T19:33:07.566 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-13T19:33:07.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4f717640 1 Processor -- start 2024-09-13T19:33:07.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4f717640 1 -- start start 2024-09-13T19:33:07.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4f717640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c4810f880 0x7f2c4811b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:07.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4f717640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4811b660 con 0x7f2c4810ed90 2024-09-13T19:33:07.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4f717640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4811c840 con 0x7f2c4810f880 2024-09-13T19:33:07.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4ccb2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c4810f880 0x7f2c4811b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:07.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4d4b3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2c4810ed90 0x7f2c4810f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:56402/0 (socket says 172.21.15.144:56402) 2024-09-13T19:33:07.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4d4b3640 1 -- 172.21.15.144:0/1443811502 learned_addr learned my addr 172.21.15.144:0/1443811502 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:07.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c3ffff640 1 -- 172.21.15.144:0/1443811502 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008256698 0 0) 0x7f2c4811b660 con 0x7f2c4810ed90 2024-09-13T19:33:07.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c3ffff640 1 -- 172.21.15.144:0/1443811502 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c34003530 con 0x7f2c4810ed90 2024-09-13T19:33:07.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4ccb2640 1 -- 172.21.15.144:0/1443811502 >> v1:172.21.15.18:6789/0 conn(0x7f2c4810ed90 legacy=0x7f2c4810f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:07.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.688+0000 7f2c4ccb2640 1 -- 172.21.15.144:0/1443811502 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4811c9c0 con 0x7f2c4810f880 2024-09-13T19:33:07.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4ccb2640 1 --2- 172.21.15.144:0/1443811502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810f880 0x7f2c4811b120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009740 tx=0x7f2c3801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3068c8479d026cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:07.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c3ffff640 1 -- 172.21.15.144:0/1443811502 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c380b1070 con 0x7f2c4810f880 2024-09-13T19:33:07.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c3ffff640 1 -- 172.21.15.144:0/1443811502 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c380ac520 con 0x7f2c4810f880 2024-09-13T19:33:07.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c3ffff640 1 -- 172.21.15.144:0/1443811502 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c380ac800 con 0x7f2c4810f880 2024-09-13T19:33:07.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 -- 172.21.15.144:0/1443811502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810f880 msgr2=0x7f2c4811b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:07.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 --2- 172.21.15.144:0/1443811502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810f880 0x7f2c4811b120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009740 tx=0x7f2c3801c370 comp rx=0 tx=0).stop 2024-09-13T19:33:07.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 -- 172.21.15.144:0/1443811502 shutdown_connections 2024-09-13T19:33:07.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 --2- 172.21.15.144:0/1443811502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810f880 0x7f2c4811b120 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:07.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 -- 172.21.15.144:0/1443811502 >> 172.21.15.144:0/1443811502 conn(0x7f2c4806f390 msgr2=0x7f2c480717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:07.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 -- 172.21.15.144:0/1443811502 shutdown_connections 2024-09-13T19:33:07.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 -- 172.21.15.144:0/1443811502 wait complete. 2024-09-13T19:33:07.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 Processor -- start 2024-09-13T19:33:07.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 -- start start 2024-09-13T19:33:07.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810ed90 0x7f2c481acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:07.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4f717640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4811c490 con 0x7f2c4810ed90 2024-09-13T19:33:07.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4d4b3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810ed90 0x7f2c481acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:07.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4d4b3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810ed90 0x7f2c481acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37198/0 (socket says 172.21.15.144:37198) 2024-09-13T19:33:07.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.692+0000 7f2c4d4b3640 1 -- 172.21.15.144:0/3487455316 learned_addr learned my addr 172.21.15.144:0/3487455316 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c4d4b3640 1 -- 172.21.15.144:0/3487455316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c481ad150 con 0x7f2c4810ed90 2024-09-13T19:33:07.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c4d4b3640 1 --2- 172.21.15.144:0/3487455316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810ed90 0x7f2c481acb80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c3d0 tx=0x7f2c4400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c3dffb640 1 -- 172.21.15.144:0/3487455316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c44017070 con 0x7f2c4810ed90 2024-09-13T19:33:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c481ad3e0 con 0x7f2c4810ed90 2024-09-13T19:33:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c3dffb640 1 -- 172.21.15.144:0/3487455316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c44005ce0 con 0x7f2c4810ed90 2024-09-13T19:33:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c3dffb640 1 -- 172.21.15.144:0/3487455316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c440070d0 con 0x7f2c4810ed90 2024-09-13T19:33:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c481a6df0 con 0x7f2c4810ed90 2024-09-13T19:33:07.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4810f170 con 0x7f2c4810ed90 2024-09-13T19:33:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c3dffb640 1 -- 172.21.15.144:0/3487455316 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2c4401a070 con 0x7f2c4810ed90 2024-09-13T19:33:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c3dffb640 1 --2- 172.21.15.144:0/3487455316 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2c2c035d60 0x7f2c2c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c3dffb640 1 -- 172.21.15.144:0/3487455316 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3873+0+0 (secure 0 0 0) 0x7f2c440480c0 con 0x7f2c4810ed90 2024-09-13T19:33:07.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c4ccb2640 1 --2- 172.21.15.144:0/3487455316 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2c2c035d60 0x7f2c2c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:07.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.696+0000 7f2c4ccb2640 1 --2- 172.21.15.144:0/3487455316 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2c2c035d60 0x7f2c2c038220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c380ae000 tx=0x7f2c38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:07.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.712+0000 7f2c3dffb640 1 -- 172.21.15.144:0/3487455316 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2c44021020 con 0x7f2c4810ed90 2024-09-13T19:33:07.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:07.876+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f2c481ad610 con 0x7f2c4810ed90 2024-09-13T19:33:08.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.308+0000 7f2c3dffb640 1 -- 172.21.15.144:0/3487455316 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7f2c44010950 con 0x7f2c4810ed90 2024-09-13T19:33:08.310 INFO:teuthology.orchestra.run.smithi144.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-13T19:33:08.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.312+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2c2c035d60 msgr2=0x7f2c2c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:08.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.312+0000 7f2c4f717640 1 --2- 172.21.15.144:0/3487455316 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2c2c035d60 0x7f2c2c038220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c380ae000 tx=0x7f2c38008040 comp rx=0 tx=0).stop 2024-09-13T19:33:08.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.312+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810ed90 msgr2=0x7f2c481acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:08.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.312+0000 7f2c4f717640 1 --2- 172.21.15.144:0/3487455316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810ed90 0x7f2c481acb80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c3d0 tx=0x7f2c4400c890 comp rx=0 tx=0).stop 2024-09-13T19:33:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.312+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 shutdown_connections 2024-09-13T19:33:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.312+0000 7f2c4f717640 1 --2- 172.21.15.144:0/3487455316 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2c2c035d60 0x7f2c2c038220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.312+0000 7f2c4f717640 1 --2- 172.21.15.144:0/3487455316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c4810ed90 0x7f2c481acb80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.312+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 >> 172.21.15.144:0/3487455316 conn(0x7f2c4806f390 msgr2=0x7f2c4811a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:08.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.316+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 shutdown_connections 2024-09-13T19:33:08.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.316+0000 7f2c4f717640 1 -- 172.21.15.144:0/3487455316 wait complete. 2024-09-13T19:33:08.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-13T19:33:08.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7f5fd2640 1 Processor -- start 2024-09-13T19:33:08.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7f5fd2640 1 -- start start 2024-09-13T19:33:08.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7f5fd2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd7f0117f60 0x7fd7f0118340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:08.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7f5fd2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7f0118a00 con 0x7fd7f0111db0 2024-09-13T19:33:08.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7f5fd2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd7f0112950 con 0x7fd7f0117f60 2024-09-13T19:33:08.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7ef7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd7f0117f60 0x7fd7f0118340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:08.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7ef7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd7f0117f60 0x7fd7f0118340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37208/0 (socket says 172.21.15.144:37208) 2024-09-13T19:33:08.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7ef7fe640 1 -- 172.21.15.144:0/3709068228 learned_addr learned my addr 172.21.15.144:0/3709068228 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:08.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7eeffd640 1 --1- 172.21.15.144:0/3709068228 >> v1:172.21.15.18:6789/0 conn(0x7fd7f0111db0 0x7fd7f0112240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:56404/0 (socket says 172.21.15.144:56404) 2024-09-13T19:33:08.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7ef7fe640 1 -- 172.21.15.144:0/3709068228 >> v1:172.21.15.18:6789/0 conn(0x7fd7f0111db0 legacy=0x7fd7f0112240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:08.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.472+0000 7fd7ef7fe640 1 -- 172.21.15.144:0/3709068228 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f0112b00 con 0x7fd7f0117f60 2024-09-13T19:33:08.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ef7fe640 1 --2- 172.21.15.144:0/3709068228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0117f60 0x7fd7f0118340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80097f0 tx=0x7fd7e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd92fe1ba493f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:08.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ee7fc640 1 -- 172.21.15.144:0/3709068228 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7e80ab580 con 0x7fd7f0117f60 2024-09-13T19:33:08.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ee7fc640 1 -- 172.21.15.144:0/3709068228 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7e80b0070 con 0x7fd7f0117f60 2024-09-13T19:33:08.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ee7fc640 1 -- 172.21.15.144:0/3709068228 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7e80ab870 con 0x7fd7f0117f60 2024-09-13T19:33:08.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/3709068228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0117f60 msgr2=0x7fd7f0118340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:08.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 --2- 172.21.15.144:0/3709068228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0117f60 0x7fd7f0118340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80097f0 tx=0x7fd7e801c430 comp rx=0 tx=0).stop 2024-09-13T19:33:08.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/3709068228 shutdown_connections 2024-09-13T19:33:08.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 --2- 172.21.15.144:0/3709068228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0117f60 0x7fd7f0118340 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:08.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/3709068228 >> 172.21.15.144:0/3709068228 conn(0x7fd7f006e6f0 msgr2=0x7fd7f006eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:08.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/3709068228 shutdown_connections 2024-09-13T19:33:08.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/3709068228 wait complete. 2024-09-13T19:33:08.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 Processor -- start 2024-09-13T19:33:08.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 -- start start 2024-09-13T19:33:08.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0111db0 0x7fd7f01aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:08.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7f5fd2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0120910 con 0x7fd7f0111db0 2024-09-13T19:33:08.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ef7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0111db0 0x7fd7f01aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:08.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ef7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0111db0 0x7fd7f01aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37212/0 (socket says 172.21.15.144:37212) 2024-09-13T19:33:08.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ef7fe640 1 -- 172.21.15.144:0/942486924 learned_addr learned my addr 172.21.15.144:0/942486924 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ef7fe640 1 -- 172.21.15.144:0/942486924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f01af490 con 0x7fd7f0111db0 2024-09-13T19:33:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.476+0000 7fd7ef7fe640 1 --2- 172.21.15.144:0/942486924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0111db0 0x7fd7f01aeec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80ad040 tx=0x7fd7e801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7e7fff640 1 -- 172.21.15.144:0/942486924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7e80aa7f0 con 0x7fd7f0111db0 2024-09-13T19:33:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f01af6c0 con 0x7fd7f0111db0 2024-09-13T19:33:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7e7fff640 1 -- 172.21.15.144:0/942486924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7e80aa990 con 0x7fd7f0111db0 2024-09-13T19:33:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f01a8f60 con 0x7fd7f0111db0 2024-09-13T19:33:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7e7fff640 1 -- 172.21.15.144:0/942486924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7e80aac70 con 0x7fd7f0111db0 2024-09-13T19:33:08.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f01183c0 con 0x7fd7f0111db0 2024-09-13T19:33:08.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7e7fff640 1 -- 172.21.15.144:0/942486924 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd7e80be3f0 con 0x7fd7f0111db0 2024-09-13T19:33:08.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7e7fff640 1 --2- 172.21.15.144:0/942486924 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd7d4035d60 0x7fd7d4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:08.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7e7fff640 1 -- 172.21.15.144:0/942486924 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3884+0+0 (secure 0 0 0) 0x7fd7e80e37e0 con 0x7fd7f0111db0 2024-09-13T19:33:08.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7eeffd640 1 --2- 172.21.15.144:0/942486924 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd7d4035d60 0x7fd7d4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:08.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.480+0000 7fd7eeffd640 1 --2- 172.21.15.144:0/942486924 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd7d4035d60 0x7fd7d4038220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8000f70 tx=0x7fd7d8007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:08.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.492+0000 7fd7e7fff640 1 -- 172.21.15.144:0/942486924 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd7e80160b0 con 0x7fd7f0111db0 2024-09-13T19:33:08.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:08.656+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fd7f0117f60 con 0x7fd7f0111db0 2024-09-13T19:33:09.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.316+0000 7fd7e7fff640 1 -- 172.21.15.144:0/942486924 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7fd7e80c6790 con 0x7fd7f0111db0 2024-09-13T19:33:09.319 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'default.rgw.buckets.index' created 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd7d4035d60 msgr2=0x7fd7d4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 --2- 172.21.15.144:0/942486924 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd7d4035d60 0x7fd7d4038220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8000f70 tx=0x7fd7d8007a90 comp rx=0 tx=0).stop 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0111db0 msgr2=0x7fd7f01aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 --2- 172.21.15.144:0/942486924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0111db0 0x7fd7f01aeec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80ad040 tx=0x7fd7e801ac70 comp rx=0 tx=0).stop 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 shutdown_connections 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 --2- 172.21.15.144:0/942486924 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd7d4035d60 0x7fd7d4038220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 --2- 172.21.15.144:0/942486924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7f0111db0 0x7fd7f01aeec0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 >> 172.21.15.144:0/942486924 conn(0x7fd7f006e6f0 msgr2=0x7fd7f0118bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 shutdown_connections 2024-09-13T19:33:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.320+0000 7fd7f5fd2640 1 -- 172.21.15.144:0/942486924 wait complete. 2024-09-13T19:33:09.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-13T19:33:09.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f0722743640 1 Processor -- start 2024-09-13T19:33:09.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f0722743640 1 -- start start 2024-09-13T19:33:09.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f0722743640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f071c1171c0 0x7f071c1195b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:09.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f0722743640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f071c119af0 con 0x7f071c114450 2024-09-13T19:33:09.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f0722743640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f071c11acd0 con 0x7f071c1171c0 2024-09-13T19:33:09.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f071b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f071c1171c0 0x7f071c1195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:09.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f071b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f071c1171c0 0x7f071c1195b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37228/0 (socket says 172.21.15.144:37228) 2024-09-13T19:33:09.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f071b7fe640 1 -- 172.21.15.144:0/3897390841 learned_addr learned my addr 172.21.15.144:0/3897390841 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:09.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f071b7fe640 1 -- 172.21.15.144:0/3897390841 >> v1:172.21.15.18:6789/0 conn(0x7f071c114450 legacy=0x7f071c114830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:09.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.472+0000 7f071b7fe640 1 -- 172.21.15.144:0/3897390841 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c11ae80 con 0x7f071c1171c0 2024-09-13T19:33:09.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f071b7fe640 1 --2- 172.21.15.144:0/3897390841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c1171c0 0x7f071c1195b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0704006fd0 tx=0x7f070401e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7dcc4ae5eae25d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:09.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f071affd640 1 -- 172.21.15.144:0/3897390841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07040ad070 con 0x7f071c1171c0 2024-09-13T19:33:09.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f071affd640 1 -- 172.21.15.144:0/3897390841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0704004160 con 0x7f071c1171c0 2024-09-13T19:33:09.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f071affd640 1 -- 172.21.15.144:0/3897390841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07040044c0 con 0x7f071c1171c0 2024-09-13T19:33:09.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 -- 172.21.15.144:0/3897390841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c1171c0 msgr2=0x7f071c1195b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:09.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 --2- 172.21.15.144:0/3897390841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c1171c0 0x7f071c1195b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0704006fd0 tx=0x7f070401e8e0 comp rx=0 tx=0).stop 2024-09-13T19:33:09.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 -- 172.21.15.144:0/3897390841 shutdown_connections 2024-09-13T19:33:09.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 --2- 172.21.15.144:0/3897390841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c1171c0 0x7f071c1195b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:09.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 -- 172.21.15.144:0/3897390841 >> 172.21.15.144:0/3897390841 conn(0x7f071c06f390 msgr2=0x7f071c0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:09.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 -- 172.21.15.144:0/3897390841 shutdown_connections 2024-09-13T19:33:09.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 -- 172.21.15.144:0/3897390841 wait complete. 2024-09-13T19:33:09.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 Processor -- start 2024-09-13T19:33:09.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.476+0000 7f0722743640 1 -- start start 2024-09-13T19:33:09.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0722743640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c114450 0x7f071c1ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:09.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0722743640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f071c11a9f0 con 0x7f071c114450 2024-09-13T19:33:09.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f071bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c114450 0x7f071c1ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:09.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f071bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c114450 0x7f071c1ab370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37238/0 (socket says 172.21.15.144:37238) 2024-09-13T19:33:09.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f071bfff640 1 -- 172.21.15.144:0/3961117912 learned_addr learned my addr 172.21.15.144:0/3961117912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:09.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f071bfff640 1 -- 172.21.15.144:0/3961117912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c1ab940 con 0x7f071c114450 2024-09-13T19:33:09.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f071bfff640 1 --2- 172.21.15.144:0/3961117912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c114450 0x7f071c1ab370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c3a0 tx=0x7f070c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0718ff9640 1 -- 172.21.15.144:0/3961117912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f070c005150 con 0x7f071c114450 2024-09-13T19:33:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0718ff9640 1 -- 172.21.15.144:0/3961117912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c0052f0 con 0x7f071c114450 2024-09-13T19:33:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071c1abbd0 con 0x7f071c114450 2024-09-13T19:33:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0718ff9640 1 -- 172.21.15.144:0/3961117912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f070c0067e0 con 0x7f071c114450 2024-09-13T19:33:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071c1a5660 con 0x7f071c114450 2024-09-13T19:33:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f071c114830 con 0x7f071c114450 2024-09-13T19:33:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0718ff9640 1 -- 172.21.15.144:0/3961117912 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f070c019020 con 0x7f071c114450 2024-09-13T19:33:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.480+0000 7f0718ff9640 1 --2- 172.21.15.144:0/3961117912 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06fc035d60 0x7f06fc038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.484+0000 7f0718ff9640 1 -- 172.21.15.144:0/3961117912 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4220+0+0 (secure 0 0 0) 0x7f070c047f30 con 0x7f071c114450 2024-09-13T19:33:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.484+0000 7f071b7fe640 1 --2- 172.21.15.144:0/3961117912 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06fc035d60 0x7f06fc038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.484+0000 7f071b7fe640 1 --2- 172.21.15.144:0/3961117912 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06fc035d60 0x7f06fc038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07040b1000 tx=0x7f07040a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:09.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.496+0000 7f0718ff9640 1 -- 172.21.15.144:0/3961117912 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f070c01a560 con 0x7f071c114450 2024-09-13T19:33:09.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:09.660+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f071c1abe70 con 0x7f071c114450 2024-09-13T19:33:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.316+0000 7f0718ff9640 1 -- 172.21.15.144:0/3961117912 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7f071c1abe70 con 0x7f071c114450 2024-09-13T19:33:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-13T19:33:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.320+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06fc035d60 msgr2=0x7f06fc038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.320+0000 7f0722743640 1 --2- 172.21.15.144:0/3961117912 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06fc035d60 0x7f06fc038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07040b1000 tx=0x7f07040a9070 comp rx=0 tx=0).stop 2024-09-13T19:33:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.320+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c114450 msgr2=0x7f071c1ab370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.320+0000 7f0722743640 1 --2- 172.21.15.144:0/3961117912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c114450 0x7f071c1ab370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c3a0 tx=0x7f070c00c860 comp rx=0 tx=0).stop 2024-09-13T19:33:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.324+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 shutdown_connections 2024-09-13T19:33:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.324+0000 7f0722743640 1 --2- 172.21.15.144:0/3961117912 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06fc035d60 0x7f06fc038220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.324+0000 7f0722743640 1 --2- 172.21.15.144:0/3961117912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f071c114450 0x7f071c1ab370 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.324+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 >> 172.21.15.144:0/3961117912 conn(0x7f071c06f390 msgr2=0x7f071c1179a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.332+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 shutdown_connections 2024-09-13T19:33:10.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:10.332+0000 7f0722743640 1 -- 172.21.15.144:0/3961117912 wait complete. 2024-09-13T19:33:10.372 DEBUG:tasks.rgw:Pools created 2024-09-13T19:33:10.372 INFO:tasks.rgw:Starting rgw... 2024-09-13T19:33:10.372 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-13T19:33:10.372 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-13T19:33:10.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo echo -n http://smithi144.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-13T19:33:10.385 INFO:teuthology.orchestra.run.smithi144.stdout:http://smithi144.front.sepia.ceph.com:80 2024-09-13T19:33:10.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-13T19:33:10.442 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-13T19:33:10.442 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-13T19:33:10.486 INFO:tasks.rgw.client.0:Started 2024-09-13T19:33:10.486 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi144.front.sepia.ceph.com:80/ 2024-09-13T19:33:10.486 DEBUG:teuthology.orchestra.run.smithi144:> curl http://smithi144.front.sepia.ceph.com:80/ 2024-09-13T19:33:10.521 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:33:10.521 INFO:teuthology.orchestra.run.smithi144.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:33:10.521 INFO:teuthology.orchestra.run.smithi144.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:33:10.521 INFO:teuthology.orchestra.run.smithi144.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:33:10.521 INFO:teuthology.orchestra.run.smithi144.stderr:curl: (7) Failed to connect to smithi144.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T19:33:11.522 DEBUG:teuthology.orchestra.run.smithi144:> curl http://smithi144.front.sepia.ceph.com:80/ 2024-09-13T19:33:11.534 INFO:teuthology.orchestra.run.smithi144.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:33:11.534 INFO:teuthology.orchestra.run.smithi144.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:33:11.534 INFO:teuthology.orchestra.run.smithi144.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:33:11.534 INFO:teuthology.orchestra.run.smithi144.stderr:curl: (7) Failed to connect to smithi144.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T19:33:11.535 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:33:13.536 DEBUG:teuthology.orchestra.run.smithi144:> curl http://smithi144.front.sepia.ceph.com:80/ 2024-09-13T19:33:13.548 INFO:teuthology.orchestra.run.smithi144.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:33:13.548 INFO:teuthology.orchestra.run.smithi144.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:33:13.548 INFO:teuthology.orchestra.run.smithi144.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:33:13.548 INFO:teuthology.orchestra.run.smithi144.stderr:curl: (7) Failed to connect to smithi144.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T19:33:13.549 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:33:17.550 DEBUG:teuthology.orchestra.run.smithi144:> curl http://smithi144.front.sepia.ceph.com:80/ 2024-09-13T19:33:17.562 INFO:teuthology.orchestra.run.smithi144.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:33:17.562 INFO:teuthology.orchestra.run.smithi144.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:33:17.562 INFO:teuthology.orchestra.run.smithi144.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:33:17.562 INFO:teuthology.orchestra.run.smithi144.stderr:curl: (7) Failed to connect to smithi144.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T19:33:17.563 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:33:19.527 INFO:tasks.rgw.client.0.smithi144.stdout:2024-09-13T19:33:19.523+0000 7f73d527da40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-13T19:33:25.564 DEBUG:teuthology.orchestra.run.smithi144:> curl http://smithi144.front.sepia.ceph.com:80/ 2024-09-13T19:33:25.576 INFO:teuthology.orchestra.run.smithi144.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:33:25.576 INFO:teuthology.orchestra.run.smithi144.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:33:25.580 INFO:teuthology.orchestra.run.smithi144.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 48121 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-13T19:33:25.581 INFO:teuthology.orchestra.run.smithi144.stdout:anonymous 2024-09-13T19:33:25.581 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-13T19:33:25.844 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-13T19:33:25.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T19:33:25.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T19:33:25.844 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T19:33:25.882 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:25.882 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:25.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa6730ca980 1 Processor -- start 2024-09-13T19:33:25.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa6730ca980 1 -- start start 2024-09-13T19:33:25.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa6730ca980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a86c8d88d0 0x55a86c8d8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa6730ca980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a86c75eae0 con 0x55a86c8d9220 2024-09-13T19:33:25.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa6730ca980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55a86c782e30 con 0x55a86c8d88d0 2024-09-13T19:33:25.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa670bda640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a86c8d88d0 0x55a86c8d8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa670bda640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a86c8d88d0 0x55a86c8d8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48140/0 (socket says 172.21.15.144:48140) 2024-09-13T19:33:25.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa670bda640 1 -- 172.21.15.144:0/545202824 learned_addr learned my addr 172.21.15.144:0/545202824 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:25.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.879+0000 7fa6703d9640 1 --1- 172.21.15.144:0/545202824 >> v1:172.21.15.18:6789/0 conn(0x55a86c8d9220 0x55a86c8ddc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42174/0 (socket says 172.21.15.144:42174) 2024-09-13T19:33:25.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.883+0000 7fa670bda640 1 -- 172.21.15.144:0/545202824 >> v1:172.21.15.18:6789/0 conn(0x55a86c8d9220 legacy=0x55a86c8ddc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:25.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.883+0000 7fa670bda640 1 -- 172.21.15.144:0/545202824 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86c8e04a0 con 0x55a86c8d88d0 2024-09-13T19:33:25.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.883+0000 7fa670bda640 1 --2- 172.21.15.144:0/545202824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c8d8cb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa66000a5c0 tx=0x7fa66001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3c6a5d67e86e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.883+0000 7fa66fbd8640 1 -- 172.21.15.144:0/545202824 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6600a6070 con 0x55a86c8d88d0 2024-09-13T19:33:25.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.883+0000 7fa66fbd8640 1 -- 172.21.15.144:0/545202824 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6600af070 con 0x55a86c8d88d0 2024-09-13T19:33:25.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.883+0000 7fa66fbd8640 1 -- 172.21.15.144:0/545202824 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6600aa5c0 con 0x55a86c8d88d0 2024-09-13T19:33:25.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.883+0000 7fa6730ca980 1 -- 172.21.15.144:0/545202824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 msgr2=0x55a86c8d8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:25.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.883+0000 7fa6730ca980 1 --2- 172.21.15.144:0/545202824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c8d8cb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa66000a5c0 tx=0x7fa66001b340 comp rx=0 tx=0).stop 2024-09-13T19:33:25.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.887+0000 7fa6730ca980 1 -- 172.21.15.144:0/545202824 shutdown_connections 2024-09-13T19:33:25.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.887+0000 7fa6730ca980 1 --2- 172.21.15.144:0/545202824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c8d8cb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:25.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.887+0000 7fa6730ca980 1 -- 172.21.15.144:0/545202824 >> 172.21.15.144:0/545202824 conn(0x55a86c84c220 msgr2=0x55a86c84c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:25.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.887+0000 7fa6730ca980 1 -- 172.21.15.144:0/545202824 shutdown_connections 2024-09-13T19:33:25.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.887+0000 7fa6730ca980 1 -- 172.21.15.144:0/545202824 wait complete. 2024-09-13T19:33:25.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.899+0000 7fa6730ca980 1 Processor -- start 2024-09-13T19:33:25.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.899+0000 7fa6730ca980 1 -- start start 2024-09-13T19:33:25.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.899+0000 7fa6730ca980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.899+0000 7fa6730ca980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a86c784200 con 0x55a86c8d88d0 2024-09-13T19:33:25.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48144/0 (socket says 172.21.15.144:48144) 2024-09-13T19:33:25.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 -- 172.21.15.144:0/1481149749 learned_addr learned my addr 172.21.15.144:0/1481149749 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:25.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 -- 172.21.15.144:0/1481149749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86c9c4190 con 0x55a86c8d88d0 2024-09-13T19:33:25.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 --2- 172.21.15.144:0/1481149749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9c3bc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa6600199f0 tx=0x7fa660003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e37ca38889f767 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa55ee0d640 1 -- 172.21.15.144:0/1481149749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6600aaa00 con 0x55a86c8d88d0 2024-09-13T19:33:25.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa55ee0d640 1 -- 172.21.15.144:0/1481149749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6600aaba0 con 0x55a86c8d88d0 2024-09-13T19:33:25.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa55ee0d640 1 -- 172.21.15.144:0/1481149749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6600bd3f0 con 0x55a86c8d88d0 2024-09-13T19:33:25.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 -- 172.21.15.144:0/1481149749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 msgr2=0x55a86c9c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:25.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1481149749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9c3bc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa6600199f0 tx=0x7fa660003030 comp rx=0 tx=0).stop 2024-09-13T19:33:25.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 -- 172.21.15.144:0/1481149749 shutdown_connections 2024-09-13T19:33:25.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1481149749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9c3bc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:25.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 -- 172.21.15.144:0/1481149749 >> 172.21.15.144:0/1481149749 conn(0x55a86c84c220 msgr2=0x55a86c9bf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 -- 172.21.15.144:0/1481149749 shutdown_connections 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 -- 172.21.15.144:0/1481149749 wait complete. 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 Processor -- start 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 -- start start 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa6730ca980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a86c8dfee0 con 0x55a86c8d88d0 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48158/0 (socket says 172.21.15.144:48158) 2024-09-13T19:33:25.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 -- 172.21.15.144:0/1623893575 learned_addr learned my addr 172.21.15.144:0/1623893575 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:25.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.903+0000 7fa670bda640 1 -- 172.21.15.144:0/1623893575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86c9cb370 con 0x55a86c8d88d0 2024-09-13T19:33:25.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa670bda640 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9cae30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa6600199f0 tx=0x7fa6600180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa55d60a640 1 -- 172.21.15.144:0/1623893575 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6600bd7c0 con 0x55a86c8d88d0 2024-09-13T19:33:25.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa55d60a640 1 -- 172.21.15.144:0/1623893575 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6600bd960 con 0x55a86c8d88d0 2024-09-13T19:33:25.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a86c9cb600 con 0x55a86c8d88d0 2024-09-13T19:33:25.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa55d60a640 1 -- 172.21.15.144:0/1623893575 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6600bdc40 con 0x55a86c8d88d0 2024-09-13T19:33:25.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86c9ce2e0 con 0x55a86c8d88d0 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa55d60a640 1 -- 172.21.15.144:0/1623893575 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa6600ce020 con 0x55a86c8d88d0 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa55d60a640 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa558034650 0x7fa558036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa55d60a640 1 -- 172.21.15.144:0/1623893575 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa6600cc020 con 0x55a86c8d88d0 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6703d9640 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa558034650 0x7fa558036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86c8d9220 0x55a86c9d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86c9d2460 con 0x55a86c8d9220 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6713db640 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86c8d9220 0x55a86c9d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6703d9640 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa558034650 0x7fa558036b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa664000f70 tx=0x7fa664001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6713db640 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86c8d9220 0x55a86c9d1e20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6713db640 1 -- 172.21.15.144:0/1623893575 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa66800a4d0 con 0x55a86c8d9220 2024-09-13T19:33:25.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86c9cf4e0 con 0x55a86c8d9220 2024-09-13T19:33:25.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6713db640 1 -- 172.21.15.144:0/1623893575 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa66800a4d0 con 0x55a86c8d9220 2024-09-13T19:33:25.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86c9d4790 0x55a86c9d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86c9d7250 con 0x55a86c9d4790 2024-09-13T19:33:25.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.907+0000 7fa670bda640 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86c9d4790 0x55a86c9d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa670bda640 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86c9d4790 0x55a86c9d6b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa670bda640 1 -- 172.21.15.144:0/1623893575 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86c9d4790 2024-09-13T19:33:25.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86c9d3630 con 0x55a86c8d9220 2024-09-13T19:33:25.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6713db640 1 -- 172.21.15.144:0/1623893575 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa66800a4d0 con 0x55a86c8d9220 2024-09-13T19:33:25.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86c9d3b10 con 0x55a86c8d9220 2024-09-13T19:33:25.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6713db640 1 -- 172.21.15.144:0/1623893575 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa66800a4d0 con 0x55a86c8d9220 2024-09-13T19:33:25.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6730ca980 1 Processor -- start 2024-09-13T19:33:25.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6730ca980 1 -- start start 2024-09-13T19:33:25.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6730ca980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9e5930 0x55a86c9e5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6730ca980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a86c7dd800 con 0x55a86c9e5930 2024-09-13T19:33:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6713db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9e5930 0x55a86c9e5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6713db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9e5930 0x55a86c9e5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48170/0 (socket says 172.21.15.144:48170) 2024-09-13T19:33:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6713db640 1 -- 172.21.15.144:0/2589477694 learned_addr learned my addr 172.21.15.144:0/2589477694 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.911+0000 7fa6713db640 1 -- 172.21.15.144:0/2589477694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86c9e6290 con 0x55a86c9e5930 2024-09-13T19:33:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6713db640 1 --2- 172.21.15.144:0/2589477694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9e5930 0x55a86c9e5d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55a86c9d2860 tx=0x7fa668018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa5567fc640 1 -- 172.21.15.144:0/2589477694 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa668014450 con 0x55a86c9e5930 2024-09-13T19:33:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa5567fc640 1 -- 172.21.15.144:0/2589477694 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6680145f0 con 0x55a86c9e5930 2024-09-13T19:33:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6730ca980 1 -- 172.21.15.144:0/2589477694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a86c9e6520 con 0x55a86c9e5930 2024-09-13T19:33:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa5567fc640 1 -- 172.21.15.144:0/2589477694 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa668014910 con 0x55a86c9e5930 2024-09-13T19:33:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6730ca980 1 -- 172.21.15.144:0/2589477694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86c9e91a0 con 0x55a86c9e5930 2024-09-13T19:33:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa5567fc640 1 -- 172.21.15.144:0/2589477694 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa668011040 con 0x55a86c9e5930 2024-09-13T19:33:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa5567fc640 1 --2- 172.21.15.144:0/2589477694 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa5480346f0 0x7fa548036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa5567fc640 1 -- 172.21.15.144:0/2589477694 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa66801e070 con 0x55a86c9e5930 2024-09-13T19:33:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa670bda640 1 --2- 172.21.15.144:0/2589477694 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa5480346f0 0x7fa548036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6730ca980 1 Processor -- start 2024-09-13T19:33:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6730ca980 1 -- start start 2024-09-13T19:33:25.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa670bda640 1 --2- 172.21.15.144:0/2589477694 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa5480346f0 0x7fa548036bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55a86c9d2900 tx=0x7fa6600d04d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6730ca980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6730ca980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a86c9c4450 con 0x55a86c9f2390 2024-09-13T19:33:25.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6713db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6713db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48172/0 (socket says 172.21.15.144:48172) 2024-09-13T19:33:25.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.915+0000 7fa6713db640 1 -- 172.21.15.144:0/2104669515 learned_addr learned my addr 172.21.15.144:0/2104669515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:25.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6713db640 1 -- 172.21.15.144:0/2104669515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86c9f2d60 con 0x55a86c9f2390 2024-09-13T19:33:25.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6713db640 1 --2- 172.21.15.144:0/2104669515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f2790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa66804a120 tx=0x7fa668016a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88c386059651c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa547fff640 1 -- 172.21.15.144:0/2104669515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66803f020 con 0x55a86c9f2390 2024-09-13T19:33:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa547fff640 1 -- 172.21.15.144:0/2104669515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa668013dc0 con 0x55a86c9f2390 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa547fff640 1 -- 172.21.15.144:0/2104669515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa668028030 con 0x55a86c9f2390 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- 172.21.15.144:0/2104669515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 msgr2=0x55a86c9f2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 --2- 172.21.15.144:0/2104669515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f2790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa66804a120 tx=0x7fa668016a90 comp rx=0 tx=0).stop 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- 172.21.15.144:0/2104669515 shutdown_connections 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 --2- 172.21.15.144:0/2104669515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f2790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- 172.21.15.144:0/2104669515 >> 172.21.15.144:0/2104669515 conn(0x55a86c9ee7c0 msgr2=0x55a86c9ec8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- 172.21.15.144:0/2104669515 shutdown_connections 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- 172.21.15.144:0/2104669515 wait complete. 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 Processor -- start 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- start start 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a86c9f33b0 con 0x55a86c9f2390 2024-09-13T19:33:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6713db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6713db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48186/0 (socket says 172.21.15.144:48186) 2024-09-13T19:33:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 learned_addr learned my addr 172.21.15.144:0/3187786317 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:25.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86c9f9d10 con 0x55a86c9f2390 2024-09-13T19:33:25.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6713db640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f97d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55a86c9ed4c0 tx=0x7fa66804a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa5467fc640 1 -- 172.21.15.144:0/3187786317 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa668031030 con 0x55a86c9f2390 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa5467fc640 1 -- 172.21.15.144:0/3187786317 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66802b560 con 0x55a86c9f2390 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a86c9f9fa0 con 0x55a86c9f2390 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa5467fc640 1 -- 172.21.15.144:0/3187786317 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66802b710 con 0x55a86c9f2390 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.919+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86c9fcc80 con 0x55a86c9f2390 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa5467fc640 1 -- 172.21.15.144:0/3187786317 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa668042020 con 0x55a86c9f2390 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa5467fc640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa53c034650 0x7fa53c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa5467fc640 1 -- 172.21.15.144:0/3187786317 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa668035070 con 0x55a86c9f2390 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa670bda640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa53c034650 0x7fa53c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86ca04e00 0x55a86ca072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca079f0 con 0x55a86ca04e00 2024-09-13T19:33:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6703d9640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86ca04e00 0x55a86ca072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa670bda640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa53c034650 0x7fa53c036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa660005550 tx=0x7fa6600dd000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6703d9640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86ca04e00 0x55a86ca072a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa66400f620 con 0x55a86ca04e00 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 realm 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca042d0 con 0x55a86ca04e00 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa66400f620 con 0x55a86ca04e00 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca084f0 con 0x55a86ca04e00 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa66400f620 con 0x55a86ca04e00 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca08a20 con 0x55a86ca04e00 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa66400f620 con 0x55a86ca04e00 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86ca09820 0x55a86ca0bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0c190 con 0x55a86ca09820 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.923+0000 7fa6713db640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86ca09820 0x55a86ca0bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6713db640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86ca09820 0x55a86ca0bc10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6730ca980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6730ca980 20 searching for the correct realm 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a86ca0e150 0x55a86ca10610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa670bda640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a86ca0e150 0x55a86ca10610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa670bda640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a86ca0e150 0x55a86ca10610 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa670bda640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa6600e3c20 0x7fa6600c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x7fa6600e3c20 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6703d9640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa6600e3c20 0x7fa6600c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6703d9640 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa6600e3c20 0x7fa6600c5810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66400f620 con 0x7fa6600e3c20 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca04e00 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa66400f620 con 0x55a86ca04e00 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.927+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca04e00 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x7fa6600e3c20 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca04e00 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca04e00 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.931+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x7fa6600e3c20 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca04e00 2024-09-13T19:33:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca04e00 2024-09-13T19:33:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.935+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x7fa6600e3c20 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca04e00 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x7fa6600e3c20 2024-09-13T19:33:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca0e150 2024-09-13T19:33:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca09820 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x55a86ca04e00 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.939+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca10ce0 con 0x7fa6600e3c20 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cb50 con 0x55a86ca04e00 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca04e00 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0d430 con 0x55a86ca04e00 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:25.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 zone default found 2024-09-13T19:33:25.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 4 Realm: () 2024-09-13T19:33:25.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:25.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:25.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:25.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 zonegroup default 2024-09-13T19:33:25.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca11160 con 0x55a86ca09820 2024-09-13T19:33:25.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:25.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca13390 con 0x55a86ca0e150 2024-09-13T19:33:25.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:25.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados->read ofs=0 len=0 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca13730 con 0x55a86ca0e150 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 started sync module instance, tier type = 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.943+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca127d0 con 0x7fa6600e3c20 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.947+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.947+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94181865368864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca127d0 con 0x7fa6600e3c20 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.947+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca140f0 con 0x55a86ca04e00 2024-09-13T19:33:25.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.947+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94181865368864] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.947+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.947+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94181865366576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca140f0 con 0x55a86ca04e00 2024-09-13T19:33:25.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.947+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca14980 con 0x55a86ca0e150 2024-09-13T19:33:25.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.951+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.951+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94181865374240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca15220 con 0x55a86ca0e150 2024-09-13T19:33:25.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.951+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca15be0 con 0x7fa6600e3c20 2024-09-13T19:33:25.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.951+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94181865366576] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.951+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.951+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94181865379632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca15b50 con 0x7fa6600e3c20 2024-09-13T19:33:25.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.951+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca16970 con 0x55a86ca04e00 2024-09-13T19:33:25.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.951+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94181865374240] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.955+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.955+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94181865377136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca16930 con 0x55a86ca04e00 2024-09-13T19:33:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.955+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca09820 2024-09-13T19:33:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.955+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94181865379632] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.955+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94181865377136] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.955+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.955+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94181865381840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca16fe0 con 0x55a86ca09820 2024-09-13T19:33:25.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.955+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17bd0 con 0x55a86ca09820 2024-09-13T19:33:25.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94181865381840] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94181865382896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17bd0 con 0x55a86ca09820 2024-09-13T19:33:25.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca18460 con 0x55a86ca09820 2024-09-13T19:33:25.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94181865382896] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94181865387808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca18660 con 0x55a86ca09820 2024-09-13T19:33:25.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 20 add_watcher() i=0 2024-09-13T19:33:25.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 20 add_watcher() i=1 2024-09-13T19:33:25.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 20 add_watcher() i=2 2024-09-13T19:33:25.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 20 add_watcher() i=3 2024-09-13T19:33:25.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 20 add_watcher() i=4 2024-09-13T19:33:25.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 20 add_watcher() i=5 2024-09-13T19:33:25.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.959+0000 7fa6730ca980 20 add_watcher() i=6 2024-09-13T19:33:25.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94181865387808] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6730ca980 20 add_watcher() i=7 2024-09-13T19:33:25.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6730ca980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:25.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca1bad0 con 0x55a86ca04e00 2024-09-13T19:33:25.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94181865391600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca18ec0 con 0x55a86ca04e00 2024-09-13T19:33:25.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94181865391600] v30'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa526fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:25.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6730ca980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:25.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6730ca980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:25.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa6730ca980 5 note: GC not initialized 2024-09-13T19:33:25.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.963+0000 7fa525fe3640 20 reqs_thread_entry: start 2024-09-13T19:33:25.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6730ca980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:25.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6730ca980 20 Filter name: none 2024-09-13T19:33:25.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa4977fe640 20 reqs_thread_entry: start 2024-09-13T19:33:25.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca3e640 con 0x55a86ca0e150 2024-09-13T19:33:25.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca3e640 con 0x55a86ca0e150 2024-09-13T19:33:25.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca3e640 con 0x55a86ca04e00 2024-09-13T19:33:25.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca04e00 2024-09-13T19:33:25.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x7fa6600e3c20 2024-09-13T19:33:25.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca0e150 2024-09-13T19:33:25.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca04e00 2024-09-13T19:33:25.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca0e150 2024-09-13T19:33:25.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x7fa6600e3c20 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca0e150 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca04e00 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.967+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca09820 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca09820 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca0e150 2024-09-13T19:33:25.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca09820 2024-09-13T19:33:25.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca09820 2024-09-13T19:33:25.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.971+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca09820 2024-09-13T19:33:25.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca0e150 2024-09-13T19:33:25.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x7fa6600e3c20 2024-09-13T19:33:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca04e00 2024-09-13T19:33:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca04e00 2024-09-13T19:33:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca0e150 2024-09-13T19:33:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x7fa6600e3c20 2024-09-13T19:33:25.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca09820 2024-09-13T19:33:25.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca04e00 2024-09-13T19:33:25.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca09820 2024-09-13T19:33:25.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.975+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca0e150 2024-09-13T19:33:25.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x7fa6600e3c20 2024-09-13T19:33:25.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca09820 2024-09-13T19:33:25.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca04e00 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x55a86ca0e150 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca17380 con 0x7fa6600e3c20 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa526fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.979+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94181865391600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca04e00 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94181865391600] v30'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94181865368864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x7fa6600e3c20 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94181865368864] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6730ca980 20 remove_watcher() i=0 2024-09-13T19:33:25.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6730ca980 2 removed watcher, disabling cache 2024-09-13T19:33:25.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94181865366576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca04e00 2024-09-13T19:33:25.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94181865366576] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6730ca980 20 remove_watcher() i=1 2024-09-13T19:33:25.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.983+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94181865374240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca0cfd0 con 0x55a86ca0e150 2024-09-13T19:33:25.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.987+0000 7fa670bda640 1 -- 172.21.15.144:0/3187786317 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94181865374240] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6600cf370 con 0x55a86ca0e150 2024-09-13T19:33:25.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.987+0000 7fa6730ca980 20 remove_watcher() i=2 2024-09-13T19:33:25.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.987+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94181865379632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca12430 con 0x7fa6600e3c20 2024-09-13T19:33:25.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.987+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94181865379632] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x7fa6600e3c20 2024-09-13T19:33:25.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.987+0000 7fa6730ca980 20 remove_watcher() i=3 2024-09-13T19:33:25.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.987+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94181865377136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca15730 con 0x55a86ca04e00 2024-09-13T19:33:25.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.991+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94181865377136] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66402b040 con 0x55a86ca04e00 2024-09-13T19:33:25.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.991+0000 7fa6730ca980 20 remove_watcher() i=4 2024-09-13T19:33:25.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.991+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94181865381840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca12430 con 0x55a86ca09820 2024-09-13T19:33:25.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.991+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94181865381840] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.991+0000 7fa6730ca980 20 remove_watcher() i=5 2024-09-13T19:33:25.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.991+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94181865382896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca15730 con 0x55a86ca09820 2024-09-13T19:33:25.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.995+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94181865382896] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:25.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.995+0000 7fa6730ca980 20 remove_watcher() i=6 2024-09-13T19:33:25.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.995+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94181865387808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a86ca15730 con 0x55a86ca09820 2024-09-13T19:33:26.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.995+0000 7fa6713db640 1 -- 172.21.15.144:0/3187786317 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94181865387808] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa668052070 con 0x55a86ca09820 2024-09-13T19:33:26.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.995+0000 7fa6730ca980 20 remove_watcher() i=7 2024-09-13T19:33:26.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86ca09820 msgr2=0x55a86ca0bc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86ca09820 0x55a86ca0bc10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86ca04e00 msgr2=0x55a86ca072a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86ca04e00 0x55a86ca072a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa6600e3c20 msgr2=0x7fa6600c5810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa6600e3c20 0x7fa6600c5810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a86ca0e150 msgr2=0x55a86ca10610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a86ca0e150 0x55a86ca10610 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa53c034650 msgr2=0x7fa53c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa53c034650 0x7fa53c036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa660005550 tx=0x7fa6600dd000 comp rx=0 tx=0).stop 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 msgr2=0x55a86c9f97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f97d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55a86c9ed4c0 tx=0x7fa66804a080 comp rx=0 tx=0).stop 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6703d9640 1 -- 172.21.15.144:0/3187786317 reap_dead start 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 shutdown_connections 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/3187786317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9f2390 0x55a86c9f97d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 >> 172.21.15.144:0/3187786317 conn(0x55a86c9ee7c0 msgr2=0x55a86c9ec890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 shutdown_connections 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/3187786317 wait complete. 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/2589477694 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa5480346f0 msgr2=0x7fa548036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/2589477694 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa5480346f0 0x7fa548036bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55a86c9d2900 tx=0x7fa6600d04d0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/2589477694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9e5930 msgr2=0x55a86c9e5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/2589477694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9e5930 0x55a86c9e5d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55a86c9d2860 tx=0x7fa668018830 comp rx=0 tx=0).stop 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/2589477694 shutdown_connections 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/2589477694 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa5480346f0 0x7fa548036bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/2589477694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c9e5930 0x55a86c9e5d50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/2589477694 >> 172.21.15.144:0/2589477694 conn(0x55a86c9daa80 msgr2=0x55a86c9dd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/2589477694 shutdown_connections 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/2589477694 wait complete. 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86c9d4790 msgr2=0x55a86c9d6b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86c9d4790 0x55a86c9d6b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86c8d9220 msgr2=0x55a86c9d1e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86c8d9220 0x55a86c9d1e20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa558034650 msgr2=0x7fa558036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa558034650 0x7fa558036b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa664000f70 tx=0x7fa664001380 comp rx=0 tx=0).stop 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 msgr2=0x55a86c9cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9cae30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa6600199f0 tx=0x7fa6600180e0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 shutdown_connections 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a86c8d9220 0x55a86c9d1e20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a86c9d4790 0x55a86c9d6b80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa558034650 0x7fa558036b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 --2- 172.21.15.144:0/1623893575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a86c8d88d0 0x55a86c9cae30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 >> 172.21.15.144:0/1623893575 conn(0x55a86c84c220 msgr2=0x55a86c9be370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 shutdown_connections 2024-09-13T19:33:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:25.999+0000 7fa6730ca980 1 -- 172.21.15.144:0/1623893575 wait complete. 2024-09-13T19:33:26.013 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-13T19:33:26.013 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:33:26.013 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-13T19:33:26.013 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-13T19:33:26.013 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-13T19:33:26.089 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:26.089 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa59558980 1 Processor -- start 2024-09-13T19:33:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa59558980 1 -- start start 2024-09-13T19:33:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa59558980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f321e08910 0x55f321e0ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa59558980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f321c8dae0 con 0x55f321e04540 2024-09-13T19:33:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa59558980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55f321cb1e30 con 0x55f321e08910 2024-09-13T19:33:26.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa56867640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f321e08910 0x55f321e0ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa57068640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55f321e04540 0x55f321e04920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42184/0 (socket says 172.21.15.144:42184) 2024-09-13T19:33:26.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa57068640 1 -- 172.21.15.144:0/2932645808 learned_addr learned my addr 172.21.15.144:0/2932645808 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:26.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa56867640 1 -- 172.21.15.144:0/2932645808 >> v1:172.21.15.18:6789/0 conn(0x55f321e04540 legacy=0x55f321e04920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.087+0000 7ffa56867640 1 -- 172.21.15.144:0/2932645808 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f321e0c250 con 0x55f321e08910 2024-09-13T19:33:26.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa56867640 1 --2- 172.21.15.144:0/2932645808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e08910 0x55f321e0ad00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00a420 tx=0x7ffa4c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bcb561cf5e4db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa56066640 1 -- 172.21.15.144:0/2932645808 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c0af070 con 0x55f321e08910 2024-09-13T19:33:26.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa56066640 1 -- 172.21.15.144:0/2932645808 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c0aa530 con 0x55f321e08910 2024-09-13T19:33:26.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa56066640 1 -- 172.21.15.144:0/2932645808 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4c0aa850 con 0x55f321e08910 2024-09-13T19:33:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa59558980 1 -- 172.21.15.144:0/2932645808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e08910 msgr2=0x55f321e0ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa59558980 1 --2- 172.21.15.144:0/2932645808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e08910 0x55f321e0ad00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00a420 tx=0x7ffa4c01afd0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa59558980 1 -- 172.21.15.144:0/2932645808 shutdown_connections 2024-09-13T19:33:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa59558980 1 --2- 172.21.15.144:0/2932645808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e08910 0x55f321e0ad00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa59558980 1 -- 172.21.15.144:0/2932645808 >> 172.21.15.144:0/2932645808 conn(0x55f321e00060 msgr2=0x55f321e02480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa59558980 1 -- 172.21.15.144:0/2932645808 shutdown_connections 2024-09-13T19:33:26.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.091+0000 7ffa59558980 1 -- 172.21.15.144:0/2932645808 wait complete. 2024-09-13T19:33:26.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa59558980 1 Processor -- start 2024-09-13T19:33:26.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa59558980 1 -- start start 2024-09-13T19:33:26.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa59558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321d793e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa59558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f321cb3200 con 0x55f321e04540 2024-09-13T19:33:26.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa57068640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321d793e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa57068640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321d793e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48200/0 (socket says 172.21.15.144:48200) 2024-09-13T19:33:26.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa57068640 1 -- 172.21.15.144:0/2847767352 learned_addr learned my addr 172.21.15.144:0/2847767352 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa57068640 1 -- 172.21.15.144:0/2847767352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f321d799b0 con 0x55f321e04540 2024-09-13T19:33:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ffa57068640 1 --2- 172.21.15.144:0/2847767352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321d793e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa48001d90 tx=0x7ffa48001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8830d867dcdddba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ff94560a640 1 -- 172.21.15.144:0/2847767352 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48013030 con 0x55f321e04540 2024-09-13T19:33:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ff94560a640 1 -- 172.21.15.144:0/2847767352 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4800e690 con 0x55f321e04540 2024-09-13T19:33:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.107+0000 7ff94560a640 1 -- 172.21.15.144:0/2847767352 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4800ea10 con 0x55f321e04540 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- 172.21.15.144:0/2847767352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 msgr2=0x55f321d793e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 --2- 172.21.15.144:0/2847767352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321d793e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa48001d90 tx=0x7ffa48001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- 172.21.15.144:0/2847767352 shutdown_connections 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 --2- 172.21.15.144:0/2847767352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321d793e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- 172.21.15.144:0/2847767352 >> 172.21.15.144:0/2847767352 conn(0x55f321e00060 msgr2=0x55f321eeb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- 172.21.15.144:0/2847767352 shutdown_connections 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- 172.21.15.144:0/2847767352 wait complete. 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 Processor -- start 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- start start 2024-09-13T19:33:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321ef7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f321e0bd50 con 0x55f321e04540 2024-09-13T19:33:26.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa57068640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321ef7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa57068640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321ef7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48216/0 (socket says 172.21.15.144:48216) 2024-09-13T19:33:26.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa57068640 1 -- 172.21.15.144:0/3220396598 learned_addr learned my addr 172.21.15.144:0/3220396598 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa57068640 1 -- 172.21.15.144:0/3220396598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f321ef8330 con 0x55f321e04540 2024-09-13T19:33:26.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa57068640 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321ef7df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55f321ef1c60 tx=0x7ffa48000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ff943e07640 1 -- 172.21.15.144:0/3220396598 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48027070 con 0x55f321e04540 2024-09-13T19:33:26.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f321ef85c0 con 0x55f321e04540 2024-09-13T19:33:26.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ff943e07640 1 -- 172.21.15.144:0/3220396598 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa480198e0 con 0x55f321e04540 2024-09-13T19:33:26.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ff943e07640 1 -- 172.21.15.144:0/3220396598 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48019c00 con 0x55f321e04540 2024-09-13T19:33:26.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.111+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f321efb2a0 con 0x55f321e04540 2024-09-13T19:33:26.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ff943e07640 1 -- 172.21.15.144:0/3220396598 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa4802a070 con 0x55f321e04540 2024-09-13T19:33:26.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ff943e07640 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff93c034650 0x7ff93c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ff943e07640 1 -- 172.21.15.144:0/3220396598 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ffa4801f070 con 0x55f321e04540 2024-09-13T19:33:26.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa56867640 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff93c034650 0x7ff93c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321e08910 0x55f321efede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321eff420 con 0x55f321e08910 2024-09-13T19:33:26.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa57869640 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321e08910 0x55f321efede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa56867640 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff93c034650 0x7ff93c036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0ac000 tx=0x7ffa4c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa57869640 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321e08910 0x55f321efede0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa57869640 1 -- 172.21.15.144:0/3220396598 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa500083f0 con 0x55f321e08910 2024-09-13T19:33:26.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321efc4a0 con 0x55f321e08910 2024-09-13T19:33:26.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa57869640 1 -- 172.21.15.144:0/3220396598 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa500083f0 con 0x55f321e08910 2024-09-13T19:33:26.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f01750 0x55f321f03b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f04210 con 0x55f321f01750 2024-09-13T19:33:26.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa57068640 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f01750 0x55f321f03b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa57068640 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f01750 0x55f321f03b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa57068640 1 -- 172.21.15.144:0/3220396598 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f01750 2024-09-13T19:33:26.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.115+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f005f0 con 0x55f321e08910 2024-09-13T19:33:26.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa57869640 1 -- 172.21.15.144:0/3220396598 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa500083f0 con 0x55f321e08910 2024-09-13T19:33:26.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f00ad0 con 0x55f321e08910 2024-09-13T19:33:26.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa57869640 1 -- 172.21.15.144:0/3220396598 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa500083f0 con 0x55f321e08910 2024-09-13T19:33:26.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa59558980 1 Processor -- start 2024-09-13T19:33:26.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa59558980 1 -- start start 2024-09-13T19:33:26.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa59558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f128f0 0x55f321f12d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa59558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f321d0c800 con 0x55f321f128f0 2024-09-13T19:33:26.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa57869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f128f0 0x55f321f12d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa57869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f128f0 0x55f321f12d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48226/0 (socket says 172.21.15.144:48226) 2024-09-13T19:33:26.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa57869640 1 -- 172.21.15.144:0/1060743030 learned_addr learned my addr 172.21.15.144:0/1060743030 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa57869640 1 -- 172.21.15.144:0/1060743030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f321f13250 con 0x55f321f128f0 2024-09-13T19:33:26.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa57869640 1 --2- 172.21.15.144:0/1060743030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f128f0 0x55f321f12d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55f321eff820 tx=0x7ffa5000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ff941602640 1 -- 172.21.15.144:0/1060743030 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50007e00 con 0x55f321f128f0 2024-09-13T19:33:26.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ff941602640 1 -- 172.21.15.144:0/1060743030 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5001e020 con 0x55f321f128f0 2024-09-13T19:33:26.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa59558980 1 -- 172.21.15.144:0/1060743030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f321f134e0 con 0x55f321f128f0 2024-09-13T19:33:26.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ff941602640 1 -- 172.21.15.144:0/1060743030 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50019590 con 0x55f321f128f0 2024-09-13T19:33:26.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.119+0000 7ffa59558980 1 -- 172.21.15.144:0/1060743030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f321f16160 con 0x55f321f128f0 2024-09-13T19:33:26.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ff941602640 1 -- 172.21.15.144:0/1060743030 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa50016040 con 0x55f321f128f0 2024-09-13T19:33:26.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ff941602640 1 --2- 172.21.15.144:0/1060743030 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff9300346a0 0x7ff930036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ff941602640 1 -- 172.21.15.144:0/1060743030 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ffa5001f030 con 0x55f321f128f0 2024-09-13T19:33:26.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa57068640 1 --2- 172.21.15.144:0/1060743030 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff9300346a0 0x7ff930036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 Processor -- start 2024-09-13T19:33:26.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 -- start start 2024-09-13T19:33:26.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f1f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa57068640 1 --2- 172.21.15.144:0/1060743030 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff9300346a0 0x7ff930036b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55f321eff8c0 tx=0x7ffa4802aea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f321d79d30 con 0x55f321f1f340 2024-09-13T19:33:26.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa57869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f1f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa57869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f1f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48236/0 (socket says 172.21.15.144:48236) 2024-09-13T19:33:26.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa57869640 1 -- 172.21.15.144:0/940759235 learned_addr learned my addr 172.21.15.144:0/940759235 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa57869640 1 -- 172.21.15.144:0/940759235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f321f1fcf0 con 0x55f321f1f340 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa57869640 1 --2- 172.21.15.144:0/940759235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f1f720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa5004a340 tx=0x7ffa50023730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7550fb845a1f4262 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ff93affd640 1 -- 172.21.15.144:0/940759235 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa5001d040 con 0x55f321f1f340 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ff93affd640 1 -- 172.21.15.144:0/940759235 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5002b350 con 0x55f321f1f340 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ff93affd640 1 -- 172.21.15.144:0/940759235 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50015cb0 con 0x55f321f1f340 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 -- 172.21.15.144:0/940759235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 msgr2=0x55f321f1f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 --2- 172.21.15.144:0/940759235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f1f720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa5004a340 tx=0x7ffa50023730 comp rx=0 tx=0).stop 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 -- 172.21.15.144:0/940759235 shutdown_connections 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 --2- 172.21.15.144:0/940759235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f1f720 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 -- 172.21.15.144:0/940759235 >> 172.21.15.144:0/940759235 conn(0x55f321f1b720 msgr2=0x55f321f19820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 -- 172.21.15.144:0/940759235 shutdown_connections 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 -- 172.21.15.144:0/940759235 wait complete. 2024-09-13T19:33:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.123+0000 7ffa59558980 1 Processor -- start 2024-09-13T19:33:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa59558980 1 -- start start 2024-09-13T19:33:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa59558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f26710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa59558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f321f20310 con 0x55f321f1f340 2024-09-13T19:33:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa57869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f26710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa57869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f26710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48240/0 (socket says 172.21.15.144:48240) 2024-09-13T19:33:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 learned_addr learned my addr 172.21.15.144:0/2821954067 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f321f26c50 con 0x55f321f1f340 2024-09-13T19:33:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa57869640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f26710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffa500491e0 tx=0x7ffa5004a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ff9397fa640 1 -- 172.21.15.144:0/2821954067 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa5001d070 con 0x55f321f1f340 2024-09-13T19:33:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f321f26ee0 con 0x55f321f1f340 2024-09-13T19:33:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ff9397fa640 1 -- 172.21.15.144:0/2821954067 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5002b500 con 0x55f321f1f340 2024-09-13T19:33:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ff9397fa640 1 -- 172.21.15.144:0/2821954067 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50017770 con 0x55f321f1f340 2024-09-13T19:33:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f321f26ee0 con 0x55f321f1f340 2024-09-13T19:33:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ff9397fa640 1 -- 172.21.15.144:0/2821954067 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa500223c0 con 0x55f321f1f340 2024-09-13T19:33:26.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ff9397fa640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff920034650 0x7ff920036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ff9397fa640 1 -- 172.21.15.144:0/2821954067 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ffa5001a070 con 0x55f321f1f340 2024-09-13T19:33:26.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa57068640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff920034650 0x7ff920036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321f31900 0x55f321f33dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f34510 con 0x55f321f31900 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.127+0000 7ffa56867640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321f31900 0x55f321f33dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa57068640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff920034650 0x7ff920036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa48048540 tx=0x7ffa48034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa56867640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321f31900 0x55f321f33dc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 realm 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f34940 con 0x55f321f31900 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f35210 con 0x55f321f31900 2024-09-13T19:33:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f355b0 con 0x55f321f31900 2024-09-13T19:33:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f36310 0x55f321f38700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f38d10 con 0x55f321f36310 2024-09-13T19:33:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa57869640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f36310 0x55f321f38700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa57869640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f36310 0x55f321f38700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 20 searching for the correct realm 2024-09-13T19:33:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f321f3abf0 0x55f321f3d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f3abf0 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.131+0000 7ffa57068640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f321f3abf0 0x55f321f3d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57068640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f321f3abf0 0x55f321f3d060 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57068640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7ffa4802c060 0x7ffa4802a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x7ffa4802c060 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa56867640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7ffa4802c060 0x7ffa4802a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa56867640 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7ffa4802c060 0x7ffa4802a540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f36310 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f31900 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f31900 2024-09-13T19:33:26.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f36310 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f36310 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.135+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x7ffa4802c060 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f3abf0 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f31900 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f36310 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f31900 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x7ffa4802c060 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3d730 con 0x55f321f3abf0 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f3abf0 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f36310 2024-09-13T19:33:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f3abf0 2024-09-13T19:33:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f3abf0 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.139+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f31900 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f31900 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f36310 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f3abf0 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x7ffa4802c060 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f31900 2024-09-13T19:33:26.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f36310 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f3abf0 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.143+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f36310 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x7ffa4802c060 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f3abf0 2024-09-13T19:33:26.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f36310 2024-09-13T19:33:26.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x55f321f31900 2024-09-13T19:33:26.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ffa48060040 con 0x7ffa4802c060 2024-09-13T19:33:26.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f39660 con 0x55f321f31900 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f39f00 con 0x55f321f31900 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f392a0 con 0x55f321f31900 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 zone default found 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 4 Realm: () 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 zonegroup default 2024-09-13T19:33:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3dbf0 con 0x55f321f36310 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.147+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3fec0 con 0x55f321f3abf0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f40260 con 0x55f321f3abf0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 20 started sync module instance, tier type = 2024-09-13T19:33:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3f350 con 0x7ffa4802c060 2024-09-13T19:33:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94502735050880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3f350 con 0x7ffa4802c060 2024-09-13T19:33:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f40d10 con 0x55f321f31900 2024-09-13T19:33:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.151+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94502735050880] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.155+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.155+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94502735054832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3f350 con 0x55f321f31900 2024-09-13T19:33:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.155+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f41720 con 0x55f321f3abf0 2024-09-13T19:33:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.155+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94502735054832] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.155+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.155+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94502735048352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3f2c0 con 0x55f321f3abf0 2024-09-13T19:33:26.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.155+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f42470 con 0x7ffa4802c060 2024-09-13T19:33:26.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.159+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.159+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94502735060928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f42890 con 0x7ffa4802c060 2024-09-13T19:33:26.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.159+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f43290 con 0x55f321f31900 2024-09-13T19:33:26.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.159+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94502735048352] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.159+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.159+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94502735059728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f43250 con 0x55f321f31900 2024-09-13T19:33:26.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.159+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f43ca0 con 0x55f321f36310 2024-09-13T19:33:26.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.159+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94502735060928] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.163+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94502735059728] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.163+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.163+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94502735064480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f431c0 con 0x55f321f36310 2024-09-13T19:33:26.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.163+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f44150 con 0x55f321f36310 2024-09-13T19:33:26.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.163+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94502735064480] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.163+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.163+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94502735067120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f440c0 con 0x55f321f36310 2024-09-13T19:33:26.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.163+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f44a80 con 0x55f321f36310 2024-09-13T19:33:26.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94502735067120] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94502735068448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f44a80 con 0x55f321f36310 2024-09-13T19:33:26.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 20 add_watcher() i=0 2024-09-13T19:33:26.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 20 add_watcher() i=1 2024-09-13T19:33:26.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 20 add_watcher() i=2 2024-09-13T19:33:26.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 20 add_watcher() i=3 2024-09-13T19:33:26.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 20 add_watcher() i=4 2024-09-13T19:33:26.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 20 add_watcher() i=5 2024-09-13T19:33:26.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 20 add_watcher() i=6 2024-09-13T19:33:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94502735068448] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 20 add_watcher() i=7 2024-09-13T19:33:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f47dd0 con 0x55f321f31900 2024-09-13T19:33:26.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.167+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94502735083488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f44bf0 con 0x55f321f31900 2024-09-13T19:33:26.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.171+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94502735083488] v30'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.171+0000 7ff90dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:26.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.171+0000 7ffa59558980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:26.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.171+0000 7ffa59558980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:26.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.171+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f47030 con 0x55f321f31900 2024-09-13T19:33:26.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.171+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.171+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f50e90 con 0x55f321f36310 2024-09-13T19:33:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.175+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.175+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f50e90 con 0x55f321f3abf0 2024-09-13T19:33:26.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.175+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.175+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51340 con 0x55f321f31900 2024-09-13T19:33:26.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.175+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.175+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51510 con 0x7ffa4802c060 2024-09-13T19:33:26.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.179+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.179+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51630 con 0x55f321f3abf0 2024-09-13T19:33:26.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.179+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.179+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51ae0 con 0x55f321f31900 2024-09-13T19:33:26.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.183+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.183+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51ae0 con 0x55f321f36310 2024-09-13T19:33:26.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.183+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.183+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51ae0 con 0x7ffa4802c060 2024-09-13T19:33:26.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.187+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.187+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f3abf0 2024-09-13T19:33:26.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.187+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.187+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x7ffa4802c060 2024-09-13T19:33:26.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.187+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.187+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f36310 2024-09-13T19:33:26.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.191+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.191+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x7ffa4802c060 2024-09-13T19:33:26.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.191+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.191+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f36310 2024-09-13T19:33:26.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.195+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.195+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f31900 2024-09-13T19:33:26.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.195+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.199+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f3abf0 2024-09-13T19:33:26.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.199+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.199+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x7ffa4802c060 2024-09-13T19:33:26.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.199+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.203+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f3abf0 2024-09-13T19:33:26.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.203+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.203+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f31900 2024-09-13T19:33:26.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.203+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.203+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f31900 2024-09-13T19:33:26.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.207+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.207+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f3abf0 2024-09-13T19:33:26.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.207+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.207+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x7ffa4802c060 2024-09-13T19:33:26.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.211+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.211+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f20 con 0x55f321f3abf0 2024-09-13T19:33:26.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.215+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.215+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x55f321f3abf0 2024-09-13T19:33:26.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.215+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.215+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x55f321f3abf0 2024-09-13T19:33:26.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.219+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.219+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x55f321f3abf0 2024-09-13T19:33:26.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.219+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.219+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x55f321f36310 2024-09-13T19:33:26.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.223+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.223+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x55f321f3abf0 2024-09-13T19:33:26.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.227+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.227+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x55f321f36310 2024-09-13T19:33:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.227+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.227+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x55f321f3abf0 2024-09-13T19:33:26.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.231+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.231+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x55f321f36310 2024-09-13T19:33:26.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.235+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.235+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f51f40 con 0x7ffa4802c060 2024-09-13T19:33:26.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ff90cfe1640 20 reqs_thread_entry: start 2024-09-13T19:33:26.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:26.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 20 Filter name: none 2024-09-13T19:33:26.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ff8867fc640 20 reqs_thread_entry: start 2024-09-13T19:33:26.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:33:26.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f321f4f7f0 con 0x7ffa4802c060 2024-09-13T19:33:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-13T19:33:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:33:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:33:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ff90dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.239+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94502735083488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f4f2a0 con 0x55f321f31900 2024-09-13T19:33:26.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.243+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94502735083488] v30'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.243+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94502735050880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f47770 con 0x7ffa4802c060 2024-09-13T19:33:26.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.243+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94502735050880] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.243+0000 7ffa59558980 20 remove_watcher() i=0 2024-09-13T19:33:26.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.243+0000 7ffa59558980 2 removed watcher, disabling cache 2024-09-13T19:33:26.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.243+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94502735054832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3f880 con 0x55f321f31900 2024-09-13T19:33:26.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.247+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94502735054832] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.247+0000 7ffa59558980 20 remove_watcher() i=1 2024-09-13T19:33:26.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.247+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94502735048352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3f880 con 0x55f321f3abf0 2024-09-13T19:33:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.247+0000 7ffa57068640 1 -- 172.21.15.144:0/2821954067 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94502735048352] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48029030 con 0x55f321f3abf0 2024-09-13T19:33:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.247+0000 7ffa59558980 20 remove_watcher() i=2 2024-09-13T19:33:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.247+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94502735060928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3eea0 con 0x7ffa4802c060 2024-09-13T19:33:26.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.251+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94502735060928] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x7ffa4802c060 2024-09-13T19:33:26.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.251+0000 7ffa59558980 20 remove_watcher() i=3 2024-09-13T19:33:26.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.251+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94502735059728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3f880 con 0x55f321f31900 2024-09-13T19:33:26.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.251+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94502735059728] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa4c0b2070 con 0x55f321f31900 2024-09-13T19:33:26.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.251+0000 7ffa59558980 20 remove_watcher() i=4 2024-09-13T19:33:26.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.251+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94502735064480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f41fc0 con 0x55f321f36310 2024-09-13T19:33:26.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.255+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94502735064480] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.255+0000 7ffa59558980 20 remove_watcher() i=5 2024-09-13T19:33:26.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.255+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94502735067120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3eea0 con 0x55f321f36310 2024-09-13T19:33:26.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.255+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94502735067120] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.255+0000 7ffa59558980 20 remove_watcher() i=6 2024-09-13T19:33:26.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.255+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94502735068448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f321f3f880 con 0x55f321f36310 2024-09-13T19:33:26.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa57869640 1 -- 172.21.15.144:0/2821954067 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94502735068448] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50042020 con 0x55f321f36310 2024-09-13T19:33:26.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 20 remove_watcher() i=7 2024-09-13T19:33:26.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f36310 msgr2=0x55f321f38700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f36310 0x55f321f38700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321f31900 msgr2=0x55f321f33dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321f31900 0x55f321f33dc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7ffa4802c060 msgr2=0x7ffa4802a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7ffa4802c060 0x7ffa4802a540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f321f3abf0 msgr2=0x55f321f3d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f321f3abf0 0x55f321f3d060 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff920034650 msgr2=0x7ff920036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff920034650 0x7ff920036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa48048540 tx=0x7ffa48034000 comp rx=0 tx=0).stop 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa56867640 1 -- 172.21.15.144:0/2821954067 reap_dead start 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 msgr2=0x55f321f26710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f26710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffa500491e0 tx=0x7ffa5004a2a0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 shutdown_connections 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/2821954067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f1f340 0x55f321f26710 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 >> 172.21.15.144:0/2821954067 conn(0x55f321f1b720 msgr2=0x55f321f197f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 shutdown_connections 2024-09-13T19:33:26.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/2821954067 wait complete. 2024-09-13T19:33:26.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/1060743030 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff9300346a0 msgr2=0x7ff930036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/1060743030 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff9300346a0 0x7ff930036b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55f321eff8c0 tx=0x7ffa4802aea0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/1060743030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f128f0 msgr2=0x55f321f12d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/1060743030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f128f0 0x55f321f12d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55f321eff820 tx=0x7ffa5000af40 comp rx=0 tx=0).stop 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/1060743030 shutdown_connections 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/1060743030 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff9300346a0 0x7ff930036b60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 --2- 172.21.15.144:0/1060743030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321f128f0 0x55f321f12d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/1060743030 >> 172.21.15.144:0/1060743030 conn(0x55f321f07a40 msgr2=0x55f321f0a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/1060743030 shutdown_connections 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.259+0000 7ffa59558980 1 -- 172.21.15.144:0/1060743030 wait complete. 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f01750 msgr2=0x55f321f03b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f01750 0x55f321f03b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321e08910 msgr2=0x55f321efede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321e08910 0x55f321efede0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff93c034650 msgr2=0x7ff93c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff93c034650 0x7ff93c036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0ac000 tx=0x7ffa4c0a5000 comp rx=0 tx=0).stop 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 msgr2=0x55f321ef7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321ef7df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55f321ef1c60 tx=0x7ffa48000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 shutdown_connections 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f321e08910 0x55f321efede0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f321f01750 0x55f321f03b40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7ff93c034650 0x7ff93c036b10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 --2- 172.21.15.144:0/3220396598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f321e04540 0x55f321ef7df0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 >> 172.21.15.144:0/3220396598 conn(0x55f321e00060 msgr2=0x55f321eea110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 shutdown_connections 2024-09-13T19:33:26.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.263+0000 7ffa59558980 1 -- 172.21.15.144:0/3220396598 wait complete. 2024-09-13T19:33:26.276 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:33:26.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-13T19:33:26.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-13T19:33:26.277 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-13T19:33:26.360 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:26.360 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:26.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44c10e980 1 Processor -- start 2024-09-13T19:33:26.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44c10e980 1 -- start start 2024-09-13T19:33:26.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44c10e980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x561b6f48d930 0x561b6f48fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44c10e980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561b6f30fae0 con 0x561b6f489df0 2024-09-13T19:33:26.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44c10e980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x561b6f333e30 con 0x561b6f48d930 2024-09-13T19:33:26.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44941d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x561b6f48d930 0x561b6f48fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb449c1e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x561b6f489df0 0x561b6f48c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42198/0 (socket says 172.21.15.144:42198) 2024-09-13T19:33:26.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44941d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x561b6f48d930 0x561b6f48fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48246/0 (socket says 172.21.15.144:48246) 2024-09-13T19:33:26.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb449c1e640 1 -- 172.21.15.144:0/3463606944 learned_addr learned my addr 172.21.15.144:0/3463606944 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:26.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44941d640 1 -- 172.21.15.144:0/3463606944 >> v1:172.21.15.18:6789/0 conn(0x561b6f489df0 legacy=0x561b6f48c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.359+0000 7fb44941d640 1 -- 172.21.15.144:0/3463606944 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6f4913f0 con 0x561b6f48d930 2024-09-13T19:33:26.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb44941d640 1 --2- 172.21.15.144:0/3463606944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f48d930 0x561b6f48fd50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb44000a480 tx=0x7fb44001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9056afa714f39adf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb448c1c640 1 -- 172.21.15.144:0/3463606944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4400b0070 con 0x561b6f48d930 2024-09-13T19:33:26.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb448c1c640 1 -- 172.21.15.144:0/3463606944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4400ab540 con 0x561b6f48d930 2024-09-13T19:33:26.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb448c1c640 1 -- 172.21.15.144:0/3463606944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4400ab840 con 0x561b6f48d930 2024-09-13T19:33:26.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb44c10e980 1 -- 172.21.15.144:0/3463606944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f48d930 msgr2=0x561b6f48fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3463606944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f48d930 0x561b6f48fd50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb44000a480 tx=0x7fb44001b280 comp rx=0 tx=0).stop 2024-09-13T19:33:26.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb44c10e980 1 -- 172.21.15.144:0/3463606944 shutdown_connections 2024-09-13T19:33:26.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3463606944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f48d930 0x561b6f48fd50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb44c10e980 1 -- 172.21.15.144:0/3463606944 >> 172.21.15.144:0/3463606944 conn(0x561b6f3fd280 msgr2=0x561b6f3fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb44c10e980 1 -- 172.21.15.144:0/3463606944 shutdown_connections 2024-09-13T19:33:26.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.363+0000 7fb44c10e980 1 -- 172.21.15.144:0/3463606944 wait complete. 2024-09-13T19:33:26.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 Processor -- start 2024-09-13T19:33:26.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 -- start start 2024-09-13T19:33:26.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f574d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561b6f335200 con 0x561b6f489df0 2024-09-13T19:33:26.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb449c1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f574d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb449c1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f574d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48254/0 (socket says 172.21.15.144:48254) 2024-09-13T19:33:26.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb449c1e640 1 -- 172.21.15.144:0/1168219464 learned_addr learned my addr 172.21.15.144:0/1168219464 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb449c1e640 1 -- 172.21.15.144:0/1168219464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6f5752d0 con 0x561b6f489df0 2024-09-13T19:33:26.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb449c1e640 1 --2- 172.21.15.144:0/1168219464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f574d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0017b0 tx=0x7fb43c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15212fc0170764d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb337e07640 1 -- 172.21.15.144:0/1168219464 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb43c016070 con 0x561b6f489df0 2024-09-13T19:33:26.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb337e07640 1 -- 172.21.15.144:0/1168219464 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43c004530 con 0x561b6f489df0 2024-09-13T19:33:26.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb337e07640 1 -- 172.21.15.144:0/1168219464 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb43c004870 con 0x561b6f489df0 2024-09-13T19:33:26.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 -- 172.21.15.144:0/1168219464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 msgr2=0x561b6f574d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 --2- 172.21.15.144:0/1168219464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f574d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0017b0 tx=0x7fb43c001c70 comp rx=0 tx=0).stop 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 -- 172.21.15.144:0/1168219464 shutdown_connections 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 --2- 172.21.15.144:0/1168219464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f574d00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 -- 172.21.15.144:0/1168219464 >> 172.21.15.144:0/1168219464 conn(0x561b6f3fd280 msgr2=0x561b6f570930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 -- 172.21.15.144:0/1168219464 shutdown_connections 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.379+0000 7fb44c10e980 1 -- 172.21.15.144:0/1168219464 wait complete. 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44c10e980 1 Processor -- start 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44c10e980 1 -- start start 2024-09-13T19:33:26.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44c10e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f57bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44c10e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561b6f490ec0 con 0x561b6f489df0 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb449c1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f57bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb449c1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f57bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48264/0 (socket says 172.21.15.144:48264) 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb449c1e640 1 -- 172.21.15.144:0/2006127264 learned_addr learned my addr 172.21.15.144:0/2006127264 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb449c1e640 1 -- 172.21.15.144:0/2006127264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6f57c510 con 0x561b6f489df0 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb449c1e640 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f57bfd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb43c000f90 tx=0x7fb43c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb336604640 1 -- 172.21.15.144:0/2006127264 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb43c020070 con 0x561b6f489df0 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b6f57c7a0 con 0x561b6f489df0 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb336604640 1 -- 172.21.15.144:0/2006127264 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43c011400 con 0x561b6f489df0 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb336604640 1 -- 172.21.15.144:0/2006127264 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb43c016040 con 0x561b6f489df0 2024-09-13T19:33:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b6f57f480 con 0x561b6f489df0 2024-09-13T19:33:26.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb336604640 1 -- 172.21.15.144:0/2006127264 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb43c023070 con 0x561b6f489df0 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb336604640 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb330034650 0x7fb330036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb336604640 1 -- 172.21.15.144:0/2006127264 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb43c048fc0 con 0x561b6f489df0 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44941d640 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb330034650 0x7fb330036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f48d930 0x561b6f5830d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.383+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f583610 con 0x561b6f48d930 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44a41f640 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f48d930 0x561b6f5830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44941d640 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb330034650 0x7fb330036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4400ad000 tx=0x7fb4400a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44a41f640 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f48d930 0x561b6f5830d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44a41f640 1 -- 172.21.15.144:0/2006127264 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4440083f0 con 0x561b6f48d930 2024-09-13T19:33:26.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f580680 con 0x561b6f48d930 2024-09-13T19:33:26.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44a41f640 1 -- 172.21.15.144:0/2006127264 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4440083f0 con 0x561b6f48d930 2024-09-13T19:33:26.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f585930 0x561b6f587d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5883f0 con 0x561b6f585930 2024-09-13T19:33:26.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb449c1e640 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f585930 0x561b6f587d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb449c1e640 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f585930 0x561b6f587d20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb449c1e640 1 -- 172.21.15.144:0/2006127264 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f585930 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5847d0 con 0x561b6f48d930 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44a41f640 1 -- 172.21.15.144:0/2006127264 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4440083f0 con 0x561b6f48d930 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.387+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f584cb0 con 0x561b6f48d930 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44a41f640 1 -- 172.21.15.144:0/2006127264 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb4440083f0 con 0x561b6f48d930 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44c10e980 1 Processor -- start 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44c10e980 1 -- start start 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44c10e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f596b30 0x561b6f596f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44c10e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561b6f38e800 con 0x561b6f596b30 2024-09-13T19:33:26.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44a41f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f596b30 0x561b6f596f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44a41f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f596b30 0x561b6f596f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48278/0 (socket says 172.21.15.144:48278) 2024-09-13T19:33:26.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44a41f640 1 -- 172.21.15.144:0/215791995 learned_addr learned my addr 172.21.15.144:0/215791995 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44a41f640 1 -- 172.21.15.144:0/215791995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6f597490 con 0x561b6f596b30 2024-09-13T19:33:26.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44a41f640 1 --2- 172.21.15.144:0/215791995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f596b30 0x561b6f596f50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x561b6f57ced0 tx=0x7fb44400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb32f7fe640 1 -- 172.21.15.144:0/215791995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb444007d70 con 0x561b6f596b30 2024-09-13T19:33:26.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb32f7fe640 1 -- 172.21.15.144:0/215791995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44401e020 con 0x561b6f596b30 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44c10e980 1 -- 172.21.15.144:0/215791995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b6f597720 con 0x561b6f596b30 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb32f7fe640 1 -- 172.21.15.144:0/215791995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb444019590 con 0x561b6f596b30 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb44c10e980 1 -- 172.21.15.144:0/215791995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b6f59a3a0 con 0x561b6f596b30 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb32f7fe640 1 -- 172.21.15.144:0/215791995 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb444016040 con 0x561b6f596b30 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb32f7fe640 1 --2- 172.21.15.144:0/215791995 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb324034650 0x7fb324036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb32f7fe640 1 -- 172.21.15.144:0/215791995 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb44401f030 con 0x561b6f596b30 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.391+0000 7fb449c1e640 1 --2- 172.21.15.144:0/215791995 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb324034650 0x7fb324036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 Processor -- start 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- start start 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb449c1e640 1 --2- 172.21.15.144:0/215791995 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb324034650 0x7fb324036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x561b6f583aa0 tx=0x7fb43c01b870 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561b6f575650 con 0x561b6f5a36c0 2024-09-13T19:33:26.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44a41f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44a41f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5a3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48280/0 (socket says 172.21.15.144:48280) 2024-09-13T19:33:26.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44a41f640 1 -- 172.21.15.144:0/2857462124 learned_addr learned my addr 172.21.15.144:0/2857462124 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44a41f640 1 -- 172.21.15.144:0/2857462124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6f5a4090 con 0x561b6f5a36c0 2024-09-13T19:33:26.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44a41f640 1 --2- 172.21.15.144:0/2857462124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5a3ac0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb44404a2a0 tx=0x7fb44403bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23757f4ee01c9fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb32d7fa640 1 -- 172.21.15.144:0/2857462124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb44401d070 con 0x561b6f5a36c0 2024-09-13T19:33:26.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb32d7fa640 1 -- 172.21.15.144:0/2857462124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44403f030 con 0x561b6f5a36c0 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb32d7fa640 1 -- 172.21.15.144:0/2857462124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb444043650 con 0x561b6f5a36c0 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- 172.21.15.144:0/2857462124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 msgr2=0x561b6f5a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2857462124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5a3ac0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb44404a2a0 tx=0x7fb44403bcc0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- 172.21.15.144:0/2857462124 shutdown_connections 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2857462124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5a3ac0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- 172.21.15.144:0/2857462124 >> 172.21.15.144:0/2857462124 conn(0x561b6f59fa50 msgr2=0x561b6f59db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- 172.21.15.144:0/2857462124 shutdown_connections 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- 172.21.15.144:0/2857462124 wait complete. 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 Processor -- start 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- start start 2024-09-13T19:33:26.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44c10e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561b6f5a4670 con 0x561b6f5a36c0 2024-09-13T19:33:26.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44a41f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44a41f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48292/0 (socket says 172.21.15.144:48292) 2024-09-13T19:33:26.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.395+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 learned_addr learned my addr 172.21.15.144:0/3384191003 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6f5aaf20 con 0x561b6f5a36c0 2024-09-13T19:33:26.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44a41f640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5aa9e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb44403bd00 tx=0x7fb44404a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb31b7fe640 1 -- 172.21.15.144:0/3384191003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb444017770 con 0x561b6f5a36c0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b6f5ab1b0 con 0x561b6f5a36c0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b6f5ab5c0 con 0x561b6f5a36c0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb31b7fe640 1 -- 172.21.15.144:0/3384191003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44402b7d0 con 0x561b6f5a36c0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb31b7fe640 1 -- 172.21.15.144:0/3384191003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb44402bab0 con 0x561b6f5a36c0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb31b7fe640 1 -- 172.21.15.144:0/3384191003 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb444052020 con 0x561b6f5a36c0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb31b7fe640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb314034650 0x7fb314036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb31b7fe640 1 -- 172.21.15.144:0/3384191003 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb444055aa0 con 0x561b6f5a36c0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb449c1e640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb314034650 0x7fb314036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f5b5e80 0x561b6f5b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5b8a90 con 0x561b6f5b5e80 2024-09-13T19:33:26.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44941d640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f5b5e80 0x561b6f5b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb449c1e640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb314034650 0x7fb314036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb43c01b9c0 tx=0x7fb43c026000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44941d640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f5b5e80 0x561b6f5b8340 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 20 realm 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.399+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5b8ec0 con 0x561b6f5b5e80 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5b9790 con 0x561b6f5b5e80 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5b9b30 con 0x561b6f5b5e80 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f5ba890 0x561b6f5bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5bd2d0 con 0x561b6f5ba890 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44a41f640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f5ba890 0x561b6f5bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44a41f640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f5ba890 0x561b6f5bcc80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:26.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 20 searching for the correct realm 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561b6f5bf220 0x561b6f5c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb449c1e640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561b6f5bf220 0x561b6f5c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb449c1e640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561b6f5bf220 0x561b6f5c1650 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb449c1e640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb43c025070 0x7fb43c040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.403+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x7fb43c025070 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44941d640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb43c025070 0x7fb43c040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44941d640 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb43c025070 0x7fb43c040130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5b5e80 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5b5e80 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.407+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x7fb43c025070 2024-09-13T19:33:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5b5e80 2024-09-13T19:33:26.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5b5e80 2024-09-13T19:33:26.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x7fb43c025070 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.411+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5b5e80 2024-09-13T19:33:26.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5b5e80 2024-09-13T19:33:26.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x7fb43c025070 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5b5e80 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.415+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x7fb43c025070 2024-09-13T19:33:26.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5bf220 2024-09-13T19:33:26.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5ba890 2024-09-13T19:33:26.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x561b6f5b5e80 2024-09-13T19:33:26.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c1d20 con 0x7fb43c025070 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5bdc90 con 0x561b6f5b5e80 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5be080 con 0x561b6f5b5e80 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5be080 con 0x561b6f5b5e80 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 zone default found 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 4 Realm: () 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:26.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 zonegroup default 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.419+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5be4a0 con 0x561b6f5ba890 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3b80 con 0x561b6f5bf220 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3f70 con 0x561b6f5bf220 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 20 started sync module instance, tier type = 2024-09-13T19:33:26.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:26.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3020 con 0x7fb43c025070 2024-09-13T19:33:26.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94675832419616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3020 con 0x7fb43c025070 2024-09-13T19:33:26.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.423+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c4a50 con 0x561b6f5b5e80 2024-09-13T19:33:26.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.427+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94675832419616] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.427+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.427+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94675832423744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3020 con 0x561b6f5b5e80 2024-09-13T19:33:26.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.427+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c5490 con 0x561b6f5bf220 2024-09-13T19:33:26.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.427+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.427+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94675832426464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c5ce0 con 0x561b6f5bf220 2024-09-13T19:33:26.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.427+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c66a0 con 0x7fb43c025070 2024-09-13T19:33:26.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.427+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94675832423744] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.431+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94675832426464] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.431+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.431+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94675832417136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c5940 con 0x7fb43c025070 2024-09-13T19:33:26.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.431+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c66a0 con 0x561b6f5b5e80 2024-09-13T19:33:26.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.435+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.435+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94675832432288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c7260 con 0x561b6f5b5e80 2024-09-13T19:33:26.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.435+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c7d50 con 0x561b6f5ba890 2024-09-13T19:33:26.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.435+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94675832417136] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.435+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94675832432288] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.439+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.439+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94675832433888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c7d10 con 0x561b6f5ba890 2024-09-13T19:33:26.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.439+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c8140 con 0x561b6f5ba890 2024-09-13T19:33:26.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.439+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94675832433888] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.439+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.439+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94675832431088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c80f0 con 0x561b6f5ba890 2024-09-13T19:33:26.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.439+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c8b90 con 0x561b6f5ba890 2024-09-13T19:33:26.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94675832440480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c8fd0 con 0x561b6f5ba890 2024-09-13T19:33:26.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 20 add_watcher() i=0 2024-09-13T19:33:26.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 20 add_watcher() i=1 2024-09-13T19:33:26.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 20 add_watcher() i=2 2024-09-13T19:33:26.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 20 add_watcher() i=3 2024-09-13T19:33:26.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 20 add_watcher() i=4 2024-09-13T19:33:26.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 20 add_watcher() i=5 2024-09-13T19:33:26.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94675832431088] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 20 add_watcher() i=6 2024-09-13T19:33:26.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94675832440480] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 20 add_watcher() i=7 2024-09-13T19:33:26.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:26.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c7820 con 0x561b6f5b5e80 2024-09-13T19:33:26.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.443+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94675832436768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c9550 con 0x561b6f5b5e80 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.447+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94675832436768] v30'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.447+0000 7fb2fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.447+0000 7fb44c10e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.447+0000 7fb44c10e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.447+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d48d0 con 0x561b6f5b5e80 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.447+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.447+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d4fa0 con 0x561b6f5ba890 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.451+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.451+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d4fa0 con 0x561b6f5bf220 2024-09-13T19:33:26.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.451+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.451+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d5a40 con 0x561b6f5b5e80 2024-09-13T19:33:26.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.455+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.455+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d2770 con 0x7fb43c025070 2024-09-13T19:33:26.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.455+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.455+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d2770 con 0x561b6f5bf220 2024-09-13T19:33:26.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.455+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.455+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d63d0 con 0x561b6f5b5e80 2024-09-13T19:33:26.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.459+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.459+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d63d0 con 0x561b6f5ba890 2024-09-13T19:33:26.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.463+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.463+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6460 con 0x7fb43c025070 2024-09-13T19:33:26.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.463+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.463+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6460 con 0x561b6f5bf220 2024-09-13T19:33:26.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.467+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.467+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d64f0 con 0x7fb43c025070 2024-09-13T19:33:26.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.467+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.467+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d64f0 con 0x561b6f5ba890 2024-09-13T19:33:26.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.471+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.471+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d66c0 con 0x7fb43c025070 2024-09-13T19:33:26.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.471+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.471+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d66c0 con 0x561b6f5ba890 2024-09-13T19:33:26.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.475+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.475+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d66c0 con 0x561b6f5b5e80 2024-09-13T19:33:26.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.475+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.475+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.479+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.479+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x7fb43c025070 2024-09-13T19:33:26.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.479+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.479+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.479+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.479+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5b5e80 2024-09-13T19:33:26.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.483+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.483+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5b5e80 2024-09-13T19:33:26.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.483+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.483+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.487+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.487+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x7fb43c025070 2024-09-13T19:33:26.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.487+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.487+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.491+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.491+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.491+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.491+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.491+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.491+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.495+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.495+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5ba890 2024-09-13T19:33:26.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.495+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.495+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.499+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.499+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5ba890 2024-09-13T19:33:26.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.503+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.503+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5bf220 2024-09-13T19:33:26.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.503+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.503+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x561b6f5ba890 2024-09-13T19:33:26.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.507+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.507+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d6ae0 con 0x7fb43c025070 2024-09-13T19:33:26.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.507+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.507+0000 7fb2fa7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:26.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.507+0000 7fb44c10e980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:26.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.507+0000 7fb44c10e980 20 Filter name: none 2024-09-13T19:33:26.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb26bfff640 20 reqs_thread_entry: start 2024-09-13T19:33:26.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44c10e980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:33:26.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44c10e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5d1c30 con 0x561b6f5ba890 2024-09-13T19:33:26.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44c10e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.513 INFO:teuthology.orchestra.run.smithi144.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:33:26.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44c10e980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T19:33:26.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44c10e980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:33:26.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb2fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:26.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94675832436768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5b2f40 con 0x561b6f5b5e80 2024-09-13T19:33:26.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94675832436768] v30'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.511+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94675832419616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c7820 con 0x7fb43c025070 2024-09-13T19:33:26.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.515+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94675832419616] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.515+0000 7fb44c10e980 20 remove_watcher() i=0 2024-09-13T19:33:26.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.515+0000 7fb44c10e980 2 removed watcher, disabling cache 2024-09-13T19:33:26.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.515+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94675832423744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3520 con 0x561b6f5b5e80 2024-09-13T19:33:26.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.515+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94675832423744] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.515+0000 7fb44c10e980 20 remove_watcher() i=1 2024-09-13T19:33:26.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.515+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94675832426464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3520 con 0x561b6f5bf220 2024-09-13T19:33:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.519+0000 7fb449c1e640 1 -- 172.21.15.144:0/3384191003 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94675832426464] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb43c02c070 con 0x561b6f5bf220 2024-09-13T19:33:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.519+0000 7fb44c10e980 20 remove_watcher() i=2 2024-09-13T19:33:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.519+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94675832417136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3520 con 0x7fb43c025070 2024-09-13T19:33:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.519+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94675832417136] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x7fb43c025070 2024-09-13T19:33:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.519+0000 7fb44c10e980 20 remove_watcher() i=3 2024-09-13T19:33:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.519+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94675832432288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c2b70 con 0x561b6f5b5e80 2024-09-13T19:33:26.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.523+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94675832432288] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4400b3040 con 0x561b6f5b5e80 2024-09-13T19:33:26.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.523+0000 7fb44c10e980 20 remove_watcher() i=4 2024-09-13T19:33:26.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.523+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94675832433888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3520 con 0x561b6f5ba890 2024-09-13T19:33:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.523+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94675832433888] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.523+0000 7fb44c10e980 20 remove_watcher() i=5 2024-09-13T19:33:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.523+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94675832431088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c6ce0 con 0x561b6f5ba890 2024-09-13T19:33:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94675832431088] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 20 remove_watcher() i=6 2024-09-13T19:33:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94675832440480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561b6f5c3520 con 0x561b6f5ba890 2024-09-13T19:33:26.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44a41f640 1 -- 172.21.15.144:0/3384191003 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94675832440480] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb444036030 con 0x561b6f5ba890 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 20 remove_watcher() i=7 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f5ba890 msgr2=0x561b6f5bcc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f5ba890 0x561b6f5bcc80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f5b5e80 msgr2=0x561b6f5b8340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f5b5e80 0x561b6f5b8340 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb43c025070 msgr2=0x7fb43c040130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb43c025070 0x7fb43c040130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561b6f5bf220 msgr2=0x561b6f5c1650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561b6f5bf220 0x561b6f5c1650 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb314034650 msgr2=0x7fb314036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb314034650 0x7fb314036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb43c01b9c0 tx=0x7fb43c026000 comp rx=0 tx=0).stop 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 msgr2=0x561b6f5aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 --2- 172.21.15.144:0/3384191003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f5a36c0 0x561b6f5aa9e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb44403bd00 tx=0x7fb44404a230 comp rx=0 tx=0).stop 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 reap_dead start 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 shutdown_connections 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44941d640 1 -- 172.21.15.144:0/3384191003 reap_dead start 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 >> 172.21.15.144:0/3384191003 conn(0x561b6f59fa50 msgr2=0x561b6f59db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 shutdown_connections 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.527+0000 7fb44c10e980 1 -- 172.21.15.144:0/3384191003 wait complete. 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/215791995 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb324034650 msgr2=0x7fb324036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/215791995 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb324034650 0x7fb324036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x561b6f583aa0 tx=0x7fb43c01b870 comp rx=0 tx=0).stop 2024-09-13T19:33:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/215791995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f596b30 msgr2=0x561b6f596f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/215791995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f596b30 0x561b6f596f50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x561b6f57ced0 tx=0x7fb44400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/215791995 shutdown_connections 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/215791995 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb324034650 0x7fb324036b10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/215791995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f596b30 0x561b6f596f50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/215791995 >> 172.21.15.144:0/215791995 conn(0x561b6f58bc80 msgr2=0x561b6f58e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/215791995 shutdown_connections 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/215791995 wait complete. 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f585930 msgr2=0x561b6f587d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f585930 0x561b6f587d20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f48d930 msgr2=0x561b6f5830d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f48d930 0x561b6f5830d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb330034650 msgr2=0x7fb330036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb330034650 0x7fb330036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4400ad000 tx=0x7fb4400a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 msgr2=0x561b6f57bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f57bfd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb43c000f90 tx=0x7fb43c001260 comp rx=0 tx=0).stop 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 shutdown_connections 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561b6f48d930 0x561b6f5830d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561b6f585930 0x561b6f587d20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb330034650 0x7fb330036b10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 --2- 172.21.15.144:0/2006127264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6f489df0 0x561b6f57bfd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 >> 172.21.15.144:0/2006127264 conn(0x561b6f3fd280 msgr2=0x561b6f56f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 shutdown_connections 2024-09-13T19:33:26.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.531+0000 7fb44c10e980 1 -- 172.21.15.144:0/2006127264 wait complete. 2024-09-13T19:33:26.544 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:33:26.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:33:26.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:33:26.545 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:33:26.624 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:26.624 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:26.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b25a97980 1 Processor -- start 2024-09-13T19:33:26.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b25a97980 1 -- start start 2024-09-13T19:33:26.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b25a97980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x562d97222c60 0x562d97225050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b25a97980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d970a4ae0 con 0x562d9721e8e0 2024-09-13T19:33:26.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b25a97980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x562d970c8e30 con 0x562d97222c60 2024-09-13T19:33:26.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b22da6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x562d97222c60 0x562d97225050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b235a7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x562d9721e8e0 0x562d9721ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42202/0 (socket says 172.21.15.144:42202) 2024-09-13T19:33:26.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b235a7640 1 -- 172.21.15.144:0/3425419674 learned_addr learned my addr 172.21.15.144:0/3425419674 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:26.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b22da6640 1 -- 172.21.15.144:0/3425419674 >> v1:172.21.15.18:6789/0 conn(0x562d9721e8e0 legacy=0x562d9721ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.623+0000 7f7b22da6640 1 -- 172.21.15.144:0/3425419674 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d972265a0 con 0x562d97222c60 2024-09-13T19:33:26.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b22da6640 1 --2- 172.21.15.144:0/3425419674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d97222c60 0x562d97225050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800a480 tx=0x7f7b1801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb79015fbcebdb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b225a5640 1 -- 172.21.15.144:0/3425419674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b180b0070 con 0x562d97222c60 2024-09-13T19:33:26.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b225a5640 1 -- 172.21.15.144:0/3425419674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b180ab540 con 0x562d97222c60 2024-09-13T19:33:26.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b225a5640 1 -- 172.21.15.144:0/3425419674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b180ab840 con 0x562d97222c60 2024-09-13T19:33:26.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b25a97980 1 -- 172.21.15.144:0/3425419674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d97222c60 msgr2=0x562d97225050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b25a97980 1 --2- 172.21.15.144:0/3425419674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d97222c60 0x562d97225050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800a480 tx=0x7f7b1801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:26.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b25a97980 1 -- 172.21.15.144:0/3425419674 shutdown_connections 2024-09-13T19:33:26.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b25a97980 1 --2- 172.21.15.144:0/3425419674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d97222c60 0x562d97225050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b25a97980 1 -- 172.21.15.144:0/3425419674 >> 172.21.15.144:0/3425419674 conn(0x562d97192230 msgr2=0x562d97192640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b25a97980 1 -- 172.21.15.144:0/3425419674 shutdown_connections 2024-09-13T19:33:26.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.627+0000 7f7b25a97980 1 -- 172.21.15.144:0/3425419674 wait complete. 2024-09-13T19:33:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b25a97980 1 Processor -- start 2024-09-13T19:33:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b25a97980 1 -- start start 2024-09-13T19:33:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b25a97980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97309c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b25a97980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d970ca200 con 0x562d9721e8e0 2024-09-13T19:33:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b235a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97309c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b235a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97309c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48304/0 (socket says 172.21.15.144:48304) 2024-09-13T19:33:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b235a7640 1 -- 172.21.15.144:0/1509175779 learned_addr learned my addr 172.21.15.144:0/1509175779 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b235a7640 1 -- 172.21.15.144:0/1509175779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d9730a210 con 0x562d9721e8e0 2024-09-13T19:33:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.643+0000 7f7b235a7640 1 --2- 172.21.15.144:0/1509175779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97309c40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7b140017b0 tx=0x7f7b14001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6601ea307768c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7a1160a640 1 -- 172.21.15.144:0/1509175779 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14016070 con 0x562d9721e8e0 2024-09-13T19:33:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7a1160a640 1 -- 172.21.15.144:0/1509175779 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14004530 con 0x562d9721e8e0 2024-09-13T19:33:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7a1160a640 1 -- 172.21.15.144:0/1509175779 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14004870 con 0x562d9721e8e0 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- 172.21.15.144:0/1509175779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 msgr2=0x562d97309c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1509175779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97309c40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7b140017b0 tx=0x7f7b14001c70 comp rx=0 tx=0).stop 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- 172.21.15.144:0/1509175779 shutdown_connections 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1509175779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97309c40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- 172.21.15.144:0/1509175779 >> 172.21.15.144:0/1509175779 conn(0x562d97192230 msgr2=0x562d97305870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- 172.21.15.144:0/1509175779 shutdown_connections 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- 172.21.15.144:0/1509175779 wait complete. 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 Processor -- start 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- start start 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97310fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d972260a0 con 0x562d9721e8e0 2024-09-13T19:33:26.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b235a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97310fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b235a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97310fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48312/0 (socket says 172.21.15.144:48312) 2024-09-13T19:33:26.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b235a7640 1 -- 172.21.15.144:0/4213810990 learned_addr learned my addr 172.21.15.144:0/4213810990 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b235a7640 1 -- 172.21.15.144:0/4213810990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d97311500 con 0x562d9721e8e0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b235a7640 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97310fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000f90 tx=0x7f7b14001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7a0fe07640 1 -- 172.21.15.144:0/4213810990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14020070 con 0x562d9721e8e0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d97311790 con 0x562d9721e8e0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d97314470 con 0x562d9721e8e0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7a0fe07640 1 -- 172.21.15.144:0/4213810990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14025450 con 0x562d9721e8e0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.647+0000 7f7a0fe07640 1 -- 172.21.15.144:0/4213810990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1402a060 con 0x562d9721e8e0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7a0fe07640 1 -- 172.21.15.144:0/4213810990 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b14023070 con 0x562d9721e8e0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7a0fe07640 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7a080346f0 0x7f7a08036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7a0fe07640 1 -- 172.21.15.144:0/4213810990 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7b140493e0 con 0x562d9721e8e0 2024-09-13T19:33:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b22da6640 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7a080346f0 0x7f7a08036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d97222c60 0x562d973180c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97318600 con 0x562d97222c60 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b23da8640 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d97222c60 0x562d973180c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b22da6640 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7a080346f0 0x7f7a08036bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b180ad000 tx=0x7f7b180a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b23da8640 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d97222c60 0x562d973180c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b23da8640 1 -- 172.21.15.144:0/4213810990 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d97222c60 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97318a00 con 0x562d97222c60 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b23da8640 1 -- 172.21.15.144:0/4213810990 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d97222c60 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9731a810 0x562d9731cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d9731d2f0 con 0x562d9731a810 2024-09-13T19:33:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b235a7640 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9731a810 0x562d9731cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.651+0000 7f7b235a7640 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9731a810 0x562d9731cc00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b235a7640 1 -- 172.21.15.144:0/4213810990 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b14022030 con 0x562d9731a810 2024-09-13T19:33:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d973196b0 con 0x562d97222c60 2024-09-13T19:33:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b23da8640 1 -- 172.21.15.144:0/4213810990 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d97222c60 2024-09-13T19:33:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97319b90 con 0x562d97222c60 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b23da8640 1 -- 172.21.15.144:0/4213810990 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d97222c60 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b25a97980 1 Processor -- start 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b25a97980 1 -- start start 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b25a97980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9732ba10 0x562d9732be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b25a97980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d97123800 con 0x562d9732ba10 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b23da8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9732ba10 0x562d9732be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b23da8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9732ba10 0x562d9732be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48328/0 (socket says 172.21.15.144:48328) 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b23da8640 1 -- 172.21.15.144:0/3223600537 learned_addr learned my addr 172.21.15.144:0/3223600537 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b23da8640 1 -- 172.21.15.144:0/3223600537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d9732c370 con 0x562d9732ba10 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.655+0000 7f7b23da8640 1 --2- 172.21.15.144:0/3223600537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9732ba10 0x562d9732be30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x562d973123f0 tx=0x7f7b1c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7a0d602640 1 -- 172.21.15.144:0/3223600537 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c007dd0 con 0x562d9732ba10 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b25a97980 1 -- 172.21.15.144:0/3223600537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d9732c600 con 0x562d9732ba10 2024-09-13T19:33:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7a0d602640 1 -- 172.21.15.144:0/3223600537 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c01e020 con 0x562d9732ba10 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b25a97980 1 -- 172.21.15.144:0/3223600537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d9732f280 con 0x562d9732ba10 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7a0d602640 1 -- 172.21.15.144:0/3223600537 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c019550 con 0x562d9732ba10 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7a0d602640 1 -- 172.21.15.144:0/3223600537 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b1c016040 con 0x562d9732ba10 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7a0d602640 1 --2- 172.21.15.144:0/3223600537 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79fc034650 0x7f79fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7a0d602640 1 -- 172.21.15.144:0/3223600537 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7b1c01f030 con 0x562d9732ba10 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b235a7640 1 --2- 172.21.15.144:0/3223600537 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79fc034650 0x7f79fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b25a97980 1 Processor -- start 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b25a97980 1 -- start start 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b235a7640 1 --2- 172.21.15.144:0/3223600537 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79fc034650 0x7f79fc036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x562d973155f0 tx=0x7f7b1402e760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b25a97980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d973388c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b25a97980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d9730a590 con 0x562d973384c0 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b23da8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d973388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b23da8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d973388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48336/0 (socket says 172.21.15.144:48336) 2024-09-13T19:33:26.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b23da8640 1 -- 172.21.15.144:0/2263205751 learned_addr learned my addr 172.21.15.144:0/2263205751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b23da8640 1 -- 172.21.15.144:0/2263205751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d97338e90 con 0x562d973384c0 2024-09-13T19:33:26.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7b23da8640 1 --2- 172.21.15.144:0/2263205751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d973388c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c04a010 tx=0x7f7b1c015800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a8bfe604fcf61d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7a06ffd640 1 -- 172.21.15.144:0/2263205751 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c01d070 con 0x562d973384c0 2024-09-13T19:33:26.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.659+0000 7f7a06ffd640 1 -- 172.21.15.144:0/2263205751 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0224f0 con 0x562d973384c0 2024-09-13T19:33:26.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7a06ffd640 1 -- 172.21.15.144:0/2263205751 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c014470 con 0x562d973384c0 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- 172.21.15.144:0/2263205751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 msgr2=0x562d973388c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 --2- 172.21.15.144:0/2263205751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d973388c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c04a010 tx=0x7f7b1c015800 comp rx=0 tx=0).stop 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- 172.21.15.144:0/2263205751 shutdown_connections 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 --2- 172.21.15.144:0/2263205751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d973388c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- 172.21.15.144:0/2263205751 >> 172.21.15.144:0/2263205751 conn(0x562d97334930 msgr2=0x562d97332a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- 172.21.15.144:0/2263205751 shutdown_connections 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- 172.21.15.144:0/2263205751 wait complete. 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 Processor -- start 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- start start 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d9733f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d973394c0 con 0x562d973384c0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b23da8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d9733f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b23da8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d9733f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48344/0 (socket says 172.21.15.144:48344) 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 learned_addr learned my addr 172.21.15.144:0/1426133541 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d9733fdb0 con 0x562d973384c0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b23da8640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d9733f870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c014880 tx=0x7f7b1c049f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7a057fa640 1 -- 172.21.15.144:0/1426133541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c019900 con 0x562d973384c0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7a057fa640 1 -- 172.21.15.144:0/1426133541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c019aa0 con 0x562d973384c0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7a057fa640 1 -- 172.21.15.144:0/1426133541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c04b190 con 0x562d973384c0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d97340040 con 0x562d973384c0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.663+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d97342d20 con 0x562d973384c0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7a057fa640 1 -- 172.21.15.144:0/1426133541 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b1c043050 con 0x562d973384c0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7a057fa640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79ec0346f0 0x7f79ec036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7a057fa640 1 -- 172.21.15.144:0/1426133541 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7b1c041020 con 0x562d973384c0 2024-09-13T19:33:26.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d9734ad50 0x562d9734d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d9734d940 con 0x562d9734ad50 2024-09-13T19:33:26.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b235a7640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79ec0346f0 0x7f79ec036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b22da6640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d9734ad50 0x562d9734d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b22da6640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d9734ad50 0x562d9734d1f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b235a7640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79ec0346f0 0x7f79ec036bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b14049350 tx=0x7f7b1403a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 realm 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d9734dd70 con 0x562d9734ad50 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d9734e640 con 0x562d9734ad50 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d9734e9e0 con 0x562d9734ad50 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9734f740 0x562d97351b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97352180 con 0x562d9734f740 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.667+0000 7f7b23da8640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9734f740 0x562d97351b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b23da8640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9734f740 0x562d97351b30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b25a97980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b25a97980 20 searching for the correct realm 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562d973540d0 0x562d97356500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b235a7640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562d973540d0 0x562d97356500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b235a7640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562d973540d0 0x562d97356500 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b235a7640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7b14025070 0x7f7b14025730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x7f7b14025070 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b22da6640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7b14025070 0x7f7b14025730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b22da6640 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7b14025070 0x7f7b14025730 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734ad50 2024-09-13T19:33:26.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734ad50 2024-09-13T19:33:26.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.671+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x7f7b14025070 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734ad50 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734ad50 2024-09-13T19:33:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x7f7b14025070 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.675+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734ad50 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734ad50 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x7f7b14025070 2024-09-13T19:33:26.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734ad50 2024-09-13T19:33:26.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.679+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x7f7b14025070 2024-09-13T19:33:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d973540d0 2024-09-13T19:33:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734f740 2024-09-13T19:33:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x562d9734ad50 2024-09-13T19:33:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562d97356bd0 con 0x7f7b14025070 2024-09-13T19:33:26.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:26.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:26.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:26.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97352b40 con 0x562d9734ad50 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97352f30 con 0x562d9734ad50 2024-09-13T19:33:26.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97352f30 con 0x562d9734ad50 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 zone default found 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 4 Realm: () 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 zonegroup default 2024-09-13T19:33:26.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.683+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97353350 con 0x562d9734f740 2024-09-13T19:33:26.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97358a30 con 0x562d973540d0 2024-09-13T19:33:26.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97358dd0 con 0x562d973540d0 2024-09-13T19:33:26.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 20 started sync module instance, tier type = 2024-09-13T19:33:26.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:26.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d97357ed0 con 0x7f7b14025070 2024-09-13T19:33:26.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94753810383824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d97357ed0 con 0x7f7b14025070 2024-09-13T19:33:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.687+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d973598e0 con 0x562d9734ad50 2024-09-13T19:33:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.691+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94753810383824] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.691+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.691+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94753810387920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d97357ed0 con 0x562d9734ad50 2024-09-13T19:33:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.691+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735a2f0 con 0x562d973540d0 2024-09-13T19:33:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.691+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94753810387920] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.691+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.691+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94753810381344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d97357e40 con 0x562d973540d0 2024-09-13T19:33:26.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.691+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735aff0 con 0x7f7b14025070 2024-09-13T19:33:26.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.695+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.695+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94753810394192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735b6a0 con 0x7f7b14025070 2024-09-13T19:33:26.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.695+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735c1c0 con 0x562d9734ad50 2024-09-13T19:33:26.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.695+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94753810381344] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.695+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94753810394192] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.695+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.695+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94753810398352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735c180 con 0x562d9734ad50 2024-09-13T19:33:26.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.695+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735c5b0 con 0x562d9734f740 2024-09-13T19:33:26.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.699+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.699+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94753810395376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735ce50 con 0x562d9734f740 2024-09-13T19:33:26.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.699+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735d810 con 0x562d9734f740 2024-09-13T19:33:26.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.699+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94753810398352] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.699+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.699+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94753810392720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735d810 con 0x562d9734f740 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.699+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735e210 con 0x562d9734f740 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.699+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94753810395376] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94753810392720] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94753810406688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735d3a0 con 0x562d9734f740 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 20 add_watcher() i=0 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 20 add_watcher() i=1 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 20 add_watcher() i=2 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 20 add_watcher() i=3 2024-09-13T19:33:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 20 add_watcher() i=4 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 20 add_watcher() i=5 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 20 add_watcher() i=6 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94753810406688] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 20 add_watcher() i=7 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97361310 con 0x562d9734ad50 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.703+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94753810401616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735e790 con 0x562d9734ad50 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.707+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94753810401616] v30'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.707+0000 7f79d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.707+0000 7f7b25a97980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.707+0000 7f7b25a97980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:26.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.707+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d973699e0 con 0x562d9734ad50 2024-09-13T19:33:26.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.707+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.707+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736a0b0 con 0x562d9734f740 2024-09-13T19:33:26.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.711+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.711+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736a0b0 con 0x562d973540d0 2024-09-13T19:33:26.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.711+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.711+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736a900 con 0x562d9734ad50 2024-09-13T19:33:26.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.711+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.711+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d973678d0 con 0x7f7b14025070 2024-09-13T19:33:26.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.715+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.715+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d973678d0 con 0x562d973540d0 2024-09-13T19:33:26.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.715+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.715+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736b460 con 0x562d9734ad50 2024-09-13T19:33:26.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.719+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.719+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736b590 con 0x562d9734f740 2024-09-13T19:33:26.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.719+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.719+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736ba10 con 0x7f7b14025070 2024-09-13T19:33:26.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.723+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.723+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736ba10 con 0x562d973540d0 2024-09-13T19:33:26.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.723+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.723+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736ba10 con 0x7f7b14025070 2024-09-13T19:33:26.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.723+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.723+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736ba10 con 0x562d9734f740 2024-09-13T19:33:26.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.727+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.727+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736ba10 con 0x7f7b14025070 2024-09-13T19:33:26.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.727+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.727+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736ba10 con 0x562d9734f740 2024-09-13T19:33:26.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.731+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.731+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736ba10 con 0x562d9734ad50 2024-09-13T19:33:26.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.731+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'38 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.731+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736ba10 con 0x562d973540d0 2024-09-13T19:33:26.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.735+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.735+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736baa0 con 0x7f7b14025070 2024-09-13T19:33:26.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.735+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.735+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736baa0 con 0x562d973540d0 2024-09-13T19:33:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.739+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.739+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736baa0 con 0x562d9734ad50 2024-09-13T19:33:26.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.743+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.743+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736baa0 con 0x562d9734ad50 2024-09-13T19:33:26.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.743+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.743+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736baa0 con 0x562d973540d0 2024-09-13T19:33:26.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.747+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.747+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x7f7b14025070 2024-09-13T19:33:26.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.747+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.747+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d973540d0 2024-09-13T19:33:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.747+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.747+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d973540d0 2024-09-13T19:33:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.751+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.751+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d973540d0 2024-09-13T19:33:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.751+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.751+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d973540d0 2024-09-13T19:33:26.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.751+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.751+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d9734f740 2024-09-13T19:33:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.755+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.755+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d973540d0 2024-09-13T19:33:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.755+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.755+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d9734f740 2024-09-13T19:33:26.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.759+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.759+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d973540d0 2024-09-13T19:33:26.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.763+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.763+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x562d9734f740 2024-09-13T19:33:26.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.763+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.763+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9736bac0 con 0x7f7b14025070 2024-09-13T19:33:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.767+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.767+0000 7f79d8fe1640 20 reqs_thread_entry: start 2024-09-13T19:33:26.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.767+0000 7f7b25a97980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:26.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.767+0000 7f7b25a97980 20 Filter name: none 2024-09-13T19:33:26.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.767+0000 7f79527fc640 20 reqs_thread_entry: start 2024-09-13T19:33:26.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.767+0000 7f7b25a97980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:33:26.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.767+0000 7f7b25a97980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.767+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562d97366da0 con 0x562d9734f740 2024-09-13T19:33:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.771+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.771+0000 7f7b25a97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.771+0000 7f7b25a97980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:33:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.771+0000 7f7b25a97980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:33:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.771+0000 7f79d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.771+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94753810401616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d973654d0 con 0x562d9734ad50 2024-09-13T19:33:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.771+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94753810401616] v30'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.771+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94753810383824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735c950 con 0x7f7b14025070 2024-09-13T19:33:26.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.775+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94753810383824] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.775+0000 7f7b25a97980 20 remove_watcher() i=0 2024-09-13T19:33:26.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.775+0000 7f7b25a97980 2 removed watcher, disabling cache 2024-09-13T19:33:26.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.775+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94753810387920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735c950 con 0x562d9734ad50 2024-09-13T19:33:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.775+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94753810387920] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.775+0000 7f7b25a97980 20 remove_watcher() i=1 2024-09-13T19:33:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.775+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94753810381344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d973593d0 con 0x562d973540d0 2024-09-13T19:33:26.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.779+0000 7f7b235a7640 1 -- 172.21.15.144:0/1426133541 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94753810381344] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b14038030 con 0x562d973540d0 2024-09-13T19:33:26.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.779+0000 7f7b25a97980 20 remove_watcher() i=2 2024-09-13T19:33:26.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.779+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94753810394192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735c950 con 0x7f7b14025070 2024-09-13T19:33:26.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.779+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94753810394192] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x7f7b14025070 2024-09-13T19:33:26.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.779+0000 7f7b25a97980 20 remove_watcher() i=3 2024-09-13T19:33:26.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.779+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94753810398352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d97357a20 con 0x562d9734ad50 2024-09-13T19:33:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.783+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94753810398352] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b180b3040 con 0x562d9734ad50 2024-09-13T19:33:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.783+0000 7f7b25a97980 20 remove_watcher() i=4 2024-09-13T19:33:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.783+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94753810395376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d973593d0 con 0x562d9734f740 2024-09-13T19:33:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.787+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94753810395376] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.787+0000 7f7b25a97980 20 remove_watcher() i=5 2024-09-13T19:33:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.787+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94753810392720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735ac50 con 0x562d9734f740 2024-09-13T19:33:26.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.787+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94753810392720] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.787+0000 7f7b25a97980 20 remove_watcher() i=6 2024-09-13T19:33:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.787+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94753810406688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562d9735c950 con 0x562d9734f740 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b23da8640 1 -- 172.21.15.144:0/1426133541 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94753810406688] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0083f0 con 0x562d9734f740 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 20 remove_watcher() i=7 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9734f740 msgr2=0x562d97351b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9734f740 0x562d97351b30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d9734ad50 msgr2=0x562d9734d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d9734ad50 0x562d9734d1f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7b14025070 msgr2=0x7f7b14025730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7b14025070 0x7f7b14025730 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562d973540d0 msgr2=0x562d97356500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562d973540d0 0x562d97356500 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79ec0346f0 msgr2=0x7f79ec036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79ec0346f0 0x7f79ec036bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b14049350 tx=0x7f7b1403a000 comp rx=0 tx=0).stop 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 msgr2=0x562d9733f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/1426133541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d973384c0 0x562d9733f870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c014880 tx=0x7f7b1c049f70 comp rx=0 tx=0).stop 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 reap_dead start 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b22da6640 1 -- 172.21.15.144:0/1426133541 reap_dead start 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 shutdown_connections 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 >> 172.21.15.144:0/1426133541 conn(0x562d97334930 msgr2=0x562d97332a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 shutdown_connections 2024-09-13T19:33:26.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/1426133541 wait complete. 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/3223600537 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79fc034650 msgr2=0x7f79fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/3223600537 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79fc034650 0x7f79fc036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x562d973155f0 tx=0x7f7b1402e760 comp rx=0 tx=0).stop 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/3223600537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9732ba10 msgr2=0x562d9732be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/3223600537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9732ba10 0x562d9732be30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x562d973123f0 tx=0x7f7b1c00af40 comp rx=0 tx=0).stop 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/3223600537 shutdown_connections 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/3223600537 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f79fc034650 0x7f79fc036b10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/3223600537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9732ba10 0x562d9732be30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/3223600537 >> 172.21.15.144:0/3223600537 conn(0x562d97320b60 msgr2=0x562d973235e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/3223600537 shutdown_connections 2024-09-13T19:33:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/3223600537 wait complete. 2024-09-13T19:33:26.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9731a810 msgr2=0x562d9731cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9731a810 0x562d9731cc00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d97222c60 msgr2=0x562d973180c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d97222c60 0x562d973180c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7a080346f0 msgr2=0x7f7a08036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7a080346f0 0x7f7a08036bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b180ad000 tx=0x7f7b180a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 msgr2=0x562d97310fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97310fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000f90 tx=0x7f7b14001260 comp rx=0 tx=0).stop 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 shutdown_connections 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562d97222c60 0x562d973180c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562d9731a810 0x562d9731cc00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7a080346f0 0x7f7a08036bb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 --2- 172.21.15.144:0/4213810990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d9721e8e0 0x562d97310fc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 >> 172.21.15.144:0/4213810990 conn(0x562d97192230 msgr2=0x562d973043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 shutdown_connections 2024-09-13T19:33:26.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.791+0000 7f7b25a97980 1 -- 172.21.15.144:0/4213810990 wait complete. 2024-09-13T19:33:26.808 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:33:26.809 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:33:26.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:33:26.809 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:33:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:26.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.883+0000 7f2261d85980 1 Processor -- start 2024-09-13T19:33:26.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f2261d85980 1 -- start start 2024-09-13T19:33:26.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f2261d85980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b59e535ac0 0x55b59e537eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f2261d85980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b59e3b9ae0 con 0x55b59e4a6290 2024-09-13T19:33:26.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f2261d85980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55b59e3dde30 con 0x55b59e535ac0 2024-09-13T19:33:26.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f2257094640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b59e535ac0 0x55b59e537eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f225f895640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55b59e4a6290 0x55b59e5343a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42204/0 (socket says 172.21.15.144:42204) 2024-09-13T19:33:26.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f225f895640 1 -- 172.21.15.144:0/2423471472 learned_addr learned my addr 172.21.15.144:0/2423471472 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:26.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f2257094640 1 -- 172.21.15.144:0/2423471472 >> v1:172.21.15.18:6789/0 conn(0x55b59e4a6290 legacy=0x55b59e5343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f2257094640 1 -- 172.21.15.144:0/2423471472 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59e4a6820 con 0x55b59e535ac0 2024-09-13T19:33:26.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.887+0000 7f225f094640 1 -- 172.21.15.144:0/2423471472 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506583473 0 0) 0x55b59e3b9ae0 con 0x55b59e4a6290 2024-09-13T19:33:26.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f2257094640 1 --2- 172.21.15.144:0/2423471472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e535ac0 0x55b59e537eb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f224800a480 tx=0x7f224801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a628a9f0d6cd245 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f225f094640 1 -- 172.21.15.144:0/2423471472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22480b0070 con 0x55b59e535ac0 2024-09-13T19:33:26.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f225f094640 1 -- 172.21.15.144:0/2423471472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22480ab540 con 0x55b59e535ac0 2024-09-13T19:33:26.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f225f094640 1 -- 172.21.15.144:0/2423471472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22480ab840 con 0x55b59e535ac0 2024-09-13T19:33:26.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f2261d85980 1 -- 172.21.15.144:0/2423471472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e535ac0 msgr2=0x55b59e537eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f2261d85980 1 --2- 172.21.15.144:0/2423471472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e535ac0 0x55b59e537eb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f224800a480 tx=0x7f224801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:26.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f2261d85980 1 -- 172.21.15.144:0/2423471472 shutdown_connections 2024-09-13T19:33:26.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f2261d85980 1 --2- 172.21.15.144:0/2423471472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e535ac0 0x55b59e537eb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f2261d85980 1 -- 172.21.15.144:0/2423471472 >> 172.21.15.144:0/2423471472 conn(0x55b59e52c090 msgr2=0x55b59e52e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f2261d85980 1 -- 172.21.15.144:0/2423471472 shutdown_connections 2024-09-13T19:33:26.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.891+0000 7f2261d85980 1 -- 172.21.15.144:0/2423471472 wait complete. 2024-09-13T19:33:26.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f2261d85980 1 Processor -- start 2024-09-13T19:33:26.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f2261d85980 1 -- start start 2024-09-13T19:33:26.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f2261d85980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e61c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f2261d85980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b59e3df200 con 0x55b59e4a6290 2024-09-13T19:33:26.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f225f895640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e61c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f225f895640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e61c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48362/0 (socket says 172.21.15.144:48362) 2024-09-13T19:33:26.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f225f895640 1 -- 172.21.15.144:0/733035579 learned_addr learned my addr 172.21.15.144:0/733035579 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f225f895640 1 -- 172.21.15.144:0/733035579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59e61cf00 con 0x55b59e4a6290 2024-09-13T19:33:26.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f225f895640 1 --2- 172.21.15.144:0/733035579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e61c930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f225000b250 tx=0x7f225000b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa61b394bf25a262 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f214de0b640 1 -- 172.21.15.144:0/733035579 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f225000d640 con 0x55b59e4a6290 2024-09-13T19:33:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f214de0b640 1 -- 172.21.15.144:0/733035579 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2250008070 con 0x55b59e4a6290 2024-09-13T19:33:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.907+0000 7f214de0b640 1 -- 172.21.15.144:0/733035579 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f225000d990 con 0x55b59e4a6290 2024-09-13T19:33:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- 172.21.15.144:0/733035579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 msgr2=0x55b59e61c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 --2- 172.21.15.144:0/733035579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e61c930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f225000b250 tx=0x7f225000b710 comp rx=0 tx=0).stop 2024-09-13T19:33:26.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- 172.21.15.144:0/733035579 shutdown_connections 2024-09-13T19:33:26.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 --2- 172.21.15.144:0/733035579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e61c930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- 172.21.15.144:0/733035579 >> 172.21.15.144:0/733035579 conn(0x55b59e52c090 msgr2=0x55b59e6184c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- 172.21.15.144:0/733035579 shutdown_connections 2024-09-13T19:33:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- 172.21.15.144:0/733035579 wait complete. 2024-09-13T19:33:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 Processor -- start 2024-09-13T19:33:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- start start 2024-09-13T19:33:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e623cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b59e538f00 con 0x55b59e4a6290 2024-09-13T19:33:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f225f895640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e623cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f225f895640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e623cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48378/0 (socket says 172.21.15.144:48378) 2024-09-13T19:33:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f225f895640 1 -- 172.21.15.144:0/204252348 learned_addr learned my addr 172.21.15.144:0/204252348 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f225f895640 1 -- 172.21.15.144:0/204252348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59e624230 con 0x55b59e4a6290 2024-09-13T19:33:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f225f895640 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e623cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2250000c10 tx=0x7f2250000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2147fff640 1 -- 172.21.15.144:0/204252348 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f225001a7c0 con 0x55b59e4a6290 2024-09-13T19:33:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b59e6244c0 con 0x55b59e4a6290 2024-09-13T19:33:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59e6271a0 con 0x55b59e4a6290 2024-09-13T19:33:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2147fff640 1 -- 172.21.15.144:0/204252348 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225001a960 con 0x55b59e4a6290 2024-09-13T19:33:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2147fff640 1 -- 172.21.15.144:0/204252348 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f225002c060 con 0x55b59e4a6290 2024-09-13T19:33:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2147fff640 1 -- 172.21.15.144:0/204252348 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2250017070 con 0x55b59e4a6290 2024-09-13T19:33:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2147fff640 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f21480346a0 0x7f2148036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.911+0000 7f2147fff640 1 -- 172.21.15.144:0/204252348 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2250015020 con 0x55b59e4a6290 2024-09-13T19:33:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2257094640 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f21480346a0 0x7f2148036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e628c70 0x55b59e62b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e62b6b0 con 0x55b59e628c70 2024-09-13T19:33:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2260096640 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e628c70 0x55b59e62b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2257094640 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f21480346a0 0x7f2148036b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22480ad000 tx=0x7f22480a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2260096640 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e628c70 0x55b59e62b060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2260096640 1 -- 172.21.15.144:0/204252348 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f225800a4d0 con 0x55b59e628c70 2024-09-13T19:33:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6283c0 con 0x55b59e628c70 2024-09-13T19:33:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2260096640 1 -- 172.21.15.144:0/204252348 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f225800a4d0 con 0x55b59e628c70 2024-09-13T19:33:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e62d9e0 0x55b59e62fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6304c0 con 0x55b59e62d9e0 2024-09-13T19:33:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f225f895640 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e62d9e0 0x55b59e62fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f225f895640 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e62d9e0 0x55b59e62fdd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f225f895640 1 -- 172.21.15.144:0/204252348 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f225002e070 con 0x55b59e62d9e0 2024-09-13T19:33:26.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e62c880 con 0x55b59e628c70 2024-09-13T19:33:26.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2260096640 1 -- 172.21.15.144:0/204252348 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f225800a4d0 con 0x55b59e628c70 2024-09-13T19:33:26.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.915+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e62cd20 con 0x55b59e628c70 2024-09-13T19:33:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2260096640 1 -- 172.21.15.144:0/204252348 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f225800a4d0 con 0x55b59e628c70 2024-09-13T19:33:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2261d85980 1 Processor -- start 2024-09-13T19:33:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2261d85980 1 -- start start 2024-09-13T19:33:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2261d85980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e63ebc0 0x55b59e63efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2261d85980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b59e438800 con 0x55b59e63ebc0 2024-09-13T19:33:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2260096640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e63ebc0 0x55b59e63efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2260096640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e63ebc0 0x55b59e63efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48380/0 (socket says 172.21.15.144:48380) 2024-09-13T19:33:26.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2260096640 1 -- 172.21.15.144:0/2390953617 learned_addr learned my addr 172.21.15.144:0/2390953617 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2260096640 1 -- 172.21.15.144:0/2390953617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59e63f520 con 0x55b59e63ebc0 2024-09-13T19:33:26.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2260096640 1 --2- 172.21.15.144:0/2390953617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e63ebc0 0x55b59e63efe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55b59e624f40 tx=0x7f2258018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f21457fa640 1 -- 172.21.15.144:0/2390953617 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2258014450 con 0x55b59e63ebc0 2024-09-13T19:33:26.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2261d85980 1 -- 172.21.15.144:0/2390953617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b59e63f7b0 con 0x55b59e63ebc0 2024-09-13T19:33:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f21457fa640 1 -- 172.21.15.144:0/2390953617 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22580145f0 con 0x55b59e63ebc0 2024-09-13T19:33:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f21457fa640 1 -- 172.21.15.144:0/2390953617 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22580148f0 con 0x55b59e63ebc0 2024-09-13T19:33:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f2261d85980 1 -- 172.21.15.144:0/2390953617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59e642430 con 0x55b59e63ebc0 2024-09-13T19:33:26.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f21457fa640 1 -- 172.21.15.144:0/2390953617 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2258011040 con 0x55b59e63ebc0 2024-09-13T19:33:26.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f21457fa640 1 --2- 172.21.15.144:0/2390953617 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2138034650 0x7f2138036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f21457fa640 1 -- 172.21.15.144:0/2390953617 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f225801e070 con 0x55b59e63ebc0 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.919+0000 7f225f895640 1 --2- 172.21.15.144:0/2390953617 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2138034650 0x7f2138036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 Processor -- start 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- start start 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f225f895640 1 --2- 172.21.15.144:0/2390953617 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2138034650 0x7f2138036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55b59e62bb30 tx=0x7f2250028f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e64bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b59e61d280 con 0x55b59e64b6e0 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2260096640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e64bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2260096640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e64bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48388/0 (socket says 172.21.15.144:48388) 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2260096640 1 -- 172.21.15.144:0/79413785 learned_addr learned my addr 172.21.15.144:0/79413785 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2260096640 1 -- 172.21.15.144:0/79413785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59e64c0b0 con 0x55b59e64b6e0 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2260096640 1 --2- 172.21.15.144:0/79413785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e64bae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f225804a0e0 tx=0x7f2258011330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8400d9d517b94984 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f213effd640 1 -- 172.21.15.144:0/79413785 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2258022c90 con 0x55b59e64b6e0 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f213effd640 1 -- 172.21.15.144:0/79413785 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2258022e30 con 0x55b59e64b6e0 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f213effd640 1 -- 172.21.15.144:0/79413785 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f225803ab60 con 0x55b59e64b6e0 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- 172.21.15.144:0/79413785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 msgr2=0x55b59e64bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 --2- 172.21.15.144:0/79413785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e64bae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f225804a0e0 tx=0x7f2258011330 comp rx=0 tx=0).stop 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- 172.21.15.144:0/79413785 shutdown_connections 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 --2- 172.21.15.144:0/79413785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e64bae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- 172.21.15.144:0/79413785 >> 172.21.15.144:0/79413785 conn(0x55b59e647ac0 msgr2=0x55b59e645bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- 172.21.15.144:0/79413785 shutdown_connections 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- 172.21.15.144:0/79413785 wait complete. 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 Processor -- start 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- start start 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e531c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2261d85980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b59e64c6b0 con 0x55b59e64b6e0 2024-09-13T19:33:26.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2260096640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e531c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2260096640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e531c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48396/0 (socket says 172.21.15.144:48396) 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.923+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 learned_addr learned my addr 172.21.15.144:0/2197257148 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59e5321c0 con 0x55b59e64b6e0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2260096640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e531c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2258011950 tx=0x7f225804a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f213d7fa640 1 -- 172.21.15.144:0/2197257148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22580119c0 con 0x55b59e64b6e0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b59e5303a0 con 0x55b59e64b6e0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f213d7fa640 1 -- 172.21.15.144:0/2197257148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22580168f0 con 0x55b59e64b6e0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f213d7fa640 1 -- 172.21.15.144:0/2197257148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2258013990 con 0x55b59e64b6e0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59e530810 con 0x55b59e64b6e0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f213d7fa640 1 -- 172.21.15.144:0/2197257148 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f225802b350 con 0x55b59e64b6e0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f213d7fa640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2128034650 0x7f2128036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f213d7fa640 1 -- 172.21.15.144:0/2197257148 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2258035030 con 0x55b59e64b6e0 2024-09-13T19:33:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f225f895640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2128034650 0x7f2128036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e6602f0 0x55b59e6627b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e662f00 con 0x55b59e6602f0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2257094640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e6602f0 0x55b59e6627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f225f895640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2128034650 0x7f2128036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2250019de0 tx=0x7f2250036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2257094640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e6602f0 0x55b59e6627b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 20 realm 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e663330 con 0x55b59e6602f0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.927+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e663c00 con 0x55b59e6602f0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e663fa0 con 0x55b59e6602f0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e664d00 0x55b59e6670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e667700 con 0x55b59e664d00 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2260096640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e664d00 0x55b59e6670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2260096640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e664d00 0x55b59e6670f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 20 searching for the correct realm 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b59e6695e0 0x55b59e66ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f225f895640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b59e6695e0 0x55b59e66ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f225f895640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b59e6695e0 0x55b59e66ba50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f225f895640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f22500423b0 0x7f225000f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x7f22500423b0 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2257094640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f22500423b0 0x7f225000f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.931+0000 7f2257094640 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f22500423b0 0x7f225000f400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:26.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6602f0 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6602f0 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x7f22500423b0 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6602f0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.935+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6602f0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x7f22500423b0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6602f0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6602f0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.939+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x7f22500423b0 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6602f0 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x7f22500423b0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6695e0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.943+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e664d00 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x55b59e6602f0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66c120 con 0x7f22500423b0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:26.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e668050 con 0x55b59e6602f0 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e668440 con 0x55b59e6602f0 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e668440 con 0x55b59e6602f0 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 zone default found 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 4 Realm: () 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 zonegroup default 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e668860 con 0x55b59e664d00 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66df80 con 0x55b59e6695e0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.947+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66e3f0 con 0x55b59e6695e0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 20 started sync module instance, tier type = 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66d420 con 0x7f22500423b0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94238534982000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66d420 con 0x7f22500423b0 2024-09-13T19:33:26.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.951+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66ef00 con 0x55b59e6602f0 2024-09-13T19:33:26.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.955+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.955+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94238534982000] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.955+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94238534986224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66d420 con 0x55b59e6602f0 2024-09-13T19:33:26.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.955+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66f910 con 0x55b59e6695e0 2024-09-13T19:33:26.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.955+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94238534986224] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.955+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.955+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94238534979440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66d390 con 0x55b59e6695e0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.955+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e670660 con 0x7f22500423b0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.959+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94238534979440] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.959+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.959+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94238534991376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e670820 con 0x7f22500423b0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.959+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e671310 con 0x55b59e6602f0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.963+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.963+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94238534995424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6712d0 con 0x55b59e6602f0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.963+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6721d0 con 0x55b59e664d00 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.963+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94238534991376] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.967+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.967+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94238534999328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6725c0 con 0x55b59e664d00 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.967+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e672f80 con 0x55b59e664d00 2024-09-13T19:33:26.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.967+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94238534995424] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.967+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94238534999328] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.971+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.971+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94238534992496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e672ad0 con 0x55b59e664d00 2024-09-13T19:33:26.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.971+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6733c0 con 0x55b59e664d00 2024-09-13T19:33:26.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94238534992496] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94238534997760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6735a0 con 0x55b59e664d00 2024-09-13T19:33:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 20 add_watcher() i=0 2024-09-13T19:33:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 20 add_watcher() i=1 2024-09-13T19:33:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 20 add_watcher() i=2 2024-09-13T19:33:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 20 add_watcher() i=3 2024-09-13T19:33:26.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 20 add_watcher() i=4 2024-09-13T19:33:26.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 20 add_watcher() i=5 2024-09-13T19:33:26.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 20 add_watcher() i=6 2024-09-13T19:33:26.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94238534997760] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 20 add_watcher() i=7 2024-09-13T19:33:26.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:26.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e676970 con 0x55b59e6602f0 2024-09-13T19:33:26.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.975+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94238535005328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e673d60 con 0x55b59e6602f0 2024-09-13T19:33:26.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.979+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94238535005328] v30'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.979+0000 7f21167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:26.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.979+0000 7f2261d85980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:26.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.979+0000 7f2261d85980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:26.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.979+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e67f160 con 0x55b59e6602f0 2024-09-13T19:33:26.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.979+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.979+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e67f7b0 con 0x55b59e664d00 2024-09-13T19:33:26.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.983+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.983+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e67f7b0 con 0x55b59e6695e0 2024-09-13T19:33:26.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.983+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.983+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e67ec50 con 0x55b59e6602f0 2024-09-13T19:33:26.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.987+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.987+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680460 con 0x7f22500423b0 2024-09-13T19:33:26.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.987+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.987+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6809d0 con 0x55b59e6695e0 2024-09-13T19:33:26.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.991+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:26.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.991+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6809d0 con 0x55b59e6602f0 2024-09-13T19:33:26.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.991+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:26.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.991+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6809d0 con 0x55b59e664d00 2024-09-13T19:33:26.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.995+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:26.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.995+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6809d0 con 0x7f22500423b0 2024-09-13T19:33:26.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.995+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:26.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.995+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e6809d0 con 0x55b59e6695e0 2024-09-13T19:33:27.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.999+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.999+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x7f22500423b0 2024-09-13T19:33:27.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.999+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:27.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:26.999+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e664d00 2024-09-13T19:33:27.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.003+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:27.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.003+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x7f22500423b0 2024-09-13T19:33:27.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.003+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:27.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.003+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e664d00 2024-09-13T19:33:27.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.007+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:27.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.007+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6602f0 2024-09-13T19:33:27.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.007+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:27.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.007+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.011+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.011+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x7f22500423b0 2024-09-13T19:33:27.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.011+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:27.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.011+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.015+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.015+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6602f0 2024-09-13T19:33:27.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.015+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:27.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.015+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6602f0 2024-09-13T19:33:27.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.019+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:27.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.019+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.019+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.019+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x7f22500423b0 2024-09-13T19:33:27.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.023+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:27.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.023+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.023+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.023+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.027+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.027+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.027+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.027+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.027+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.027+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e664d00 2024-09-13T19:33:27.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.031+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:27.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.031+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.035+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.035+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e664d00 2024-09-13T19:33:27.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.035+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:27.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.035+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e6695e0 2024-09-13T19:33:27.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.039+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.039+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x55b59e664d00 2024-09-13T19:33:27.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.039+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:27.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.039+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e680e10 con 0x7f22500423b0 2024-09-13T19:33:27.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:27.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f21157e2640 20 reqs_thread_entry: start 2024-09-13T19:33:27.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2261d85980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:27.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2261d85980 20 Filter name: none 2024-09-13T19:33:27.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f210e7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:27.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2261d85980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:27.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2261d85980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b59e67d500 con 0x55b59e6602f0 2024-09-13T19:33:27.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:27.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2261d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2261d85980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T19:33:27.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.043+0000 7f2261d85980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:27.048 INFO:teuthology.orchestra.run.smithi144.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:33:27.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.047+0000 7f21167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:27.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.047+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94238535005328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e67cf00 con 0x55b59e6602f0 2024-09-13T19:33:27.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.047+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94238535005328] v30'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:27.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.047+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94238534982000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e673490 con 0x7f22500423b0 2024-09-13T19:33:27.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.047+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94238534982000] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:27.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.047+0000 7f2261d85980 20 remove_watcher() i=0 2024-09-13T19:33:27.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.047+0000 7f2261d85980 2 removed watcher, disabling cache 2024-09-13T19:33:27.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.047+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94238534986224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e673490 con 0x55b59e6602f0 2024-09-13T19:33:27.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.051+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94238534986224] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:27.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.051+0000 7f2261d85980 20 remove_watcher() i=1 2024-09-13T19:33:27.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.051+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94238534979440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e673490 con 0x55b59e6695e0 2024-09-13T19:33:27.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.051+0000 7f225f895640 1 -- 172.21.15.144:0/2197257148 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94238534979440] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225002e070 con 0x55b59e6695e0 2024-09-13T19:33:27.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.051+0000 7f2261d85980 20 remove_watcher() i=2 2024-09-13T19:33:27.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.051+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94238534991376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66cf70 con 0x7f22500423b0 2024-09-13T19:33:27.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.055+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94238534991376] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x7f22500423b0 2024-09-13T19:33:27.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.055+0000 7f2261d85980 20 remove_watcher() i=3 2024-09-13T19:33:27.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.055+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94238534995424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e673490 con 0x55b59e6602f0 2024-09-13T19:33:27.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.055+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94238534995424] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22480b3040 con 0x55b59e6602f0 2024-09-13T19:33:27.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.055+0000 7f2261d85980 20 remove_watcher() i=4 2024-09-13T19:33:27.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.055+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94238534999328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e66cf70 con 0x55b59e664d00 2024-09-13T19:33:27.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.059+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94238534999328] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:27.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.059+0000 7f2261d85980 20 remove_watcher() i=5 2024-09-13T19:33:27.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.059+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94238534992496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e670de0 con 0x55b59e664d00 2024-09-13T19:33:27.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.059+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94238534992496] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:27.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.059+0000 7f2261d85980 20 remove_watcher() i=6 2024-09-13T19:33:27.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.059+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94238534997760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b59e673490 con 0x55b59e664d00 2024-09-13T19:33:27.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2260096640 1 -- 172.21.15.144:0/2197257148 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94238534997760] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f225805e040 con 0x55b59e664d00 2024-09-13T19:33:27.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 20 remove_watcher() i=7 2024-09-13T19:33:27.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e664d00 msgr2=0x55b59e6670f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e664d00 0x55b59e6670f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e6602f0 msgr2=0x55b59e6627b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e6602f0 0x55b59e6627b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f22500423b0 msgr2=0x7f225000f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f22500423b0 0x7f225000f400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b59e6695e0 msgr2=0x55b59e66ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b59e6695e0 0x55b59e66ba50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2128034650 msgr2=0x7f2128036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2128034650 0x7f2128036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2250019de0 tx=0x7f2250036000 comp rx=0 tx=0).stop 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 msgr2=0x55b59e531c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e531c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2258011950 tx=0x7f225804a070 comp rx=0 tx=0).stop 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2257094640 1 -- 172.21.15.144:0/2197257148 reap_dead start 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 shutdown_connections 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2197257148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e64b6e0 0x55b59e531c80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 >> 172.21.15.144:0/2197257148 conn(0x55b59e647ac0 msgr2=0x55b59e645b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 shutdown_connections 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2197257148 wait complete. 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2390953617 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2138034650 msgr2=0x7f2138036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2390953617 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2138034650 0x7f2138036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55b59e62bb30 tx=0x7f2250028f80 comp rx=0 tx=0).stop 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2390953617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e63ebc0 msgr2=0x55b59e63efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2390953617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e63ebc0 0x55b59e63efe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55b59e624f40 tx=0x7f2258018830 comp rx=0 tx=0).stop 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2390953617 shutdown_connections 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2390953617 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2138034650 0x7f2138036b10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/2390953617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e63ebc0 0x55b59e63efe0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2390953617 >> 172.21.15.144:0/2390953617 conn(0x55b59e633d10 msgr2=0x55b59e636790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2390953617 shutdown_connections 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/2390953617 wait complete. 2024-09-13T19:33:27.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e62d9e0 msgr2=0x55b59e62fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e62d9e0 0x55b59e62fdd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e628c70 msgr2=0x55b59e62b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e628c70 0x55b59e62b060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f21480346a0 msgr2=0x7f2148036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f21480346a0 0x7f2148036b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22480ad000 tx=0x7f22480a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 msgr2=0x55b59e623cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e623cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2250000c10 tx=0x7f2250000ee0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 shutdown_connections 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b59e628c70 0x55b59e62b060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b59e62d9e0 0x55b59e62fdd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f21480346a0 0x7f2148036b60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 --2- 172.21.15.144:0/204252348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b59e4a6290 0x55b59e623cf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 >> 172.21.15.144:0/204252348 conn(0x55b59e52c090 msgr2=0x55b59e617040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 shutdown_connections 2024-09-13T19:33:27.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.063+0000 7f2261d85980 1 -- 172.21.15.144:0/204252348 wait complete. 2024-09-13T19:33:27.078 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:33:27.079 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:33:27.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:33:27.079 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T19:33:27.159 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:27.159 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:27.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.155+0000 7fac9546b980 1 Processor -- start 2024-09-13T19:33:27.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.155+0000 7fac9546b980 1 -- start start 2024-09-13T19:33:27.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.155+0000 7fac9546b980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e541a51930 0x55e541a51d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.155+0000 7fac9546b980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5418d7ae0 con 0x55e541a52280 2024-09-13T19:33:27.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.155+0000 7fac9546b980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55e5418fbe30 con 0x55e541a51930 2024-09-13T19:33:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac92f7b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e541a51930 0x55e541a51d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac92f7b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e541a51930 0x55e541a51d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48412/0 (socket says 172.21.15.144:48412) 2024-09-13T19:33:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac92f7b640 1 -- 172.21.15.144:0/4291686705 learned_addr learned my addr 172.21.15.144:0/4291686705 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac9277a640 1 --1- 172.21.15.144:0/4291686705 >> v1:172.21.15.18:6789/0 conn(0x55e541a52280 0x55e541a56be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42218/0 (socket says 172.21.15.144:42218) 2024-09-13T19:33:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac92f7b640 1 -- 172.21.15.144:0/4291686705 >> v1:172.21.15.18:6789/0 conn(0x55e541a52280 legacy=0x55e541a56be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac92f7b640 1 -- 172.21.15.144:0/4291686705 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e541a59430 con 0x55e541a51930 2024-09-13T19:33:27.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac92f7b640 1 --2- 172.21.15.144:0/4291686705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541a51d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00a4e0 tx=0x7fac8c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d91a90075c286c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac91f79640 1 -- 172.21.15.144:0/4291686705 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac8c0aa540 con 0x55e541a51930 2024-09-13T19:33:27.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac91f79640 1 -- 172.21.15.144:0/4291686705 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c0aa6e0 con 0x55e541a51930 2024-09-13T19:33:27.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.159+0000 7fac91f79640 1 -- 172.21.15.144:0/4291686705 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac8c0aaa40 con 0x55e541a51930 2024-09-13T19:33:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.163+0000 7fac9546b980 1 -- 172.21.15.144:0/4291686705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 msgr2=0x55e541a51d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.163+0000 7fac9546b980 1 --2- 172.21.15.144:0/4291686705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541a51d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00a4e0 tx=0x7fac8c01b090 comp rx=0 tx=0).stop 2024-09-13T19:33:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.163+0000 7fac9546b980 1 -- 172.21.15.144:0/4291686705 shutdown_connections 2024-09-13T19:33:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.163+0000 7fac9546b980 1 --2- 172.21.15.144:0/4291686705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541a51d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.163+0000 7fac9546b980 1 -- 172.21.15.144:0/4291686705 >> 172.21.15.144:0/4291686705 conn(0x55e5419c51e0 msgr2=0x55e5419c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.163+0000 7fac9546b980 1 -- 172.21.15.144:0/4291686705 shutdown_connections 2024-09-13T19:33:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.163+0000 7fac9546b980 1 -- 172.21.15.144:0/4291686705 wait complete. 2024-09-13T19:33:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.175+0000 7fac9546b980 1 Processor -- start 2024-09-13T19:33:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- start start 2024-09-13T19:33:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b3cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e5418fd200 con 0x55e541a51930 2024-09-13T19:33:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac92f7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b3cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac92f7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b3cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48418/0 (socket says 172.21.15.144:48418) 2024-09-13T19:33:27.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac92f7b640 1 -- 172.21.15.144:0/338412687 learned_addr learned my addr 172.21.15.144:0/338412687 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac92f7b640 1 -- 172.21.15.144:0/338412687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e541b3d230 con 0x55e541a51930 2024-09-13T19:33:27.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac92f7b640 1 --2- 172.21.15.144:0/338412687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b3cc60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac8c017ca0 tx=0x7fac8c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42302f8e4a44b389 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fab7fe17640 1 -- 172.21.15.144:0/338412687 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac8c0b9030 con 0x55e541a51930 2024-09-13T19:33:27.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fab7fe17640 1 -- 172.21.15.144:0/338412687 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c0aaac0 con 0x55e541a51930 2024-09-13T19:33:27.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fab7fe17640 1 -- 172.21.15.144:0/338412687 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac8c0aada0 con 0x55e541a51930 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- 172.21.15.144:0/338412687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 msgr2=0x55e541b3cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 --2- 172.21.15.144:0/338412687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b3cc60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac8c017ca0 tx=0x7fac8c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- 172.21.15.144:0/338412687 shutdown_connections 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 --2- 172.21.15.144:0/338412687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b3cc60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- 172.21.15.144:0/338412687 >> 172.21.15.144:0/338412687 conn(0x55e5419c51e0 msgr2=0x55e541b38890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- 172.21.15.144:0/338412687 shutdown_connections 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- 172.21.15.144:0/338412687 wait complete. 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 Processor -- start 2024-09-13T19:33:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- start start 2024-09-13T19:33:27.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b43f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac9546b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e541a58e70 con 0x55e541a51930 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac92f7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b43f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac92f7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b43f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48422/0 (socket says 172.21.15.144:48422) 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.179+0000 7fac92f7b640 1 -- 172.21.15.144:0/3473544758 learned_addr learned my addr 172.21.15.144:0/3473544758 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac92f7b640 1 -- 172.21.15.144:0/3473544758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e541b44460 con 0x55e541a51930 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac92f7b640 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b43f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac8c005cc0 tx=0x7fac8c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab7e614640 1 -- 172.21.15.144:0/3473544758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac8c0b9030 con 0x55e541a51930 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e541b446f0 con 0x55e541a51930 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab7e614640 1 -- 172.21.15.144:0/3473544758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c0c3070 con 0x55e541a51930 2024-09-13T19:33:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab7e614640 1 -- 172.21.15.144:0/3473544758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac8c0bf750 con 0x55e541a51930 2024-09-13T19:33:27.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e541b473d0 con 0x55e541a51930 2024-09-13T19:33:27.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 Processor -- start 2024-09-13T19:33:27.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 -- start start 2024-09-13T19:33:27.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e541956800 con 0x55e541b50ce0 2024-09-13T19:33:27.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9377c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab7e614640 1 -- 172.21.15.144:0/3473544758 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fac8c0c5030 con 0x55e541a51930 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9377c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48428/0 (socket says 172.21.15.144:48428) 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9377c640 1 -- 172.21.15.144:0/3783184129 learned_addr learned my addr 172.21.15.144:0/3783184129 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab7e614640 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab78034650 0x7fab78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab7e614640 1 -- 172.21.15.144:0/3473544758 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fac8c0ba070 con 0x55e541a51930 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac92f7b640 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab78034650 0x7fab78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9377c640 1 -- 172.21.15.144:0/3783184129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e541b51620 con 0x55e541b50ce0 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9377c640 1 --2- 172.21.15.144:0/3783184129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b510e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fac8400a440 tx=0x7fac8400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3a1e6d0661505c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac92f7b640 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab78034650 0x7fab78036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0bf010 tx=0x7fac8c0a3c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab77fff640 1 -- 172.21.15.144:0/3783184129 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac84008850 con 0x55e541b50ce0 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab77fff640 1 -- 172.21.15.144:0/3783184129 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac84008a10 con 0x55e541b50ce0 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fab77fff640 1 -- 172.21.15.144:0/3783184129 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac84008d30 con 0x55e541b50ce0 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 -- 172.21.15.144:0/3783184129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 msgr2=0x55e541b510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 --2- 172.21.15.144:0/3783184129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b510e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fac8400a440 tx=0x7fac8400a900 comp rx=0 tx=0).stop 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 -- 172.21.15.144:0/3783184129 shutdown_connections 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 --2- 172.21.15.144:0/3783184129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b510e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.183+0000 7fac9546b980 1 -- 172.21.15.144:0/3783184129 >> 172.21.15.144:0/3783184129 conn(0x55e541a52280 msgr2=0x55e541b4c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 -- 172.21.15.144:0/3783184129 shutdown_connections 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 -- 172.21.15.144:0/3783184129 wait complete. 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 Processor -- start 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 -- start start 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b58020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e541b518b0 con 0x55e541b50ce0 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9377c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b58020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9377c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b58020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48440/0 (socket says 172.21.15.144:48440) 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9377c640 1 -- 172.21.15.144:0/3064338680 learned_addr learned my addr 172.21.15.144:0/3064338680 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9377c640 1 -- 172.21.15.144:0/3064338680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e541b58560 con 0x55e541b50ce0 2024-09-13T19:33:27.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9377c640 1 --2- 172.21.15.144:0/3064338680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b58020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e541b51a90 tx=0x7fac84003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fab767fc640 1 -- 172.21.15.144:0/3064338680 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac84013a70 con 0x55e541b50ce0 2024-09-13T19:33:27.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 -- 172.21.15.144:0/3064338680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e541b587f0 con 0x55e541b50ce0 2024-09-13T19:33:27.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 -- 172.21.15.144:0/3064338680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e541b5b4d0 con 0x55e541b50ce0 2024-09-13T19:33:27.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fab767fc640 1 -- 172.21.15.144:0/3064338680 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac84023070 con 0x55e541b50ce0 2024-09-13T19:33:27.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fab767fc640 1 -- 172.21.15.144:0/3064338680 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac84013d40 con 0x55e541b50ce0 2024-09-13T19:33:27.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fab767fc640 1 -- 172.21.15.144:0/3064338680 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fac84028460 con 0x55e541b50ce0 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fab767fc640 1 --2- 172.21.15.144:0/3064338680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab6c034650 0x7fab6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 Processor -- start 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fab767fc640 1 -- 172.21.15.144:0/3064338680 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fac84049e00 con 0x55e541b50ce0 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9377c640 1 --2- 172.21.15.144:0/3064338680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab6c034650 0x7fab6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.187+0000 7fac9546b980 1 -- start start 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9546b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b718e0 0x55e541b71d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9546b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e541b3d4f0 con 0x55e541b718e0 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9377c640 1 --2- 172.21.15.144:0/3064338680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab6c034650 0x7fab6c036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac8401e590 tx=0x7fac8401e4c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac92f7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b718e0 0x55e541b71d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac92f7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b718e0 0x55e541b71d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48446/0 (socket says 172.21.15.144:48446) 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac92f7b640 1 -- 172.21.15.144:0/177104895 learned_addr learned my addr 172.21.15.144:0/177104895 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac92f7b640 1 -- 172.21.15.144:0/177104895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e541b722d0 con 0x55e541b718e0 2024-09-13T19:33:27.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac92f7b640 1 --2- 172.21.15.144:0/177104895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b718e0 0x55e541b71d00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0a3cb0 tx=0x7fac8c0e3470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fab567e4640 1 -- 172.21.15.144:0/177104895 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac8c0df070 con 0x55e541b718e0 2024-09-13T19:33:27.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9546b980 1 -- 172.21.15.144:0/177104895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e541b74ea0 con 0x55e541b718e0 2024-09-13T19:33:27.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fab567e4640 1 -- 172.21.15.144:0/177104895 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c0d5070 con 0x55e541b718e0 2024-09-13T19:33:27.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9546b980 1 -- 172.21.15.144:0/177104895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e541b75250 con 0x55e541b718e0 2024-09-13T19:33:27.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fab567e4640 1 -- 172.21.15.144:0/177104895 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac8c0b43a0 con 0x55e541b718e0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fab567e4640 1 -- 172.21.15.144:0/177104895 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fac8c0e2070 con 0x55e541b718e0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fab567e4640 1 --2- 172.21.15.144:0/177104895 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faad4034650 0x7faad4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fab567e4640 1 -- 172.21.15.144:0/177104895 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fac8c0eead0 con 0x55e541b718e0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9277a640 1 --2- 172.21.15.144:0/177104895 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faad4034650 0x7faad4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7faac7fff640 20 reqs_thread_entry: start 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e541b773b0 0x55e541b79820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e541b79ef0 con 0x55e541b773b0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9277a640 1 --2- 172.21.15.144:0/177104895 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faad4034650 0x7faad4036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac7c000f70 tx=0x7fac7c001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.191+0000 7fac9377c640 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e541b773b0 0x55e541b79820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.195+0000 7fac9377c640 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e541b773b0 0x55e541b79820 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.195+0000 7fac9377c640 1 -- 172.21.15.144:0/3473544758 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac8401e7a0 con 0x55e541b773b0 2024-09-13T19:33:27.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.195+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e541b7bd10 0x55e541b7e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.195+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:2 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e541b7e710 con 0x55e541b7bd10 2024-09-13T19:33:27.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.195+0000 7fac92f7b640 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e541b7bd10 0x55e541b7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.195+0000 7fac92f7b640 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e541b7bd10 0x55e541b7e100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.195+0000 7fac92f7b640 1 -- 172.21.15.144:0/3473544758 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(2 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fac8c0f6040 con 0x55e541b7bd10 2024-09-13T19:33:27.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.195+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e541b83480 con 0x55e541b7bd10 2024-09-13T19:33:27.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac92f7b640 1 -- 172.21.15.144:0/3473544758 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [stat,call,call,writefull 0~993] v30'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fac8c0f6040 con 0x55e541b7bd10 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3064338680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab6c034650 msgr2=0x7fab6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3064338680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab6c034650 0x7fab6c036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac8401e590 tx=0x7fac8401e4c0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3064338680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 msgr2=0x55e541b58020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3064338680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b58020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e541b51a90 tx=0x7fac84003000 comp rx=0 tx=0).stop 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3064338680 shutdown_connections 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3064338680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab6c034650 0x7fab6c036b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3064338680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b50ce0 0x55e541b58020 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3064338680 >> 172.21.15.144:0/3064338680 conn(0x55e541a52280 msgr2=0x55e541b4c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3064338680 shutdown_connections 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3064338680 wait complete. 2024-09-13T19:33:27.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/177104895 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faad4034650 msgr2=0x7faad4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/177104895 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faad4034650 0x7faad4036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac7c000f70 tx=0x7fac7c001300 comp rx=0 tx=0).stop 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/177104895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b718e0 msgr2=0x55e541b71d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/177104895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b718e0 0x55e541b71d00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0a3cb0 tx=0x7fac8c0e3470 comp rx=0 tx=0).stop 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/177104895 shutdown_connections 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/177104895 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faad4034650 0x7faad4036b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/177104895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541b718e0 0x55e541b71d00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/177104895 >> 172.21.15.144:0/177104895 conn(0x55e541b66910 msgr2=0x55e541b69200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/177104895 shutdown_connections 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/177104895 wait complete. 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e541b7bd10 msgr2=0x55e541b7e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e541b7bd10 0x55e541b7e100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e541b773b0 msgr2=0x55e541b79820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e541b773b0 0x55e541b79820 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab78034650 msgr2=0x7fab78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab78034650 0x7fab78036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0bf010 tx=0x7fac8c0a3c40 comp rx=0 tx=0).stop 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 msgr2=0x55e541b43f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b43f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac8c005cc0 tx=0x7fac8c017e30 comp rx=0 tx=0).stop 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 shutdown_connections 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e541b773b0 0x55e541b79820 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e541b7bd10 0x55e541b7e100 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab78034650 0x7fab78036b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 --2- 172.21.15.144:0/3473544758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e541a51930 0x55e541b43f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 >> 172.21.15.144:0/3473544758 conn(0x55e5419c51e0 msgr2=0x55e541b37410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 shutdown_connections 2024-09-13T19:33:27.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.199+0000 7fac9546b980 1 -- 172.21.15.144:0/3473544758 wait complete. 2024-09-13T19:33:27.213 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:33:27.214 DEBUG:tasks.util.rgw: json result: {'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:33:27.215 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T19:33:27.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T19:33:27.215 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T19:33:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:27.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d14061980 1 Processor -- start 2024-09-13T19:33:27.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d14061980 1 -- start start 2024-09-13T19:33:27.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d14061980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55675c39ba80 0x55675c39de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d14061980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55675c21fae0 con 0x55675c30bab0 2024-09-13T19:33:27.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d14061980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55675c243e30 con 0x55675c39ba80 2024-09-13T19:33:27.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d11370640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55675c39ba80 0x55675c39de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d11370640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55675c39ba80 0x55675c39de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48454/0 (socket says 172.21.15.144:48454) 2024-09-13T19:33:27.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d11370640 1 -- 172.21.15.144:0/3550769593 learned_addr learned my addr 172.21.15.144:0/3550769593 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d11370640 1 -- 172.21.15.144:0/3550769593 >> v1:172.21.15.18:6789/0 conn(0x55675c30bab0 legacy=0x55675c39a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.287+0000 7f4d11370640 1 -- 172.21.15.144:0/3550769593 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675c39f3c0 con 0x55675c39ba80 2024-09-13T19:33:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d11370640 1 --2- 172.21.15.144:0/3550769593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c39ba80 0x55675c39de70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a5c0 tx=0x7f4cfc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e140387efc45b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d10b6f640 1 -- 172.21.15.144:0/3550769593 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc0a6070 con 0x55675c39ba80 2024-09-13T19:33:27.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d10b6f640 1 -- 172.21.15.144:0/3550769593 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc0af070 con 0x55675c39ba80 2024-09-13T19:33:27.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d10b6f640 1 -- 172.21.15.144:0/3550769593 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc0aa5c0 con 0x55675c39ba80 2024-09-13T19:33:27.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d14061980 1 -- 172.21.15.144:0/3550769593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c39ba80 msgr2=0x55675c39de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d14061980 1 --2- 172.21.15.144:0/3550769593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c39ba80 0x55675c39de70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a5c0 tx=0x7f4cfc01b340 comp rx=0 tx=0).stop 2024-09-13T19:33:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d14061980 1 -- 172.21.15.144:0/3550769593 shutdown_connections 2024-09-13T19:33:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d14061980 1 --2- 172.21.15.144:0/3550769593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c39ba80 0x55675c39de70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d14061980 1 -- 172.21.15.144:0/3550769593 >> 172.21.15.144:0/3550769593 conn(0x55675c392050 msgr2=0x55675c394470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d14061980 1 -- 172.21.15.144:0/3550769593 shutdown_connections 2024-09-13T19:33:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.291+0000 7f4d14061980 1 -- 172.21.15.144:0/3550769593 wait complete. 2024-09-13T19:33:27.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.307+0000 7f4d14061980 1 Processor -- start 2024-09-13T19:33:27.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.307+0000 7f4d14061980 1 -- start start 2024-09-13T19:33:27.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.307+0000 7f4d14061980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c482a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.307+0000 7f4d14061980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55675c245200 con 0x55675c30bab0 2024-09-13T19:33:27.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.307+0000 7f4d11b71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c482a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.307+0000 7f4d11b71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c482a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48466/0 (socket says 172.21.15.144:48466) 2024-09-13T19:33:27.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.307+0000 7f4d11b71640 1 -- 172.21.15.144:0/2726030441 learned_addr learned my addr 172.21.15.144:0/2726030441 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.307+0000 7f4d11b71640 1 -- 172.21.15.144:0/2726030441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675c483020 con 0x55675c30bab0 2024-09-13T19:33:27.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d11b71640 1 --2- 172.21.15.144:0/2726030441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c482a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d040015f0 tx=0x7f4d04001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba9e3fd2ec96d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4bffe07640 1 -- 172.21.15.144:0/2726030441 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d04016070 con 0x55675c30bab0 2024-09-13T19:33:27.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4bffe07640 1 -- 172.21.15.144:0/2726030441 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0400f640 con 0x55675c30bab0 2024-09-13T19:33:27.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4bffe07640 1 -- 172.21.15.144:0/2726030441 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0400f960 con 0x55675c30bab0 2024-09-13T19:33:27.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- 172.21.15.144:0/2726030441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 msgr2=0x55675c482a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 --2- 172.21.15.144:0/2726030441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c482a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d040015f0 tx=0x7f4d04001ab0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- 172.21.15.144:0/2726030441 shutdown_connections 2024-09-13T19:33:27.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 --2- 172.21.15.144:0/2726030441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c482a50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- 172.21.15.144:0/2726030441 >> 172.21.15.144:0/2726030441 conn(0x55675c392050 msgr2=0x55675c47e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- 172.21.15.144:0/2726030441 shutdown_connections 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- 172.21.15.144:0/2726030441 wait complete. 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 Processor -- start 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- start start 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c489e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55675c39ee00 con 0x55675c30bab0 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d11b71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c489e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d11b71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c489e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48478/0 (socket says 172.21.15.144:48478) 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d11b71640 1 -- 172.21.15.144:0/3338790867 learned_addr learned my addr 172.21.15.144:0/3338790867 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d11b71640 1 -- 172.21.15.144:0/3338790867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675c48a340 con 0x55675c30bab0 2024-09-13T19:33:27.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d11b71640 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c489e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d04001af0 tx=0x7f4d04000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4bfe604640 1 -- 172.21.15.144:0/3338790867 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d04016040 con 0x55675c30bab0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4bfe604640 1 -- 172.21.15.144:0/3338790867 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d04022070 con 0x55675c30bab0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55675c48a5d0 con 0x55675c30bab0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4bfe604640 1 -- 172.21.15.144:0/3338790867 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d04006180 con 0x55675c30bab0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.311+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675c48d2b0 con 0x55675c30bab0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4bfe604640 1 -- 172.21.15.144:0/3338790867 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d040117c0 con 0x55675c30bab0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4bfe604640 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bf8034650 0x7f4bf8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4bfe604640 1 -- 172.21.15.144:0/3338790867 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4d04049690 con 0x55675c30bab0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d11370640 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bf8034650 0x7f4bf8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c39ba80 0x55675c490d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4913d0 con 0x55675c39ba80 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d12372640 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c39ba80 0x55675c490d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d11370640 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bf8034650 0x7f4bf8036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0ae000 tx=0x7f4cfc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d12372640 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c39ba80 0x55675c490d90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d12372640 1 -- 172.21.15.144:0/3338790867 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d0c0083f0 con 0x55675c39ba80 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c48e4b0 con 0x55675c39ba80 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d12372640 1 -- 172.21.15.144:0/3338790867 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d0c0083f0 con 0x55675c39ba80 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c493700 0x55675c495af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4961c0 con 0x55675c493700 2024-09-13T19:33:27.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d11b71640 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c493700 0x55675c495af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.315+0000 7f4d11b71640 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c493700 0x55675c495af0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d11b71640 1 -- 172.21.15.144:0/3338790867 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d0400f070 con 0x55675c493700 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c492570 con 0x55675c39ba80 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d12372640 1 -- 172.21.15.144:0/3338790867 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d0c0083f0 con 0x55675c39ba80 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c492a60 con 0x55675c39ba80 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d12372640 1 -- 172.21.15.144:0/3338790867 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d0c0083f0 con 0x55675c39ba80 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d14061980 1 Processor -- start 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d14061980 1 -- start start 2024-09-13T19:33:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d14061980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c4a48c0 0x55675c4a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d14061980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55675c29e800 con 0x55675c4a48c0 2024-09-13T19:33:27.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d12372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c4a48c0 0x55675c4a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d12372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c4a48c0 0x55675c4a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48484/0 (socket says 172.21.15.144:48484) 2024-09-13T19:33:27.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d12372640 1 -- 172.21.15.144:0/3257867448 learned_addr learned my addr 172.21.15.144:0/3257867448 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d12372640 1 -- 172.21.15.144:0/3257867448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675c4a5220 con 0x55675c4a48c0 2024-09-13T19:33:27.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d12372640 1 --2- 172.21.15.144:0/3257867448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c4a48c0 0x55675c4a4ce0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55675c48b230 tx=0x7f4d0c00af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4bf77fe640 1 -- 172.21.15.144:0/3257867448 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c007d70 con 0x55675c4a48c0 2024-09-13T19:33:27.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d14061980 1 -- 172.21.15.144:0/3257867448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55675c4a54b0 con 0x55675c4a48c0 2024-09-13T19:33:27.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4bf77fe640 1 -- 172.21.15.144:0/3257867448 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c01e020 con 0x55675c4a48c0 2024-09-13T19:33:27.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4bf77fe640 1 -- 172.21.15.144:0/3257867448 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c019590 con 0x55675c4a48c0 2024-09-13T19:33:27.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.319+0000 7f4d14061980 1 -- 172.21.15.144:0/3257867448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675c4a8130 con 0x55675c4a48c0 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4bf77fe640 1 -- 172.21.15.144:0/3257867448 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d0c016040 con 0x55675c4a48c0 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4bf77fe640 1 --2- 172.21.15.144:0/3257867448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bec034650 0x7f4bec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4bf77fe640 1 -- 172.21.15.144:0/3257867448 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4d0c01f030 con 0x55675c4a48c0 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d11b71640 1 --2- 172.21.15.144:0/3257867448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bec034650 0x7f4bec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 Processor -- start 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 -- start start 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d11b71640 1 --2- 172.21.15.144:0/3257867448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bec034650 0x7f4bec036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d0401cf70 tx=0x7f4d04047b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c396720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55675c4833a0 con 0x55675c396320 2024-09-13T19:33:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d12372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c396720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d12372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c396720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48496/0 (socket says 172.21.15.144:48496) 2024-09-13T19:33:27.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d12372640 1 -- 172.21.15.144:0/913783083 learned_addr learned my addr 172.21.15.144:0/913783083 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d12372640 1 -- 172.21.15.144:0/913783083 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675c396cf0 con 0x55675c396320 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d12372640 1 --2- 172.21.15.144:0/913783083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c396720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c04a2f0 tx=0x7f4d0c023790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bd5baf16a7cc1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4bf57fa640 1 -- 172.21.15.144:0/913783083 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c048070 con 0x55675c396320 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4bf57fa640 1 -- 172.21.15.144:0/913783083 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c046030 con 0x55675c396320 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4bf57fa640 1 -- 172.21.15.144:0/913783083 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c015af0 con 0x55675c396320 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 -- 172.21.15.144:0/913783083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 msgr2=0x55675c396720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 --2- 172.21.15.144:0/913783083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c396720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c04a2f0 tx=0x7f4d0c023790 comp rx=0 tx=0).stop 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 -- 172.21.15.144:0/913783083 shutdown_connections 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 --2- 172.21.15.144:0/913783083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c396720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 -- 172.21.15.144:0/913783083 >> 172.21.15.144:0/913783083 conn(0x55675c4ad800 msgr2=0x55675c4ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 -- 172.21.15.144:0/913783083 shutdown_connections 2024-09-13T19:33:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 -- 172.21.15.144:0/913783083 wait complete. 2024-09-13T19:33:27.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 Processor -- start 2024-09-13T19:33:27.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 -- start start 2024-09-13T19:33:27.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.323+0000 7f4d14061980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c4ba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d14061980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55675c3974a0 con 0x55675c396320 2024-09-13T19:33:27.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d12372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c4ba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d12372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c4ba9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48504/0 (socket says 172.21.15.144:48504) 2024-09-13T19:33:27.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 learned_addr learned my addr 172.21.15.144:0/99080369 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675c4baf30 con 0x55675c396320 2024-09-13T19:33:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d12372640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c4ba9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0237d0 tx=0x7f4d0c04a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4be37fe640 1 -- 172.21.15.144:0/99080369 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c023410 con 0x55675c396320 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55675c4bb1c0 con 0x55675c396320 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4be37fe640 1 -- 172.21.15.144:0/99080369 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c018a60 con 0x55675c396320 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675c4bdea0 con 0x55675c396320 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4be37fe640 1 -- 172.21.15.144:0/99080369 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c018d40 con 0x55675c396320 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4be37fe640 1 -- 172.21.15.144:0/99080369 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d0c0153e0 con 0x55675c396320 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4be37fe640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bdc034650 0x7f4bdc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4be37fe640 1 -- 172.21.15.144:0/99080369 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4d0c034070 con 0x55675c396320 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d11b71640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bdc034650 0x7f4bdc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c4c5e20 0x55675c4c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4c8a10 con 0x55675c4c5e20 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d11370640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c4c5e20 0x55675c4c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d11b71640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bdc034650 0x7f4bdc036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400ffb0 tx=0x7f4d04038000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.327+0000 7f4d11370640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c4c5e20 0x55675c4c82c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 realm 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4c8e40 con 0x55675c4c5e20 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4c96e0 con 0x55675c4c5e20 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4c9a80 con 0x55675c4c5e20 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c4ca7e0 0x55675c4ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4cd110 con 0x55675c4ca7e0 2024-09-13T19:33:27.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d12372640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c4ca7e0 0x55675c4ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d12372640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c4ca7e0 0x55675c4ccbd0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 20 searching for the correct realm 2024-09-13T19:33:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55675c4cf060 0x55675c4d1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11b71640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55675c4cf060 0x55675c4d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11b71640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55675c4cf060 0x55675c4d1520 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11b71640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d04056040 0x7f4d040265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x7f4d04056040 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.331+0000 7f4d11370640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d04056040 0x7f4d040265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d04056040 0x7f4d040265e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4c5e20 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4c5e20 2024-09-13T19:33:27.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x7f4d04056040 2024-09-13T19:33:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.335+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4c5e20 2024-09-13T19:33:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4c5e20 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x7f4d04056040 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4c5e20 2024-09-13T19:33:27.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.339+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4c5e20 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x7f4d04056040 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4c5e20 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x7f4d04056040 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.343+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4cf060 2024-09-13T19:33:27.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4ca7e0 2024-09-13T19:33:27.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x55675c4c5e20 2024-09-13T19:33:27.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d1bf0 con 0x7f4d04056040 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4cdad0 con 0x55675c4c5e20 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4cdf20 con 0x55675c4c5e20 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4ce340 con 0x55675c4c5e20 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 zone default found 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 4 Realm: () 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:27.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 zonegroup default 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4ce340 con 0x55675c4ca7e0 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d3f00 con 0x55675c4cf060 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d42a0 con 0x55675c4cf060 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.347+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d14061980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d14061980 20 started sync module instance, tier type = 2024-09-13T19:33:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d14061980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d3340 con 0x7f4d04056040 2024-09-13T19:33:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93902418556720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d3340 con 0x7f4d04056040 2024-09-13T19:33:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d4b30 con 0x55675c4c5e20 2024-09-13T19:33:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93902418556720] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93902418560576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d3340 con 0x55675c4c5e20 2024-09-13T19:33:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.351+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d5540 con 0x55675c4cf060 2024-09-13T19:33:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.355+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.355+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93902418563216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d5d90 con 0x55675c4cf060 2024-09-13T19:33:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.355+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d6750 con 0x7f4d04056040 2024-09-13T19:33:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.355+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93902418560576] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.355+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.355+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93902418567840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d66c0 con 0x7f4d04056040 2024-09-13T19:33:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.355+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d74e0 con 0x55675c4c5e20 2024-09-13T19:33:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.355+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93902418563216] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.359+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93902418567840] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.359+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.359+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93902418565344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d6fa0 con 0x55675c4c5e20 2024-09-13T19:33:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.359+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d7d80 con 0x55675c4ca7e0 2024-09-13T19:33:27.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.359+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93902418565344] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.359+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.359+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93902418569968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d6f10 con 0x55675c4ca7e0 2024-09-13T19:33:27.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.359+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d8270 con 0x55675c4ca7e0 2024-09-13T19:33:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93902418569968] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93902418573520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d81a0 con 0x55675c4ca7e0 2024-09-13T19:33:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d8c70 con 0x55675c4ca7e0 2024-09-13T19:33:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93902418577248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d90e0 con 0x55675c4ca7e0 2024-09-13T19:33:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 20 add_watcher() i=0 2024-09-13T19:33:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 20 add_watcher() i=1 2024-09-13T19:33:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 20 add_watcher() i=2 2024-09-13T19:33:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 20 add_watcher() i=3 2024-09-13T19:33:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 20 add_watcher() i=4 2024-09-13T19:33:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 20 add_watcher() i=5 2024-09-13T19:33:27.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93902418573520] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.363+0000 7f4d14061980 20 add_watcher() i=6 2024-09-13T19:33:27.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93902418577248] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 20 add_watcher() i=7 2024-09-13T19:33:27.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:27.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d90e0 con 0x55675c4c5e20 2024-09-13T19:33:27.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93902418578480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c4d9050 con 0x55675c4c5e20 2024-09-13T19:33:27.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93902418578480] v30'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4bc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:27.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 5 note: GC not initialized 2024-09-13T19:33:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4bc27fc640 20 reqs_thread_entry: start 2024-09-13T19:33:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 20 Filter name: none 2024-09-13T19:33:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4b33fff640 20 reqs_thread_entry: start 2024-09-13T19:33:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4ffd70 con 0x55675c4c5e20 2024-09-13T19:33:27.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.367+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4ffd70 con 0x7f4d04056040 2024-09-13T19:33:27.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4ffd30 con 0x55675c4c5e20 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c4ffd30 con 0x55675c4cf060 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500280 con 0x55675c4cf060 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500670 con 0x55675c4cf060 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500670 con 0x55675c4c5e20 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500670 con 0x55675c4c5e20 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500670 con 0x55675c4cf060 2024-09-13T19:33:27.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x7f4d04056040 2024-09-13T19:33:27.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.371+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.375+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x7f4d04056040 2024-09-13T19:33:27.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.379+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.383+0000 7f4bc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:27.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.383+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93902418578480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.383+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93902418578480] v30'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.383+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93902418556720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x7f4d04056040 2024-09-13T19:33:27.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.383+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93902418556720] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.383+0000 7f4d14061980 20 remove_watcher() i=0 2024-09-13T19:33:27.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.383+0000 7f4d14061980 2 removed watcher, disabling cache 2024-09-13T19:33:27.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.383+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93902418560576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.387+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93902418560576] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.387+0000 7f4d14061980 20 remove_watcher() i=1 2024-09-13T19:33:27.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.387+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93902418563216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4cf060 2024-09-13T19:33:27.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.387+0000 7f4d11b71640 1 -- 172.21.15.144:0/99080369 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93902418563216] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0403b070 con 0x55675c4cf060 2024-09-13T19:33:27.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.387+0000 7f4d14061980 20 remove_watcher() i=2 2024-09-13T19:33:27.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.387+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93902418567840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x7f4d04056040 2024-09-13T19:33:27.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.391+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93902418567840] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x7f4d04056040 2024-09-13T19:33:27.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.391+0000 7f4d14061980 20 remove_watcher() i=3 2024-09-13T19:33:27.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.391+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93902418565344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4c5e20 2024-09-13T19:33:27.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.391+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93902418565344] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc0aaa40 con 0x55675c4c5e20 2024-09-13T19:33:27.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.391+0000 7f4d14061980 20 remove_watcher() i=4 2024-09-13T19:33:27.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.391+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93902418569968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.395+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93902418569968] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.395+0000 7f4d14061980 20 remove_watcher() i=5 2024-09-13T19:33:27.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.395+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93902418573520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.395+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93902418573520] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.395+0000 7f4d14061980 20 remove_watcher() i=6 2024-09-13T19:33:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.395+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93902418577248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55675c500620 con 0x55675c4ca7e0 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d12372640 1 -- 172.21.15.144:0/99080369 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93902418577248] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55675c4ca7e0 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 20 remove_watcher() i=7 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c4ca7e0 msgr2=0x55675c4ccbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c4ca7e0 0x55675c4ccbd0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c4c5e20 msgr2=0x55675c4c82c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c4c5e20 0x55675c4c82c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d04056040 msgr2=0x7f4d040265e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d04056040 0x7f4d040265e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55675c4cf060 msgr2=0x55675c4d1520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55675c4cf060 0x55675c4d1520 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bdc034650 msgr2=0x7f4bdc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bdc034650 0x7f4bdc036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400ffb0 tx=0x7f4d04038000 comp rx=0 tx=0).stop 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 msgr2=0x55675c4ba9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d11370640 1 -- 172.21.15.144:0/99080369 reap_dead start 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c4ba9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0237d0 tx=0x7f4d0c04a280 comp rx=0 tx=0).stop 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 shutdown_connections 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/99080369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c396320 0x55675c4ba9f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 >> 172.21.15.144:0/99080369 conn(0x55675c4ad800 msgr2=0x55675c4ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 shutdown_connections 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/99080369 wait complete. 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3257867448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bec034650 msgr2=0x7f4bec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3257867448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bec034650 0x7f4bec036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d0401cf70 tx=0x7f4d04047b00 comp rx=0 tx=0).stop 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3257867448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c4a48c0 msgr2=0x55675c4a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3257867448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c4a48c0 0x55675c4a4ce0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55675c48b230 tx=0x7f4d0c00af20 comp rx=0 tx=0).stop 2024-09-13T19:33:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3257867448 shutdown_connections 2024-09-13T19:33:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3257867448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bec034650 0x7f4bec036b10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3257867448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c4a48c0 0x55675c4a4ce0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3257867448 >> 172.21.15.144:0/3257867448 conn(0x55675c499a10 msgr2=0x55675c49c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3257867448 shutdown_connections 2024-09-13T19:33:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3257867448 wait complete. 2024-09-13T19:33:27.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c493700 msgr2=0x55675c495af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c493700 0x55675c495af0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c39ba80 msgr2=0x55675c490d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c39ba80 0x55675c490d90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bf8034650 msgr2=0x7f4bf8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bf8034650 0x7f4bf8036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0ae000 tx=0x7f4cfc0a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 msgr2=0x55675c489e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c489e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d04001af0 tx=0x7f4d04000f50 comp rx=0 tx=0).stop 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 shutdown_connections 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55675c39ba80 0x55675c490d90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55675c493700 0x55675c495af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4bf8034650 0x7f4bf8036b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 --2- 172.21.15.144:0/3338790867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c30bab0 0x55675c489e00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 >> 172.21.15.144:0/3338790867 conn(0x55675c392050 msgr2=0x55675c47d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 shutdown_connections 2024-09-13T19:33:27.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.399+0000 7f4d14061980 1 -- 172.21.15.144:0/3338790867 wait complete. 2024-09-13T19:33:27.417 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[],"summary":[]} 2024-09-13T19:33:27.417 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T19:33:27.417 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:33:27.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:33:27.417 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:33:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5aeb4b7980 1 Processor -- start 2024-09-13T19:33:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5aeb4b7980 1 -- start start 2024-09-13T19:33:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5aeb4b7980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5650eab69a90 0x5650eab6be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5aeb4b7980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5650ea9edae0 con 0x5650eaad9ac0 2024-09-13T19:33:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5aeb4b7980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5650eaa11e30 con 0x5650eab69a90 2024-09-13T19:33:27.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5ae87c6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5650eab69a90 0x5650eab6be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5ae87c6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5650eab69a90 0x5650eab6be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48516/0 (socket says 172.21.15.144:48516) 2024-09-13T19:33:27.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5ae8fc7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5650eaad9ac0 0x5650eab68370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42242/0 (socket says 172.21.15.144:42242) 2024-09-13T19:33:27.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5ae87c6640 1 -- 172.21.15.144:0/1946381714 learned_addr learned my addr 172.21.15.144:0/1946381714 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5ae87c6640 1 -- 172.21.15.144:0/1946381714 >> v1:172.21.15.18:6789/0 conn(0x5650eaad9ac0 legacy=0x5650eab68370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.495+0000 7f5ae87c6640 1 -- 172.21.15.144:0/1946381714 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650eab6d3d0 con 0x5650eab69a90 2024-09-13T19:33:27.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5ae87c6640 1 --2- 172.21.15.144:0/1946381714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eab69a90 0x5650eab6be80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00a5c0 tx=0x7f5adc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0f5df96d892d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5ae7fc5640 1 -- 172.21.15.144:0/1946381714 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5adc0a6070 con 0x5650eab69a90 2024-09-13T19:33:27.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5ae7fc5640 1 -- 172.21.15.144:0/1946381714 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc0af070 con 0x5650eab69a90 2024-09-13T19:33:27.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5ae7fc5640 1 -- 172.21.15.144:0/1946381714 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5adc0aa5c0 con 0x5650eab69a90 2024-09-13T19:33:27.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1946381714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eab69a90 msgr2=0x5650eab6be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/1946381714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eab69a90 0x5650eab6be80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00a5c0 tx=0x7f5adc01b340 comp rx=0 tx=0).stop 2024-09-13T19:33:27.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1946381714 shutdown_connections 2024-09-13T19:33:27.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/1946381714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eab69a90 0x5650eab6be80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1946381714 >> 172.21.15.144:0/1946381714 conn(0x5650eab60060 msgr2=0x5650eab62480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1946381714 shutdown_connections 2024-09-13T19:33:27.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.499+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1946381714 wait complete. 2024-09-13T19:33:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.515+0000 7f5aeb4b7980 1 Processor -- start 2024-09-13T19:33:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.515+0000 7f5aeb4b7980 1 -- start start 2024-09-13T19:33:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.515+0000 7f5aeb4b7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eab65ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.515+0000 7f5aeb4b7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5650eaa13200 con 0x5650eaad9ac0 2024-09-13T19:33:27.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.515+0000 7f5ae8fc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eab65ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.515+0000 7f5ae8fc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eab65ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48530/0 (socket says 172.21.15.144:48530) 2024-09-13T19:33:27.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.515+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/3409901423 learned_addr learned my addr 172.21.15.144:0/3409901423 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.515+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/3409901423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650eab660a0 con 0x5650eaad9ac0 2024-09-13T19:33:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/3409901423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eab65ad0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8001e50 tx=0x7f5ad8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b30f455c95c122 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f59d6e0d640 1 -- 172.21.15.144:0/3409901423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad800e5d0 con 0x5650eaad9ac0 2024-09-13T19:33:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f59d6e0d640 1 -- 172.21.15.144:0/3409901423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad800e770 con 0x5650eaad9ac0 2024-09-13T19:33:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f59d6e0d640 1 -- 172.21.15.144:0/3409901423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad800eab0 con 0x5650eaad9ac0 2024-09-13T19:33:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/3409901423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 msgr2=0x5650eab65ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/3409901423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eab65ad0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8001e50 tx=0x7f5ad8001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/3409901423 shutdown_connections 2024-09-13T19:33:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/3409901423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eab65ad0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/3409901423 >> 172.21.15.144:0/3409901423 conn(0x5650eab60060 msgr2=0x5650eac4c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/3409901423 shutdown_connections 2024-09-13T19:33:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/3409901423 wait complete. 2024-09-13T19:33:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 Processor -- start 2024-09-13T19:33:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- start start 2024-09-13T19:33:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eac5a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5650eab6ce10 con 0x5650eaad9ac0 2024-09-13T19:33:27.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5ae8fc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eac5a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5ae8fc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eac5a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48534/0 (socket says 172.21.15.144:48534) 2024-09-13T19:33:27.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/255754680 learned_addr learned my addr 172.21.15.144:0/255754680 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/255754680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650eac5a550 con 0x5650eaad9ac0 2024-09-13T19:33:27.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eac5a010 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5650eab65650 tx=0x7f5ad8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f59d560a640 1 -- 172.21.15.144:0/255754680 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad8001260 con 0x5650eaad9ac0 2024-09-13T19:33:27.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650eac5a7e0 con 0x5650eaad9ac0 2024-09-13T19:33:27.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f59d560a640 1 -- 172.21.15.144:0/255754680 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad800fa40 con 0x5650eaad9ac0 2024-09-13T19:33:27.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.519+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650eac5d4c0 con 0x5650eaad9ac0 2024-09-13T19:33:27.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f59d560a640 1 -- 172.21.15.144:0/255754680 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad802c060 con 0x5650eaad9ac0 2024-09-13T19:33:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f59d560a640 1 -- 172.21.15.144:0/255754680 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5ad8017070 con 0x5650eaad9ac0 2024-09-13T19:33:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f59d560a640 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59d0034650 0x7f59d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f59d560a640 1 -- 172.21.15.144:0/255754680 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5ad8015020 con 0x5650eaad9ac0 2024-09-13T19:33:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5ae87c6640 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59d0034650 0x7f59d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eab69a90 0x5650eac61000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac61670 con 0x5650eab69a90 2024-09-13T19:33:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5ae97c8640 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eab69a90 0x5650eac61000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5ae87c6640 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59d0034650 0x7f59d0036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0ae000 tx=0x7f5adc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5ae97c8640 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eab69a90 0x5650eac61000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5ae97c8640 1 -- 172.21.15.144:0/255754680 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ae000a4d0 con 0x5650eab69a90 2024-09-13T19:33:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac5e6c0 con 0x5650eab69a90 2024-09-13T19:33:27.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5ae97c8640 1 -- 172.21.15.144:0/255754680 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ae000a4d0 con 0x5650eab69a90 2024-09-13T19:33:27.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac639a0 0x5650eac65d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac66460 con 0x5650eac639a0 2024-09-13T19:33:27.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.523+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac639a0 0x5650eac65d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac639a0 0x5650eac65d90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/255754680 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac639a0 2024-09-13T19:33:27.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac62840 con 0x5650eab69a90 2024-09-13T19:33:27.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae97c8640 1 -- 172.21.15.144:0/255754680 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ae000a4d0 con 0x5650eab69a90 2024-09-13T19:33:27.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac62d20 con 0x5650eab69a90 2024-09-13T19:33:27.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae97c8640 1 -- 172.21.15.144:0/255754680 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5ae000a4d0 con 0x5650eab69a90 2024-09-13T19:33:27.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5aeb4b7980 1 Processor -- start 2024-09-13T19:33:27.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5aeb4b7980 1 -- start start 2024-09-13T19:33:27.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5aeb4b7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac74b40 0x5650eac74f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5aeb4b7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5650eaa6c800 con 0x5650eac74b40 2024-09-13T19:33:27.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae97c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac74b40 0x5650eac74f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae97c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac74b40 0x5650eac74f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48544/0 (socket says 172.21.15.144:48544) 2024-09-13T19:33:27.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae97c8640 1 -- 172.21.15.144:0/1301935618 learned_addr learned my addr 172.21.15.144:0/1301935618 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae97c8640 1 -- 172.21.15.144:0/1301935618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650eac754a0 con 0x5650eac74b40 2024-09-13T19:33:27.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.527+0000 7f5ae97c8640 1 --2- 172.21.15.144:0/1301935618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac74b40 0x5650eac74f60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5650eac61a70 tx=0x7f5ae0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f59ce7fc640 1 -- 172.21.15.144:0/1301935618 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0014450 con 0x5650eac74b40 2024-09-13T19:33:27.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1301935618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650eac75730 con 0x5650eac74b40 2024-09-13T19:33:27.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f59ce7fc640 1 -- 172.21.15.144:0/1301935618 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae00145f0 con 0x5650eac74b40 2024-09-13T19:33:27.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f59ce7fc640 1 -- 172.21.15.144:0/1301935618 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0014910 con 0x5650eac74b40 2024-09-13T19:33:27.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1301935618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650eac783b0 con 0x5650eac74b40 2024-09-13T19:33:27.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f59ce7fc640 1 -- 172.21.15.144:0/1301935618 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5ae0011040 con 0x5650eac74b40 2024-09-13T19:33:27.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f59ce7fc640 1 --2- 172.21.15.144:0/1301935618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59c0034650 0x7f59c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f59ce7fc640 1 -- 172.21.15.144:0/1301935618 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5ae001e070 con 0x5650eac74b40 2024-09-13T19:33:27.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/1301935618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59c0034650 0x7f59c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5aeb4b7980 1 Processor -- start 2024-09-13T19:33:27.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5aeb4b7980 1 -- start start 2024-09-13T19:33:27.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/1301935618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59c0034650 0x7f59c0036b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5650eac61b10 tx=0x7f5ad8048dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5aeb4b7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac81a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5aeb4b7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5650eab642c0 con 0x5650eac81690 2024-09-13T19:33:27.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5ae97c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac81a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5ae97c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac81a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48548/0 (socket says 172.21.15.144:48548) 2024-09-13T19:33:27.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5ae97c8640 1 -- 172.21.15.144:0/1154498358 learned_addr learned my addr 172.21.15.144:0/1154498358 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5ae97c8640 1 -- 172.21.15.144:0/1154498358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650eac82060 con 0x5650eac81690 2024-09-13T19:33:27.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.531+0000 7f5ae97c8640 1 --2- 172.21.15.144:0/1154498358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac81a90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5ae004a150 tx=0x7f5ae0011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ad2683d4c46e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f59bffff640 1 -- 172.21.15.144:0/1154498358 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0041070 con 0x5650eac81690 2024-09-13T19:33:27.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f59bffff640 1 -- 172.21.15.144:0/1154498358 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0013c10 con 0x5650eac81690 2024-09-13T19:33:27.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f59bffff640 1 -- 172.21.15.144:0/1154498358 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0028070 con 0x5650eac81690 2024-09-13T19:33:27.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1154498358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 msgr2=0x5650eac81a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/1154498358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac81a90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5ae004a150 tx=0x7f5ae0011f90 comp rx=0 tx=0).stop 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1154498358 shutdown_connections 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/1154498358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac81a90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1154498358 >> 172.21.15.144:0/1154498358 conn(0x5650eac7da20 msgr2=0x5650eac7bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1154498358 shutdown_connections 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1154498358 wait complete. 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 Processor -- start 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- start start 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac88a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5650eac82640 con 0x5650eac81690 2024-09-13T19:33:27.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5ae97c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac88a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5ae97c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac88a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48554/0 (socket says 172.21.15.144:48554) 2024-09-13T19:33:27.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 learned_addr learned my addr 172.21.15.144:0/2556029155 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650eac88f40 con 0x5650eac81690 2024-09-13T19:33:27.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5ae97c8640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac88a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0014fa0 tx=0x7f5ae004a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f59be7fc640 1 -- 172.21.15.144:0/2556029155 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae0041050 con 0x5650eac81690 2024-09-13T19:33:27.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650eac891d0 con 0x5650eac81690 2024-09-13T19:33:27.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f59be7fc640 1 -- 172.21.15.144:0/2556029155 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0013dc0 con 0x5650eac81690 2024-09-13T19:33:27.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f59be7fc640 1 -- 172.21.15.144:0/2556029155 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ae00139e0 con 0x5650eac81690 2024-09-13T19:33:27.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.535+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650eac8beb0 con 0x5650eac81690 2024-09-13T19:33:27.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f59be7fc640 1 -- 172.21.15.144:0/2556029155 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5ae002b560 con 0x5650eac81690 2024-09-13T19:33:27.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f59be7fc640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59b40345b0 0x7f59b4036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f59be7fc640 1 -- 172.21.15.144:0/2556029155 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5ae000e040 con 0x5650eac81690 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59b40345b0 0x7f59b4036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eac93e60 0x5650eac962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac96a20 con 0x5650eac93e60 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae87c6640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eac93e60 0x5650eac962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59b40345b0 0x7f59b4036a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8029000 tx=0x7f5ad8044070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae87c6640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eac93e60 0x5650eac962d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 realm 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac96e50 con 0x5650eac93e60 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac97720 con 0x5650eac93e60 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac97ac0 con 0x5650eac93e60 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac98820 0x5650eac9ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9b150 con 0x5650eac98820 2024-09-13T19:33:27.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae97c8640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac98820 0x5650eac9ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.539+0000 7f5ae97c8640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac98820 0x5650eac9ac10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5aeb4b7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:27.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5aeb4b7980 20 searching for the correct realm 2024-09-13T19:33:27.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5650eac9d0c0 0x5650eac9f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac9d0c0 2024-09-13T19:33:27.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5650eac9d0c0 0x5650eac9f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5650eac9d0c0 0x5650eac9f580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae8fc7640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f5ad80424d0 0x7f5ad801d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x7f5ad80424d0 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae87c6640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f5ad80424d0 0x7f5ad801d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae87c6640 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f5ad80424d0 0x7f5ad801d5f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac98820 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac93e60 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac93e60 2024-09-13T19:33:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.543+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac98820 2024-09-13T19:33:27.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac98820 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x7f5ad80424d0 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac9d0c0 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac93e60 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac98820 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac93e60 2024-09-13T19:33:27.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x7f5ad80424d0 2024-09-13T19:33:27.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac9d0c0 2024-09-13T19:33:27.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9fc50 con 0x5650eac9d0c0 2024-09-13T19:33:27.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.547+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac98820 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac9d0c0 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac9d0c0 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac93e60 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac93e60 2024-09-13T19:33:27.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac98820 2024-09-13T19:33:27.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac9d0c0 2024-09-13T19:33:27.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x7f5ad80424d0 2024-09-13T19:33:27.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac93e60 2024-09-13T19:33:27.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.551+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac98820 2024-09-13T19:33:27.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac9d0c0 2024-09-13T19:33:27.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac98820 2024-09-13T19:33:27.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x7f5ad80424d0 2024-09-13T19:33:27.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac9d0c0 2024-09-13T19:33:27.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac98820 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x5650eac93e60 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5ad8062040 con 0x7f5ad80424d0 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9baa0 con 0x5650eac93e60 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9bec0 con 0x5650eac93e60 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.555+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9c2e0 con 0x5650eac93e60 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 zone default found 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 4 Realm: () 2024-09-13T19:33:27.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:27.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:27.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:27.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 zonegroup default 2024-09-13T19:33:27.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9c2e0 con 0x5650eac98820 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eac9b6e0 con 0x5650eac9d0c0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca2050 con 0x5650eac9d0c0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 started sync module instance, tier type = 2024-09-13T19:33:27.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:27.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca13f0 con 0x7f5ad80424d0 2024-09-13T19:33:27.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94905536485616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca13f0 con 0x7f5ad80424d0 2024-09-13T19:33:27.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca2bb0 con 0x5650eac93e60 2024-09-13T19:33:27.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.559+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94905536485616] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.563+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.563+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94905536489088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca13f0 con 0x5650eac93e60 2024-09-13T19:33:27.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.563+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca35c0 con 0x5650eac9d0c0 2024-09-13T19:33:27.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.563+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94905536489088] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.563+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.563+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94905536483136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca1360 con 0x5650eac9d0c0 2024-09-13T19:33:27.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.563+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca4300 con 0x7f5ad80424d0 2024-09-13T19:33:27.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.567+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.567+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94905536495120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca4ba0 con 0x7f5ad80424d0 2024-09-13T19:33:27.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.567+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca5560 con 0x5650eac93e60 2024-09-13T19:33:27.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.567+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94905536483136] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.567+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94905536495120] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.567+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.567+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94905536499888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca4b00 con 0x5650eac93e60 2024-09-13T19:33:27.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.567+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca54d0 con 0x5650eac98820 2024-09-13T19:33:27.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.571+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94905536499888] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.571+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.571+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94905536497504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca5e30 con 0x5650eac98820 2024-09-13T19:33:27.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.571+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca6680 con 0x5650eac98820 2024-09-13T19:33:27.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.571+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94905536497504] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94905536502624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca6550 con 0x5650eac98820 2024-09-13T19:33:27.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca7070 con 0x5650eac98820 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94905536506688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca74e0 con 0x5650eac98820 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 20 add_watcher() i=0 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 20 add_watcher() i=1 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 20 add_watcher() i=2 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 20 add_watcher() i=3 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 20 add_watcher() i=4 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 20 add_watcher() i=5 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94905536502624] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.575+0000 7f5aeb4b7980 20 add_watcher() i=6 2024-09-13T19:33:27.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94905536506688] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 20 add_watcher() i=7 2024-09-13T19:33:27.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:27.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca74e0 con 0x5650eac93e60 2024-09-13T19:33:27.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94905536507952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca7450 con 0x5650eac93e60 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94905536507952] v30'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f599efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 5 note: GC not initialized 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f599dfe3640 20 reqs_thread_entry: start 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 20 Filter name: none 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f590f7fe640 20 reqs_thread_entry: start 2024-09-13T19:33:27.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650eaccd6b0 con 0x5650eac93e60 2024-09-13T19:33:27.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.579+0000 7f5aeb4b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.584 INFO:teuthology.orchestra.run.smithi144.stderr:could not fetch user info: no user info saved 2024-09-13T19:33:27.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.583+0000 7f599efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:27.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.583+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94905536507952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaccd670 con 0x5650eac93e60 2024-09-13T19:33:27.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.583+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94905536507952] v30'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.583+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94905536485616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaccd670 con 0x7f5ad80424d0 2024-09-13T19:33:27.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.583+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94905536485616] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.583+0000 7f5aeb4b7980 20 remove_watcher() i=0 2024-09-13T19:33:27.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.583+0000 7f5aeb4b7980 2 removed watcher, disabling cache 2024-09-13T19:33:27.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.583+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94905536489088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaccd670 con 0x5650eac93e60 2024-09-13T19:33:27.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.587+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94905536489088] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.587+0000 7f5aeb4b7980 20 remove_watcher() i=1 2024-09-13T19:33:27.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.587+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94905536483136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaccd670 con 0x5650eac9d0c0 2024-09-13T19:33:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.587+0000 7f5ae8fc7640 1 -- 172.21.15.144:0/2556029155 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94905536483136] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ad802e070 con 0x5650eac9d0c0 2024-09-13T19:33:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.587+0000 7f5aeb4b7980 20 remove_watcher() i=2 2024-09-13T19:33:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.587+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94905536495120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaccb540 con 0x7f5ad80424d0 2024-09-13T19:33:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.591+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94905536495120] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x7f5ad80424d0 2024-09-13T19:33:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.591+0000 7f5aeb4b7980 20 remove_watcher() i=3 2024-09-13T19:33:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.591+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94905536499888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca0f40 con 0x5650eac93e60 2024-09-13T19:33:27.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.591+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94905536499888] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5adc0aaa40 con 0x5650eac93e60 2024-09-13T19:33:27.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.591+0000 7f5aeb4b7980 20 remove_watcher() i=4 2024-09-13T19:33:27.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.591+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94905536497504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaccb540 con 0x5650eac98820 2024-09-13T19:33:27.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.595+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94905536497504] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.595+0000 7f5aeb4b7980 20 remove_watcher() i=5 2024-09-13T19:33:27.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.595+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94905536502624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca50b0 con 0x5650eac98820 2024-09-13T19:33:27.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.595+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94905536502624] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.595+0000 7f5aeb4b7980 20 remove_watcher() i=6 2024-09-13T19:33:27.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.595+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94905536506688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650eaca0f40 con 0x5650eac98820 2024-09-13T19:33:27.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5ae97c8640 1 -- 172.21.15.144:0/2556029155 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94905536506688] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ae002a070 con 0x5650eac98820 2024-09-13T19:33:27.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 20 remove_watcher() i=7 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac98820 msgr2=0x5650eac9ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac98820 0x5650eac9ac10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eac93e60 msgr2=0x5650eac962d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eac93e60 0x5650eac962d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f5ad80424d0 msgr2=0x7f5ad801d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f5ad80424d0 0x7f5ad801d5f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5650eac9d0c0 msgr2=0x5650eac9f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5650eac9d0c0 0x5650eac9f580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59b40345b0 msgr2=0x7f59b4036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59b40345b0 0x7f59b4036a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8029000 tx=0x7f5ad8044070 comp rx=0 tx=0).stop 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 msgr2=0x5650eac88a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5ae87c6640 1 -- 172.21.15.144:0/2556029155 reap_dead start 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac88a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0014fa0 tx=0x7f5ae004a0b0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 shutdown_connections 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/2556029155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac81690 0x5650eac88a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 >> 172.21.15.144:0/2556029155 conn(0x5650eac7da20 msgr2=0x5650eac7baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 shutdown_connections 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/2556029155 wait complete. 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1301935618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59c0034650 msgr2=0x7f59c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/1301935618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59c0034650 0x7f59c0036b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5650eac61b10 tx=0x7f5ad8048dd0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1301935618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac74b40 msgr2=0x5650eac74f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/1301935618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac74b40 0x5650eac74f60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5650eac61a70 tx=0x7f5ae0018830 comp rx=0 tx=0).stop 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1301935618 shutdown_connections 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/1301935618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59c0034650 0x7f59c0036b10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/1301935618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eac74b40 0x5650eac74f60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1301935618 >> 172.21.15.144:0/1301935618 conn(0x5650eac69c90 msgr2=0x5650eac6c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1301935618 shutdown_connections 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/1301935618 wait complete. 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac639a0 msgr2=0x5650eac65d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac639a0 0x5650eac65d90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eab69a90 msgr2=0x5650eac61000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eab69a90 0x5650eac61000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59d0034650 msgr2=0x7f59d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59d0034650 0x7f59d0036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0ae000 tx=0x7f5adc0a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 msgr2=0x5650eac5a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eac5a010 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5650eab65650 tx=0x7f5ad8000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 shutdown_connections 2024-09-13T19:33:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5650eab69a90 0x5650eac61000 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5650eac639a0 0x5650eac65d90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f59d0034650 0x7f59d0036b10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 --2- 172.21.15.144:0/255754680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650eaad9ac0 0x5650eac5a010 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 >> 172.21.15.144:0/255754680 conn(0x5650eab60060 msgr2=0x5650eac4c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 shutdown_connections 2024-09-13T19:33:27.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.599+0000 7f5aeb4b7980 1 -- 172.21.15.144:0/255754680 wait complete. 2024-09-13T19:33:27.616 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T19:33:27.617 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T19:33:27.617 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T19:33:27.617 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-13T19:33:27.705 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:27.705 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:27.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81e7667980 1 Processor -- start 2024-09-13T19:33:27.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81e7667980 1 -- start start 2024-09-13T19:33:27.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81e7667980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5619a0c16c00 0x5619a0c18ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81e7667980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619a0a98ae0 con 0x5619a0c12880 2024-09-13T19:33:27.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81e7667980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5619a0abce30 con 0x5619a0c16c00 2024-09-13T19:33:27.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81dffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5619a0c16c00 0x5619a0c18ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81e5177640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5619a0c12880 0x5619a0c12c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42252/0 (socket says 172.21.15.144:42252) 2024-09-13T19:33:27.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81e5177640 1 -- 172.21.15.144:0/207018830 learned_addr learned my addr 172.21.15.144:0/207018830 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:27.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81dffff640 1 -- 172.21.15.144:0/207018830 >> v1:172.21.15.18:6789/0 conn(0x5619a0c12880 legacy=0x5619a0c12c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.703+0000 7f81dffff640 1 -- 172.21.15.144:0/207018830 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a0c1a540 con 0x5619a0c16c00 2024-09-13T19:33:27.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81dffff640 1 --2- 172.21.15.144:0/207018830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c16c00 0x5619a0c18ff0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f81d000a480 tx=0x7f81d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585fb7c086b40064 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e4976640 1 -- 172.21.15.144:0/207018830 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81d00b0070 con 0x5619a0c16c00 2024-09-13T19:33:27.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e4976640 1 -- 172.21.15.144:0/207018830 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d00ab540 con 0x5619a0c16c00 2024-09-13T19:33:27.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e4976640 1 -- 172.21.15.144:0/207018830 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81d00ab840 con 0x5619a0c16c00 2024-09-13T19:33:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e7667980 1 -- 172.21.15.144:0/207018830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c16c00 msgr2=0x5619a0c18ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e7667980 1 --2- 172.21.15.144:0/207018830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c16c00 0x5619a0c18ff0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f81d000a480 tx=0x7f81d001b280 comp rx=0 tx=0).stop 2024-09-13T19:33:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e7667980 1 -- 172.21.15.144:0/207018830 shutdown_connections 2024-09-13T19:33:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e7667980 1 --2- 172.21.15.144:0/207018830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c16c00 0x5619a0c18ff0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e7667980 1 -- 172.21.15.144:0/207018830 >> 172.21.15.144:0/207018830 conn(0x5619a0b861d0 msgr2=0x5619a0b865e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e7667980 1 -- 172.21.15.144:0/207018830 shutdown_connections 2024-09-13T19:33:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.707+0000 7f81e7667980 1 -- 172.21.15.144:0/207018830 wait complete. 2024-09-13T19:33:27.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e7667980 1 Processor -- start 2024-09-13T19:33:27.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e7667980 1 -- start start 2024-09-13T19:33:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e7667980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0cfdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e7667980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5619a0abe200 con 0x5619a0c12880 2024-09-13T19:33:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e5177640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0cfdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e5177640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0cfdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48568/0 (socket says 172.21.15.144:48568) 2024-09-13T19:33:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e5177640 1 -- 172.21.15.144:0/1975082850 learned_addr learned my addr 172.21.15.144:0/1975082850 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e5177640 1 -- 172.21.15.144:0/1975082850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a0cfe260 con 0x5619a0c12880 2024-09-13T19:33:27.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f81e5177640 1 --2- 172.21.15.144:0/1975082850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0cfdc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f81d8001d90 tx=0x7f81d8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d468de8590320d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f80d3606640 1 -- 172.21.15.144:0/1975082850 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81d8013030 con 0x5619a0c12880 2024-09-13T19:33:27.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f80d3606640 1 -- 172.21.15.144:0/1975082850 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d800e690 con 0x5619a0c12880 2024-09-13T19:33:27.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.723+0000 7f80d3606640 1 -- 172.21.15.144:0/1975082850 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81d800ea10 con 0x5619a0c12880 2024-09-13T19:33:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- 172.21.15.144:0/1975082850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 msgr2=0x5619a0cfdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 --2- 172.21.15.144:0/1975082850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0cfdc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f81d8001d90 tx=0x7f81d8001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- 172.21.15.144:0/1975082850 shutdown_connections 2024-09-13T19:33:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 --2- 172.21.15.144:0/1975082850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0cfdc90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- 172.21.15.144:0/1975082850 >> 172.21.15.144:0/1975082850 conn(0x5619a0b861d0 msgr2=0x5619a0cf98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- 172.21.15.144:0/1975082850 shutdown_connections 2024-09-13T19:33:27.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- 172.21.15.144:0/1975082850 wait complete. 2024-09-13T19:33:27.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 Processor -- start 2024-09-13T19:33:27.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- start start 2024-09-13T19:33:27.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0d05000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5619a0c1a040 con 0x5619a0c12880 2024-09-13T19:33:27.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e5177640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0d05000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e5177640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0d05000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48584/0 (socket says 172.21.15.144:48584) 2024-09-13T19:33:27.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e5177640 1 -- 172.21.15.144:0/3704245737 learned_addr learned my addr 172.21.15.144:0/3704245737 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e5177640 1 -- 172.21.15.144:0/3704245737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a0d05540 con 0x5619a0c12880 2024-09-13T19:33:27.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e5177640 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0d05000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5619a0cfee70 tx=0x7f81d8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f80d1e03640 1 -- 172.21.15.144:0/3704245737 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81d8027070 con 0x5619a0c12880 2024-09-13T19:33:27.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619a0d057d0 con 0x5619a0c12880 2024-09-13T19:33:27.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f80d1e03640 1 -- 172.21.15.144:0/3704245737 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d8019900 con 0x5619a0c12880 2024-09-13T19:33:27.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a0d084b0 con 0x5619a0c12880 2024-09-13T19:33:27.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.727+0000 7f80d1e03640 1 -- 172.21.15.144:0/3704245737 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81d8019be0 con 0x5619a0c12880 2024-09-13T19:33:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f80d1e03640 1 -- 172.21.15.144:0/3704245737 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f81d802a070 con 0x5619a0c12880 2024-09-13T19:33:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f80d1e03640 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80cc0346f0 0x7f80cc036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f80d1e03640 1 -- 172.21.15.144:0/3704245737 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f81d801f070 con 0x5619a0c12880 2024-09-13T19:33:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81dffff640 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80cc0346f0 0x7f80cc036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0c16c00 0x5619a0d0c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d0c600 con 0x5619a0c16c00 2024-09-13T19:33:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e5978640 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0c16c00 0x5619a0d0c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81dffff640 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80cc0346f0 0x7f80cc036bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81d00ad000 tx=0x7f81d00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e5978640 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0c16c00 0x5619a0d0c010 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e5978640 1 -- 172.21.15.144:0/3704245737 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81e000a4d0 con 0x5619a0c16c00 2024-09-13T19:33:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d096d0 con 0x5619a0c16c00 2024-09-13T19:33:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e5978640 1 -- 172.21.15.144:0/3704245737 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81e000a4d0 con 0x5619a0c16c00 2024-09-13T19:33:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d0e950 0x5619a0d10d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d11410 con 0x5619a0d0e950 2024-09-13T19:33:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e5177640 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d0e950 0x5619a0d10d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e5177640 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d0e950 0x5619a0d10d40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.731+0000 7f81e5177640 1 -- 172.21.15.144:0/3704245737 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81d8029030 con 0x5619a0d0e950 2024-09-13T19:33:27.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d0d7c0 con 0x5619a0c16c00 2024-09-13T19:33:27.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e5978640 1 -- 172.21.15.144:0/3704245737 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81e000a4d0 con 0x5619a0c16c00 2024-09-13T19:33:27.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d0dca0 con 0x5619a0c16c00 2024-09-13T19:33:27.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e5978640 1 -- 172.21.15.144:0/3704245737 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81e000a4d0 con 0x5619a0c16c00 2024-09-13T19:33:27.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e7667980 1 Processor -- start 2024-09-13T19:33:27.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e7667980 1 -- start start 2024-09-13T19:33:27.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e7667980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d1fad0 0x5619a0d1fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e7667980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5619a0b17800 con 0x5619a0d1fad0 2024-09-13T19:33:27.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e5978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d1fad0 0x5619a0d1fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e5978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d1fad0 0x5619a0d1fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48588/0 (socket says 172.21.15.144:48588) 2024-09-13T19:33:27.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e5978640 1 -- 172.21.15.144:0/705764810 learned_addr learned my addr 172.21.15.144:0/705764810 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e5978640 1 -- 172.21.15.144:0/705764810 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a0d20430 con 0x5619a0d1fad0 2024-09-13T19:33:27.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e5978640 1 --2- 172.21.15.144:0/705764810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d1fad0 0x5619a0d1fef0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5619a0d06430 tx=0x7f81e0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f80caffd640 1 -- 172.21.15.144:0/705764810 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e0014450 con 0x5619a0d1fad0 2024-09-13T19:33:27.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e7667980 1 -- 172.21.15.144:0/705764810 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619a0d206c0 con 0x5619a0d1fad0 2024-09-13T19:33:27.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f80caffd640 1 -- 172.21.15.144:0/705764810 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e00145f0 con 0x5619a0d1fad0 2024-09-13T19:33:27.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f81e7667980 1 -- 172.21.15.144:0/705764810 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a0d23340 con 0x5619a0d1fad0 2024-09-13T19:33:27.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.735+0000 7f80caffd640 1 -- 172.21.15.144:0/705764810 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e0028060 con 0x5619a0d1fad0 2024-09-13T19:33:27.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f80caffd640 1 -- 172.21.15.144:0/705764810 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f81e0011040 con 0x5619a0d1fad0 2024-09-13T19:33:27.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f80caffd640 1 --2- 172.21.15.144:0/705764810 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80bc034650 0x7f80bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f80caffd640 1 -- 172.21.15.144:0/705764810 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f81e001e070 con 0x5619a0d1fad0 2024-09-13T19:33:27.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e5177640 1 --2- 172.21.15.144:0/705764810 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80bc034650 0x7f80bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 Processor -- start 2024-09-13T19:33:27.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 -- start start 2024-09-13T19:33:27.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d2c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5619a0cfe5e0 con 0x5619a0d2c5d0 2024-09-13T19:33:27.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e5177640 1 --2- 172.21.15.144:0/705764810 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80bc034650 0x7f80bc036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81d802af90 tx=0x7f81d8016400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e5978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d2c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e5978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d2c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48592/0 (socket says 172.21.15.144:48592) 2024-09-13T19:33:27.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e5978640 1 -- 172.21.15.144:0/4028550042 learned_addr learned my addr 172.21.15.144:0/4028550042 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e5978640 1 -- 172.21.15.144:0/4028550042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a0d2cf80 con 0x5619a0d2c5d0 2024-09-13T19:33:27.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e5978640 1 --2- 172.21.15.144:0/4028550042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d2c9b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f81e004a160 tx=0x7f81e0011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc39b803f1dd1203 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f80c8ff9640 1 -- 172.21.15.144:0/4028550042 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e00168f0 con 0x5619a0d2c5d0 2024-09-13T19:33:27.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f80c8ff9640 1 -- 172.21.15.144:0/4028550042 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e003be50 con 0x5619a0d2c5d0 2024-09-13T19:33:27.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f80c8ff9640 1 -- 172.21.15.144:0/4028550042 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e0022bb0 con 0x5619a0d2c5d0 2024-09-13T19:33:27.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 -- 172.21.15.144:0/4028550042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 msgr2=0x5619a0d2c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 --2- 172.21.15.144:0/4028550042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d2c9b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f81e004a160 tx=0x7f81e0011970 comp rx=0 tx=0).stop 2024-09-13T19:33:27.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 -- 172.21.15.144:0/4028550042 shutdown_connections 2024-09-13T19:33:27.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 --2- 172.21.15.144:0/4028550042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d2c9b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 -- 172.21.15.144:0/4028550042 >> 172.21.15.144:0/4028550042 conn(0x5619a0d289b0 msgr2=0x5619a0d26ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 -- 172.21.15.144:0/4028550042 shutdown_connections 2024-09-13T19:33:27.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 -- 172.21.15.144:0/4028550042 wait complete. 2024-09-13T19:33:27.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.739+0000 7f81e7667980 1 Processor -- start 2024-09-13T19:33:27.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e7667980 1 -- start start 2024-09-13T19:33:27.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e7667980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d339a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e7667980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5619a0d2d540 con 0x5619a0d2c5d0 2024-09-13T19:33:27.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e5978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e5978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d339a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48596/0 (socket says 172.21.15.144:48596) 2024-09-13T19:33:27.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 learned_addr learned my addr 172.21.15.144:0/948765481 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a0d33ee0 con 0x5619a0d2c5d0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e5978640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d339a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81e00117d0 tx=0x7f81e004a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f80baffd640 1 -- 172.21.15.144:0/948765481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e002bc90 con 0x5619a0d2c5d0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619a0d34170 con 0x5619a0d2c5d0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f80baffd640 1 -- 172.21.15.144:0/948765481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e002be30 con 0x5619a0d2c5d0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f80baffd640 1 -- 172.21.15.144:0/948765481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e0014a00 con 0x5619a0d2c5d0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a0d36e50 con 0x5619a0d2c5d0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f80baffd640 1 -- 172.21.15.144:0/948765481 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f81e0014ba0 con 0x5619a0d2c5d0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f80baffd640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80b0034650 0x7f80b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f80baffd640 1 -- 172.21.15.144:0/948765481 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f81e0034030 con 0x5619a0d2c5d0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e5177640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80b0034650 0x7f80b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0d3eec0 0x5619a0d41380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d41ad0 con 0x5619a0d3eec0 2024-09-13T19:33:27.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.743+0000 7f81dffff640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0d3eec0 0x5619a0d41380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e5177640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80b0034650 0x7f80b0036b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81d80453f0 tx=0x7f81d803f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81dffff640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0d3eec0 0x5619a0d41380 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 realm 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d41f00 con 0x5619a0d3eec0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d427d0 con 0x5619a0d3eec0 2024-09-13T19:33:27.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d42b70 con 0x5619a0d3eec0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d438d0 0x5619a0d45cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d462d0 con 0x5619a0d438d0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e5978640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d438d0 0x5619a0d45cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e5978640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d438d0 0x5619a0d45cc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:27.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 20 searching for the correct realm 2024-09-13T19:33:27.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619a0d481b0 0x5619a0d4a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e5177640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619a0d481b0 0x5619a0d4a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.747+0000 7f81e5177640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619a0d481b0 0x5619a0d4a620 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5177640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81d8056040 0x7f81d8045ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x7f81d8056040 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81dffff640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81d8056040 0x7f81d8045ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81dffff640 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81d8056040 0x7f81d8045ae0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d3eec0 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d3eec0 2024-09-13T19:33:27.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.751+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x7f81d8056040 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d3eec0 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d3eec0 2024-09-13T19:33:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x7f81d8056040 2024-09-13T19:33:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.755+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d3eec0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d3eec0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x7f81d8056040 2024-09-13T19:33:27.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d3eec0 2024-09-13T19:33:27.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.759+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x7f81d8056040 2024-09-13T19:33:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d481b0 2024-09-13T19:33:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d438d0 2024-09-13T19:33:27.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x5619a0d3eec0 2024-09-13T19:33:27.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4acf0 con 0x7f81d8056040 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d46c20 con 0x5619a0d3eec0 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d47010 con 0x5619a0d3eec0 2024-09-13T19:33:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d47010 con 0x5619a0d3eec0 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 zone default found 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 4 Realm: () 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 zonegroup default 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.763+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d47430 con 0x5619a0d438d0 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4cb50 con 0x5619a0d481b0 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4cfb0 con 0x5619a0d481b0 2024-09-13T19:33:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 20 started sync module instance, tier type = 2024-09-13T19:33:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d46810 con 0x7f81d8056040 2024-09-13T19:33:27.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94668072468368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4d410 con 0x7f81d8056040 2024-09-13T19:33:27.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.767+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4dc60 con 0x5619a0d3eec0 2024-09-13T19:33:27.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.771+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.771+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94668072473888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4def0 con 0x5619a0d3eec0 2024-09-13T19:33:27.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.771+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94668072468368] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.771+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4ea10 con 0x5619a0d481b0 2024-09-13T19:33:27.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.771+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.771+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94668072477920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4ee30 con 0x5619a0d481b0 2024-09-13T19:33:27.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.771+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94668072473888] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.771+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4f7f0 con 0x7f81d8056040 2024-09-13T19:33:27.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.775+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.775+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94668072481600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4fc10 con 0x7f81d8056040 2024-09-13T19:33:27.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.775+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d504a0 con 0x5619a0d3eec0 2024-09-13T19:33:27.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.775+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94668072477920] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.775+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.775+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94668072469424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d500c0 con 0x5619a0d3eec0 2024-09-13T19:33:27.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.775+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d50eb0 con 0x5619a0d438d0 2024-09-13T19:33:27.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.779+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94668072481600] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.779+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.779+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94668072487424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d51250 con 0x5619a0d438d0 2024-09-13T19:33:27.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.779+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d51b20 con 0x5619a0d438d0 2024-09-13T19:33:27.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.783+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94668072469424] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.783+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.783+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94668072483856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d51d00 con 0x5619a0d438d0 2024-09-13T19:33:27.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.783+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d52590 con 0x5619a0d438d0 2024-09-13T19:33:27.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94668072487424] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94668072482656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d52770 con 0x5619a0d438d0 2024-09-13T19:33:27.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 20 add_watcher() i=0 2024-09-13T19:33:27.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 20 add_watcher() i=1 2024-09-13T19:33:27.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 20 add_watcher() i=2 2024-09-13T19:33:27.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 20 add_watcher() i=3 2024-09-13T19:33:27.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 20 add_watcher() i=4 2024-09-13T19:33:27.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 20 add_watcher() i=5 2024-09-13T19:33:27.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94668072483856] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 20 add_watcher() i=6 2024-09-13T19:33:27.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94668072482656] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 20 add_watcher() i=7 2024-09-13T19:33:27.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:27.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d55690 con 0x5619a0d3eec0 2024-09-13T19:33:27.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.787+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94668072489552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d52b10 con 0x5619a0d3eec0 2024-09-13T19:33:27.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94668072489552] v30'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f809b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:27.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:27.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:27.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 5 note: GC not initialized 2024-09-13T19:33:27.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f809a7e4640 20 reqs_thread_entry: start 2024-09-13T19:33:27.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 Filter name: none 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f800bfff640 20 reqs_thread_entry: start 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d78bd0 con 0x5619a0d3eec0 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T19:33:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d77370 con 0x5619a0d3eec0 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d77370 con 0x5619a0d438d0 2024-09-13T19:33:27.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-13T19:33:27.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:33:27.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T19:33:27.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T19:33:27.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.791+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d77c90 con 0x5619a0d3eec0 2024-09-13T19:33:27.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81e7667980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81e7667980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81e7667980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94668072646944 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d7c670 con 0x5619a0d3eec0 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== watch-notify(notify (1) cookie 94668072469424 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5619a0d78030 con 0x5619a0d3eec0 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f80c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94668072469424 notifier 4286 bl.length()=567 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f80c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f80c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:27.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f80c8ff9640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f80a8003eb0 con 0x5619a0d3eec0 2024-09-13T19:33:27.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(66 notify.4 [notify cookie 94668072646944 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== watch-notify(notify_complete (2) cookie 94668072646944 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619a0d78780 con 0x5619a0d3eec0 2024-09-13T19:33:27.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.795+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d77920 con 0x5619a0d3eec0 2024-09-13T19:33:27.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T19:33:27.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:33:27.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94668072646944 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d7ca80 con 0x7f81d8056040 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== watch-notify(notify (1) cookie 94668072481600 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x5619a0d78780 con 0x7f81d8056040 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f80bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94668072481600 notifier 4286 bl.length()=169 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f80bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f80bbfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f80bbfff640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8018003410 con 0x7f81d8056040 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(69 notify.3 [notify cookie 94668072646944 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== watch-notify(notify_complete (2) cookie 94668072646944 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619a0c1a540 con 0x7f81d8056040 2024-09-13T19:33:27.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d77920 con 0x5619a0d438d0 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.799+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94668072646944 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d7ca80 con 0x7f81d8056040 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== watch-notify(notify (1) cookie 94668072481600 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5619a0c1a540 con 0x7f81d8056040 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f80c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94668072481600 notifier 4286 bl.length()=177 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f80c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f80c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:33:27.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f80c8ff9640 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f80a8003eb0 con 0x7f81d8056040 2024-09-13T19:33:27.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(72 notify.3 [notify cookie 94668072646944 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== watch-notify(notify_complete (2) cookie 94668072646944 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f81d00cf640 con 0x7f81d8056040 2024-09-13T19:33:27.806 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:27.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f809b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:27.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94668072489552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d76970 con 0x5619a0d3eec0 2024-09-13T19:33:27.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94668072489552] v30'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.803+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94668072468368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d76970 con 0x7f81d8056040 2024-09-13T19:33:27.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.807+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94668072468368] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.807+0000 7f81e7667980 20 remove_watcher() i=0 2024-09-13T19:33:27.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.807+0000 7f81e7667980 2 removed watcher, disabling cache 2024-09-13T19:33:27.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.807+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94668072473888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4bf90 con 0x5619a0d3eec0 2024-09-13T19:33:27.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.807+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94668072473888] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.807+0000 7f81e7667980 20 remove_watcher() i=1 2024-09-13T19:33:27.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.807+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94668072477920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4d520 con 0x5619a0d481b0 2024-09-13T19:33:27.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81e5177640 1 -- 172.21.15.144:0/948765481 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94668072477920] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d8053070 con 0x5619a0d481b0 2024-09-13T19:33:27.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81e7667980 20 remove_watcher() i=2 2024-09-13T19:33:27.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94668072481600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4bf90 con 0x7f81d8056040 2024-09-13T19:33:27.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94668072481600] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x7f81d8056040 2024-09-13T19:33:27.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81e7667980 20 remove_watcher() i=3 2024-09-13T19:33:27.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94668072469424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4d520 con 0x5619a0d3eec0 2024-09-13T19:33:27.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94668072469424] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81d00b3040 con 0x5619a0d3eec0 2024-09-13T19:33:27.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81e7667980 20 remove_watcher() i=4 2024-09-13T19:33:27.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.811+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94668072487424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4f340 con 0x5619a0d438d0 2024-09-13T19:33:27.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.815+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94668072487424] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.815+0000 7f81e7667980 20 remove_watcher() i=5 2024-09-13T19:33:27.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.815+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94668072483856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d4d520 con 0x5619a0d438d0 2024-09-13T19:33:27.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.815+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94668072483856] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.815+0000 7f81e7667980 20 remove_watcher() i=6 2024-09-13T19:33:27.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.815+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94668072482656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619a0d50a00 con 0x5619a0d438d0 2024-09-13T19:33:27.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e5978640 1 -- 172.21.15.144:0/948765481 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94668072482656] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e002a070 con 0x5619a0d438d0 2024-09-13T19:33:27.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 20 remove_watcher() i=7 2024-09-13T19:33:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d438d0 msgr2=0x5619a0d45cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d438d0 0x5619a0d45cc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0d3eec0 msgr2=0x5619a0d41380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0d3eec0 0x5619a0d41380 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81d8056040 msgr2=0x7f81d8045ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81d8056040 0x7f81d8045ae0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619a0d481b0 msgr2=0x5619a0d4a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619a0d481b0 0x5619a0d4a620 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80b0034650 msgr2=0x7f80b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80b0034650 0x7f80b0036b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81d80453f0 tx=0x7f81d803f000 comp rx=0 tx=0).stop 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 msgr2=0x5619a0d339a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81dffff640 1 -- 172.21.15.144:0/948765481 reap_dead start 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d339a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81e00117d0 tx=0x7f81e004a0f0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 shutdown_connections 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/948765481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d2c5d0 0x5619a0d339a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 >> 172.21.15.144:0/948765481 conn(0x5619a0d289b0 msgr2=0x5619a0d2dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 shutdown_connections 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/948765481 wait complete. 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/705764810 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80bc034650 msgr2=0x7f80bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/705764810 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80bc034650 0x7f80bc036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81d802af90 tx=0x7f81d8016400 comp rx=0 tx=0).stop 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/705764810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d1fad0 msgr2=0x5619a0d1fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/705764810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d1fad0 0x5619a0d1fef0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5619a0d06430 tx=0x7f81e0018830 comp rx=0 tx=0).stop 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/705764810 shutdown_connections 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/705764810 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80bc034650 0x7f80bc036b10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/705764810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0d1fad0 0x5619a0d1fef0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/705764810 >> 172.21.15.144:0/705764810 conn(0x5619a0d14c20 msgr2=0x5619a0d176a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/705764810 shutdown_connections 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/705764810 wait complete. 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d0e950 msgr2=0x5619a0d10d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d0e950 0x5619a0d10d40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0c16c00 msgr2=0x5619a0d0c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0c16c00 0x5619a0d0c010 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80cc0346f0 msgr2=0x7f80cc036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80cc0346f0 0x7f80cc036bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81d00ad000 tx=0x7f81d00a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 msgr2=0x5619a0d05000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0d05000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5619a0cfee70 tx=0x7f81d8000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 shutdown_connections 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619a0c16c00 0x5619a0d0c010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619a0d0e950 0x5619a0d10d40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80cc0346f0 0x7f80cc036bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 --2- 172.21.15.144:0/3704245737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619a0c12880 0x5619a0d05000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 >> 172.21.15.144:0/3704245737 conn(0x5619a0b861d0 msgr2=0x5619a0cf8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 shutdown_connections 2024-09-13T19:33:27.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.819+0000 7f81e7667980 1 -- 172.21.15.144:0/3704245737 wait complete. 2024-09-13T19:33:27.835 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:27.835 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T19:33:27.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T19:33:27.835 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-13T19:33:27.922 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:27.922 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:27.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb06ba0d980 1 Processor -- start 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb06ba0d980 1 -- start start 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb06ba0d980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5643f8929b30 0x5643f892bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb06ba0d980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5643f87adae0 con 0x5643f8923a60 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb06ba0d980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5643f87d1e30 con 0x5643f8929b30 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb068d1c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5643f8929b30 0x5643f892bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb068d1c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5643f8929b30 0x5643f892bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48598/0 (socket says 172.21.15.144:48598) 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb06951d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5643f8923a60 0x5643f8923e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42254/0 (socket says 172.21.15.144:42254) 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb068d1c640 1 -- 172.21.15.144:0/715946911 learned_addr learned my addr 172.21.15.144:0/715946911 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb068d1c640 1 -- 172.21.15.144:0/715946911 >> v1:172.21.15.18:6789/0 conn(0x5643f8923a60 legacy=0x5643f8923e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb068d1c640 1 -- 172.21.15.144:0/715946911 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f8924550 con 0x5643f8929b30 2024-09-13T19:33:27.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.919+0000 7fb063fff640 1 -- 172.21.15.144:0/715946911 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297160097 0 0) 0x5643f87adae0 con 0x5643f8923a60 2024-09-13T19:33:27.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb068d1c640 1 --2- 172.21.15.144:0/715946911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8929b30 0x5643f892bf20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb05400a5c0 tx=0x7fb05401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dbf3874b341849 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb063fff640 1 -- 172.21.15.144:0/715946911 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0540a6070 con 0x5643f8929b30 2024-09-13T19:33:27.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb063fff640 1 -- 172.21.15.144:0/715946911 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0540af070 con 0x5643f8929b30 2024-09-13T19:33:27.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb063fff640 1 -- 172.21.15.144:0/715946911 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0540aa5c0 con 0x5643f8929b30 2024-09-13T19:33:27.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb06ba0d980 1 -- 172.21.15.144:0/715946911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8929b30 msgr2=0x5643f892bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/715946911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8929b30 0x5643f892bf20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb05400a5c0 tx=0x7fb05401b340 comp rx=0 tx=0).stop 2024-09-13T19:33:27.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb06ba0d980 1 -- 172.21.15.144:0/715946911 shutdown_connections 2024-09-13T19:33:27.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/715946911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8929b30 0x5643f892bf20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb06ba0d980 1 -- 172.21.15.144:0/715946911 >> 172.21.15.144:0/715946911 conn(0x5643f891f740 msgr2=0x5643f8921b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb06ba0d980 1 -- 172.21.15.144:0/715946911 shutdown_connections 2024-09-13T19:33:27.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.923+0000 7fb06ba0d980 1 -- 172.21.15.144:0/715946911 wait complete. 2024-09-13T19:33:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.939+0000 7fb06ba0d980 1 Processor -- start 2024-09-13T19:33:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.939+0000 7fb06ba0d980 1 -- start start 2024-09-13T19:33:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.939+0000 7fb06ba0d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a10780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.939+0000 7fb06ba0d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f87d3200 con 0x5643f8923a60 2024-09-13T19:33:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06951d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a10780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06951d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a10780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48614/0 (socket says 172.21.15.144:48614) 2024-09-13T19:33:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06951d640 1 -- 172.21.15.144:0/3398751869 learned_addr learned my addr 172.21.15.144:0/3398751869 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06951d640 1 -- 172.21.15.144:0/3398751869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f8a10d50 con 0x5643f8923a60 2024-09-13T19:33:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06951d640 1 --2- 172.21.15.144:0/3398751869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a10780 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0016c0 tx=0x7fb05c001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb09d85d7a9426c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7faf57606640 1 -- 172.21.15.144:0/3398751869 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c003460 con 0x5643f8923a60 2024-09-13T19:33:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7faf57606640 1 -- 172.21.15.144:0/3398751869 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c003600 con 0x5643f8923a60 2024-09-13T19:33:27.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7faf57606640 1 -- 172.21.15.144:0/3398751869 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c003920 con 0x5643f8923a60 2024-09-13T19:33:27.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 -- 172.21.15.144:0/3398751869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 msgr2=0x5643f8a10780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/3398751869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a10780 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0016c0 tx=0x7fb05c001b80 comp rx=0 tx=0).stop 2024-09-13T19:33:27.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 -- 172.21.15.144:0/3398751869 shutdown_connections 2024-09-13T19:33:27.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/3398751869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a10780 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 -- 172.21.15.144:0/3398751869 >> 172.21.15.144:0/3398751869 conn(0x5643f891f740 msgr2=0x5643f8a0c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 -- 172.21.15.144:0/3398751869 shutdown_connections 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 -- 172.21.15.144:0/3398751869 wait complete. 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 Processor -- start 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 -- start start 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a17c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06ba0d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f892ef80 con 0x5643f8923a60 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06951d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a17c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06951d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a17c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48620/0 (socket says 172.21.15.144:48620) 2024-09-13T19:33:27.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.943+0000 7fb06951d640 1 -- 172.21.15.144:0/4277516398 learned_addr learned my addr 172.21.15.144:0/4277516398 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06951d640 1 -- 172.21.15.144:0/4277516398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f8a18140 con 0x5643f8923a60 2024-09-13T19:33:27.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06951d640 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a17c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0012f0 tx=0x7fb05c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7faf55e03640 1 -- 172.21.15.144:0/4277516398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c013760 con 0x5643f8923a60 2024-09-13T19:33:27.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643f8a183d0 con 0x5643f8923a60 2024-09-13T19:33:27.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7faf55e03640 1 -- 172.21.15.144:0/4277516398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c023070 con 0x5643f8923a60 2024-09-13T19:33:27.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f8a1b0b0 con 0x5643f8923a60 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7faf55e03640 1 -- 172.21.15.144:0/4277516398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c013a30 con 0x5643f8923a60 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7faf55e03640 1 -- 172.21.15.144:0/4277516398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb05c010070 con 0x5643f8923a60 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7faf55e03640 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf500346a0 0x7faf50036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7faf55e03640 1 -- 172.21.15.144:0/4277516398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb05c049970 con 0x5643f8923a60 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8929b30 0x5643f8a1eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb068d1c640 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf500346a0 0x7faf50036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a1f1b0 con 0x5643f8929b30 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb069d1e640 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8929b30 0x5643f8a1eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb069d1e640 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8929b30 0x5643f8a1eb90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb068d1c640 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf500346a0 0x7faf50036b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb05400a5c0 tx=0x7fb0540a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb069d1e640 1 -- 172.21.15.144:0/4277516398 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0640083f0 con 0x5643f8929b30 2024-09-13T19:33:27.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a1c2b0 con 0x5643f8929b30 2024-09-13T19:33:27.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb069d1e640 1 -- 172.21.15.144:0/4277516398 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0640083f0 con 0x5643f8929b30 2024-09-13T19:33:27.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a21510 0x5643f8a23900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.947+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a23fd0 con 0x5643f8a21510 2024-09-13T19:33:27.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06951d640 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a21510 0x5643f8a23900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06951d640 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a21510 0x5643f8a23900 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06951d640 1 -- 172.21.15.144:0/4277516398 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb05c00f030 con 0x5643f8a21510 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a203b0 con 0x5643f8929b30 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb069d1e640 1 -- 172.21.15.144:0/4277516398 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0640083f0 con 0x5643f8929b30 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a20890 con 0x5643f8929b30 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb069d1e640 1 -- 172.21.15.144:0/4277516398 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0640083f0 con 0x5643f8929b30 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06ba0d980 1 Processor -- start 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06ba0d980 1 -- start start 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06ba0d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a326b0 0x5643f8a32ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb06ba0d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f882c800 con 0x5643f8a326b0 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb069d1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a326b0 0x5643f8a32ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb069d1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a326b0 0x5643f8a32ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48626/0 (socket says 172.21.15.144:48626) 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb069d1e640 1 -- 172.21.15.144:0/1164724758 learned_addr learned my addr 172.21.15.144:0/1164724758 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.951+0000 7fb069d1e640 1 -- 172.21.15.144:0/1164724758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f8a33010 con 0x5643f8a326b0 2024-09-13T19:33:27.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb069d1e640 1 --2- 172.21.15.144:0/1164724758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a326b0 0x5643f8a32ad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5643f8a1f590 tx=0x7fb06400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7faf4effd640 1 -- 172.21.15.144:0/1164724758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb064007da0 con 0x5643f8a326b0 2024-09-13T19:33:27.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7faf4effd640 1 -- 172.21.15.144:0/1164724758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06401e020 con 0x5643f8a326b0 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1164724758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643f8a332a0 con 0x5643f8a326b0 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7faf4effd640 1 -- 172.21.15.144:0/1164724758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb064019590 con 0x5643f8a326b0 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1164724758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f8a35f20 con 0x5643f8a326b0 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7faf4effd640 1 -- 172.21.15.144:0/1164724758 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb064016040 con 0x5643f8a326b0 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7faf4effd640 1 --2- 172.21.15.144:0/1164724758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf400346a0 0x7faf40036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7faf4effd640 1 -- 172.21.15.144:0/1164724758 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb06401f030 con 0x5643f8a326b0 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb06951d640 1 --2- 172.21.15.144:0/1164724758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf400346a0 0x7faf40036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb06ba0d980 1 Processor -- start 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb06ba0d980 1 -- start start 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb06951d640 1 --2- 172.21.15.144:0/1164724758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf400346a0 0x7faf40036b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5643f8a1f680 tx=0x7fb05c012f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb06ba0d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a3f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb06ba0d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f8a110d0 con 0x5643f8a3f170 2024-09-13T19:33:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb069d1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a3f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb069d1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a3f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48628/0 (socket says 172.21.15.144:48628) 2024-09-13T19:33:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.955+0000 7fb069d1e640 1 -- 172.21.15.144:0/1129386266 learned_addr learned my addr 172.21.15.144:0/1129386266 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb069d1e640 1 -- 172.21.15.144:0/1129386266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f8a3fb40 con 0x5643f8a3f170 2024-09-13T19:33:27.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb069d1e640 1 --2- 172.21.15.144:0/1129386266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a3f570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb06404a280 tx=0x7fb064017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c26f250917ddeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7faf4cff9640 1 -- 172.21.15.144:0/1129386266 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb06401d040 con 0x5643f8a3f170 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7faf4cff9640 1 -- 172.21.15.144:0/1129386266 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb064023410 con 0x5643f8a3f170 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7faf4cff9640 1 -- 172.21.15.144:0/1129386266 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb064019c90 con 0x5643f8a3f170 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1129386266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 msgr2=0x5643f8a3f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1129386266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a3f570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb06404a280 tx=0x7fb064017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1129386266 shutdown_connections 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1129386266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a3f570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1129386266 >> 172.21.15.144:0/1129386266 conn(0x5643f8a3b5a0 msgr2=0x5643f8a396a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1129386266 shutdown_connections 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1129386266 wait complete. 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 Processor -- start 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- start start 2024-09-13T19:33:27.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f8a40190 con 0x5643f8a3f170 2024-09-13T19:33:27.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb069d1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb069d1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a465d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48642/0 (socket says 172.21.15.144:48642) 2024-09-13T19:33:27.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 learned_addr learned my addr 172.21.15.144:0/1868189595 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:27.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f8a46b10 con 0x5643f8a3f170 2024-09-13T19:33:27.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb069d1e640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a465d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb064015c40 tx=0x7fb06404a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7faf3effd640 1 -- 172.21.15.144:0/1868189595 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb06401d070 con 0x5643f8a3f170 2024-09-13T19:33:27.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643f8a46da0 con 0x5643f8a3f170 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7faf3effd640 1 -- 172.21.15.144:0/1868189595 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb064033070 con 0x5643f8a3f170 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f8a49a80 con 0x5643f8a3f170 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.959+0000 7faf3effd640 1 -- 172.21.15.144:0/1868189595 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb064015cb0 con 0x5643f8a3f170 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7faf3effd640 1 -- 172.21.15.144:0/1868189595 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb064035070 con 0x5643f8a3f170 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7faf3effd640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf340346a0 0x7faf34036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7faf3effd640 1 -- 172.21.15.144:0/1868189595 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb064038b10 con 0x5643f8a3f170 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06951d640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf340346a0 0x7faf34036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8a51a60 0x5643f8a53f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a54650 con 0x5643f8a51a60 2024-09-13T19:33:27.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb068d1c640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8a51a60 0x5643f8a53f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06951d640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf340346a0 0x7faf34036b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb05c001340 tx=0x7fb05c03d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb068d1c640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8a51a60 0x5643f8a53f00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 realm 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a54a80 con 0x5643f8a51a60 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a55320 con 0x5643f8a51a60 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a556c0 con 0x5643f8a51a60 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a56470 0x5643f8a58860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a58e70 con 0x5643f8a56470 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.963+0000 7fb069d1e640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a56470 0x5643f8a58860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb069d1e640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a56470 0x5643f8a58860 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06ba0d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06ba0d980 20 searching for the correct realm 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f8a5adc0 0x5643f8a5d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06951d640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f8a5adc0 0x5643f8a5d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06951d640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f8a5adc0 0x5643f8a5d1f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06951d640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb05c057040 0x7fb05c0128d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x7fb05c057040 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb068d1c640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb05c057040 0x7fb05c0128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb068d1c640 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb05c057040 0x7fb05c0128d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a51a60 2024-09-13T19:33:27.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a51a60 2024-09-13T19:33:27.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.967+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x7fb05c057040 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a51a60 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a51a60 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x7fb05c057040 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.971+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a51a60 2024-09-13T19:33:27.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a51a60 2024-09-13T19:33:27.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x7fb05c057040 2024-09-13T19:33:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a51a60 2024-09-13T19:33:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.975+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x7fb05c057040 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a5adc0 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a56470 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x5643f8a51a60 2024-09-13T19:33:27.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5d870 con 0x7fb05c057040 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a59830 con 0x5643f8a51a60 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a59470 con 0x5643f8a51a60 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5a150 con 0x5643f8a51a60 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 zone default found 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 4 Realm: () 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:27.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 zonegroup default 2024-09-13T19:33:27.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.979+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5dcf0 con 0x5643f8a56470 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5fad0 con 0x5643f8a5adc0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5ffa0 con 0x5643f8a5adc0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:27.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 20 started sync module instance, tier type = 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5ef10 con 0x7fb05c057040 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94849934423088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5ef10 con 0x7fb05c057040 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a60aa0 con 0x5643f8a51a60 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.983+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94849934423088] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94849934427504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5ef10 con 0x5643f8a51a60 2024-09-13T19:33:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a614b0 con 0x5643f8a5adc0 2024-09-13T19:33:27.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94849934427504] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94849934420576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5ee80 con 0x5643f8a5adc0 2024-09-13T19:33:27.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a62200 con 0x7fb05c057040 2024-09-13T19:33:27.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94849934433888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a62aa0 con 0x7fb05c057040 2024-09-13T19:33:27.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.987+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a63460 con 0x5643f8a51a60 2024-09-13T19:33:27.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94849934420576] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:27.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94849934433888] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:27.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94849934438320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a62a10 con 0x5643f8a51a60 2024-09-13T19:33:27.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a633d0 con 0x5643f8a56470 2024-09-13T19:33:27.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94849934438320] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:27.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:27.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94849934435952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a63d00 con 0x5643f8a56470 2024-09-13T19:33:27.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.991+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a64550 con 0x5643f8a56470 2024-09-13T19:33:27.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.995+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.995+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94849934435952] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.995+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94849934442208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a63930 con 0x5643f8a56470 2024-09-13T19:33:28.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.995+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a64f20 con 0x5643f8a56470 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94849934442208] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94849934445072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a64ee0 con 0x5643f8a56470 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 20 add_watcher() i=0 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 20 add_watcher() i=1 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 20 add_watcher() i=2 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 20 add_watcher() i=3 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 20 add_watcher() i=4 2024-09-13T19:33:28.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 20 add_watcher() i=5 2024-09-13T19:33:28.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 20 add_watcher() i=6 2024-09-13T19:33:28.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94849934445072] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 20 add_watcher() i=7 2024-09-13T19:33:28.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:28.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a68340 con 0x5643f8a51a60 2024-09-13T19:33:28.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:28.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:27.999+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94849934443328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a65830 con 0x5643f8a51a60 2024-09-13T19:33:28.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94849934443328] v30'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:28.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7faf1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 5 note: GC not initialized 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7faf1efe5640 20 reqs_thread_entry: start 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 Filter name: none 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7faf1cfe1640 20 reqs_thread_entry: start 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a8b960 con 0x5643f8a56470 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a8a100 con 0x5643f8a51a60 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 rados_obj.operate() r=0 bl.length=7 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-13T19:33:28.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:33:28.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:28.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a8a4f0 con 0x5643f8a51a60 2024-09-13T19:33:28.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:28.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:28.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 20 get_user_info_from_index found 0 xattrs 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7faf1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.003+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94849934443328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a4bc00 con 0x5643f8a51a60 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94849934443328] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94849934423088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a89790 con 0x7fb05c057040 2024-09-13T19:33:28.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94849934423088] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:28.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb06ba0d980 20 remove_watcher() i=0 2024-09-13T19:33:28.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb06ba0d980 2 removed watcher, disabling cache 2024-09-13T19:33:28.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94849934427504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5f430 con 0x5643f8a51a60 2024-09-13T19:33:28.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94849934427504] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:28.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb06ba0d980 20 remove_watcher() i=1 2024-09-13T19:33:28.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.007+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94849934420576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a89790 con 0x5643f8a5adc0 2024-09-13T19:33:28.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.011+0000 7fb06951d640 1 -- 172.21.15.144:0/1868189595 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94849934420576] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05c03d070 con 0x5643f8a5adc0 2024-09-13T19:33:28.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.011+0000 7fb06ba0d980 20 remove_watcher() i=2 2024-09-13T19:33:28.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.011+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94849934433888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a60570 con 0x7fb05c057040 2024-09-13T19:33:28.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.011+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94849934433888] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x7fb05c057040 2024-09-13T19:33:28.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.011+0000 7fb06ba0d980 20 remove_watcher() i=3 2024-09-13T19:33:28.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.011+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94849934438320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5f430 con 0x5643f8a51a60 2024-09-13T19:33:28.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.015+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94849934438320] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0540aa970 con 0x5643f8a51a60 2024-09-13T19:33:28.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.015+0000 7fb06ba0d980 20 remove_watcher() i=4 2024-09-13T19:33:28.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.015+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94849934435952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a5ea60 con 0x5643f8a56470 2024-09-13T19:33:28.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.015+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94849934435952] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.015+0000 7fb06ba0d980 20 remove_watcher() i=5 2024-09-13T19:33:28.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.015+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94849934442208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a61e60 con 0x5643f8a56470 2024-09-13T19:33:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94849934442208] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 20 remove_watcher() i=6 2024-09-13T19:33:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94849934445072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f8a60570 con 0x5643f8a56470 2024-09-13T19:33:28.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb069d1e640 1 -- 172.21.15.144:0/1868189595 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94849934445072] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb064042020 con 0x5643f8a56470 2024-09-13T19:33:28.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 20 remove_watcher() i=7 2024-09-13T19:33:28.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a56470 msgr2=0x5643f8a58860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a56470 0x5643f8a58860 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8a51a60 msgr2=0x5643f8a53f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8a51a60 0x5643f8a53f00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb05c057040 msgr2=0x7fb05c0128d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb05c057040 0x7fb05c0128d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f8a5adc0 msgr2=0x5643f8a5d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f8a5adc0 0x5643f8a5d1f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf340346a0 msgr2=0x7faf34036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf340346a0 0x7faf34036b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb05c001340 tx=0x7fb05c03d000 comp rx=0 tx=0).stop 2024-09-13T19:33:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 msgr2=0x5643f8a465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb068d1c640 1 -- 172.21.15.144:0/1868189595 reap_dead start 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a465d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb064015c40 tx=0x7fb06404a210 comp rx=0 tx=0).stop 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 shutdown_connections 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1868189595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a3f170 0x5643f8a465d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 >> 172.21.15.144:0/1868189595 conn(0x5643f8a3b5a0 msgr2=0x5643f8a39670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 shutdown_connections 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.019+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1868189595 wait complete. 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1164724758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf400346a0 msgr2=0x7faf40036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1164724758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf400346a0 0x7faf40036b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5643f8a1f680 tx=0x7fb05c012f70 comp rx=0 tx=0).stop 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1164724758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a326b0 msgr2=0x5643f8a32ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1164724758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a326b0 0x5643f8a32ad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5643f8a1f590 tx=0x7fb06400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1164724758 shutdown_connections 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1164724758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf400346a0 0x7faf40036b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/1164724758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8a326b0 0x5643f8a32ad0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1164724758 >> 172.21.15.144:0/1164724758 conn(0x5643f8a27800 msgr2=0x5643f8a2a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1164724758 shutdown_connections 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/1164724758 wait complete. 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a21510 msgr2=0x5643f8a23900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a21510 0x5643f8a23900 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8929b30 msgr2=0x5643f8a1eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8929b30 0x5643f8a1eb90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf500346a0 msgr2=0x7faf50036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf500346a0 0x7faf50036b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb05400a5c0 tx=0x7fb0540a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 msgr2=0x5643f8a17c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a17c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0012f0 tx=0x7fb05c001260 comp rx=0 tx=0).stop 2024-09-13T19:33:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 shutdown_connections 2024-09-13T19:33:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8929b30 0x5643f8a1eb90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f8a21510 0x5643f8a23900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faf500346a0 0x7faf50036b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 --2- 172.21.15.144:0/4277516398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8923a60 0x5643f8a17c00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 >> 172.21.15.144:0/4277516398 conn(0x5643f891f740 msgr2=0x5643f8a0af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 shutdown_connections 2024-09-13T19:33:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.023+0000 7fb06ba0d980 1 -- 172.21.15.144:0/4277516398 wait complete. 2024-09-13T19:33:28.034 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-13T19:33:28.034 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:33:28.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:33:28.035 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:33:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8e0fa8980 1 Processor -- start 2024-09-13T19:33:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8e0fa8980 1 -- start start 2024-09-13T19:33:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8e0fa8980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559841821c60 0x559841824050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8e0fa8980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598416a3ae0 con 0x55984181d8e0 2024-09-13T19:33:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8e0fa8980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5598416c7e30 con 0x559841821c60 2024-09-13T19:33:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8de2b7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559841821c60 0x559841824050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8deab8640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55984181d8e0 0x55984181dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42262/0 (socket says 172.21.15.144:42262) 2024-09-13T19:33:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8deab8640 1 -- 172.21.15.144:0/4248426081 learned_addr learned my addr 172.21.15.144:0/4248426081 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8de2b7640 1 -- 172.21.15.144:0/4248426081 >> v1:172.21.15.18:6789/0 conn(0x55984181d8e0 legacy=0x55984181dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.103+0000 7fe8de2b7640 1 -- 172.21.15.144:0/4248426081 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598418255a0 con 0x559841821c60 2024-09-13T19:33:28.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8de2b7640 1 --2- 172.21.15.144:0/4248426081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841821c60 0x559841824050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400a420 tx=0x7fe8d401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1686d8d103edf82c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8ddab6640 1 -- 172.21.15.144:0/4248426081 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d40af070 con 0x559841821c60 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8ddab6640 1 -- 172.21.15.144:0/4248426081 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d40aa530 con 0x559841821c60 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8ddab6640 1 -- 172.21.15.144:0/4248426081 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d40aa850 con 0x559841821c60 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/4248426081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841821c60 msgr2=0x559841824050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/4248426081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841821c60 0x559841824050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400a420 tx=0x7fe8d401afd0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/4248426081 shutdown_connections 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/4248426081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841821c60 0x559841824050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/4248426081 >> 172.21.15.144:0/4248426081 conn(0x559841791230 msgr2=0x559841791640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/4248426081 shutdown_connections 2024-09-13T19:33:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.107+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/4248426081 wait complete. 2024-09-13T19:33:28.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 Processor -- start 2024-09-13T19:33:28.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- start start 2024-09-13T19:33:28.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x559841908c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5598416c9200 con 0x55984181d8e0 2024-09-13T19:33:28.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8deab8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x559841908c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8deab8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x559841908c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48654/0 (socket says 172.21.15.144:48654) 2024-09-13T19:33:28.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8deab8640 1 -- 172.21.15.144:0/3197541659 learned_addr learned my addr 172.21.15.144:0/3197541659 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8deab8640 1 -- 172.21.15.144:0/3197541659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559841909200 con 0x55984181d8e0 2024-09-13T19:33:28.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8deab8640 1 --2- 172.21.15.144:0/3197541659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x559841908c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0001d90 tx=0x7fe8d0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216124b2dbdc98a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe7cce09640 1 -- 172.21.15.144:0/3197541659 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d0013030 con 0x55984181d8e0 2024-09-13T19:33:28.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe7cce09640 1 -- 172.21.15.144:0/3197541659 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d000e690 con 0x55984181d8e0 2024-09-13T19:33:28.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe7cce09640 1 -- 172.21.15.144:0/3197541659 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d000ea10 con 0x55984181d8e0 2024-09-13T19:33:28.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/3197541659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 msgr2=0x559841908c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/3197541659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x559841908c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0001d90 tx=0x7fe8d0001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/3197541659 shutdown_connections 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/3197541659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x559841908c30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/3197541659 >> 172.21.15.144:0/3197541659 conn(0x559841791230 msgr2=0x559841904860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/3197541659 shutdown_connections 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/3197541659 wait complete. 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 Processor -- start 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- start start 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x55984190ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8e0fa8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5598418250a0 con 0x55984181d8e0 2024-09-13T19:33:28.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8deab8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x55984190ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8deab8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x55984190ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48662/0 (socket says 172.21.15.144:48662) 2024-09-13T19:33:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.123+0000 7fe8deab8640 1 -- 172.21.15.144:0/931254061 learned_addr learned my addr 172.21.15.144:0/931254061 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8deab8640 1 -- 172.21.15.144:0/931254061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598419104e0 con 0x55984181d8e0 2024-09-13T19:33:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8deab8640 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x55984190ffa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x559841909e10 tx=0x7fe8d0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe7cb606640 1 -- 172.21.15.144:0/931254061 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d0027070 con 0x55984181d8e0 2024-09-13T19:33:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559841910770 con 0x55984181d8e0 2024-09-13T19:33:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe7cb606640 1 -- 172.21.15.144:0/931254061 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d0019900 con 0x55984181d8e0 2024-09-13T19:33:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559841913450 con 0x55984181d8e0 2024-09-13T19:33:28.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe7cb606640 1 -- 172.21.15.144:0/931254061 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d0019be0 con 0x55984181d8e0 2024-09-13T19:33:28.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe7cb606640 1 -- 172.21.15.144:0/931254061 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8d002a070 con 0x55984181d8e0 2024-09-13T19:33:28.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe7cb606640 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7c4034650 0x7fe7c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe7cb606640 1 -- 172.21.15.144:0/931254061 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe8d001f070 con 0x55984181d8e0 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8de2b7640 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7c4034650 0x7fe7c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841821c60 0x559841916f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5598419175d0 con 0x559841821c60 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8df2b9640 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841821c60 0x559841916f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8de2b7640 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7c4034650 0x7fe7c4036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40ac000 tx=0x7fe8d40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8df2b9640 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841821c60 0x559841916f90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8df2b9640 1 -- 172.21.15.144:0/931254061 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x559841821c60 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559841914670 con 0x559841821c60 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8df2b9640 1 -- 172.21.15.144:0/931254061 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe8d80083f0 con 0x559841821c60 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559841919950 0x55984191bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.127+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55984191c410 con 0x559841919950 2024-09-13T19:33:28.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8deab8640 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559841919950 0x55984191bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8deab8640 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559841919950 0x55984191bd40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8deab8640 1 -- 172.21.15.144:0/931254061 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe8d0029030 con 0x559841919950 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5598419187f0 con 0x559841821c60 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8df2b9640 1 -- 172.21.15.144:0/931254061 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe8d80083f0 con 0x559841821c60 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559841918cd0 con 0x559841821c60 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8df2b9640 1 -- 172.21.15.144:0/931254061 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe8d80083f0 con 0x559841821c60 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8e0fa8980 1 Processor -- start 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8e0fa8980 1 -- start start 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8e0fa8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984192aaf0 0x55984192af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8e0fa8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559841722800 con 0x55984192aaf0 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8df2b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984192aaf0 0x55984192af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8df2b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984192aaf0 0x55984192af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48676/0 (socket says 172.21.15.144:48676) 2024-09-13T19:33:28.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8df2b9640 1 -- 172.21.15.144:0/1064463804 learned_addr learned my addr 172.21.15.144:0/1064463804 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.131+0000 7fe8df2b9640 1 -- 172.21.15.144:0/1064463804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984192b450 con 0x55984192aaf0 2024-09-13T19:33:28.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8df2b9640 1 --2- 172.21.15.144:0/1064463804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984192aaf0 0x55984192af10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5598419179b0 tx=0x7fe8d800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c8e01640 1 -- 172.21.15.144:0/1064463804 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d8007da0 con 0x55984192aaf0 2024-09-13T19:33:28.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/1064463804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55984192b6e0 con 0x55984192aaf0 2024-09-13T19:33:28.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/1064463804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55984192e360 con 0x55984192aaf0 2024-09-13T19:33:28.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c8e01640 1 -- 172.21.15.144:0/1064463804 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d801e020 con 0x55984192aaf0 2024-09-13T19:33:28.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c8e01640 1 -- 172.21.15.144:0/1064463804 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d8019550 con 0x55984192aaf0 2024-09-13T19:33:28.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c8e01640 1 -- 172.21.15.144:0/1064463804 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8d8016040 con 0x55984192aaf0 2024-09-13T19:33:28.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c8e01640 1 --2- 172.21.15.144:0/1064463804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7b8034650 0x7fe7b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c8e01640 1 -- 172.21.15.144:0/1064463804 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe8d801f030 con 0x55984192aaf0 2024-09-13T19:33:28.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8deab8640 1 --2- 172.21.15.144:0/1064463804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7b8034650 0x7fe7b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8e0fa8980 1 Processor -- start 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8e0fa8980 1 -- start start 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8deab8640 1 --2- 172.21.15.144:0/1064463804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7b8034650 0x7fe7b8036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x559841917aa0 tx=0x7fe8d0017f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8e0fa8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x559841937a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8e0fa8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559841909580 con 0x559841937670 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8df2b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x559841937a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8df2b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x559841937a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48684/0 (socket says 172.21.15.144:48684) 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8df2b9640 1 -- 172.21.15.144:0/113255650 learned_addr learned my addr 172.21.15.144:0/113255650 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8df2b9640 1 -- 172.21.15.144:0/113255650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559841938020 con 0x559841937670 2024-09-13T19:33:28.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe8df2b9640 1 --2- 172.21.15.144:0/113255650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x559841937a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8049ff0 tx=0x7fe8d8018570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60632a529b7ca2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c27fc640 1 -- 172.21.15.144:0/113255650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d8040070 con 0x559841937670 2024-09-13T19:33:28.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c27fc640 1 -- 172.21.15.144:0/113255650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d8023410 con 0x559841937670 2024-09-13T19:33:28.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.135+0000 7fe7c27fc640 1 -- 172.21.15.144:0/113255650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d801d070 con 0x559841937670 2024-09-13T19:33:28.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/113255650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 msgr2=0x559841937a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/113255650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x559841937a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8049ff0 tx=0x7fe8d8018570 comp rx=0 tx=0).stop 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/113255650 shutdown_connections 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/113255650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x559841937a50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/113255650 >> 172.21.15.144:0/113255650 conn(0x559841933a50 msgr2=0x559841931b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/113255650 shutdown_connections 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/113255650 wait complete. 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 Processor -- start 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- start start 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x55984193ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5598419385e0 con 0x559841937670 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8df2b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x55984193ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8df2b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x55984193ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48700/0 (socket says 172.21.15.144:48700) 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 learned_addr learned my addr 172.21.15.144:0/2331713544 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984193ef60 con 0x559841937670 2024-09-13T19:33:28.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8df2b9640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x55984193ea20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8017930 tx=0x7fe8d8049f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe7c0ff9640 1 -- 172.21.15.144:0/2331713544 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d8040030 con 0x559841937670 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55984193f1f0 con 0x559841937670 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe7c0ff9640 1 -- 172.21.15.144:0/2331713544 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d8030070 con 0x559841937670 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559841941ed0 con 0x559841937670 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe7c0ff9640 1 -- 172.21.15.144:0/2331713544 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d80196f0 con 0x559841937670 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.139+0000 7fe7c0ff9640 1 -- 172.21.15.144:0/2331713544 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8d8019890 con 0x559841937670 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe7c0ff9640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7a8034650 0x7fe7a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe7c0ff9640 1 -- 172.21.15.144:0/2331713544 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe8d8041070 con 0x559841937670 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8deab8640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7a8034650 0x7fe7a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841949dd0 0x55984194c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55984194c9c0 con 0x559841949dd0 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8de2b7640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841949dd0 0x55984194c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8deab8640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7a8034650 0x7fe7a8036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8d002af70 tx=0x7fe8d0035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8de2b7640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841949dd0 0x55984194c270 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 realm 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55984194cdf0 con 0x559841949dd0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55984194d6c0 con 0x559841949dd0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55984194da60 con 0x559841949dd0 2024-09-13T19:33:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55984194e7c0 0x559841950bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8df2b9640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55984194e7c0 0x559841950bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8df2b9640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55984194e7c0 0x559841950bb0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 20 searching for the correct realm 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559841953020 0x5598419554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559841955bb0 con 0x559841953020 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.143+0000 7fe8deab8640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559841953020 0x5598419554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8deab8640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559841953020 0x5598419554e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8deab8640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe8d002c060 0x7fe8d0016570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559841955bb0 con 0x7fe8d002c060 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8de2b7640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe8d002c060 0x7fe8d0016570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8de2b7640 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe8d002c060 0x7fe8d0016570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559841955bb0 con 0x55984194e7c0 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841949dd0 2024-09-13T19:33:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841949dd0 2024-09-13T19:33:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.147+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x7fe8d002c060 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841953020 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841949dd0 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841949dd0 2024-09-13T19:33:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x7fe8d002c060 2024-09-13T19:33:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841953020 2024-09-13T19:33:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841953020 2024-09-13T19:33:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841953020 2024-09-13T19:33:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841953020 2024-09-13T19:33:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841949dd0 2024-09-13T19:33:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.151+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841949dd0 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841953020 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x7fe8d002c060 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841949dd0 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841953020 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x7fe8d002c060 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.155+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841953020 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x55984194e7c0 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x559841949dd0 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5598419510f0 con 0x7fe8d002c060 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:28.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559841951940 con 0x559841949dd0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559841951d30 con 0x559841949dd0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559841952150 con 0x559841949dd0 2024-09-13T19:33:28.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 zone default found 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 4 Realm: () 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 zonegroup default 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559841952580 con 0x55984194e7c0 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5598419515a0 con 0x559841953020 2024-09-13T19:33:28.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559841958010 con 0x559841953020 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 started sync module instance, tier type = 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.159+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559841957350 con 0x7fe8d002c060 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.163+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.163+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94112423704656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559841957350 con 0x7fe8d002c060 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.163+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559841958b80 con 0x559841949dd0 2024-09-13T19:33:28.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.163+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94112423704656] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.163+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.163+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94112423708256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559841957350 con 0x559841949dd0 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.163+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559841959590 con 0x559841953020 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94112423708256] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94112423702176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5598419572c0 con 0x559841953020 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195a320 con 0x7fe8d002c060 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94112423714352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195a250 con 0x7fe8d002c060 2024-09-13T19:33:28.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195b1e0 con 0x559841949dd0 2024-09-13T19:33:28.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94112423702176] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.167+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94112423714352] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.171+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.171+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94112423713152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195ad30 con 0x559841949dd0 2024-09-13T19:33:28.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.171+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195ba80 con 0x55984194e7c0 2024-09-13T19:33:28.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.171+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94112423713152] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.171+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.171+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94112423716544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195ad30 con 0x55984194e7c0 2024-09-13T19:33:28.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.171+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195bf30 con 0x55984194e7c0 2024-09-13T19:33:28.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94112423716544] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94112423720400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195bea0 con 0x55984194e7c0 2024-09-13T19:33:28.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195c910 con 0x55984194e7c0 2024-09-13T19:33:28.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94112423720400] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94112423724000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195caf0 con 0x55984194e7c0 2024-09-13T19:33:28.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 20 add_watcher() i=0 2024-09-13T19:33:28.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 20 add_watcher() i=1 2024-09-13T19:33:28.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 20 add_watcher() i=2 2024-09-13T19:33:28.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 20 add_watcher() i=3 2024-09-13T19:33:28.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 20 add_watcher() i=4 2024-09-13T19:33:28.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 20 add_watcher() i=5 2024-09-13T19:33:28.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.175+0000 7fe8e0fa8980 20 add_watcher() i=6 2024-09-13T19:33:28.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94112423724000] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 20 add_watcher() i=7 2024-09-13T19:33:28.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:28.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55984195fec0 con 0x559841949dd0 2024-09-13T19:33:28.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94112423725536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195d2b0 con 0x559841949dd0 2024-09-13T19:33:28.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94112423725536] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe7957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 5 note: GC not initialized 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe70ffff640 20 reqs_thread_entry: start 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 20 Filter name: none 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe70dffb640 20 reqs_thread_entry: start 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559841982eb0 con 0x559841949dd0 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.179+0000 7fe8e0fa8980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:28.185 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:28.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.183+0000 7fe7957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.183+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94112423725536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559841981e00 con 0x559841949dd0 2024-09-13T19:33:28.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.183+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94112423725536] v30'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.183+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94112423704656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195c9e0 con 0x7fe8d002c060 2024-09-13T19:33:28.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.183+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94112423704656] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.183+0000 7fe8e0fa8980 20 remove_watcher() i=0 2024-09-13T19:33:28.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.183+0000 7fe8e0fa8980 2 removed watcher, disabling cache 2024-09-13T19:33:28.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.183+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94112423708256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195c9e0 con 0x559841949dd0 2024-09-13T19:33:28.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94112423708256] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8e0fa8980 20 remove_watcher() i=1 2024-09-13T19:33:28.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94112423702176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195c9e0 con 0x559841953020 2024-09-13T19:33:28.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8deab8640 1 -- 172.21.15.144:0/2331713544 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94112423702176] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d0052070 con 0x559841953020 2024-09-13T19:33:28.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8e0fa8980 20 remove_watcher() i=2 2024-09-13T19:33:28.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94112423714352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195c9e0 con 0x7fe8d002c060 2024-09-13T19:33:28.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94112423714352] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x7fe8d002c060 2024-09-13T19:33:28.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8e0fa8980 20 remove_watcher() i=3 2024-09-13T19:33:28.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.187+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94112423713152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559841959e30 con 0x559841949dd0 2024-09-13T19:33:28.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.191+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94112423713152] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d40b2070 con 0x559841949dd0 2024-09-13T19:33:28.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.191+0000 7fe8e0fa8980 20 remove_watcher() i=4 2024-09-13T19:33:28.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.191+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94112423716544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195c9e0 con 0x55984194e7c0 2024-09-13T19:33:28.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.191+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94112423716544] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.191+0000 7fe8e0fa8980 20 remove_watcher() i=5 2024-09-13T19:33:28.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.191+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94112423720400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559841959e30 con 0x55984194e7c0 2024-09-13T19:33:28.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94112423720400] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 20 remove_watcher() i=6 2024-09-13T19:33:28.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94112423724000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55984195a6c0 con 0x55984194e7c0 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8df2b9640 1 -- 172.21.15.144:0/2331713544 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94112423724000] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x55984194e7c0 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 20 remove_watcher() i=7 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55984194e7c0 msgr2=0x559841950bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55984194e7c0 0x559841950bb0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841949dd0 msgr2=0x55984194c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841949dd0 0x55984194c270 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe8d002c060 msgr2=0x7fe8d0016570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe8d002c060 0x7fe8d0016570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559841953020 msgr2=0x5598419554e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559841953020 0x5598419554e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7a8034650 msgr2=0x7fe7a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7a8034650 0x7fe7a8036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8d002af70 tx=0x7fe8d0035000 comp rx=0 tx=0).stop 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 msgr2=0x55984193ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8de2b7640 1 -- 172.21.15.144:0/2331713544 reap_dead start 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.195+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x55984193ea20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8017930 tx=0x7fe8d8049f50 comp rx=0 tx=0).stop 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 shutdown_connections 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/2331713544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559841937670 0x55984193ea20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 >> 172.21.15.144:0/2331713544 conn(0x559841933a50 msgr2=0x559841931b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 shutdown_connections 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/2331713544 wait complete. 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/1064463804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7b8034650 msgr2=0x7fe7b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/1064463804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7b8034650 0x7fe7b8036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x559841917aa0 tx=0x7fe8d0017f60 comp rx=0 tx=0).stop 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/1064463804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984192aaf0 msgr2=0x55984192af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/1064463804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984192aaf0 0x55984192af10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5598419179b0 tx=0x7fe8d800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/1064463804 shutdown_connections 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/1064463804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7b8034650 0x7fe7b8036b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/1064463804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984192aaf0 0x55984192af10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/1064463804 >> 172.21.15.144:0/1064463804 conn(0x55984191fc40 msgr2=0x5598419226c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/1064463804 shutdown_connections 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/1064463804 wait complete. 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559841919950 msgr2=0x55984191bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559841919950 0x55984191bd40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841821c60 msgr2=0x559841916f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841821c60 0x559841916f90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7c4034650 msgr2=0x7fe7c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7c4034650 0x7fe7c4036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40ac000 tx=0x7fe8d40a5000 comp rx=0 tx=0).stop 2024-09-13T19:33:28.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 msgr2=0x55984190ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x55984190ffa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x559841909e10 tx=0x7fe8d0000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 shutdown_connections 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559841821c60 0x559841916f90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559841919950 0x55984191bd40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe7c4034650 0x7fe7c4036b10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 --2- 172.21.15.144:0/931254061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55984181d8e0 0x55984190ffa0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 >> 172.21.15.144:0/931254061 conn(0x559841791230 msgr2=0x5598419033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 shutdown_connections 2024-09-13T19:33:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.199+0000 7fe8e0fa8980 1 -- 172.21.15.144:0/931254061 wait complete. 2024-09-13T19:33:28.210 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:28.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T19:33:28.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T19:33:28.211 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T19:33:28.282 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:28.282 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:28.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f72805b8980 1 Processor -- start 2024-09-13T19:33:28.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f72805b8980 1 -- start start 2024-09-13T19:33:28.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f72805b8980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x557e193b9b00 0x557e19446120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f72805b8980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557e192cdae0 con 0x557e19446660 2024-09-13T19:33:28.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f72805b8980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x557e192f1e30 con 0x557e193b9b00 2024-09-13T19:33:28.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f727e0c8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x557e193b9b00 0x557e19446120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f727d8c7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x557e19446660 0x557e19448a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42278/0 (socket says 172.21.15.144:42278) 2024-09-13T19:33:28.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f727e0c8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x557e193b9b00 0x557e19446120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48702/0 (socket says 172.21.15.144:48702) 2024-09-13T19:33:28.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f727d8c7640 1 -- 172.21.15.144:0/1143624057 learned_addr learned my addr 172.21.15.144:0/1143624057 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:28.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f727e0c8640 1 -- 172.21.15.144:0/1143624057 >> v1:172.21.15.18:6789/0 conn(0x557e19446660 legacy=0x557e19448a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.279+0000 7f727e0c8640 1 -- 172.21.15.144:0/1143624057 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e1944a1a0 con 0x557e193b9b00 2024-09-13T19:33:28.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f727e0c8640 1 --2- 172.21.15.144:0/1143624057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19446120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f727000a480 tx=0x7f727001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e403c003d5a0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f727d0c6640 1 -- 172.21.15.144:0/1143624057 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72700af070 con 0x557e193b9b00 2024-09-13T19:33:28.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f727d0c6640 1 -- 172.21.15.144:0/1143624057 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72700a3e50 con 0x557e193b9b00 2024-09-13T19:33:28.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f727d0c6640 1 -- 172.21.15.144:0/1143624057 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72700aa680 con 0x557e193b9b00 2024-09-13T19:33:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f72805b8980 1 -- 172.21.15.144:0/1143624057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 msgr2=0x557e19446120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f72805b8980 1 --2- 172.21.15.144:0/1143624057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19446120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f727000a480 tx=0x7f727001b280 comp rx=0 tx=0).stop 2024-09-13T19:33:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f72805b8980 1 -- 172.21.15.144:0/1143624057 shutdown_connections 2024-09-13T19:33:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f72805b8980 1 --2- 172.21.15.144:0/1143624057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19446120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f72805b8980 1 -- 172.21.15.144:0/1143624057 >> 172.21.15.144:0/1143624057 conn(0x557e19440060 msgr2=0x557e19442480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f72805b8980 1 -- 172.21.15.144:0/1143624057 shutdown_connections 2024-09-13T19:33:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.283+0000 7f72805b8980 1 -- 172.21.15.144:0/1143624057 wait complete. 2024-09-13T19:33:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 Processor -- start 2024-09-13T19:33:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- start start 2024-09-13T19:33:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19537440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557e192f3200 con 0x557e193b9b00 2024-09-13T19:33:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f727e0c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19537440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f727e0c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19537440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48718/0 (socket says 172.21.15.144:48718) 2024-09-13T19:33:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f727e0c8640 1 -- 172.21.15.144:0/3180426590 learned_addr learned my addr 172.21.15.144:0/3180426590 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f727e0c8640 1 -- 172.21.15.144:0/3180426590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e19537a10 con 0x557e193b9b00 2024-09-13T19:33:28.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f727e0c8640 1 --2- 172.21.15.144:0/3180426590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19537440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f72700ad040 tx=0x7f7270003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a879962eeb25942 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f716c608640 1 -- 172.21.15.144:0/3180426590 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72700af040 con 0x557e193b9b00 2024-09-13T19:33:28.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f716c608640 1 -- 172.21.15.144:0/3180426590 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72700aa870 con 0x557e193b9b00 2024-09-13T19:33:28.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f716c608640 1 -- 172.21.15.144:0/3180426590 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72700aab50 con 0x557e193b9b00 2024-09-13T19:33:28.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- 172.21.15.144:0/3180426590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 msgr2=0x557e19537440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 --2- 172.21.15.144:0/3180426590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19537440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f72700ad040 tx=0x7f7270003030 comp rx=0 tx=0).stop 2024-09-13T19:33:28.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- 172.21.15.144:0/3180426590 shutdown_connections 2024-09-13T19:33:28.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 --2- 172.21.15.144:0/3180426590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e19537440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- 172.21.15.144:0/3180426590 >> 172.21.15.144:0/3180426590 conn(0x557e19440060 msgr2=0x557e19533070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- 172.21.15.144:0/3180426590 shutdown_connections 2024-09-13T19:33:28.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- 172.21.15.144:0/3180426590 wait complete. 2024-09-13T19:33:28.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 Processor -- start 2024-09-13T19:33:28.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- start start 2024-09-13T19:33:28.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e1953e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f72805b8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557e19455a00 con 0x557e193b9b00 2024-09-13T19:33:28.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f727e0c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e1953e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f727e0c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e1953e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48720/0 (socket says 172.21.15.144:48720) 2024-09-13T19:33:28.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.299+0000 7f727e0c8640 1 -- 172.21.15.144:0/332853999 learned_addr learned my addr 172.21.15.144:0/332853999 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727e0c8640 1 -- 172.21.15.144:0/332853999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e1953ebd0 con 0x557e193b9b00 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727e0c8640 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e1953e690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f727000a480 tx=0x7f7270018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f716ae05640 1 -- 172.21.15.144:0/332853999 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72700c2070 con 0x557e193b9b00 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e1953ee60 con 0x557e193b9b00 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e19541b40 con 0x557e193b9b00 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f716ae05640 1 -- 172.21.15.144:0/332853999 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72700b58f0 con 0x557e193b9b00 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f716ae05640 1 -- 172.21.15.144:0/332853999 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72700af070 con 0x557e193b9b00 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f716ae05640 1 -- 172.21.15.144:0/332853999 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f72700c5070 con 0x557e193b9b00 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f716ae05640 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f71640346a0 0x7f7164036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f716ae05640 1 -- 172.21.15.144:0/332853999 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f72700ba070 con 0x557e193b9b00 2024-09-13T19:33:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727d8c7640 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f71640346a0 0x7f7164036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19446660 0x557e19545790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e19545d10 con 0x557e19446660 2024-09-13T19:33:28.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727e8c9640 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19446660 0x557e19545790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727d8c7640 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f71640346a0 0x7f7164036b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72740012f0 tx=0x7f7274006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727e8c9640 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19446660 0x557e19545790 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727e8c9640 1 -- 172.21.15.144:0/332853999 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e19446660 2024-09-13T19:33:28.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e19542d40 con 0x557e19446660 2024-09-13T19:33:28.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727e8c9640 1 -- 172.21.15.144:0/332853999 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72780083f0 con 0x557e19446660 2024-09-13T19:33:28.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e19548070 0x557e1954a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e1954ab30 con 0x557e19548070 2024-09-13T19:33:28.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.303+0000 7f727e0c8640 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e19548070 0x557e1954a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e0c8640 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e19548070 0x557e1954a460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e0c8640 1 -- 172.21.15.144:0/332853999 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72700ce070 con 0x557e19548070 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e19546f10 con 0x557e19446660 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e8c9640 1 -- 172.21.15.144:0/332853999 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72780083f0 con 0x557e19446660 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e195473d0 con 0x557e19446660 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e8c9640 1 -- 172.21.15.144:0/332853999 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72780083f0 con 0x557e19446660 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f72805b8980 1 Processor -- start 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f72805b8980 1 -- start start 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f72805b8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e195591f0 0x557e19559610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f72805b8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557e1934c800 con 0x557e195591f0 2024-09-13T19:33:28.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e8c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e195591f0 0x557e19559610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e8c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e195591f0 0x557e19559610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48732/0 (socket says 172.21.15.144:48732) 2024-09-13T19:33:28.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e8c9640 1 -- 172.21.15.144:0/2915965761 learned_addr learned my addr 172.21.15.144:0/2915965761 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e8c9640 1 -- 172.21.15.144:0/2915965761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e19559b50 con 0x557e195591f0 2024-09-13T19:33:28.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.307+0000 7f727e8c9640 1 --2- 172.21.15.144:0/2915965761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e195591f0 0x557e19559610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x557e195460f0 tx=0x7f727800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7163fff640 1 -- 172.21.15.144:0/2915965761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7278007da0 con 0x557e195591f0 2024-09-13T19:33:28.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f72805b8980 1 -- 172.21.15.144:0/2915965761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e19559de0 con 0x557e195591f0 2024-09-13T19:33:28.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f72805b8980 1 -- 172.21.15.144:0/2915965761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e1955ca60 con 0x557e195591f0 2024-09-13T19:33:28.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7163fff640 1 -- 172.21.15.144:0/2915965761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727801e020 con 0x557e195591f0 2024-09-13T19:33:28.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7163fff640 1 -- 172.21.15.144:0/2915965761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7278019550 con 0x557e195591f0 2024-09-13T19:33:28.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7163fff640 1 -- 172.21.15.144:0/2915965761 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7278016040 con 0x557e195591f0 2024-09-13T19:33:28.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7163fff640 1 --2- 172.21.15.144:0/2915965761 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7158034650 0x7f7158036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7163fff640 1 -- 172.21.15.144:0/2915965761 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f727801f030 con 0x557e195591f0 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f727e0c8640 1 --2- 172.21.15.144:0/2915965761 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7158034650 0x7f7158036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f72805b8980 1 Processor -- start 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f72805b8980 1 -- start start 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f727e0c8640 1 --2- 172.21.15.144:0/2915965761 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7158034650 0x7f7158036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x557e195461e0 tx=0x7f72700e2970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f72805b8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e19566150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f72805b8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557e19537cd0 con 0x557e19565d50 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f727e8c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e19566150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f727e8c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e19566150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48742/0 (socket says 172.21.15.144:48742) 2024-09-13T19:33:28.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f727e8c9640 1 -- 172.21.15.144:0/3900814552 learned_addr learned my addr 172.21.15.144:0/3900814552 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f727e8c9640 1 -- 172.21.15.144:0/3900814552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e19566720 con 0x557e19565d50 2024-09-13T19:33:28.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f727e8c9640 1 --2- 172.21.15.144:0/3900814552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e19566150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7278049ff0 tx=0x7f7278018630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59fab7d94eb81db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7161ffb640 1 -- 172.21.15.144:0/3900814552 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727801d070 con 0x557e19565d50 2024-09-13T19:33:28.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7161ffb640 1 -- 172.21.15.144:0/3900814552 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7278018850 con 0x557e19565d50 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.311+0000 7f7161ffb640 1 -- 172.21.15.144:0/3900814552 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72780153e0 con 0x557e19565d50 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- 172.21.15.144:0/3900814552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 msgr2=0x557e19566150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 --2- 172.21.15.144:0/3900814552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e19566150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7278049ff0 tx=0x7f7278018630 comp rx=0 tx=0).stop 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- 172.21.15.144:0/3900814552 shutdown_connections 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 --2- 172.21.15.144:0/3900814552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e19566150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- 172.21.15.144:0/3900814552 >> 172.21.15.144:0/3900814552 conn(0x557e19562130 msgr2=0x557e19560230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- 172.21.15.144:0/3900814552 shutdown_connections 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- 172.21.15.144:0/3900814552 wait complete. 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 Processor -- start 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- start start 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e1956d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557e19566cc0 con 0x557e19565d50 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f727e8c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e1956d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f727e8c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e1956d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48752/0 (socket says 172.21.15.144:48752) 2024-09-13T19:33:28.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 learned_addr learned my addr 172.21.15.144:0/1429770794 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e1956d600 con 0x557e19565d50 2024-09-13T19:33:28.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f727e8c9640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e1956d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7278025040 tx=0x7f7278049f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f714ffff640 1 -- 172.21.15.144:0/1429770794 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72780147c0 con 0x557e19565d50 2024-09-13T19:33:28.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e1956d890 con 0x557e19565d50 2024-09-13T19:33:28.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f714ffff640 1 -- 172.21.15.144:0/1429770794 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727804bbc0 con 0x557e19565d50 2024-09-13T19:33:28.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e19570570 con 0x557e19565d50 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f714ffff640 1 -- 172.21.15.144:0/1429770794 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727804bd70 con 0x557e19565d50 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f714ffff640 1 -- 172.21.15.144:0/1429770794 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7278014960 con 0x557e19565d50 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f714ffff640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7148034650 0x7f7148036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f714ffff640 1 -- 172.21.15.144:0/1429770794 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f727802e070 con 0x557e19565d50 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f727e0c8640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7148034650 0x7f7148036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19578580 0x557e1957aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e1957b170 con 0x557e19578580 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.315+0000 7f727d8c7640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19578580 0x557e1957aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e0c8640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7148034650 0x7f7148036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x557e1954af10 tx=0x7f72700dd000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727d8c7640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19578580 0x557e1957aa20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 realm 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e19577a90 con 0x557e19578580 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e1957bc40 con 0x557e19578580 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e1957c510 con 0x557e19578580 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e1957cf30 0x557e1957f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e1957f9f0 con 0x557e1957cf30 2024-09-13T19:33:28.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e8c9640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e1957cf30 0x557e1957f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e8c9640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e1957cf30 0x557e1957f320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:28.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 20 searching for the correct realm 2024-09-13T19:33:28.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557e19581940 0x557e19583d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e0c8640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557e19581940 0x557e19583d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e0c8640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557e19581940 0x557e19583d70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e0c8640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f72700f1040 0x7f72700b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x7f72700f1040 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.319+0000 7f727d8c7640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f72700f1040 0x7f72700b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f72700f1040 0x7f72700b3370 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19578580 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19578580 2024-09-13T19:33:28.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x7f72700f1040 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19578580 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.323+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19578580 2024-09-13T19:33:28.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x7f72700f1040 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19578580 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19578580 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.327+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x7f72700f1040 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19578580 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x7f72700f1040 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19581940 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e1957cf30 2024-09-13T19:33:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.331+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x557e19578580 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557e195843f0 con 0x7f72700f1040 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e195803b0 con 0x557e19578580 2024-09-13T19:33:28.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e1957ffc0 con 0x557e19578580 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e19580d20 con 0x557e19578580 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 zone default found 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 4 Realm: () 2024-09-13T19:33:28.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 zonegroup default 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e19584870 con 0x557e1957cf30 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e19586b40 con 0x557e19581940 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e19586ee0 con 0x557e19581940 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 started sync module instance, tier type = 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19585fd0 con 0x7f72700f1040 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94000079463712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19585fd0 con 0x7f72700f1040 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.335+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19587950 con 0x557e19578580 2024-09-13T19:33:28.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.339+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94000079463712] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.339+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.339+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94000079467552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19585fd0 con 0x557e19578580 2024-09-13T19:33:28.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.339+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19588360 con 0x557e19581940 2024-09-13T19:33:28.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.339+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94000079467552] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.339+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.339+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94000079461152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19585f40 con 0x557e19581940 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.339+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e195890b0 con 0x7f72700f1040 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.343+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.343+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94000079473936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19589760 con 0x7f72700f1040 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.343+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958a280 con 0x557e19578580 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.343+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94000079461152] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.343+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94000079473936] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.343+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.343+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94000079478096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958a240 con 0x557e19578580 2024-09-13T19:33:28.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.343+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958a670 con 0x557e1957cf30 2024-09-13T19:33:28.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.347+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94000079478096] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.347+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.347+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94000079475120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958aa60 con 0x557e1957cf30 2024-09-13T19:33:28.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.347+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958b420 con 0x557e1957cf30 2024-09-13T19:33:28.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.347+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94000079475120] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94000079472464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958b420 con 0x557e1957cf30 2024-09-13T19:33:28.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958bde0 con 0x557e1957cf30 2024-09-13T19:33:28.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94000079472464] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94000079483216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958bde0 con 0x557e1957cf30 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 20 add_watcher() i=0 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 20 add_watcher() i=1 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 20 add_watcher() i=2 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 20 add_watcher() i=3 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 20 add_watcher() i=4 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 20 add_watcher() i=5 2024-09-13T19:33:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.351+0000 7f72805b8980 20 add_watcher() i=6 2024-09-13T19:33:28.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94000079483216] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 20 add_watcher() i=7 2024-09-13T19:33:28.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:28.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e1958f1e0 con 0x557e19578580 2024-09-13T19:33:28.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94000079485696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e1958c6a0 con 0x557e19578580 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94000079485696] v30'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f71357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 5 note: GC not initialized 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f712f7fe640 20 reqs_thread_entry: start 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 20 Filter name: none 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f712d7fa640 20 reqs_thread_entry: start 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:28.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e195b2880 con 0x557e19578580 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e195b23a0 con 0x7f72700f1040 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.355+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e195b8af0 con 0x557e19578580 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f72805b8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f72805b8980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f72805b8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94000079669120 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557e195b5810 con 0x557e19578580 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94000079478096 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f727401b040 con 0x557e19578580 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f71617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94000079478096 notifier 4307 bl.length()=567 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f71617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f71617fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify cookie 94000079669120 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f71617fa640 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7144003eb0 con 0x557e19578580 2024-09-13T19:33:28.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94000079669120 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557e192cdae0 con 0x557e19578580 2024-09-13T19:33:28.364 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:28.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f71357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94000079485696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e195b06b0 con 0x557e19578580 2024-09-13T19:33:28.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94000079485696] v30'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.359+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94000079463712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e195b06b0 con 0x7f72700f1040 2024-09-13T19:33:28.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.363+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94000079463712] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.363+0000 7f72805b8980 20 remove_watcher() i=0 2024-09-13T19:33:28.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.363+0000 7f72805b8980 2 removed watcher, disabling cache 2024-09-13T19:33:28.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.363+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94000079467552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e195b06b0 con 0x557e19578580 2024-09-13T19:33:28.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.363+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94000079467552] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.363+0000 7f72805b8980 20 remove_watcher() i=1 2024-09-13T19:33:28.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.363+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94000079461152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e195b06b0 con 0x557e19581940 2024-09-13T19:33:28.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f727e0c8640 1 -- 172.21.15.144:0/1429770794 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94000079461152] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72700ce070 con 0x557e19581940 2024-09-13T19:33:28.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f72805b8980 20 remove_watcher() i=2 2024-09-13T19:33:28.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94000079473936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19585b20 con 0x7f72700f1040 2024-09-13T19:33:28.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94000079473936] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x7f72700f1040 2024-09-13T19:33:28.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f72805b8980 20 remove_watcher() i=3 2024-09-13T19:33:28.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94000079478096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e195b06b0 con 0x557e19578580 2024-09-13T19:33:28.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94000079478096] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727400f070 con 0x557e19578580 2024-09-13T19:33:28.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f72805b8980 20 remove_watcher() i=4 2024-09-13T19:33:28.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.367+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94000079475120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19588d10 con 0x557e1957cf30 2024-09-13T19:33:28.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.371+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94000079475120] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.371+0000 7f72805b8980 20 remove_watcher() i=5 2024-09-13T19:33:28.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.371+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94000079472464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e19585b20 con 0x557e1957cf30 2024-09-13T19:33:28.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.371+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94000079472464] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.371+0000 7f72805b8980 20 remove_watcher() i=6 2024-09-13T19:33:28.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.371+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94000079483216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557e195b06b0 con 0x557e1957cf30 2024-09-13T19:33:28.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f727e8c9640 1 -- 172.21.15.144:0/1429770794 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94000079483216] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72780083f0 con 0x557e1957cf30 2024-09-13T19:33:28.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 20 remove_watcher() i=7 2024-09-13T19:33:28.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e1957cf30 msgr2=0x557e1957f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e1957cf30 0x557e1957f320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19578580 msgr2=0x557e1957aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19578580 0x557e1957aa20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f72700f1040 msgr2=0x7f72700b3370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f72700f1040 0x7f72700b3370 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557e19581940 msgr2=0x557e19583d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557e19581940 0x557e19583d70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7148034650 msgr2=0x7f7148036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7148034650 0x7f7148036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x557e1954af10 tx=0x7f72700dd000 comp rx=0 tx=0).stop 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 msgr2=0x557e1956d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f727d8c7640 1 -- 172.21.15.144:0/1429770794 reap_dead start 2024-09-13T19:33:28.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e1956d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7278025040 tx=0x7f7278049f50 comp rx=0 tx=0).stop 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 shutdown_connections 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/1429770794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e19565d50 0x557e1956d0c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 >> 172.21.15.144:0/1429770794 conn(0x557e19562130 msgr2=0x557e19560200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 shutdown_connections 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/1429770794 wait complete. 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/2915965761 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7158034650 msgr2=0x7f7158036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/2915965761 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7158034650 0x7f7158036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x557e195461e0 tx=0x7f72700e2970 comp rx=0 tx=0).stop 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/2915965761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e195591f0 msgr2=0x557e19559610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/2915965761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e195591f0 0x557e19559610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x557e195460f0 tx=0x7f727800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/2915965761 shutdown_connections 2024-09-13T19:33:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/2915965761 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7158034650 0x7f7158036b10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/2915965761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e195591f0 0x557e19559610 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/2915965761 >> 172.21.15.144:0/2915965761 conn(0x557e1954e340 msgr2=0x557e19550dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/2915965761 shutdown_connections 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/2915965761 wait complete. 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e19548070 msgr2=0x557e1954a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e19548070 0x557e1954a460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19446660 msgr2=0x557e19545790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19446660 0x557e19545790 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f71640346a0 msgr2=0x7f7164036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f71640346a0 0x7f7164036b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72740012f0 tx=0x7f7274006700 comp rx=0 tx=0).stop 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 msgr2=0x557e1953e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e1953e690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f727000a480 tx=0x7f7270018020 comp rx=0 tx=0).stop 2024-09-13T19:33:28.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 shutdown_connections 2024-09-13T19:33:28.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557e19446660 0x557e19545790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557e19548070 0x557e1954a460 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f71640346a0 0x7f7164036b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 --2- 172.21.15.144:0/332853999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557e193b9b00 0x557e1953e690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 >> 172.21.15.144:0/332853999 conn(0x557e19440060 msgr2=0x557e19531bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 shutdown_connections 2024-09-13T19:33:28.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.375+0000 7f72805b8980 1 -- 172.21.15.144:0/332853999 wait complete. 2024-09-13T19:33:28.387 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:28.388 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:33:28.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:33:28.388 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:33:28.460 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:28.460 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:28.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa33081e980 1 Processor -- start 2024-09-13T19:33:28.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa33081e980 1 -- start start 2024-09-13T19:33:28.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa33081e980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55d15b2a38e0 0x55d15b2a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa33081e980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d15b129ae0 con 0x55d15b2a4230 2024-09-13T19:33:28.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa33081e980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55d15b14de30 con 0x55d15b2a38e0 2024-09-13T19:33:28.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa32e32e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55d15b2a38e0 0x55d15b2a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa32e32e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55d15b2a38e0 0x55d15b2a3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48766/0 (socket says 172.21.15.144:48766) 2024-09-13T19:33:28.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa32db2d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55d15b2a4230 0x55d15b2a8c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42294/0 (socket says 172.21.15.144:42294) 2024-09-13T19:33:28.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa32e32e640 1 -- 172.21.15.144:0/3931088726 learned_addr learned my addr 172.21.15.144:0/3931088726 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa32e32e640 1 -- 172.21.15.144:0/3931088726 >> v1:172.21.15.18:6789/0 conn(0x55d15b2a4230 legacy=0x55d15b2a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa32e32e640 1 -- 172.21.15.144:0/3931088726 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15b2ab4b0 con 0x55d15b2a38e0 2024-09-13T19:33:28.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.459+0000 7fa32e32e640 1 --2- 172.21.15.144:0/3931088726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b2a3cc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa32800a4e0 tx=0x7fa32801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63577a487b08b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa32d32c640 1 -- 172.21.15.144:0/3931088726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3280aa540 con 0x55d15b2a38e0 2024-09-13T19:33:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa32d32c640 1 -- 172.21.15.144:0/3931088726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3280aa6e0 con 0x55d15b2a38e0 2024-09-13T19:33:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa32d32c640 1 -- 172.21.15.144:0/3931088726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3280aaa40 con 0x55d15b2a38e0 2024-09-13T19:33:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa33081e980 1 -- 172.21.15.144:0/3931088726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 msgr2=0x55d15b2a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa33081e980 1 --2- 172.21.15.144:0/3931088726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b2a3cc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa32800a4e0 tx=0x7fa32801b090 comp rx=0 tx=0).stop 2024-09-13T19:33:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa33081e980 1 -- 172.21.15.144:0/3931088726 shutdown_connections 2024-09-13T19:33:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa33081e980 1 --2- 172.21.15.144:0/3931088726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b2a3cc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa33081e980 1 -- 172.21.15.144:0/3931088726 >> 172.21.15.144:0/3931088726 conn(0x55d15b217230 msgr2=0x55d15b217640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa33081e980 1 -- 172.21.15.144:0/3931088726 shutdown_connections 2024-09-13T19:33:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.463+0000 7fa33081e980 1 -- 172.21.15.144:0/3931088726 wait complete. 2024-09-13T19:33:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa33081e980 1 Processor -- start 2024-09-13T19:33:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa33081e980 1 -- start start 2024-09-13T19:33:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa33081e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b38ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa33081e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d15b14f200 con 0x55d15b2a38e0 2024-09-13T19:33:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa32e32e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b38ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa32e32e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b38ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48774/0 (socket says 172.21.15.144:48774) 2024-09-13T19:33:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa32e32e640 1 -- 172.21.15.144:0/2833022342 learned_addr learned my addr 172.21.15.144:0/2833022342 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa32e32e640 1 -- 172.21.15.144:0/2833022342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15b38f1a0 con 0x55d15b2a38e0 2024-09-13T19:33:28.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa32e32e640 1 --2- 172.21.15.144:0/2833022342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b38ebd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa328017ca0 tx=0x7fa3280033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5836cc258a4fd62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa21c608640 1 -- 172.21.15.144:0/2833022342 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3280b9030 con 0x55d15b2a38e0 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa21c608640 1 -- 172.21.15.144:0/2833022342 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3280aaac0 con 0x55d15b2a38e0 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.475+0000 7fa21c608640 1 -- 172.21.15.144:0/2833022342 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3280aada0 con 0x55d15b2a38e0 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- 172.21.15.144:0/2833022342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 msgr2=0x55d15b38ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 --2- 172.21.15.144:0/2833022342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b38ebd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa328017ca0 tx=0x7fa3280033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- 172.21.15.144:0/2833022342 shutdown_connections 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 --2- 172.21.15.144:0/2833022342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b38ebd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- 172.21.15.144:0/2833022342 >> 172.21.15.144:0/2833022342 conn(0x55d15b217230 msgr2=0x55d15b38a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- 172.21.15.144:0/2833022342 shutdown_connections 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- 172.21.15.144:0/2833022342 wait complete. 2024-09-13T19:33:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 Processor -- start 2024-09-13T19:33:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- start start 2024-09-13T19:33:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b395e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d15b2aaef0 con 0x55d15b2a38e0 2024-09-13T19:33:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa32e32e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b395e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa32e32e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b395e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48782/0 (socket says 172.21.15.144:48782) 2024-09-13T19:33:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa32e32e640 1 -- 172.21.15.144:0/3895221929 learned_addr learned my addr 172.21.15.144:0/3895221929 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa32e32e640 1 -- 172.21.15.144:0/3895221929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15b396380 con 0x55d15b2a38e0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa32e32e640 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b395e40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa328005cc0 tx=0x7fa328017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa21ae05640 1 -- 172.21.15.144:0/3895221929 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3280b9030 con 0x55d15b2a38e0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d15b396610 con 0x55d15b2a38e0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d15b3992f0 con 0x55d15b2a38e0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa21ae05640 1 -- 172.21.15.144:0/3895221929 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3280c3070 con 0x55d15b2a38e0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa21ae05640 1 -- 172.21.15.144:0/3895221929 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3280cc060 con 0x55d15b2a38e0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.479+0000 7fa21ae05640 1 -- 172.21.15.144:0/3895221929 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa3280c5030 con 0x55d15b2a38e0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa21ae05640 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2140346a0 0x7fa214036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa21ae05640 1 -- 172.21.15.144:0/3895221929 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa3280ba070 con 0x55d15b2a38e0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32db2d640 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2140346a0 0x7fa214036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b2a4230 0x55d15b39cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b39d3f0 con 0x55d15b2a4230 2024-09-13T19:33:28.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32eb2f640 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b2a4230 0x55d15b39cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32db2d640 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2140346a0 0x7fa214036b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa320000f70 tx=0x7fa320001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32eb2f640 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b2a4230 0x55d15b39cdd0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32eb2f640 1 -- 172.21.15.144:0/3895221929 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b2a4230 2024-09-13T19:33:28.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b39a510 con 0x55d15b2a4230 2024-09-13T19:33:28.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32eb2f640 1 -- 172.21.15.144:0/3895221929 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b2a4230 2024-09-13T19:33:28.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b39f770 0x55d15b3a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3a2250 con 0x55d15b39f770 2024-09-13T19:33:28.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32e32e640 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b39f770 0x55d15b3a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32e32e640 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b39f770 0x55d15b3a1b60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32e32e640 1 -- 172.21.15.144:0/3895221929 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b39f770 2024-09-13T19:33:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b39e610 con 0x55d15b2a4230 2024-09-13T19:33:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32eb2f640 1 -- 172.21.15.144:0/3895221929 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b2a4230 2024-09-13T19:33:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b39eaf0 con 0x55d15b2a4230 2024-09-13T19:33:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.483+0000 7fa32eb2f640 1 -- 172.21.15.144:0/3895221929 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b2a4230 2024-09-13T19:33:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 Processor -- start 2024-09-13T19:33:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 -- start start 2024-09-13T19:33:28.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3b0970 0x55d15b3b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d15b1a8800 con 0x55d15b3b0970 2024-09-13T19:33:28.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa32eb2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3b0970 0x55d15b3b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa32eb2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3b0970 0x55d15b3b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48786/0 (socket says 172.21.15.144:48786) 2024-09-13T19:33:28.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa32eb2f640 1 -- 172.21.15.144:0/3470204679 learned_addr learned my addr 172.21.15.144:0/3470204679 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa32eb2f640 1 -- 172.21.15.144:0/3470204679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15b3b12d0 con 0x55d15b3b0970 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa32eb2f640 1 --2- 172.21.15.144:0/3470204679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3b0970 0x55d15b3b0d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55d15b397270 tx=0x7fa31800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa213fff640 1 -- 172.21.15.144:0/3470204679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa318007d70 con 0x55d15b3b0970 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 -- 172.21.15.144:0/3470204679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d15b3b1560 con 0x55d15b3b0970 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 -- 172.21.15.144:0/3470204679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d15b3b41e0 con 0x55d15b3b0970 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa213fff640 1 -- 172.21.15.144:0/3470204679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa31801e020 con 0x55d15b3b0970 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa213fff640 1 -- 172.21.15.144:0/3470204679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa318019550 con 0x55d15b3b0970 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa213fff640 1 -- 172.21.15.144:0/3470204679 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa318016040 con 0x55d15b3b0970 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa213fff640 1 --2- 172.21.15.144:0/3470204679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2080346a0 0x7fa208036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa213fff640 1 -- 172.21.15.144:0/3470204679 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa31801f030 con 0x55d15b3b0970 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa32e32e640 1 --2- 172.21.15.144:0/3470204679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2080346a0 0x7fa208036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 Processor -- start 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 -- start start 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa32e32e640 1 --2- 172.21.15.144:0/3470204679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2080346a0 0x7fa208036b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55d15b39d8c0 tx=0x7fa3280d0a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.487+0000 7fa33081e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d15b38f460 con 0x55d15b3bd4f0 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3bd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48796/0 (socket says 172.21.15.144:48796) 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 -- 172.21.15.144:0/1103085640 learned_addr learned my addr 172.21.15.144:0/1103085640 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 -- 172.21.15.144:0/1103085640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15b3bdec0 con 0x55d15b3bd4f0 2024-09-13T19:33:28.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 --2- 172.21.15.144:0/1103085640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3bd8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa318049f00 tx=0x7fa318014a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9792037d8955b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa211ffb640 1 -- 172.21.15.144:0/1103085640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa318040070 con 0x55d15b3bd4f0 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa211ffb640 1 -- 172.21.15.144:0/1103085640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa318017ca0 con 0x55d15b3bd4f0 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa211ffb640 1 -- 172.21.15.144:0/1103085640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa31801d070 con 0x55d15b3bd4f0 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- 172.21.15.144:0/1103085640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 msgr2=0x55d15b3bd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 --2- 172.21.15.144:0/1103085640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3bd8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa318049f00 tx=0x7fa318014a60 comp rx=0 tx=0).stop 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- 172.21.15.144:0/1103085640 shutdown_connections 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 --2- 172.21.15.144:0/1103085640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3bd8f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- 172.21.15.144:0/1103085640 >> 172.21.15.144:0/1103085640 conn(0x55d15b3b9840 msgr2=0x55d15b3b7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- 172.21.15.144:0/1103085640 shutdown_connections 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- 172.21.15.144:0/1103085640 wait complete. 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 Processor -- start 2024-09-13T19:33:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- start start 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d15b3be400 con 0x55d15b3bd4f0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48800/0 (socket says 172.21.15.144:48800) 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 learned_addr learned my addr 172.21.15.144:0/2478407585 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15b3c4d30 con 0x55d15b3bd4f0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa32eb2f640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3c47f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa318014af0 tx=0x7fa318049e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa1fffff640 1 -- 172.21.15.144:0/2478407585 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa318040040 con 0x55d15b3bd4f0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d15b3c4fc0 con 0x55d15b3bd4f0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa1fffff640 1 -- 172.21.15.144:0/2478407585 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa318031030 con 0x55d15b3bd4f0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d15b3c7ca0 con 0x55d15b3bd4f0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.491+0000 7fa1fffff640 1 -- 172.21.15.144:0/2478407585 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa31804ba80 con 0x55d15b3bd4f0 2024-09-13T19:33:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa1fffff640 1 -- 172.21.15.144:0/2478407585 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa31804bc20 con 0x55d15b3bd4f0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa1fffff640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa1f8034650 0x7fa1f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa1fffff640 1 -- 172.21.15.144:0/2478407585 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa31804c060 con 0x55d15b3bd4f0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32e32e640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa1f8034650 0x7fa1f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b3cfcb0 0x55d15b3d2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3d28c0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32db2d640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b3cfcb0 0x55d15b3d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32e32e640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa1f8034650 0x7fa1f8036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3280d73f0 tx=0x7fa3280e0000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32db2d640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b3cfcb0 0x55d15b3d2170 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa32000f620 con 0x55d15b3cfcb0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 realm 2024-09-13T19:33:28.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3cf180 con 0x55d15b3cfcb0 2024-09-13T19:33:28.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa32000f620 con 0x55d15b3cfcb0 2024-09-13T19:33:28.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:28.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3d3390 con 0x55d15b3cfcb0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa32000f620 con 0x55d15b3cfcb0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3d38e0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa32000f620 con 0x55d15b3cfcb0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b3d46e0 0x55d15b3d6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3d7050 con 0x55d15b3d46e0 2024-09-13T19:33:28.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32eb2f640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b3d46e0 0x55d15b3d6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.495+0000 7fa32eb2f640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b3d46e0 0x55d15b3d6ad0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa33081e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa33081e980 20 searching for the correct realm 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55d15b3d9030 0x55d15b3db4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32e32e640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55d15b3d9030 0x55d15b3db4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32e32e640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55d15b3d9030 0x55d15b3db4f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32e32e640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa3280e3950 0x7fa3280c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x7fa3280e3950 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32db2d640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa3280e3950 0x7fa3280c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32db2d640 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa3280e3950 0x7fa3280c63c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32000f620 con 0x7fa3280e3950 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa32000f620 con 0x55d15b3cfcb0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.499+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x7fa3280e3950 2024-09-13T19:33:28.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x7fa3280e3950 2024-09-13T19:33:28.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.503+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x7fa3280e3950 2024-09-13T19:33:28.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.507+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x7fa3280e3950 2024-09-13T19:33:28.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d9030 2024-09-13T19:33:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3d46e0 2024-09-13T19:33:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dbbc0 con 0x7fa3280e3950 2024-09-13T19:33:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:28.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3d7a10 con 0x55d15b3cfcb0 2024-09-13T19:33:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3d7e40 con 0x55d15b3cfcb0 2024-09-13T19:33:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3d82a0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 zone default found 2024-09-13T19:33:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 4 Realm: () 2024-09-13T19:33:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:28.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 zonegroup default 2024-09-13T19:33:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dc040 con 0x55d15b3d46e0 2024-09-13T19:33:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3d7620 con 0x55d15b3d9030 2024-09-13T19:33:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3de370 con 0x55d15b3d9030 2024-09-13T19:33:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 started sync module instance, tier type = 2024-09-13T19:33:28.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.511+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dd700 con 0x7fa3280e3950 2024-09-13T19:33:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.515+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.515+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94357667306560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dd700 con 0x7fa3280e3950 2024-09-13T19:33:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.515+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3deea0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.515+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94357667306560] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.515+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.515+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94357667309968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3dd700 con 0x55d15b3cfcb0 2024-09-13T19:33:28.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.515+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3df8b0 con 0x55d15b3d9030 2024-09-13T19:33:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94357667312640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e0100 con 0x55d15b3d9030 2024-09-13T19:33:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e0b00 con 0x7fa3280e3950 2024-09-13T19:33:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94357667309968] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94357667304016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e0ef0 con 0x7fa3280e3950 2024-09-13T19:33:28.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e18b0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94357667304016] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.519+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94357667312640] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.523+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.523+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94357667314768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e1400 con 0x55d15b3cfcb0 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.523+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e1c50 con 0x55d15b3d46e0 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.523+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94357667314768] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.523+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.523+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94357667320832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e1820 con 0x55d15b3d46e0 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.523+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e2950 con 0x55d15b3d46e0 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94357667320832] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94357667323888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e28c0 con 0x55d15b3d46e0 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e3310 con 0x55d15b3d46e0 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94357667323888] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94357667327488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e34f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 20 add_watcher() i=0 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 20 add_watcher() i=1 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 20 add_watcher() i=2 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 20 add_watcher() i=3 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 20 add_watcher() i=4 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 20 add_watcher() i=5 2024-09-13T19:33:28.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.527+0000 7fa33081e980 20 add_watcher() i=6 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94357667327488] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 20 add_watcher() i=7 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e68c0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94357667328992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e3cb0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94357667328992] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa1e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:28.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 5 note: GC not initialized 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa15f7fe640 20 reqs_thread_entry: start 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 20 Filter name: none 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa15d7fa640 20 reqs_thread_entry: start 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.531+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d15b4099c0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa33081e980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:28.553 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:28.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa1e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94357667328992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b408910 con 0x55d15b3cfcb0 2024-09-13T19:33:28.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94357667328992] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94357667306560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e33e0 con 0x7fa3280e3950 2024-09-13T19:33:28.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94357667306560] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa33081e980 20 remove_watcher() i=0 2024-09-13T19:33:28.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa33081e980 2 removed watcher, disabling cache 2024-09-13T19:33:28.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.535+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94357667309968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e33e0 con 0x55d15b3cfcb0 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.539+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94357667309968] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.539+0000 7fa33081e980 20 remove_watcher() i=1 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.539+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94357667312640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3de990 con 0x55d15b3d9030 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.539+0000 7fa32e32e640 1 -- 172.21.15.144:0/2478407585 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94357667312640] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3280bfc70 con 0x55d15b3d9030 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.539+0000 7fa33081e980 20 remove_watcher() i=2 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.539+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94357667304016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e33e0 con 0x7fa3280e3950 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.543+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94357667304016] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x7fa3280e3950 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.543+0000 7fa33081e980 20 remove_watcher() i=3 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.543+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94357667314768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3df400 con 0x55d15b3cfcb0 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.543+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94357667314768] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa32002b040 con 0x55d15b3cfcb0 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.543+0000 7fa33081e980 20 remove_watcher() i=4 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.543+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94357667320832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e33e0 con 0x55d15b3d46e0 2024-09-13T19:33:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.547+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94357667320832] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.547+0000 7fa33081e980 20 remove_watcher() i=5 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.547+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94357667323888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3df400 con 0x55d15b3d46e0 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.547+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94357667323888] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.547+0000 7fa33081e980 20 remove_watcher() i=6 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.547+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94357667327488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d15b3e1400 con 0x55d15b3d46e0 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa32eb2f640 1 -- 172.21.15.144:0/2478407585 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94357667327488] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3180083f0 con 0x55d15b3d46e0 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 20 remove_watcher() i=7 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b3d46e0 msgr2=0x55d15b3d6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b3d46e0 0x55d15b3d6ad0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b3cfcb0 msgr2=0x55d15b3d2170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b3cfcb0 0x55d15b3d2170 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa3280e3950 msgr2=0x7fa3280c63c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fa3280e3950 0x7fa3280c63c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55d15b3d9030 msgr2=0x55d15b3db4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55d15b3d9030 0x55d15b3db4f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa1f8034650 msgr2=0x7fa1f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa1f8034650 0x7fa1f8036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3280d73f0 tx=0x7fa3280e0000 comp rx=0 tx=0).stop 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa32db2d640 1 -- 172.21.15.144:0/2478407585 reap_dead start 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 msgr2=0x55d15b3c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3c47f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa318014af0 tx=0x7fa318049e90 comp rx=0 tx=0).stop 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 shutdown_connections 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/2478407585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3bd4f0 0x55d15b3c47f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 >> 172.21.15.144:0/2478407585 conn(0x55d15b3b9840 msgr2=0x55d15b3b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 shutdown_connections 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/2478407585 wait complete. 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3470204679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2080346a0 msgr2=0x7fa208036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3470204679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2080346a0 0x7fa208036b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55d15b39d8c0 tx=0x7fa3280d0a90 comp rx=0 tx=0).stop 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3470204679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3b0970 msgr2=0x55d15b3b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3470204679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3b0970 0x55d15b3b0d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55d15b397270 tx=0x7fa31800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3470204679 shutdown_connections 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3470204679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2080346a0 0x7fa208036b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3470204679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b3b0970 0x55d15b3b0d90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3470204679 >> 172.21.15.144:0/3470204679 conn(0x55d15b3a5ac0 msgr2=0x55d15b3a8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3470204679 shutdown_connections 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3470204679 wait complete. 2024-09-13T19:33:28.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b39f770 msgr2=0x55d15b3a1b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b39f770 0x55d15b3a1b60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b2a4230 msgr2=0x55d15b39cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b2a4230 0x55d15b39cdd0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2140346a0 msgr2=0x7fa214036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2140346a0 0x7fa214036b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa320000f70 tx=0x7fa320001380 comp rx=0 tx=0).stop 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 msgr2=0x55d15b395e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b395e40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa328005cc0 tx=0x7fa328017e30 comp rx=0 tx=0).stop 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 shutdown_connections 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d15b2a4230 0x55d15b39cdd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55d15b39f770 0x55d15b3a1b60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fa2140346a0 0x7fa214036b60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 --2- 172.21.15.144:0/3895221929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d15b2a38e0 0x55d15b395e40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 >> 172.21.15.144:0/3895221929 conn(0x55d15b217230 msgr2=0x55d15b389380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 shutdown_connections 2024-09-13T19:33:28.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.551+0000 7fa33081e980 1 -- 172.21.15.144:0/3895221929 wait complete. 2024-09-13T19:33:28.565 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:28.565 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T19:33:28.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T19:33:28.565 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T19:33:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:28.638 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:28.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d6b38980 1 Processor -- start 2024-09-13T19:33:28.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d6b38980 1 -- start start 2024-09-13T19:33:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d6b38980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5643f8ee0b00 0x5643f8f6f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d6b38980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5643f8df4ae0 con 0x5643f8f6f870 2024-09-13T19:33:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d6b38980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5643f8e18e30 con 0x5643f8ee0b00 2024-09-13T19:33:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d4648640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5643f8ee0b00 0x5643f8f6f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d3e47640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5643f8f6f870 0x5643f8f71c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42296/0 (socket says 172.21.15.144:42296) 2024-09-13T19:33:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d3e47640 1 -- 172.21.15.144:0/2677519432 learned_addr learned my addr 172.21.15.144:0/2677519432 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d4648640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5643f8ee0b00 0x5643f8f6f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48806/0 (socket says 172.21.15.144:48806) 2024-09-13T19:33:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d4648640 1 -- 172.21.15.144:0/2677519432 >> v1:172.21.15.18:6789/0 conn(0x5643f8f6f870 legacy=0x5643f8f71c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.635+0000 7fc1d4648640 1 -- 172.21.15.144:0/2677519432 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f8f74390 con 0x5643f8ee0b00 2024-09-13T19:33:28.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d4648640 1 --2- 172.21.15.144:0/2677519432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f8f6f330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400a480 tx=0x7fc1c401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1913118a817d4ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d3646640 1 -- 172.21.15.144:0/2677519432 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c40b0070 con 0x5643f8ee0b00 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d3646640 1 -- 172.21.15.144:0/2677519432 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c40ab540 con 0x5643f8ee0b00 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d3646640 1 -- 172.21.15.144:0/2677519432 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c40ab840 con 0x5643f8ee0b00 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2677519432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 msgr2=0x5643f8f6f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/2677519432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f8f6f330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400a480 tx=0x7fc1c401b280 comp rx=0 tx=0).stop 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2677519432 shutdown_connections 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/2677519432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f8f6f330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2677519432 >> 172.21.15.144:0/2677519432 conn(0x5643f8f67060 msgr2=0x5643f8f69480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2677519432 shutdown_connections 2024-09-13T19:33:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.639+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2677519432 wait complete. 2024-09-13T19:33:28.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.651+0000 7fc1d6b38980 1 Processor -- start 2024-09-13T19:33:28.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.651+0000 7fc1d6b38980 1 -- start start 2024-09-13T19:33:28.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.651+0000 7fc1d6b38980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f9057a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.651+0000 7fc1d6b38980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f8e1a200 con 0x5643f8ee0b00 2024-09-13T19:33:28.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.651+0000 7fc1d4648640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f9057a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.651+0000 7fc1d4648640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f9057a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48818/0 (socket says 172.21.15.144:48818) 2024-09-13T19:33:28.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.651+0000 7fc1d4648640 1 -- 172.21.15.144:0/2265551844 learned_addr learned my addr 172.21.15.144:0/2265551844 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.651+0000 7fc1d4648640 1 -- 172.21.15.144:0/2265551844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f9058020 con 0x5643f8ee0b00 2024-09-13T19:33:28.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d4648640 1 --2- 172.21.15.144:0/2265551844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f9057a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40ae040 tx=0x7fc1c4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f695962753176cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc0c260c640 1 -- 172.21.15.144:0/2265551844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c40b0040 con 0x5643f8ee0b00 2024-09-13T19:33:28.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc0c260c640 1 -- 172.21.15.144:0/2265551844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c40ab9b0 con 0x5643f8ee0b00 2024-09-13T19:33:28.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc0c260c640 1 -- 172.21.15.144:0/2265551844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c40abc90 con 0x5643f8ee0b00 2024-09-13T19:33:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2265551844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 msgr2=0x5643f9057a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/2265551844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f9057a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40ae040 tx=0x7fc1c4003030 comp rx=0 tx=0).stop 2024-09-13T19:33:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2265551844 shutdown_connections 2024-09-13T19:33:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/2265551844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f9057a50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2265551844 >> 172.21.15.144:0/2265551844 conn(0x5643f8f67060 msgr2=0x5643f9053680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2265551844 shutdown_connections 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2265551844 wait complete. 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 Processor -- start 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- start start 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f905ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f8f73e30 con 0x5643f8ee0b00 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d4648640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f905ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d4648640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f905ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48832/0 (socket says 172.21.15.144:48832) 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d4648640 1 -- 172.21.15.144:0/3128233308 learned_addr learned my addr 172.21.15.144:0/3128233308 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d4648640 1 -- 172.21.15.144:0/3128233308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f905f1c0 con 0x5643f8ee0b00 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d4648640 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f905ec80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40030b0 tx=0x7fc1c4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc0c0e09640 1 -- 172.21.15.144:0/3128233308 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c40c5070 con 0x5643f8ee0b00 2024-09-13T19:33:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643f905f450 con 0x5643f8ee0b00 2024-09-13T19:33:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc0c0e09640 1 -- 172.21.15.144:0/3128233308 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c40b6970 con 0x5643f8ee0b00 2024-09-13T19:33:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc0c0e09640 1 -- 172.21.15.144:0/3128233308 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c40b0050 con 0x5643f8ee0b00 2024-09-13T19:33:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.655+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f9062130 con 0x5643f8ee0b00 2024-09-13T19:33:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc0c0e09640 1 -- 172.21.15.144:0/3128233308 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc1c40c8070 con 0x5643f8ee0b00 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc0c0e09640 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0bc034650 0x7fc0bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc0c0e09640 1 -- 172.21.15.144:0/3128233308 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc1c40bc070 con 0x5643f8ee0b00 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d3e47640 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0bc034650 0x7fc0bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8f6f870 0x5643f9065c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90662a0 con 0x5643f8f6f870 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d4e49640 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8f6f870 0x5643f9065c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d3e47640 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0bc034650 0x7fc0bc036b10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000f70 tx=0x7fc1c80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d4e49640 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8f6f870 0x5643f9065c30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d4e49640 1 -- 172.21.15.144:0/3128233308 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1cc00a4d0 con 0x5643f8f6f870 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f9063350 con 0x5643f8f6f870 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d4e49640 1 -- 172.21.15.144:0/3128233308 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1cc00a4d0 con 0x5643f8f6f870 2024-09-13T19:33:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f9068640 0x5643f906aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f906b120 con 0x5643f9068640 2024-09-13T19:33:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d4648640 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f9068640 0x5643f906aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d4648640 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f9068640 0x5643f906aa30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d4648640 1 -- 172.21.15.144:0/3128233308 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc1c40c7030 con 0x5643f9068640 2024-09-13T19:33:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90674e0 con 0x5643f8f6f870 2024-09-13T19:33:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d4e49640 1 -- 172.21.15.144:0/3128233308 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1cc00a4d0 con 0x5643f8f6f870 2024-09-13T19:33:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.659+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f9067980 con 0x5643f8f6f870 2024-09-13T19:33:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d4e49640 1 -- 172.21.15.144:0/3128233308 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1cc00a4d0 con 0x5643f8f6f870 2024-09-13T19:33:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d6b38980 1 Processor -- start 2024-09-13T19:33:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d6b38980 1 -- start start 2024-09-13T19:33:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d6b38980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9079820 0x5643f9079c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d6b38980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f8e73800 con 0x5643f9079820 2024-09-13T19:33:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d4e49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9079820 0x5643f9079c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d4e49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9079820 0x5643f9079c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48840/0 (socket says 172.21.15.144:48840) 2024-09-13T19:33:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d4e49640 1 -- 172.21.15.144:0/2750746328 learned_addr learned my addr 172.21.15.144:0/2750746328 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d4e49640 1 -- 172.21.15.144:0/2750746328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f907a180 con 0x5643f9079820 2024-09-13T19:33:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d4e49640 1 --2- 172.21.15.144:0/2750746328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9079820 0x5643f9079c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5643f905fed0 tx=0x7fc1cc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc0b9ffb640 1 -- 172.21.15.144:0/2750746328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc014450 con 0x5643f9079820 2024-09-13T19:33:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2750746328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643f907a410 con 0x5643f9079820 2024-09-13T19:33:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc0b9ffb640 1 -- 172.21.15.144:0/2750746328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0145f0 con 0x5643f9079820 2024-09-13T19:33:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc0b9ffb640 1 -- 172.21.15.144:0/2750746328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc0148d0 con 0x5643f9079820 2024-09-13T19:33:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2750746328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f907d090 con 0x5643f9079820 2024-09-13T19:33:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc0b9ffb640 1 -- 172.21.15.144:0/2750746328 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc1cc011040 con 0x5643f9079820 2024-09-13T19:33:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc0b9ffb640 1 --2- 172.21.15.144:0/2750746328 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0ac034650 0x7fc0ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc0b9ffb640 1 -- 172.21.15.144:0/2750746328 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc1cc01e070 con 0x5643f9079820 2024-09-13T19:33:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d4648640 1 --2- 172.21.15.144:0/2750746328 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0ac034650 0x7fc0ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.663+0000 7fc1d6b38980 1 Processor -- start 2024-09-13T19:33:28.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- start start 2024-09-13T19:33:28.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4648640 1 --2- 172.21.15.144:0/2750746328 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0ac034650 0x7fc0ac036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5643f9066790 tx=0x7fc1c40c9f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f9086740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f90582e0 con 0x5643f9086340 2024-09-13T19:33:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f9086740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f9086740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48842/0 (socket says 172.21.15.144:48842) 2024-09-13T19:33:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 -- 172.21.15.144:0/763557995 learned_addr learned my addr 172.21.15.144:0/763557995 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 -- 172.21.15.144:0/763557995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f9086d10 con 0x5643f9086340 2024-09-13T19:33:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 --2- 172.21.15.144:0/763557995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f9086740 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc013cf0 tx=0x7fc1cc011430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f405c3477caecfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc0b37fe640 1 -- 172.21.15.144:0/763557995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc043350 con 0x5643f9086340 2024-09-13T19:33:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc0b37fe640 1 -- 172.21.15.144:0/763557995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc016440 con 0x5643f9086340 2024-09-13T19:33:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc0b37fe640 1 -- 172.21.15.144:0/763557995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc02bc50 con 0x5643f9086340 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- 172.21.15.144:0/763557995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 msgr2=0x5643f9086740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/763557995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f9086740 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc013cf0 tx=0x7fc1cc011430 comp rx=0 tx=0).stop 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- 172.21.15.144:0/763557995 shutdown_connections 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/763557995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f9086740 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- 172.21.15.144:0/763557995 >> 172.21.15.144:0/763557995 conn(0x5643f9082720 msgr2=0x5643f9080820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- 172.21.15.144:0/763557995 shutdown_connections 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- 172.21.15.144:0/763557995 wait complete. 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 Processor -- start 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- start start 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f908d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d6b38980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643f9087310 con 0x5643f9086340 2024-09-13T19:33:28.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f908d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f908d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48852/0 (socket says 172.21.15.144:48852) 2024-09-13T19:33:28.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 learned_addr learned my addr 172.21.15.144:0/585087386 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f908dbe0 con 0x5643f9086340 2024-09-13T19:33:28.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.667+0000 7fc1d4e49640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f908d6a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc03d010 tx=0x7fc1cc049f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc0b1ffb640 1 -- 172.21.15.144:0/585087386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc014e00 con 0x5643f9086340 2024-09-13T19:33:28.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc0b1ffb640 1 -- 172.21.15.144:0/585087386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc04b720 con 0x5643f9086340 2024-09-13T19:33:28.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643f908de70 con 0x5643f9086340 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc0b1ffb640 1 -- 172.21.15.144:0/585087386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc04bbd0 con 0x5643f9086340 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f9090b50 con 0x5643f9086340 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc0b1ffb640 1 -- 172.21.15.144:0/585087386 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc1cc0133b0 con 0x5643f9086340 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc0b1ffb640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0a40346a0 0x7fc0a4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc0b1ffb640 1 -- 172.21.15.144:0/585087386 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc1cc00e040 con 0x5643f9086340 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d4648640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0a40346a0 0x7fc0a4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f9098d70 0x5643f909b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f909b950 con 0x5643f9098d70 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d3e47640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f9098d70 0x5643f909b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d4648640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0a40346a0 0x7fc0a4036b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5643f906b520 tx=0x7fc1c40df000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d3e47640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f9098d70 0x5643f909b200 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1c800e5a0 con 0x5643f9098d70 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 realm 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f9098280 con 0x5643f9098d70 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1c800e5a0 con 0x5643f9098d70 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f909c450 con 0x5643f9098d70 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1c800e5a0 con 0x5643f9098d70 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f909cd20 con 0x5643f9098d70 2024-09-13T19:33:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1c800e5a0 con 0x5643f9098d70 2024-09-13T19:33:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f909d740 0x5643f909fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a0220 con 0x5643f909d740 2024-09-13T19:33:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.671+0000 7fc1d4e49640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f909d740 0x5643f909fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4e49640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f909d740 0x5643f909fb30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d6b38980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:28.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d6b38980 20 searching for the correct realm 2024-09-13T19:33:28.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f90a2170 0x5643f90a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f90a2170 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4648640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f90a2170 0x5643f90a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4648640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f90a2170 0x5643f90a4580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4648640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc1c40ca060 0x7fc1c40aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x7fc1c40ca060 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d3e47640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc1c40ca060 0x7fc1c40aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d3e47640 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc1c40ca060 0x7fc1c40aa3b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c800e5a0 con 0x7fc1c40ca060 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f909d740 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f9098d70 2024-09-13T19:33:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc1c800e5a0 con 0x5643f9098d70 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f9098d70 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.675+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f909d740 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f909d740 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x7fc1c40ca060 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f90a2170 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f9098d70 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f909d740 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f9098d70 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x7fc1c40ca060 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a4c50 con 0x5643f90a2170 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f90a2170 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f909d740 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.679+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f90a2170 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f90a2170 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f9098d70 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f9098d70 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f909d740 2024-09-13T19:33:28.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f90a2170 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x7fc1c40ca060 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f9098d70 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f909d740 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f90a2170 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f909d740 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.683+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x7fc1c40ca060 2024-09-13T19:33:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f90a2170 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f909d740 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x5643f9098d70 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c40fd040 con 0x7fc1c40ca060 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:28.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a0be0 con 0x5643f9098d70 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a0820 con 0x5643f9098d70 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a0830 con 0x5643f9098d70 2024-09-13T19:33:28.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 zone default found 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 4 Realm: () 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 zonegroup default 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a5110 con 0x5643f909d740 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a73e0 con 0x5643f90a2170 2024-09-13T19:33:28.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a7780 con 0x5643f90a2170 2024-09-13T19:33:28.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.687+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d6b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d6b38980 20 started sync module instance, tier type = 2024-09-13T19:33:28.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d6b38980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:28.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a6870 con 0x7fc1c40ca060 2024-09-13T19:33:28.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94849941007760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a6870 con 0x7fc1c40ca060 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a8220 con 0x5643f9098d70 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94849941007760] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94849941011760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a6870 con 0x5643f9098d70 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.691+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a8c30 con 0x5643f90a2170 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94849941014400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a94d0 con 0x5643f90a2170 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a9ed0 con 0x7fc1c40ca060 2024-09-13T19:33:28.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94849941011760] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94849941005248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90aa2c0 con 0x7fc1c40ca060 2024-09-13T19:33:28.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90aac80 con 0x5643f9098d70 2024-09-13T19:33:28.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94849941014400] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.695+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94849941005248] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.699+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.699+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94849941019104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90aa7d0 con 0x5643f9098d70 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.699+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90ab020 con 0x5643f909d740 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.699+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94849941019104] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.699+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.699+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94849941022672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90aabf0 con 0x5643f909d740 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.699+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90abd20 con 0x5643f909d740 2024-09-13T19:33:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94849941022672] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94849941025728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90abc90 con 0x5643f909d740 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90ac740 con 0x5643f909d740 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94849941025728] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94849941029408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90ac920 con 0x5643f909d740 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 20 add_watcher() i=0 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 20 add_watcher() i=1 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 20 add_watcher() i=2 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 20 add_watcher() i=3 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 20 add_watcher() i=4 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 20 add_watcher() i=5 2024-09-13T19:33:28.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.703+0000 7fc1d6b38980 20 add_watcher() i=6 2024-09-13T19:33:28.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94849941029408] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 20 add_watcher() i=7 2024-09-13T19:33:28.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:28.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90afcf0 con 0x5643f9098d70 2024-09-13T19:33:28.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94849941030928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90ad0e0 con 0x5643f9098d70 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94849941030928] v30'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc08a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 5 note: GC not initialized 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc0897e2640 20 reqs_thread_entry: start 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 20 Filter name: none 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fbffaffd640 20 reqs_thread_entry: start 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d3270 con 0x5643f9098d70 2024-09-13T19:33:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d5d00 con 0x7fc1c40ca060 2024-09-13T19:33:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.707+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d9460 con 0x5643f9098d70 2024-09-13T19:33:28.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d6b38980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:28.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d6b38980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:28.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d6b38980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94849941212880 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d4cf0 con 0x5643f9098d70 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94849941019104 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5643f8df4ae0 con 0x5643f9098d70 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc0b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94849941019104 notifier 4321 bl.length()=567 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc0b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc0b37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc0b37fe640 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc098003eb0 con 0x5643f9098d70 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify cookie 94849941212880 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94849941212880 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc1c802dc10 con 0x5643f9098d70 2024-09-13T19:33:28.715 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:28.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc08a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94849941030928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d10a0 con 0x5643f9098d70 2024-09-13T19:33:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94849941030928] v30'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.711+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94849941007760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d10a0 con 0x7fc1c40ca060 2024-09-13T19:33:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.715+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94849941007760] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.715+0000 7fc1d6b38980 20 remove_watcher() i=0 2024-09-13T19:33:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.715+0000 7fc1d6b38980 2 removed watcher, disabling cache 2024-09-13T19:33:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.715+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94849941011760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d10a0 con 0x5643f9098d70 2024-09-13T19:33:28.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.715+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94849941011760] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.715+0000 7fc1d6b38980 20 remove_watcher() i=1 2024-09-13T19:33:28.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.715+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94849941014400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a7d30 con 0x5643f90a2170 2024-09-13T19:33:28.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d4648640 1 -- 172.21.15.144:0/585087386 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94849941014400] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c40ee070 con 0x5643f90a2170 2024-09-13T19:33:28.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d6b38980 20 remove_watcher() i=2 2024-09-13T19:33:28.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94849941005248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d10a0 con 0x7fc1c40ca060 2024-09-13T19:33:28.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94849941005248] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x7fc1c40ca060 2024-09-13T19:33:28.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d6b38980 20 remove_watcher() i=3 2024-09-13T19:33:28.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94849941019104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a8780 con 0x5643f9098d70 2024-09-13T19:33:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94849941019104] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1c8029040 con 0x5643f9098d70 2024-09-13T19:33:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d6b38980 20 remove_watcher() i=4 2024-09-13T19:33:28.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.719+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94849941022672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a7d30 con 0x5643f909d740 2024-09-13T19:33:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.723+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94849941022672] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.723+0000 7fc1d6b38980 20 remove_watcher() i=5 2024-09-13T19:33:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.723+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94849941025728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90d10a0 con 0x5643f909d740 2024-09-13T19:33:28.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.723+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94849941025728] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.723+0000 7fc1d6b38980 20 remove_watcher() i=6 2024-09-13T19:33:28.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.723+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94849941029408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5643f90a8780 con 0x5643f909d740 2024-09-13T19:33:28.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d4e49640 1 -- 172.21.15.144:0/585087386 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94849941029408] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1cc04bd70 con 0x5643f909d740 2024-09-13T19:33:28.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 20 remove_watcher() i=7 2024-09-13T19:33:28.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f909d740 msgr2=0x5643f909fb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f909d740 0x5643f909fb30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f9098d70 msgr2=0x5643f909b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f9098d70 0x5643f909b200 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc1c40ca060 msgr2=0x7fc1c40aa3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc1c40ca060 0x7fc1c40aa3b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f90a2170 msgr2=0x5643f90a4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5643f90a2170 0x5643f90a4580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0a40346a0 msgr2=0x7fc0a4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0a40346a0 0x7fc0a4036b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5643f906b520 tx=0x7fc1c40df000 comp rx=0 tx=0).stop 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 msgr2=0x5643f908d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/585087386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9086340 0x5643f908d6a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc03d010 tx=0x7fc1cc049f60 comp rx=0 tx=0).stop 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d3e47640 1 -- 172.21.15.144:0/585087386 reap_dead start 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 shutdown_connections 2024-09-13T19:33:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 >> 172.21.15.144:0/585087386 conn(0x5643f9082720 msgr2=0x5643f90807f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 shutdown_connections 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/585087386 wait complete. 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2750746328 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0ac034650 msgr2=0x7fc0ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/2750746328 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0ac034650 0x7fc0ac036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5643f9066790 tx=0x7fc1c40c9f70 comp rx=0 tx=0).stop 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2750746328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9079820 msgr2=0x5643f9079c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/2750746328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9079820 0x5643f9079c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5643f905fed0 tx=0x7fc1cc018830 comp rx=0 tx=0).stop 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2750746328 shutdown_connections 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/2750746328 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0ac034650 0x7fc0ac036b10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/2750746328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f9079820 0x5643f9079c40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2750746328 >> 172.21.15.144:0/2750746328 conn(0x5643f906e970 msgr2=0x5643f90713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2750746328 shutdown_connections 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/2750746328 wait complete. 2024-09-13T19:33:28.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f9068640 msgr2=0x5643f906aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f9068640 0x5643f906aa30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8f6f870 msgr2=0x5643f9065c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8f6f870 0x5643f9065c30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0bc034650 msgr2=0x7fc0bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0bc034650 0x7fc0bc036b10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8000f70 tx=0x7fc1c80012c0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 msgr2=0x5643f905ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f905ec80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40030b0 tx=0x7fc1c4018020 comp rx=0 tx=0).stop 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 shutdown_connections 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5643f8f6f870 0x5643f9065c30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5643f9068640 0x5643f906aa30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc0bc034650 0x7fc0bc036b10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 --2- 172.21.15.144:0/3128233308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643f8ee0b00 0x5643f905ec80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 >> 172.21.15.144:0/3128233308 conn(0x5643f8f67060 msgr2=0x5643f9052200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 shutdown_connections 2024-09-13T19:33:28.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.727+0000 7fc1d6b38980 1 -- 172.21.15.144:0/3128233308 wait complete. 2024-09-13T19:33:28.739 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:28.740 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:33:28.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:33:28.740 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:33:28.809 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:28.809 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:28.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe66a558980 1 Processor -- start 2024-09-13T19:33:28.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe66a558980 1 -- start start 2024-09-13T19:33:28.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe66a558980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x561736187c60 0x56173618a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe66a558980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561736009ae0 con 0x5617361838e0 2024-09-13T19:33:28.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe66a558980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56173602de30 con 0x561736187c60 2024-09-13T19:33:28.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe667867640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x561736187c60 0x56173618a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe668068640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5617361838e0 0x561736183cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42300/0 (socket says 172.21.15.144:42300) 2024-09-13T19:33:28.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe668068640 1 -- 172.21.15.144:0/1860091934 learned_addr learned my addr 172.21.15.144:0/1860091934 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:28.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe667867640 1 -- 172.21.15.144:0/1860091934 >> v1:172.21.15.18:6789/0 conn(0x5617361838e0 legacy=0x561736183cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.807+0000 7fe667867640 1 -- 172.21.15.144:0/1860091934 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173618b5a0 con 0x561736187c60 2024-09-13T19:33:28.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe667867640 1 --2- 172.21.15.144:0/1860091934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736187c60 0x56173618a050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe65400a480 tx=0x7fe65401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fe891791bb60f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe667066640 1 -- 172.21.15.144:0/1860091934 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6540b0070 con 0x561736187c60 2024-09-13T19:33:28.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe667066640 1 -- 172.21.15.144:0/1860091934 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6540ab540 con 0x561736187c60 2024-09-13T19:33:28.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe667066640 1 -- 172.21.15.144:0/1860091934 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6540ab840 con 0x561736187c60 2024-09-13T19:33:28.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe66a558980 1 -- 172.21.15.144:0/1860091934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736187c60 msgr2=0x56173618a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe66a558980 1 --2- 172.21.15.144:0/1860091934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736187c60 0x56173618a050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe65400a480 tx=0x7fe65401b280 comp rx=0 tx=0).stop 2024-09-13T19:33:28.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe66a558980 1 -- 172.21.15.144:0/1860091934 shutdown_connections 2024-09-13T19:33:28.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe66a558980 1 --2- 172.21.15.144:0/1860091934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736187c60 0x56173618a050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe66a558980 1 -- 172.21.15.144:0/1860091934 >> 172.21.15.144:0/1860091934 conn(0x5617360f7230 msgr2=0x5617360f7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe66a558980 1 -- 172.21.15.144:0/1860091934 shutdown_connections 2024-09-13T19:33:28.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.811+0000 7fe66a558980 1 -- 172.21.15.144:0/1860091934 wait complete. 2024-09-13T19:33:28.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.823+0000 7fe66a558980 1 Processor -- start 2024-09-13T19:33:28.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.823+0000 7fe66a558980 1 -- start start 2024-09-13T19:33:28.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.823+0000 7fe66a558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x56173626ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.823+0000 7fe66a558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56173602f200 con 0x5617361838e0 2024-09-13T19:33:28.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.823+0000 7fe668068640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x56173626ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.823+0000 7fe668068640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x56173626ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48870/0 (socket says 172.21.15.144:48870) 2024-09-13T19:33:28.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.823+0000 7fe668068640 1 -- 172.21.15.144:0/2286215440 learned_addr learned my addr 172.21.15.144:0/2286215440 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.823+0000 7fe668068640 1 -- 172.21.15.144:0/2286215440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173626f200 con 0x5617361838e0 2024-09-13T19:33:28.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe668068640 1 --2- 172.21.15.144:0/2286215440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x56173626ec30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe658001d90 tx=0x7fe658001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59db9f21dbebc899 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe555e13640 1 -- 172.21.15.144:0/2286215440 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe658013030 con 0x5617361838e0 2024-09-13T19:33:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe555e13640 1 -- 172.21.15.144:0/2286215440 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65800e690 con 0x5617361838e0 2024-09-13T19:33:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe555e13640 1 -- 172.21.15.144:0/2286215440 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe65800ea10 con 0x5617361838e0 2024-09-13T19:33:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- 172.21.15.144:0/2286215440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 msgr2=0x56173626ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 --2- 172.21.15.144:0/2286215440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x56173626ec30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe658001d90 tx=0x7fe658001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- 172.21.15.144:0/2286215440 shutdown_connections 2024-09-13T19:33:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 --2- 172.21.15.144:0/2286215440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x56173626ec30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- 172.21.15.144:0/2286215440 >> 172.21.15.144:0/2286215440 conn(0x5617360f7230 msgr2=0x56173626a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- 172.21.15.144:0/2286215440 shutdown_connections 2024-09-13T19:33:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- 172.21.15.144:0/2286215440 wait complete. 2024-09-13T19:33:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 Processor -- start 2024-09-13T19:33:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- start start 2024-09-13T19:33:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x561736275fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56173618b0a0 con 0x5617361838e0 2024-09-13T19:33:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe668068640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x561736275fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe668068640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x561736275fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48882/0 (socket says 172.21.15.144:48882) 2024-09-13T19:33:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe668068640 1 -- 172.21.15.144:0/4003646758 learned_addr learned my addr 172.21.15.144:0/4003646758 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe668068640 1 -- 172.21.15.144:0/4003646758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617362764e0 con 0x5617361838e0 2024-09-13T19:33:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe668068640 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x561736275fa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x56173626fe10 tx=0x7fe658000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe54ffff640 1 -- 172.21.15.144:0/4003646758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe658027070 con 0x5617361838e0 2024-09-13T19:33:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561736276770 con 0x5617361838e0 2024-09-13T19:33:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe54ffff640 1 -- 172.21.15.144:0/4003646758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe658019900 con 0x5617361838e0 2024-09-13T19:33:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe54ffff640 1 -- 172.21.15.144:0/4003646758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe658019be0 con 0x5617361838e0 2024-09-13T19:33:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.827+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561736279450 con 0x5617361838e0 2024-09-13T19:33:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe54ffff640 1 -- 172.21.15.144:0/4003646758 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe65802a070 con 0x5617361838e0 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe54ffff640 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe550034650 0x7fe550036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe54ffff640 1 -- 172.21.15.144:0/4003646758 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe65801f070 con 0x5617361838e0 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe667867640 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe550034650 0x7fe550036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561736187c60 0x56173627cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56173627d5b0 con 0x561736187c60 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe668869640 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561736187c60 0x56173627cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe667867640 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe550034650 0x7fe550036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6540ad000 tx=0x7fe6540a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe668869640 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561736187c60 0x56173627cf70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe668869640 1 -- 172.21.15.144:0/4003646758 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe66000a4d0 con 0x561736187c60 2024-09-13T19:33:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56173627a670 con 0x561736187c60 2024-09-13T19:33:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe668869640 1 -- 172.21.15.144:0/4003646758 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe66000a4d0 con 0x561736187c60 2024-09-13T19:33:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56173627f900 0x561736281cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362823c0 con 0x56173627f900 2024-09-13T19:33:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe668068640 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56173627f900 0x561736281cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.831+0000 7fe668068640 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56173627f900 0x561736281cf0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe668068640 1 -- 172.21.15.144:0/4003646758 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe658029030 con 0x56173627f900 2024-09-13T19:33:28.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56173627e7a0 con 0x561736187c60 2024-09-13T19:33:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe668869640 1 -- 172.21.15.144:0/4003646758 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe66000a4d0 con 0x561736187c60 2024-09-13T19:33:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56173627ec80 con 0x561736187c60 2024-09-13T19:33:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe668869640 1 -- 172.21.15.144:0/4003646758 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe66000a4d0 con 0x561736187c60 2024-09-13T19:33:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe66a558980 1 Processor -- start 2024-09-13T19:33:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe66a558980 1 -- start start 2024-09-13T19:33:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe66a558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736290aa0 0x561736290ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe66a558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561736088800 con 0x561736290aa0 2024-09-13T19:33:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe668869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736290aa0 0x561736290ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe668869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736290aa0 0x561736290ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48884/0 (socket says 172.21.15.144:48884) 2024-09-13T19:33:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe668869640 1 -- 172.21.15.144:0/1049792335 learned_addr learned my addr 172.21.15.144:0/1049792335 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe668869640 1 -- 172.21.15.144:0/1049792335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561736291400 con 0x561736290aa0 2024-09-13T19:33:28.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe668869640 1 --2- 172.21.15.144:0/1049792335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736290aa0 0x561736290ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x56173627d9b0 tx=0x7fe660018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe54d7fa640 1 -- 172.21.15.144:0/1049792335 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe660014450 con 0x561736290aa0 2024-09-13T19:33:28.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe66a558980 1 -- 172.21.15.144:0/1049792335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561736291690 con 0x561736290aa0 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe54d7fa640 1 -- 172.21.15.144:0/1049792335 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6600145f0 con 0x561736290aa0 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe54d7fa640 1 -- 172.21.15.144:0/1049792335 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe660028060 con 0x561736290aa0 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.835+0000 7fe66a558980 1 -- 172.21.15.144:0/1049792335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561736294310 con 0x561736290aa0 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe54d7fa640 1 -- 172.21.15.144:0/1049792335 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe660011040 con 0x561736290aa0 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe54d7fa640 1 --2- 172.21.15.144:0/1049792335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe540034650 0x7fe540036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe54d7fa640 1 -- 172.21.15.144:0/1049792335 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe66001e070 con 0x561736290aa0 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668068640 1 --2- 172.21.15.144:0/1049792335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe540034650 0x7fe540036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 Processor -- start 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- start start 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x56173629d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56173626f580 con 0x56173629d550 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668068640 1 --2- 172.21.15.144:0/1049792335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe540034650 0x7fe540036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56173627da50 tx=0x7fe65800dea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x56173629d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x56173629d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48900/0 (socket says 172.21.15.144:48900) 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 -- 172.21.15.144:0/3704631260 learned_addr learned my addr 172.21.15.144:0/3704631260 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 -- 172.21.15.144:0/3704631260 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173629df20 con 0x56173629d550 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 --2- 172.21.15.144:0/3704631260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x56173629d950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe66004a170 tx=0x7fe66002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c7d1e7c23159c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe546ffd640 1 -- 172.21.15.144:0/3704631260 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe66003be60 con 0x56173629d550 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe546ffd640 1 -- 172.21.15.144:0/3704631260 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe660023c00 con 0x56173629d550 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe546ffd640 1 -- 172.21.15.144:0/3704631260 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6600434d0 con 0x56173629d550 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- 172.21.15.144:0/3704631260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 msgr2=0x56173629d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 --2- 172.21.15.144:0/3704631260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x56173629d950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe66004a170 tx=0x7fe66002b900 comp rx=0 tx=0).stop 2024-09-13T19:33:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- 172.21.15.144:0/3704631260 shutdown_connections 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 --2- 172.21.15.144:0/3704631260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x56173629d950 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- 172.21.15.144:0/3704631260 >> 172.21.15.144:0/3704631260 conn(0x561736299930 msgr2=0x561736297a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- 172.21.15.144:0/3704631260 shutdown_connections 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- 172.21.15.144:0/3704631260 wait complete. 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 Processor -- start 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- start start 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x5617362a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe66a558980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56173629e520 con 0x56173629d550 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x5617362a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x5617362a4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48908/0 (socket says 172.21.15.144:48908) 2024-09-13T19:33:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 learned_addr learned my addr 172.21.15.144:0/1104737251 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.839+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617362a4e50 con 0x56173629d550 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe668869640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x5617362a4910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe66002bde0 tx=0x7fe66004a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe5457fa640 1 -- 172.21.15.144:0/1104737251 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe66003be60 con 0x56173629d550 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617362a50e0 con 0x56173629d550 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe5457fa640 1 -- 172.21.15.144:0/1104737251 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe660014ae0 con 0x56173629d550 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe5457fa640 1 -- 172.21.15.144:0/1104737251 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe660014c90 con 0x56173629d550 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617362a7dc0 con 0x56173629d550 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe5457fa640 1 -- 172.21.15.144:0/1104737251 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe660038070 con 0x56173629d550 2024-09-13T19:33:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe5457fa640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe530034650 0x7fe530036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe5457fa640 1 -- 172.21.15.144:0/1104737251 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe66000e040 con 0x56173629d550 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe668068640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe530034650 0x7fe530036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5617362affc0 0x5617362b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b2ba0 con 0x5617362affc0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe667867640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5617362affc0 0x5617362b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe668068640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe530034650 0x7fe530036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5617362827a0 tx=0x7fe658034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe667867640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5617362affc0 0x5617362b2450 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 realm 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b2fd0 con 0x5617362affc0 2024-09-13T19:33:28.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b38a0 con 0x5617362affc0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b3c40 con 0x5617362affc0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5617362b49a0 0x5617362b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b72d0 con 0x5617362b49a0 2024-09-13T19:33:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.843+0000 7fe668869640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5617362b49a0 0x5617362b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668869640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5617362b49a0 0x5617362b6d90 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe66a558980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe66a558980 20 searching for the correct realm 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5617362b9200 0x5617362bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668068640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5617362b9200 0x5617362bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668068640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5617362b9200 0x5617362bb6c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668068640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe65803b070 0x7fe65800ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x7fe65803b070 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe667867640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe65803b070 0x7fe65800ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe667867640 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe65803b070 0x7fe65800ca80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362affc0 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362affc0 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.847+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x7fe65803b070 2024-09-13T19:33:28.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362affc0 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362affc0 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x7fe65803b070 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.851+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362affc0 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362affc0 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x7fe65803b070 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362affc0 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.855+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x7fe65803b070 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b9200 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362b49a0 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x5617362affc0 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617362bbd90 con 0x7fe65803b070 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b7c20 con 0x5617362affc0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b7c20 con 0x5617362affc0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b8090 con 0x5617362affc0 2024-09-13T19:33:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 zone default found 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 4 Realm: () 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 zonegroup default 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362b84c0 con 0x5617362b49a0 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362bdbf0 con 0x5617362b9200 2024-09-13T19:33:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362bdf90 con 0x5617362b9200 2024-09-13T19:33:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 started sync module instance, tier type = 2024-09-13T19:33:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.859+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bd090 con 0x7fe65803b070 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.863+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.863+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94657693078976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bd090 con 0x7fe65803b070 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.863+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362be950 con 0x5617362affc0 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.863+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94657693078976] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.863+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.863+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94657693083056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bd090 con 0x5617362affc0 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.863+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bf270 con 0x5617362b9200 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94657693084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bfb10 con 0x5617362b9200 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c04d0 con 0x7fe65803b070 2024-09-13T19:33:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94657693083056] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94657693089824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c0440 con 0x7fe65803b070 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c1250 con 0x5617362affc0 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94657693089824] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94657693084992] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94657693087328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c0d10 con 0x5617362affc0 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.867+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c15c0 con 0x5617362b49a0 2024-09-13T19:33:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.871+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94657693087328] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.871+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.871+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94657693091856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c10e0 con 0x5617362b49a0 2024-09-13T19:33:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.871+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c1fd0 con 0x5617362b49a0 2024-09-13T19:33:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.871+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.871+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94657693091856] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.871+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94657693096736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c23f0 con 0x5617362b49a0 2024-09-13T19:33:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.871+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c0c70 con 0x5617362b49a0 2024-09-13T19:33:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94657693092976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c2e60 con 0x5617362b49a0 2024-09-13T19:33:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 20 add_watcher() i=0 2024-09-13T19:33:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 20 add_watcher() i=1 2024-09-13T19:33:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 20 add_watcher() i=2 2024-09-13T19:33:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 20 add_watcher() i=3 2024-09-13T19:33:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 20 add_watcher() i=4 2024-09-13T19:33:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 20 add_watcher() i=5 2024-09-13T19:33:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94657693096736] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 20 add_watcher() i=6 2024-09-13T19:33:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94657693092976] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 20 add_watcher() i=7 2024-09-13T19:33:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362c1f40 con 0x5617362affc0 2024-09-13T19:33:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.875+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94657693097792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c3360 con 0x5617362affc0 2024-09-13T19:33:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94657693097792] v30'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe51dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 5 note: GC not initialized 2024-09-13T19:33:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe51cfe1640 20 reqs_thread_entry: start 2024-09-13T19:33:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 20 Filter name: none 2024-09-13T19:33:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe4967fc640 20 reqs_thread_entry: start 2024-09-13T19:33:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 20 rados->read ofs=0 len=0 2024-09-13T19:33:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617362e8f30 con 0x5617362affc0 2024-09-13T19:33:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:28.884 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:28.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe51dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:28.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94657693097792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362e7e80 con 0x5617362affc0 2024-09-13T19:33:28.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94657693097792] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.879+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94657693078976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362e79d0 con 0x7fe65803b070 2024-09-13T19:33:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.883+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94657693078976] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.883+0000 7fe66a558980 20 remove_watcher() i=0 2024-09-13T19:33:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.883+0000 7fe66a558980 2 removed watcher, disabling cache 2024-09-13T19:33:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.883+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94657693083056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bd5c0 con 0x5617362affc0 2024-09-13T19:33:28.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.883+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94657693083056] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.883+0000 7fe66a558980 20 remove_watcher() i=1 2024-09-13T19:33:28.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.883+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94657693084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bd5c0 con 0x5617362b9200 2024-09-13T19:33:28.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe668068640 1 -- 172.21.15.144:0/1104737251 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94657693084992] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe658029030 con 0x5617362b9200 2024-09-13T19:33:28.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe66a558980 20 remove_watcher() i=2 2024-09-13T19:33:28.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94657693089824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bd5c0 con 0x7fe65803b070 2024-09-13T19:33:28.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94657693089824] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x7fe65803b070 2024-09-13T19:33:28.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe66a558980 20 remove_watcher() i=3 2024-09-13T19:33:28.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94657693087328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bd5c0 con 0x5617362affc0 2024-09-13T19:33:28.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94657693087328] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6540b3040 con 0x5617362affc0 2024-09-13T19:33:28.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe66a558980 20 remove_watcher() i=4 2024-09-13T19:33:28.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.887+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94657693091856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bf660 con 0x5617362b49a0 2024-09-13T19:33:28.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.891+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94657693091856] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.891+0000 7fe66a558980 20 remove_watcher() i=5 2024-09-13T19:33:28.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.891+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94657693096736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362bd5c0 con 0x5617362b49a0 2024-09-13T19:33:28.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.891+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94657693096736] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.891+0000 7fe66a558980 20 remove_watcher() i=6 2024-09-13T19:33:28.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.891+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94657693092976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617362c0810 con 0x5617362b49a0 2024-09-13T19:33:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe668869640 1 -- 172.21.15.144:0/1104737251 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94657693092976] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe66005d040 con 0x5617362b49a0 2024-09-13T19:33:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 20 remove_watcher() i=7 2024-09-13T19:33:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5617362b49a0 msgr2=0x5617362b6d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5617362b49a0 0x5617362b6d90 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5617362affc0 msgr2=0x5617362b2450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5617362affc0 0x5617362b2450 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe65803b070 msgr2=0x7fe65800ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe65803b070 0x7fe65800ca80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5617362b9200 msgr2=0x5617362bb6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5617362b9200 0x5617362bb6c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe530034650 msgr2=0x7fe530036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe530034650 0x7fe530036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5617362827a0 tx=0x7fe658034000 comp rx=0 tx=0).stop 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 msgr2=0x5617362a4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe667867640 1 -- 172.21.15.144:0/1104737251 reap_dead start 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x5617362a4910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe66002bde0 tx=0x7fe66004a100 comp rx=0 tx=0).stop 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 shutdown_connections 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1104737251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56173629d550 0x5617362a4910 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 >> 172.21.15.144:0/1104737251 conn(0x561736299930 msgr2=0x56173629ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 shutdown_connections 2024-09-13T19:33:28.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1104737251 wait complete. 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1049792335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe540034650 msgr2=0x7fe540036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1049792335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe540034650 0x7fe540036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56173627da50 tx=0x7fe65800dea0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1049792335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736290aa0 msgr2=0x561736290ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1049792335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736290aa0 0x561736290ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x56173627d9b0 tx=0x7fe660018830 comp rx=0 tx=0).stop 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1049792335 shutdown_connections 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1049792335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe540034650 0x7fe540036b10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/1049792335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561736290aa0 0x561736290ec0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1049792335 >> 172.21.15.144:0/1049792335 conn(0x561736285bf0 msgr2=0x561736288670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1049792335 shutdown_connections 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/1049792335 wait complete. 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56173627f900 msgr2=0x561736281cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56173627f900 0x561736281cf0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561736187c60 msgr2=0x56173627cf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561736187c60 0x56173627cf70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe550034650 msgr2=0x7fe550036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe550034650 0x7fe550036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6540ad000 tx=0x7fe6540a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 msgr2=0x561736275fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x561736275fa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x56173626fe10 tx=0x7fe658000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 shutdown_connections 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561736187c60 0x56173627cf70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56173627f900 0x561736281cf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe550034650 0x7fe550036b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 --2- 172.21.15.144:0/4003646758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617361838e0 0x561736275fa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 >> 172.21.15.144:0/4003646758 conn(0x5617360f7230 msgr2=0x5617362693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 shutdown_connections 2024-09-13T19:33:28.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.895+0000 7fe66a558980 1 -- 172.21.15.144:0/4003646758 wait complete. 2024-09-13T19:33:28.909 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:28.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T19:33:28.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T19:33:28.910 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-13T19:33:28.988 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:28.988 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:28.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f4442fd7980 1 Processor -- start 2024-09-13T19:33:28.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f4442fd7980 1 -- start start 2024-09-13T19:33:28.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f4442fd7980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5638390f1970 0x5638390f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:28.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f4442fd7980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563838f75ae0 con 0x5638390ed5f0 2024-09-13T19:33:28.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f4442fd7980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x563838f99e30 con 0x5638390f1970 2024-09-13T19:33:28.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f44402e6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5638390f1970 0x5638390f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:28.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f44402e6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5638390f1970 0x5638390f3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48924/0 (socket says 172.21.15.144:48924) 2024-09-13T19:33:28.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f44402e6640 1 -- 172.21.15.144:0/2129728996 learned_addr learned my addr 172.21.15.144:0/2129728996 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:28.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f44402e6640 1 -- 172.21.15.144:0/2129728996 >> v1:172.21.15.18:6789/0 conn(0x5638390ed5f0 legacy=0x5638390ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.987+0000 7f44402e6640 1 -- 172.21.15.144:0/2129728996 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638390f52b0 con 0x5638390f1970 2024-09-13T19:33:28.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f44402e6640 1 --2- 172.21.15.144:0/2129728996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x5638390f3d60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f443400a5c0 tx=0x7f443401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726089e8767b9446 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:28.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f443fae5640 1 -- 172.21.15.144:0/2129728996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44340a6070 con 0x5638390f1970 2024-09-13T19:33:28.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f443fae5640 1 -- 172.21.15.144:0/2129728996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44340af070 con 0x5638390f1970 2024-09-13T19:33:28.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f443fae5640 1 -- 172.21.15.144:0/2129728996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44340aa5c0 con 0x5638390f1970 2024-09-13T19:33:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f4442fd7980 1 -- 172.21.15.144:0/2129728996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 msgr2=0x5638390f3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f4442fd7980 1 --2- 172.21.15.144:0/2129728996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x5638390f3d60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f443400a5c0 tx=0x7f443401b340 comp rx=0 tx=0).stop 2024-09-13T19:33:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f4442fd7980 1 -- 172.21.15.144:0/2129728996 shutdown_connections 2024-09-13T19:33:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f4442fd7980 1 --2- 172.21.15.144:0/2129728996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x5638390f3d60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f4442fd7980 1 -- 172.21.15.144:0/2129728996 >> 172.21.15.144:0/2129728996 conn(0x5638390e9110 msgr2=0x5638390eb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f4442fd7980 1 -- 172.21.15.144:0/2129728996 shutdown_connections 2024-09-13T19:33:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:28.991+0000 7f4442fd7980 1 -- 172.21.15.144:0/2129728996 wait complete. 2024-09-13T19:33:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4442fd7980 1 Processor -- start 2024-09-13T19:33:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4442fd7980 1 -- start start 2024-09-13T19:33:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4442fd7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390ed5f0 0x5638391d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4442fd7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563838f9b200 con 0x5638390ed5f0 2024-09-13T19:33:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4440ae7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390ed5f0 0x5638391d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4440ae7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390ed5f0 0x5638391d8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48938/0 (socket says 172.21.15.144:48938) 2024-09-13T19:33:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4440ae7640 1 -- 172.21.15.144:0/4029978123 learned_addr learned my addr 172.21.15.144:0/4029978123 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4440ae7640 1 -- 172.21.15.144:0/4029978123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638391d9020 con 0x5638390ed5f0 2024-09-13T19:33:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f4440ae7640 1 --2- 172.21.15.144:0/4029978123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390ed5f0 0x5638391d8a50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4430001ea0 tx=0x7f443000b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cbf2e734447cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f432ee0d640 1 -- 172.21.15.144:0/4029978123 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443000a040 con 0x5638390ed5f0 2024-09-13T19:33:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f432ee0d640 1 -- 172.21.15.144:0/4029978123 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443000f620 con 0x5638390ed5f0 2024-09-13T19:33:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.003+0000 7f432ee0d640 1 -- 172.21.15.144:0/4029978123 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443000f890 con 0x5638390ed5f0 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- 172.21.15.144:0/4029978123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390ed5f0 msgr2=0x5638391d8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 --2- 172.21.15.144:0/4029978123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390ed5f0 0x5638391d8a50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4430001ea0 tx=0x7f443000b680 comp rx=0 tx=0).stop 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- 172.21.15.144:0/4029978123 shutdown_connections 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 --2- 172.21.15.144:0/4029978123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390ed5f0 0x5638391d8a50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- 172.21.15.144:0/4029978123 >> 172.21.15.144:0/4029978123 conn(0x5638390e9110 msgr2=0x5638391d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- 172.21.15.144:0/4029978123 shutdown_connections 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- 172.21.15.144:0/4029978123 wait complete. 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 Processor -- start 2024-09-13T19:33:29.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- start start 2024-09-13T19:33:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x563839063c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5638390f4db0 con 0x5638390f1970 2024-09-13T19:33:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4440ae7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x563839063c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4440ae7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x563839063c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48946/0 (socket says 172.21.15.144:48946) 2024-09-13T19:33:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4440ae7640 1 -- 172.21.15.144:0/1673132407 learned_addr learned my addr 172.21.15.144:0/1673132407 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4440ae7640 1 -- 172.21.15.144:0/1673132407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638390623b0 con 0x5638390f1970 2024-09-13T19:33:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4440ae7640 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x563839063c90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4430001fd0 tx=0x7f4430000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f432d60a640 1 -- 172.21.15.144:0/1673132407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430001520 con 0x5638390f1970 2024-09-13T19:33:29.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f432d60a640 1 -- 172.21.15.144:0/1673132407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443001c970 con 0x5638390f1970 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563839062640 con 0x5638390f1970 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f432d60a640 1 -- 172.21.15.144:0/1673132407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443001ccb0 con 0x5638390f1970 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563839062b90 con 0x5638390f1970 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f432d60a640 1 -- 172.21.15.144:0/1673132407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4430017050 con 0x5638390f1970 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f432d60a640 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f43280346a0 0x7f4328036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.007+0000 7f432d60a640 1 -- 172.21.15.144:0/1673132407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4430015020 con 0x5638390f1970 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f44402e6640 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f43280346a0 0x7f4328036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638391e7500 0x5638391e98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5638391e9e30 con 0x5638391e7500 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f44412e8640 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638391e7500 0x5638391e98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f44402e6640 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f43280346a0 0x7f4328036b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f44340ae000 tx=0x7f44340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f44412e8640 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638391e7500 0x5638391e98f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f44412e8640 1 -- 172.21.15.144:0/1673132407 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f443800a4d0 con 0x5638391e7500 2024-09-13T19:33:29.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5638391ea1f0 con 0x5638391e7500 2024-09-13T19:33:29.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f44412e8640 1 -- 172.21.15.144:0/1673132407 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f443800a4d0 con 0x5638391e7500 2024-09-13T19:33:29.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638391ec000 0x5638391ee3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5638391eeae0 con 0x5638391ec000 2024-09-13T19:33:29.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4440ae7640 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638391ec000 0x5638391ee3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4440ae7640 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638391ec000 0x5638391ee3f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4440ae7640 1 -- 172.21.15.144:0/1673132407 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f443002e070 con 0x5638391ec000 2024-09-13T19:33:29.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5638391eaea0 con 0x5638391e7500 2024-09-13T19:33:29.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f44412e8640 1 -- 172.21.15.144:0/1673132407 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f443800a4d0 con 0x5638391e7500 2024-09-13T19:33:29.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5638391eb340 con 0x5638391e7500 2024-09-13T19:33:29.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f44412e8640 1 -- 172.21.15.144:0/1673132407 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f443800a4d0 con 0x5638391e7500 2024-09-13T19:33:29.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 Processor -- start 2024-09-13T19:33:29.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.011+0000 7f4442fd7980 1 -- start start 2024-09-13T19:33:29.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4442fd7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638391fd1e0 0x5638391fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4442fd7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563838ff4800 con 0x5638391fd1e0 2024-09-13T19:33:29.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f44412e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638391fd1e0 0x5638391fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f44412e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638391fd1e0 0x5638391fd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48962/0 (socket says 172.21.15.144:48962) 2024-09-13T19:33:29.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f44412e8640 1 -- 172.21.15.144:0/428144902 learned_addr learned my addr 172.21.15.144:0/428144902 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f44412e8640 1 -- 172.21.15.144:0/428144902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638391fdb40 con 0x5638391fd1e0 2024-09-13T19:33:29.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f44412e8640 1 --2- 172.21.15.144:0/428144902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638391fd1e0 0x5638391fd600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x563839063820 tx=0x7f4438018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f43267fc640 1 -- 172.21.15.144:0/428144902 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4438014450 con 0x5638391fd1e0 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f43267fc640 1 -- 172.21.15.144:0/428144902 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44380145f0 con 0x5638391fd1e0 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4442fd7980 1 -- 172.21.15.144:0/428144902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638391fddd0 con 0x5638391fd1e0 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f43267fc640 1 -- 172.21.15.144:0/428144902 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44380148f0 con 0x5638391fd1e0 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4442fd7980 1 -- 172.21.15.144:0/428144902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563839200a50 con 0x5638391fd1e0 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f43267fc640 1 -- 172.21.15.144:0/428144902 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4438011040 con 0x5638391fd1e0 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f43267fc640 1 --2- 172.21.15.144:0/428144902 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4318034650 0x7f4318036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f43267fc640 1 -- 172.21.15.144:0/428144902 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f443801e070 con 0x5638391fd1e0 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4440ae7640 1 --2- 172.21.15.144:0/428144902 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4318034650 0x7f4318036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4442fd7980 1 Processor -- start 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4442fd7980 1 -- start start 2024-09-13T19:33:29.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4440ae7640 1 --2- 172.21.15.144:0/428144902 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4318034650 0x7f4318036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x563839062e80 tx=0x7f443000bf50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4442fd7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x56383920a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f4442fd7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5638391d93a0 con 0x563839209d00 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.015+0000 7f44412e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x56383920a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x56383920a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48974/0 (socket says 172.21.15.144:48974) 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 -- 172.21.15.144:0/3863326819 learned_addr learned my addr 172.21.15.144:0/3863326819 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 -- 172.21.15.144:0/3863326819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383920a6d0 con 0x563839209d00 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 --2- 172.21.15.144:0/3863326819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x56383920a100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f443804a0e0 tx=0x7f4438011330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94f644c9149e511 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4317fff640 1 -- 172.21.15.144:0/3863326819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4438022c90 con 0x563839209d00 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4317fff640 1 -- 172.21.15.144:0/3863326819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4438022e30 con 0x563839209d00 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4317fff640 1 -- 172.21.15.144:0/3863326819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443803ab60 con 0x563839209d00 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- 172.21.15.144:0/3863326819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 msgr2=0x56383920a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 --2- 172.21.15.144:0/3863326819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x56383920a100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f443804a0e0 tx=0x7f4438011330 comp rx=0 tx=0).stop 2024-09-13T19:33:29.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- 172.21.15.144:0/3863326819 shutdown_connections 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 --2- 172.21.15.144:0/3863326819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x56383920a100 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- 172.21.15.144:0/3863326819 >> 172.21.15.144:0/3863326819 conn(0x5638392060e0 msgr2=0x5638392041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- 172.21.15.144:0/3863326819 shutdown_connections 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- 172.21.15.144:0/3863326819 wait complete. 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 Processor -- start 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- start start 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x563839211090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56383920acd0 con 0x563839209d00 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x563839211090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x563839211090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48976/0 (socket says 172.21.15.144:48976) 2024-09-13T19:33:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 learned_addr learned my addr 172.21.15.144:0/1129513179 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638392115d0 con 0x563839209d00 2024-09-13T19:33:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f44412e8640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x563839211090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4438011950 tx=0x7f443804a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f43167fc640 1 -- 172.21.15.144:0/1129513179 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44380119c0 con 0x563839209d00 2024-09-13T19:33:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f43167fc640 1 -- 172.21.15.144:0/1129513179 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44380168f0 con 0x563839209d00 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563839211860 con 0x563839209d00 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563839214540 con 0x563839209d00 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.019+0000 7f43167fc640 1 -- 172.21.15.144:0/1129513179 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4438013970 con 0x563839209d00 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f43167fc640 1 -- 172.21.15.144:0/1129513179 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f443802b350 con 0x563839209d00 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f43167fc640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f430c034650 0x7f430c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f43167fc640 1 -- 172.21.15.144:0/1129513179 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4438035030 con 0x563839209d00 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4440ae7640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f430c034650 0x7f430c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56383921c730 0x56383921ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56383921f320 con 0x56383921c730 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f44402e6640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56383921c730 0x56383921ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4440ae7640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f430c034650 0x7f430c036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f443001dfd0 tx=0x7f4430035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f44402e6640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56383921c730 0x56383921ebd0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 realm 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56383921f750 con 0x56383921c730 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56383921fff0 con 0x56383921c730 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839220390 con 0x56383921c730 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563839221140 0x563839223530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839223b80 con 0x563839221140 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f44412e8640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563839221140 0x563839223530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.023+0000 7f44412e8640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563839221140 0x563839223530 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4442fd7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4442fd7980 20 searching for the correct realm 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563839225ad0 0x563839227f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4440ae7640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563839225ad0 0x563839227f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4440ae7640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563839225ad0 0x563839227f00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4440ae7640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5638390ed5f0 0x7f44300410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x5638390ed5f0 2024-09-13T19:33:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44402e6640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5638390ed5f0 0x7f44300410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44402e6640 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5638390ed5f0 0x7f44300410d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x56383921c730 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x56383921c730 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.027+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x5638390ed5f0 2024-09-13T19:33:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x56383921c730 2024-09-13T19:33:29.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x56383921c730 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x5638390ed5f0 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x56383921c730 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x56383921c730 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.031+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x5638390ed5f0 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x56383921c730 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x5638390ed5f0 2024-09-13T19:33:29.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839225ad0 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.035+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x563839221140 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x56383921c730 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563839228580 con 0x5638390ed5f0 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:29.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839224540 con 0x56383921c730 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839224150 con 0x56383921c730 2024-09-13T19:33:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839224e30 con 0x56383921c730 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 zone default found 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 4 Realm: () 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:29.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 zonegroup default 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839228a00 con 0x563839221140 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56383922a810 con 0x563839225ad0 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56383922ace0 con 0x563839225ad0 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 started sync module instance, tier type = 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563839229c20 con 0x5638390ed5f0 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94799476728096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563839229c20 con 0x5638390ed5f0 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.039+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922b7c0 con 0x56383921c730 2024-09-13T19:33:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.043+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94799476728096] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.043+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.043+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94799476732592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563839229c20 con 0x56383921c730 2024-09-13T19:33:29.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.043+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922c1d0 con 0x563839225ad0 2024-09-13T19:33:29.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.043+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94799476732592] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94799476725616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563839229b90 con 0x563839225ad0 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922cf10 con 0x5638390ed5f0 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94799476738592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922d7b0 con 0x5638390ed5f0 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922e170 con 0x56383921c730 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94799476725616] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94799476738592] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94799476743360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922e0e0 con 0x56383921c730 2024-09-13T19:33:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.047+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922d700 con 0x563839221140 2024-09-13T19:33:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.051+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94799476743360] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.051+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.051+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94799476740688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922ea10 con 0x563839221140 2024-09-13T19:33:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.051+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922f260 con 0x563839221140 2024-09-13T19:33:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.051+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94799476740688] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.051+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.051+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94799476746048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922f110 con 0x563839221140 2024-09-13T19:33:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.051+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922fc00 con 0x563839221140 2024-09-13T19:33:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94799476746048] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94799476747168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383922fbc0 con 0x563839221140 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 20 add_watcher() i=0 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 20 add_watcher() i=1 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 20 add_watcher() i=2 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 20 add_watcher() i=3 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 20 add_watcher() i=4 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 20 add_watcher() i=5 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 20 add_watcher() i=6 2024-09-13T19:33:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94799476747168] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 20 add_watcher() i=7 2024-09-13T19:33:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839233050 con 0x56383921c730 2024-09-13T19:33:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.055+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94799476750032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5638392305a0 con 0x56383921c730 2024-09-13T19:33:29.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94799476750032] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f42f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:29.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:29.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 5 note: GC not initialized 2024-09-13T19:33:29.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f42f5fe3640 20 reqs_thread_entry: start 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 20 Filter name: none 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f42677fe640 20 reqs_thread_entry: start 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839256620 con 0x56383921c730 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:33:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839257090 con 0x563839221140 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925ca60 con 0x56383921c730 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94799476933840 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839258130 con 0x56383921c730 2024-09-13T19:33:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94799476743360 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x5638390f52b0 con 0x56383921c730 2024-09-13T19:33:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4317fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94799476743360 notifier 4335 bl.length()=678 2024-09-13T19:33:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4317fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4317fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify cookie 94799476933840 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4317fff640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4304003eb0 con 0x56383921c730 2024-09-13T19:33:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94799476933840 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f44340bfd20 con 0x56383921c730 2024-09-13T19:33:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.059+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c4d0 con 0x563839221140 2024-09-13T19:33:29.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4442fd7980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:33:29.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4442fd7980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:29.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4442fd7980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:33:29.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94799476933840 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563839257c80 con 0x563839225ad0 2024-09-13T19:33:29.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== watch-notify(notify (1) cookie 94799476725616 notify 128849018880 ret 0) ==== 219+0+0 (crc 0 0 0) 0x563839062b90 con 0x563839225ad0 2024-09-13T19:33:29.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f43177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94799476725616 notifier 4335 bl.length()=177 2024-09-13T19:33:29.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f43177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:33:29.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f43177fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:29.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f43177fe640 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4274003410 con 0x563839225ad0 2024-09-13T19:33:29.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(68 notify.2 [notify cookie 94799476933840 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== watch-notify(notify_complete (2) cookie 94799476933840 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563839062640 con 0x563839225ad0 2024-09-13T19:33:29.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.070 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:33:29.063935Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:29.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f42f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.063+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94799476750032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563839258020 con 0x56383921c730 2024-09-13T19:33:29.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94799476750032] v30'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94799476728096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c590 con 0x5638390ed5f0 2024-09-13T19:33:29.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94799476728096] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f4442fd7980 20 remove_watcher() i=0 2024-09-13T19:33:29.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f4442fd7980 2 removed watcher, disabling cache 2024-09-13T19:33:29.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94799476732592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c590 con 0x56383921c730 2024-09-13T19:33:29.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94799476732592] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f4442fd7980 20 remove_watcher() i=1 2024-09-13T19:33:29.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.067+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94799476725616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c590 con 0x563839225ad0 2024-09-13T19:33:29.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.071+0000 7f4440ae7640 1 -- 172.21.15.144:0/1129513179 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94799476725616] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443002e070 con 0x563839225ad0 2024-09-13T19:33:29.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.071+0000 7f4442fd7980 20 remove_watcher() i=2 2024-09-13T19:33:29.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.071+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94799476738592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c590 con 0x5638390ed5f0 2024-09-13T19:33:29.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.071+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94799476738592] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x5638390ed5f0 2024-09-13T19:33:29.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.071+0000 7f4442fd7980 20 remove_watcher() i=3 2024-09-13T19:33:29.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.071+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94799476743360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c590 con 0x56383921c730 2024-09-13T19:33:29.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94799476743360] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44340aaa40 con 0x56383921c730 2024-09-13T19:33:29.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f4442fd7980 20 remove_watcher() i=4 2024-09-13T19:33:29.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94799476740688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c590 con 0x563839221140 2024-09-13T19:33:29.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94799476740688] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f4442fd7980 20 remove_watcher() i=5 2024-09-13T19:33:29.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94799476746048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c590 con 0x563839221140 2024-09-13T19:33:29.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94799476746048] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f4442fd7980 20 remove_watcher() i=6 2024-09-13T19:33:29.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.075+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94799476747168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56383925c590 con 0x563839221140 2024-09-13T19:33:29.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f44412e8640 1 -- 172.21.15.144:0/1129513179 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94799476747168] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f443805e040 con 0x563839221140 2024-09-13T19:33:29.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 20 remove_watcher() i=7 2024-09-13T19:33:29.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563839221140 msgr2=0x563839223530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563839221140 0x563839223530 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56383921c730 msgr2=0x56383921ebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56383921c730 0x56383921ebd0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5638390ed5f0 msgr2=0x7f44300410d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5638390ed5f0 0x7f44300410d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563839225ad0 msgr2=0x563839227f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563839225ad0 0x563839227f00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f430c034650 msgr2=0x7f430c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f430c034650 0x7f430c036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f443001dfd0 tx=0x7f4430035000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 msgr2=0x563839211090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f44402e6640 1 -- 172.21.15.144:0/1129513179 reap_dead start 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x563839211090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4438011950 tx=0x7f443804a070 comp rx=0 tx=0).stop 2024-09-13T19:33:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 shutdown_connections 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1129513179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563839209d00 0x563839211090 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 >> 172.21.15.144:0/1129513179 conn(0x5638392060e0 msgr2=0x5638392041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 shutdown_connections 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1129513179 wait complete. 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/428144902 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4318034650 msgr2=0x7f4318036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/428144902 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4318034650 0x7f4318036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x563839062e80 tx=0x7f443000bf50 comp rx=0 tx=0).stop 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/428144902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638391fd1e0 msgr2=0x5638391fd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/428144902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638391fd1e0 0x5638391fd600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x563839063820 tx=0x7f4438018830 comp rx=0 tx=0).stop 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/428144902 shutdown_connections 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/428144902 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4318034650 0x7f4318036b10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/428144902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638391fd1e0 0x5638391fd600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/428144902 >> 172.21.15.144:0/428144902 conn(0x5638391f2330 msgr2=0x5638391f4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/428144902 shutdown_connections 2024-09-13T19:33:29.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/428144902 wait complete. 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638391ec000 msgr2=0x5638391ee3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638391ec000 0x5638391ee3f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638391e7500 msgr2=0x5638391e98f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638391e7500 0x5638391e98f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f43280346a0 msgr2=0x7f4328036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f43280346a0 0x7f4328036b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f44340ae000 tx=0x7f44340a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 msgr2=0x563839063c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x563839063c90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4430001fd0 tx=0x7f4430000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 shutdown_connections 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638391e7500 0x5638391e98f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638391ec000 0x5638391ee3f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f43280346a0 0x7f4328036b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 --2- 172.21.15.144:0/1673132407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638390f1970 0x563839063c90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 >> 172.21.15.144:0/1673132407 conn(0x5638390e9110 msgr2=0x5638391d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 shutdown_connections 2024-09-13T19:33:29.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.079+0000 7f4442fd7980 1 -- 172.21.15.144:0/1673132407 wait complete. 2024-09-13T19:33:29.092 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:33:29.063935Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:29.093 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:33:29.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:33:29.093 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:33:29.169 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:29.169 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:29.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f1451862980 1 Processor -- start 2024-09-13T19:33:29.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f1451862980 1 -- start start 2024-09-13T19:33:29.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f1451862980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a33b4623b0 0x55a33b460b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f1451862980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a33b373ae0 con 0x55a33b4627c0 2024-09-13T19:33:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f1451862980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55a33b397e30 con 0x55a33b4623b0 2024-09-13T19:33:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f144f372640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a33b4623b0 0x55a33b460b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f144f372640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a33b4623b0 0x55a33b460b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48992/0 (socket says 172.21.15.144:48992) 2024-09-13T19:33:29.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f144eb71640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55a33b4627c0 0x55a33b4610b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42320/0 (socket says 172.21.15.144:42320) 2024-09-13T19:33:29.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f144f372640 1 -- 172.21.15.144:0/254466419 learned_addr learned my addr 172.21.15.144:0/254466419 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f144f372640 1 -- 172.21.15.144:0/254466419 >> v1:172.21.15.18:6789/0 conn(0x55a33b4627c0 legacy=0x55a33b4610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.167+0000 7f144f372640 1 -- 172.21.15.144:0/254466419 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a33b4618e0 con 0x55a33b4623b0 2024-09-13T19:33:29.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f144f372640 1 --2- 172.21.15.144:0/254466419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b460b70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f144000a5c0 tx=0x7f144001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956d97ba4655b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f144e370640 1 -- 172.21.15.144:0/254466419 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14400a6070 con 0x55a33b4623b0 2024-09-13T19:33:29.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f144e370640 1 -- 172.21.15.144:0/254466419 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14400af070 con 0x55a33b4623b0 2024-09-13T19:33:29.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f144e370640 1 -- 172.21.15.144:0/254466419 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14400aa5c0 con 0x55a33b4623b0 2024-09-13T19:33:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f1451862980 1 -- 172.21.15.144:0/254466419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 msgr2=0x55a33b460b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f1451862980 1 --2- 172.21.15.144:0/254466419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b460b70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f144000a5c0 tx=0x7f144001b340 comp rx=0 tx=0).stop 2024-09-13T19:33:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f1451862980 1 -- 172.21.15.144:0/254466419 shutdown_connections 2024-09-13T19:33:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f1451862980 1 --2- 172.21.15.144:0/254466419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b460b70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f1451862980 1 -- 172.21.15.144:0/254466419 >> 172.21.15.144:0/254466419 conn(0x55a33b4e71b0 msgr2=0x55a33b4e95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f1451862980 1 -- 172.21.15.144:0/254466419 shutdown_connections 2024-09-13T19:33:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.171+0000 7f1451862980 1 -- 172.21.15.144:0/254466419 wait complete. 2024-09-13T19:33:29.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.183+0000 7f1451862980 1 Processor -- start 2024-09-13T19:33:29.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.183+0000 7f1451862980 1 -- start start 2024-09-13T19:33:29.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.183+0000 7f1451862980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5d8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.183+0000 7f1451862980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a33b399200 con 0x55a33b4623b0 2024-09-13T19:33:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5d8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5d8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48996/0 (socket says 172.21.15.144:48996) 2024-09-13T19:33:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 -- 172.21.15.144:0/1633603711 learned_addr learned my addr 172.21.15.144:0/1633603711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 -- 172.21.15.144:0/1633603711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a33b5d9160 con 0x55a33b4623b0 2024-09-13T19:33:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 --2- 172.21.15.144:0/1633603711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5d8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1440018f70 tx=0x7f1440003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec010074bb898364 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f133d60a640 1 -- 172.21.15.144:0/1633603711 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14400aa960 con 0x55a33b4623b0 2024-09-13T19:33:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f133d60a640 1 -- 172.21.15.144:0/1633603711 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14400aab00 con 0x55a33b4623b0 2024-09-13T19:33:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f133d60a640 1 -- 172.21.15.144:0/1633603711 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14400aade0 con 0x55a33b4623b0 2024-09-13T19:33:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 -- 172.21.15.144:0/1633603711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 msgr2=0x55a33b5d8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 --2- 172.21.15.144:0/1633603711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5d8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1440018f70 tx=0x7f1440003030 comp rx=0 tx=0).stop 2024-09-13T19:33:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 -- 172.21.15.144:0/1633603711 shutdown_connections 2024-09-13T19:33:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 --2- 172.21.15.144:0/1633603711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5d8b90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 -- 172.21.15.144:0/1633603711 >> 172.21.15.144:0/1633603711 conn(0x55a33b4e71b0 msgr2=0x55a33b5d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 -- 172.21.15.144:0/1633603711 shutdown_connections 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 -- 172.21.15.144:0/1633603711 wait complete. 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 Processor -- start 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 -- start start 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5dfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f1451862980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a33b4f7200 con 0x55a33b4623b0 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5dfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5dfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:48998/0 (socket says 172.21.15.144:48998) 2024-09-13T19:33:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 -- 172.21.15.144:0/3936560274 learned_addr learned my addr 172.21.15.144:0/3936560274 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 -- 172.21.15.144:0/3936560274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a33b5e0320 con 0x55a33b4623b0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.187+0000 7f144f372640 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5dfde0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f144000a5c0 tx=0x7f14400180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f133be07640 1 -- 172.21.15.144:0/3936560274 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14400cb030 con 0x55a33b4623b0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a33b5e05b0 con 0x55a33b4623b0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f133be07640 1 -- 172.21.15.144:0/3936560274 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14400bd7c0 con 0x55a33b4623b0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f133be07640 1 -- 172.21.15.144:0/3936560274 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14400bdaa0 con 0x55a33b4623b0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a33b5e3290 con 0x55a33b4623b0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f133be07640 1 -- 172.21.15.144:0/3936560274 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f14400ce070 con 0x55a33b4623b0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f133be07640 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13340346a0 0x7f1334036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f133be07640 1 -- 172.21.15.144:0/3936560274 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f14400cc070 con 0x55a33b4623b0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f144eb71640 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13340346a0 0x7f1334036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b4627c0 0x55a33b5e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b5e7460 con 0x55a33b4627c0 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f144fb73640 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b4627c0 0x55a33b5e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f144fb73640 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b4627c0 0x55a33b5e6e20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f144eb71640 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13340346a0 0x7f1334036b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1444000f70 tx=0x7f1444001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f144fb73640 1 -- 172.21.15.144:0/3936560274 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144800a4d0 con 0x55a33b4627c0 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b5e44b0 con 0x55a33b4627c0 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f144fb73640 1 -- 172.21.15.144:0/3936560274 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f144800a4d0 con 0x55a33b4627c0 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b5e9790 0x55a33b5ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b5ec250 con 0x55a33b5e9790 2024-09-13T19:33:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.191+0000 7f144f372640 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b5e9790 0x55a33b5ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144f372640 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b5e9790 0x55a33b5ebb80 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144f372640 1 -- 172.21.15.144:0/3936560274 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f14400c6a50 con 0x55a33b5e9790 2024-09-13T19:33:29.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b5e8630 con 0x55a33b4627c0 2024-09-13T19:33:29.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144fb73640 1 -- 172.21.15.144:0/3936560274 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f144800a4d0 con 0x55a33b4627c0 2024-09-13T19:33:29.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b5e8b10 con 0x55a33b4627c0 2024-09-13T19:33:29.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144fb73640 1 -- 172.21.15.144:0/3936560274 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f144800a4d0 con 0x55a33b4627c0 2024-09-13T19:33:29.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1451862980 1 Processor -- start 2024-09-13T19:33:29.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1451862980 1 -- start start 2024-09-13T19:33:29.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1451862980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b5fa930 0x55a33b5fad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1451862980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a33b3f2800 con 0x55a33b5fa930 2024-09-13T19:33:29.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144fb73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b5fa930 0x55a33b5fad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144fb73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b5fa930 0x55a33b5fad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49002/0 (socket says 172.21.15.144:49002) 2024-09-13T19:33:29.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144fb73640 1 -- 172.21.15.144:0/329675234 learned_addr learned my addr 172.21.15.144:0/329675234 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144fb73640 1 -- 172.21.15.144:0/329675234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a33b5fb290 con 0x55a33b5fa930 2024-09-13T19:33:29.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f144fb73640 1 --2- 172.21.15.144:0/329675234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b5fa930 0x55a33b5fad50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55a33b5e7840 tx=0x7f1448018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1339602640 1 -- 172.21.15.144:0/329675234 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448014450 con 0x55a33b5fa930 2024-09-13T19:33:29.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1339602640 1 -- 172.21.15.144:0/329675234 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14480145f0 con 0x55a33b5fa930 2024-09-13T19:33:29.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1451862980 1 -- 172.21.15.144:0/329675234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a33b5fb520 con 0x55a33b5fa930 2024-09-13T19:33:29.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1339602640 1 -- 172.21.15.144:0/329675234 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448014910 con 0x55a33b5fa930 2024-09-13T19:33:29.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.195+0000 7f1451862980 1 -- 172.21.15.144:0/329675234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a33b5fe1a0 con 0x55a33b5fa930 2024-09-13T19:33:29.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1339602640 1 -- 172.21.15.144:0/329675234 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1448011040 con 0x55a33b5fa930 2024-09-13T19:33:29.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1339602640 1 --2- 172.21.15.144:0/329675234 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1328034650 0x7f1328036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1339602640 1 -- 172.21.15.144:0/329675234 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f144801e070 con 0x55a33b5fa930 2024-09-13T19:33:29.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f144f372640 1 --2- 172.21.15.144:0/329675234 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1328034650 0x7f1328036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 Processor -- start 2024-09-13T19:33:29.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- start start 2024-09-13T19:33:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f144f372640 1 --2- 172.21.15.144:0/329675234 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1328034650 0x7f1328036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55a33b5e78e0 tx=0x7f14400e3ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b607830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a33b5d9420 con 0x55a33b607430 2024-09-13T19:33:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f144fb73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b607830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f144fb73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b607830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49010/0 (socket says 172.21.15.144:49010) 2024-09-13T19:33:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f144fb73640 1 -- 172.21.15.144:0/3544824748 learned_addr learned my addr 172.21.15.144:0/3544824748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f144fb73640 1 -- 172.21.15.144:0/3544824748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a33b607e00 con 0x55a33b607430 2024-09-13T19:33:29.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f144fb73640 1 --2- 172.21.15.144:0/3544824748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b607830 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f144804a150 tx=0x7f1448011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900e85bf12a5c585 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1332ffd640 1 -- 172.21.15.144:0/3544824748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144803aa70 con 0x55a33b607430 2024-09-13T19:33:29.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1332ffd640 1 -- 172.21.15.144:0/3544824748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144803ac10 con 0x55a33b607430 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1332ffd640 1 -- 172.21.15.144:0/3544824748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448022a50 con 0x55a33b607430 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- 172.21.15.144:0/3544824748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 msgr2=0x55a33b607830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 --2- 172.21.15.144:0/3544824748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b607830 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f144804a150 tx=0x7f1448011700 comp rx=0 tx=0).stop 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- 172.21.15.144:0/3544824748 shutdown_connections 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 --2- 172.21.15.144:0/3544824748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b607830 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- 172.21.15.144:0/3544824748 >> 172.21.15.144:0/3544824748 conn(0x55a33b603810 msgr2=0x55a33b601910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- 172.21.15.144:0/3544824748 shutdown_connections 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- 172.21.15.144:0/3544824748 wait complete. 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 Processor -- start 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- start start 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b60e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.199+0000 7f1451862980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a33b608400 con 0x55a33b607430 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144fb73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b60e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144fb73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b60e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49020/0 (socket says 172.21.15.144:49020) 2024-09-13T19:33:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 learned_addr learned my addr 172.21.15.144:0/1653999643 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a33b60edb0 con 0x55a33b607430 2024-09-13T19:33:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144fb73640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b60e870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1448011b20 tx=0x7f144804a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f13317fa640 1 -- 172.21.15.144:0/1653999643 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14480138c0 con 0x55a33b607430 2024-09-13T19:33:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f13317fa640 1 -- 172.21.15.144:0/1653999643 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1448013a60 con 0x55a33b607430 2024-09-13T19:33:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a33b60f040 con 0x55a33b607430 2024-09-13T19:33:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f13317fa640 1 -- 172.21.15.144:0/1653999643 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144804a4c0 con 0x55a33b607430 2024-09-13T19:33:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a33b611d20 con 0x55a33b607430 2024-09-13T19:33:29.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f13317fa640 1 -- 172.21.15.144:0/1653999643 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f144804a660 con 0x55a33b607430 2024-09-13T19:33:29.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f13317fa640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13180346a0 0x7f1318036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f13317fa640 1 -- 172.21.15.144:0/1653999643 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1448034030 con 0x55a33b607430 2024-09-13T19:33:29.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144f372640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13180346a0 0x7f1318036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b619e10 0x55a33b61c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b61ca00 con 0x55a33b619e10 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144eb71640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b619e10 0x55a33b61c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144f372640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13180346a0 0x7f1318036b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f14400d0f90 tx=0x7f14400e9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144eb71640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b619e10 0x55a33b61c2b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144400f620 con 0x55a33b619e10 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 20 realm 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b619370 con 0x55a33b619e10 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144400f620 con 0x55a33b619e10 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.203+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b61d520 con 0x55a33b619e10 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144400f620 con 0x55a33b619e10 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b61da70 con 0x55a33b619e10 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f144400f620 con 0x55a33b619e10 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b61e870 0x55a33b620c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b6211e0 con 0x55a33b61e870 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144fb73640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b61e870 0x55a33b620c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144fb73640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b61e870 0x55a33b620c60 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 20 searching for the correct realm 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a33b6231c0 0x55a33b625680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144f372640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a33b6231c0 0x55a33b625680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144f372640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a33b6231c0 0x55a33b625680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144f372640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f14400d0030 0x7f14400b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x7f14400d0030 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144eb71640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f14400d0030 0x7f14400b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144eb71640 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f14400d0030 0x7f14400b3610 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144400f620 con 0x7f14400d0030 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.207+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b619e10 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f144400f620 con 0x55a33b619e10 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b619e10 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x7f14400d0030 2024-09-13T19:33:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b619e10 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b619e10 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x7f14400d0030 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.211+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b619e10 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b619e10 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x7f14400d0030 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b619e10 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.215+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x7f14400d0030 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b6231c0 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b61e870 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x55a33b619e10 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a33b625d50 con 0x7f14400d0030 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b621ba0 con 0x55a33b619e10 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b622020 con 0x55a33b619e10 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b622480 con 0x55a33b619e10 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 zone default found 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 4 Realm: () 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 zonegroup default 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b6261d0 con 0x55a33b61e870 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.219+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b628400 con 0x55a33b6231c0 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b6287a0 con 0x55a33b6231c0 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 20 started sync module instance, tier type = 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b627840 con 0x7f14400d0030 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94159564340272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b627840 con 0x7f14400d0030 2024-09-13T19:33:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b629160 con 0x55a33b619e10 2024-09-13T19:33:29.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94159564340272] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94159564338336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b629160 con 0x55a33b619e10 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.223+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b629a10 con 0x55a33b6231c0 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.227+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94159564338336] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.227+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.227+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94159564344768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b629e00 con 0x55a33b6231c0 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.227+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62a7c0 con 0x7f14400d0030 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.227+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.227+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94159564350496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62ae50 con 0x7f14400d0030 2024-09-13T19:33:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.227+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62b970 con 0x55a33b619e10 2024-09-13T19:33:29.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94159564350496] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94159564344768] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94159564354624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62b930 con 0x55a33b619e10 2024-09-13T19:33:29.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62bd60 con 0x55a33b61e870 2024-09-13T19:33:29.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94159564354624] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94159564345824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62c150 con 0x55a33b61e870 2024-09-13T19:33:29.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.231+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62cb10 con 0x55a33b61e870 2024-09-13T19:33:29.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94159564345824] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94159564351648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62cb10 con 0x55a33b61e870 2024-09-13T19:33:29.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62d4d0 con 0x55a33b61e870 2024-09-13T19:33:29.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94159564351648] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94159564359264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62d6b0 con 0x55a33b61e870 2024-09-13T19:33:29.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 20 add_watcher() i=0 2024-09-13T19:33:29.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 20 add_watcher() i=1 2024-09-13T19:33:29.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 20 add_watcher() i=2 2024-09-13T19:33:29.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 20 add_watcher() i=3 2024-09-13T19:33:29.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 20 add_watcher() i=4 2024-09-13T19:33:29.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 20 add_watcher() i=5 2024-09-13T19:33:29.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.235+0000 7f1451862980 20 add_watcher() i=6 2024-09-13T19:33:29.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94159564359264] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 20 add_watcher() i=7 2024-09-13T19:33:29.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:29.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b630830 con 0x55a33b619e10 2024-09-13T19:33:29.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94159564374416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62d5a0 con 0x55a33b619e10 2024-09-13T19:33:29.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94159564374416] v30'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 5 note: GC not initialized 2024-09-13T19:33:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1304fe1640 20 reqs_thread_entry: start 2024-09-13T19:33:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 20 Filter name: none 2024-09-13T19:33:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f127e7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a33b653a40 con 0x55a33b619e10 2024-09-13T19:33:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.239+0000 7f1451862980 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T19:33:29.245 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:33:29.063935Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:29.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.243+0000 7f1305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.243+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94159564374416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b6525f0 con 0x55a33b619e10 2024-09-13T19:33:29.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.243+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94159564374416] v30'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.243+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94159564340272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b651900 con 0x7f14400d0030 2024-09-13T19:33:29.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.243+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94159564340272] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.243+0000 7f1451862980 20 remove_watcher() i=0 2024-09-13T19:33:29.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.243+0000 7f1451862980 2 removed watcher, disabling cache 2024-09-13T19:33:29.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.243+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94159564338336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b651900 con 0x55a33b619e10 2024-09-13T19:33:29.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94159564338336] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f1451862980 20 remove_watcher() i=1 2024-09-13T19:33:29.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94159564344768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b651900 con 0x55a33b6231c0 2024-09-13T19:33:29.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f144f372640 1 -- 172.21.15.144:0/1653999643 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94159564344768] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14400ef040 con 0x55a33b6231c0 2024-09-13T19:33:29.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f1451862980 20 remove_watcher() i=2 2024-09-13T19:33:29.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94159564350496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b627c30 con 0x7f14400d0030 2024-09-13T19:33:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94159564350496] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x7f14400d0030 2024-09-13T19:33:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f1451862980 20 remove_watcher() i=3 2024-09-13T19:33:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.247+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94159564354624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b628dc0 con 0x55a33b619e10 2024-09-13T19:33:29.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.251+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94159564354624] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144402b040 con 0x55a33b619e10 2024-09-13T19:33:29.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.251+0000 7f1451862980 20 remove_watcher() i=4 2024-09-13T19:33:29.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.251+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94159564345824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62a420 con 0x55a33b61e870 2024-09-13T19:33:29.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.251+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94159564345824] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.251+0000 7f1451862980 20 remove_watcher() i=5 2024-09-13T19:33:29.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.251+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94159564351648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62a420 con 0x55a33b61e870 2024-09-13T19:33:29.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94159564351648] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 20 remove_watcher() i=6 2024-09-13T19:33:29.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94159564359264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a33b62a420 con 0x55a33b61e870 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f144fb73640 1 -- 172.21.15.144:0/1653999643 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94159564359264] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802a070 con 0x55a33b61e870 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 20 remove_watcher() i=7 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b61e870 msgr2=0x55a33b620c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b61e870 0x55a33b620c60 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b619e10 msgr2=0x55a33b61c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b619e10 0x55a33b61c2b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f14400d0030 msgr2=0x7f14400b3610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f14400d0030 0x7f14400b3610 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a33b6231c0 msgr2=0x55a33b625680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a33b6231c0 0x55a33b625680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13180346a0 msgr2=0x7f1318036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13180346a0 0x7f1318036b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f14400d0f90 tx=0x7f14400e9000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 msgr2=0x55a33b60e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f144eb71640 1 -- 172.21.15.144:0/1653999643 reap_dead start 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b60e870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1448011b20 tx=0x7f144804a0b0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 shutdown_connections 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/1653999643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b607430 0x55a33b60e870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 >> 172.21.15.144:0/1653999643 conn(0x55a33b603810 msgr2=0x55a33b608b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 shutdown_connections 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/1653999643 wait complete. 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/329675234 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1328034650 msgr2=0x7f1328036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/329675234 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1328034650 0x7f1328036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55a33b5e78e0 tx=0x7f14400e3ca0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/329675234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b5fa930 msgr2=0x55a33b5fad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/329675234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b5fa930 0x55a33b5fad50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55a33b5e7840 tx=0x7f1448018830 comp rx=0 tx=0).stop 2024-09-13T19:33:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/329675234 shutdown_connections 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/329675234 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1328034650 0x7f1328036b10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 --2- 172.21.15.144:0/329675234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b5fa930 0x55a33b5fad50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.255+0000 7f1451862980 1 -- 172.21.15.144:0/329675234 >> 172.21.15.144:0/329675234 conn(0x55a33b5efa80 msgr2=0x55a33b5f2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/329675234 shutdown_connections 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/329675234 wait complete. 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b5e9790 msgr2=0x55a33b5ebb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b5e9790 0x55a33b5ebb80 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b4627c0 msgr2=0x55a33b5e6e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b4627c0 0x55a33b5e6e20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13340346a0 msgr2=0x7f1334036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13340346a0 0x7f1334036b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1444000f70 tx=0x7f1444001380 comp rx=0 tx=0).stop 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 msgr2=0x55a33b5dfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5dfde0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f144000a5c0 tx=0x7f14400180e0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 shutdown_connections 2024-09-13T19:33:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a33b4627c0 0x55a33b5e6e20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a33b5e9790 0x55a33b5ebb80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f13340346a0 0x7f1334036b60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 --2- 172.21.15.144:0/3936560274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a33b4623b0 0x55a33b5dfde0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 >> 172.21.15.144:0/3936560274 conn(0x55a33b4e71b0 msgr2=0x55a33b5d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 shutdown_connections 2024-09-13T19:33:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.259+0000 7f1451862980 1 -- 172.21.15.144:0/3936560274 wait complete. 2024-09-13T19:33:29.270 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:33:29.063935Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:29.270 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T19:33:29.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T19:33:29.270 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-13T19:33:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f0893698980 1 Processor -- start 2024-09-13T19:33:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f0893698980 1 -- start start 2024-09-13T19:33:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f0893698980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56198857ae60 0x56198857d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f0893698980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619883fcae0 con 0x5619884e8b10 2024-09-13T19:33:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f0893698980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x561988420e30 con 0x56198857ae60 2024-09-13T19:33:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f088bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56198857ae60 0x56198857d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f088bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56198857ae60 0x56198857d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49028/0 (socket says 172.21.15.144:49028) 2024-09-13T19:33:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f088bfff640 1 -- 172.21.15.144:0/1087460509 learned_addr learned my addr 172.21.15.144:0/1087460509 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f08911a8640 1 --1- 172.21.15.144:0/1087460509 >> v1:172.21.15.18:6789/0 conn(0x5619884e8b10 0x561988579740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42326/0 (socket says 172.21.15.144:42326) 2024-09-13T19:33:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f088bfff640 1 -- 172.21.15.144:0/1087460509 >> v1:172.21.15.18:6789/0 conn(0x5619884e8b10 legacy=0x561988579740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f088bfff640 1 -- 172.21.15.144:0/1087460509 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619884e8ef0 con 0x56198857ae60 2024-09-13T19:33:29.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.339+0000 7f088bfff640 1 --2- 172.21.15.144:0/1087460509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56198857ae60 0x56198857d250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f087c00a5c0 tx=0x7f087c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e752ea5c4bfd579 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f08909a7640 1 -- 172.21.15.144:0/1087460509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f087c0a6070 con 0x56198857ae60 2024-09-13T19:33:29.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f08909a7640 1 -- 172.21.15.144:0/1087460509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c0af070 con 0x56198857ae60 2024-09-13T19:33:29.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f08909a7640 1 -- 172.21.15.144:0/1087460509 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f087c0aa5c0 con 0x56198857ae60 2024-09-13T19:33:29.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f0893698980 1 -- 172.21.15.144:0/1087460509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56198857ae60 msgr2=0x56198857d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f0893698980 1 --2- 172.21.15.144:0/1087460509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56198857ae60 0x56198857d250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f087c00a5c0 tx=0x7f087c01b340 comp rx=0 tx=0).stop 2024-09-13T19:33:29.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f0893698980 1 -- 172.21.15.144:0/1087460509 shutdown_connections 2024-09-13T19:33:29.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f0893698980 1 --2- 172.21.15.144:0/1087460509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56198857ae60 0x56198857d250 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f0893698980 1 -- 172.21.15.144:0/1087460509 >> 172.21.15.144:0/1087460509 conn(0x56198856f070 msgr2=0x561988571490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f0893698980 1 -- 172.21.15.144:0/1087460509 shutdown_connections 2024-09-13T19:33:29.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.343+0000 7f0893698980 1 -- 172.21.15.144:0/1087460509 wait complete. 2024-09-13T19:33:29.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 Processor -- start 2024-09-13T19:33:29.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 -- start start 2024-09-13T19:33:29.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988661c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561988422200 con 0x5619884e8b10 2024-09-13T19:33:29.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f08911a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988661c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f08911a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988661c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49034/0 (socket says 172.21.15.144:49034) 2024-09-13T19:33:29.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f08911a8640 1 -- 172.21.15.144:0/3792690600 learned_addr learned my addr 172.21.15.144:0/3792690600 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f08911a8640 1 -- 172.21.15.144:0/3792690600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561988662250 con 0x5619884e8b10 2024-09-13T19:33:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f08911a8640 1 --2- 172.21.15.144:0/3792690600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988661c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0884001e50 tx=0x7f0884001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d51efe7e7747762 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f077f606640 1 -- 172.21.15.144:0/3792690600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088400e5d0 con 0x5619884e8b10 2024-09-13T19:33:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f077f606640 1 -- 172.21.15.144:0/3792690600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088400e770 con 0x5619884e8b10 2024-09-13T19:33:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f077f606640 1 -- 172.21.15.144:0/3792690600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088400eab0 con 0x5619884e8b10 2024-09-13T19:33:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 -- 172.21.15.144:0/3792690600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 msgr2=0x561988661c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 --2- 172.21.15.144:0/3792690600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988661c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0884001e50 tx=0x7f0884001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 -- 172.21.15.144:0/3792690600 shutdown_connections 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 --2- 172.21.15.144:0/3792690600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988661c80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 -- 172.21.15.144:0/3792690600 >> 172.21.15.144:0/3792690600 conn(0x56198856f070 msgr2=0x56198865d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 -- 172.21.15.144:0/3792690600 shutdown_connections 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 -- 172.21.15.144:0/3792690600 wait complete. 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 Processor -- start 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.355+0000 7f0893698980 1 -- start start 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f0893698980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988669050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f0893698980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561988580220 con 0x5619884e8b10 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f08911a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988669050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f08911a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988669050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49050/0 (socket says 172.21.15.144:49050) 2024-09-13T19:33:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f08911a8640 1 -- 172.21.15.144:0/1667848764 learned_addr learned my addr 172.21.15.144:0/1667848764 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f08911a8640 1 -- 172.21.15.144:0/1667848764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561988669590 con 0x5619884e8b10 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f08911a8640 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988669050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x561988662e60 tx=0x7f0884000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f077de03640 1 -- 172.21.15.144:0/1667848764 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0884001260 con 0x5619884e8b10 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561988669820 con 0x5619884e8b10 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f077de03640 1 -- 172.21.15.144:0/1667848764 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088400fa40 con 0x5619884e8b10 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198866c500 con 0x5619884e8b10 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f077de03640 1 -- 172.21.15.144:0/1667848764 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088402c060 con 0x5619884e8b10 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f077de03640 1 -- 172.21.15.144:0/1667848764 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0884017070 con 0x5619884e8b10 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f077de03640 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0778034650 0x7f0778036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f077de03640 1 -- 172.21.15.144:0/1667848764 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0884015020 con 0x5619884e8b10 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f088bfff640 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0778034650 0x7f0778036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56198857ae60 0x561988670040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886706b0 con 0x56198857ae60 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f08919a9640 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56198857ae60 0x561988670040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f088bfff640 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0778034650 0x7f0778036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f087c0ae000 tx=0x7f087c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f08919a9640 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56198857ae60 0x561988670040 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.359+0000 7f08919a9640 1 -- 172.21.15.144:0/1667848764 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f088c00a4d0 con 0x56198857ae60 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56198866d700 con 0x56198857ae60 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08919a9640 1 -- 172.21.15.144:0/1667848764 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f088c00a4d0 con 0x56198857ae60 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886729e0 0x561988674dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886754a0 con 0x5619886729e0 2024-09-13T19:33:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08911a8640 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886729e0 0x561988674dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08911a8640 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886729e0 0x561988674dd0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08911a8640 1 -- 172.21.15.144:0/1667848764 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f088402e070 con 0x5619886729e0 2024-09-13T19:33:29.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561988671880 con 0x56198857ae60 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08919a9640 1 -- 172.21.15.144:0/1667848764 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f088c00a4d0 con 0x56198857ae60 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561988671d60 con 0x56198857ae60 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08919a9640 1 -- 172.21.15.144:0/1667848764 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f088c00a4d0 con 0x56198857ae60 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 Processor -- start 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 -- start start 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561988683b80 0x561988683fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f0893698980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56198847b800 con 0x561988683b80 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08919a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561988683b80 0x561988683fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08919a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561988683b80 0x561988683fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49062/0 (socket says 172.21.15.144:49062) 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.363+0000 7f08919a9640 1 -- 172.21.15.144:0/1337186229 learned_addr learned my addr 172.21.15.144:0/1337186229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08919a9640 1 -- 172.21.15.144:0/1337186229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619886844e0 con 0x561988683b80 2024-09-13T19:33:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08919a9640 1 --2- 172.21.15.144:0/1337186229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561988683b80 0x561988683fa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x561988670ab0 tx=0x7f088c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0776ffd640 1 -- 172.21.15.144:0/1337186229 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088c014450 con 0x561988683b80 2024-09-13T19:33:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0776ffd640 1 -- 172.21.15.144:0/1337186229 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088c0145f0 con 0x561988683b80 2024-09-13T19:33:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0893698980 1 -- 172.21.15.144:0/1337186229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561988684770 con 0x561988683b80 2024-09-13T19:33:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0776ffd640 1 -- 172.21.15.144:0/1337186229 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088c014910 con 0x561988683b80 2024-09-13T19:33:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0893698980 1 -- 172.21.15.144:0/1337186229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619886873f0 con 0x561988683b80 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0776ffd640 1 -- 172.21.15.144:0/1337186229 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f088c011040 con 0x561988683b80 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0776ffd640 1 --2- 172.21.15.144:0/1337186229 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0768034650 0x7f0768036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0776ffd640 1 -- 172.21.15.144:0/1337186229 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f088c01e070 con 0x561988683b80 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08911a8640 1 --2- 172.21.15.144:0/1337186229 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0768034650 0x7f0768036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0893698980 1 Processor -- start 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0893698980 1 -- start start 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08911a8640 1 --2- 172.21.15.144:0/1337186229 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0768034650 0x7f0768036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x561988670b50 tx=0x7f0884048dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0893698980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988690ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0893698980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5619886625d0 con 0x5619886906d0 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08919a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988690ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08919a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988690ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49072/0 (socket says 172.21.15.144:49072) 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08919a9640 1 -- 172.21.15.144:0/1722827147 learned_addr learned my addr 172.21.15.144:0/1722827147 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08919a9640 1 -- 172.21.15.144:0/1722827147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619886910a0 con 0x5619886906d0 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f08919a9640 1 --2- 172.21.15.144:0/1722827147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988690ad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f088c04a120 tx=0x7f088c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22016dc68fd3bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0774ff9640 1 -- 172.21.15.144:0/1722827147 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088c041070 con 0x5619886906d0 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0774ff9640 1 -- 172.21.15.144:0/1722827147 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088c013c50 con 0x5619886906d0 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.367+0000 7f0774ff9640 1 -- 172.21.15.144:0/1722827147 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088c028070 con 0x5619886906d0 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- 172.21.15.144:0/1722827147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 msgr2=0x561988690ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 --2- 172.21.15.144:0/1722827147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988690ad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f088c04a120 tx=0x7f088c011f90 comp rx=0 tx=0).stop 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- 172.21.15.144:0/1722827147 shutdown_connections 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 --2- 172.21.15.144:0/1722827147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988690ad0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- 172.21.15.144:0/1722827147 >> 172.21.15.144:0/1722827147 conn(0x56198868ca60 msgr2=0x56198868ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- 172.21.15.144:0/1722827147 shutdown_connections 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- 172.21.15.144:0/1722827147 wait complete. 2024-09-13T19:33:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 Processor -- start 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- start start 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988697a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561988691680 con 0x5619886906d0 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f08919a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988697a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f08919a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988697a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49082/0 (socket says 172.21.15.144:49082) 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 learned_addr learned my addr 172.21.15.144:0/4212617612 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561988697f90 con 0x5619886906d0 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f08919a9640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988697a50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f088c03f040 tx=0x7f088c04a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0766ffd640 1 -- 172.21.15.144:0/4212617612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088c041030 con 0x5619886906d0 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0766ffd640 1 -- 172.21.15.144:0/4212617612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088c013e00 con 0x5619886906d0 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561988698220 con 0x5619886906d0 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0766ffd640 1 -- 172.21.15.144:0/4212617612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f088c02b350 con 0x5619886906d0 2024-09-13T19:33:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198869af00 con 0x5619886906d0 2024-09-13T19:33:29.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0766ffd640 1 -- 172.21.15.144:0/4212617612 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f088c02b4f0 con 0x5619886906d0 2024-09-13T19:33:29.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.371+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0766ffd640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f075c034650 0x7f075c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0766ffd640 1 -- 172.21.15.144:0/4212617612 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f088c042070 con 0x5619886906d0 2024-09-13T19:33:29.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f08911a8640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f075c034650 0x7f075c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619886a3080 0x5619886a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886a5c60 con 0x5619886a3080 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f088bfff640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619886a3080 0x5619886a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f08911a8640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f075c034650 0x7f075c036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f088400fed0 tx=0x7f088403a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f088bfff640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619886a3080 0x5619886a5510 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 realm 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886a6090 con 0x5619886a3080 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886a6960 con 0x5619886a3080 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886a6d00 con 0x5619886a3080 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886a7a60 0x5619886a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886aa4a0 con 0x5619886a7a60 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f08919a9640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886a7a60 0x5619886a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f08919a9640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886a7a60 0x5619886a9e50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 20 searching for the correct realm 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619886ac3f0 0x5619886ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f08911a8640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619886ac3f0 0x5619886ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.375+0000 7f08911a8640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619886ac3f0 0x5619886ae800 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08911a8640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f088404a070 0x7f088401d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x7f088404a070 2024-09-13T19:33:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f088404a070 0x7f088401d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f088404a070 0x7f088401d5f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a3080 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a3080 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x7f088404a070 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a3080 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.379+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a3080 2024-09-13T19:33:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x7f088404a070 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a3080 2024-09-13T19:33:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a3080 2024-09-13T19:33:29.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.383+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x7f088404a070 2024-09-13T19:33:29.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a3080 2024-09-13T19:33:29.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x7f088404a070 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886ac3f0 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a7a60 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x5619886a3080 2024-09-13T19:33:29.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5619886aeed0 con 0x7f088404a070 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.387+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886aae60 con 0x5619886a3080 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886aaaa0 con 0x5619886a3080 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886ab780 con 0x5619886a3080 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 zone default found 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 4 Realm: () 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 zonegroup default 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886af350 con 0x5619886a7a60 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886b10d0 con 0x5619886ac3f0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886b1580 con 0x5619886ac3f0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 started sync module instance, tier type = 2024-09-13T19:33:29.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:29.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b0570 con 0x7f088404a070 2024-09-13T19:33:29.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667662887536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b0570 con 0x7f088404a070 2024-09-13T19:33:29.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.391+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b2070 con 0x5619886a3080 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.395+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667662887536] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.395+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.395+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667662891904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b2070 con 0x5619886a3080 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.395+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b2a70 con 0x5619886ac3f0 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.395+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667662891904] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.395+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.395+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667662885056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b2e60 con 0x5619886ac3f0 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.395+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b3820 con 0x7f088404a070 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667662898304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b3eb0 con 0x7f088404a070 2024-09-13T19:33:29.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b49d0 con 0x5619886a3080 2024-09-13T19:33:29.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667662885056] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667662898304] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667662902432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b4990 con 0x5619886a3080 2024-09-13T19:33:29.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b4dc0 con 0x5619886a7a60 2024-09-13T19:33:29.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.399+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667662902432] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.403+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.403+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667662899456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b51b0 con 0x5619886a7a60 2024-09-13T19:33:29.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.403+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b5b70 con 0x5619886a7a60 2024-09-13T19:33:29.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.403+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667662899456] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.403+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.403+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667662894464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b5b70 con 0x5619886a7a60 2024-09-13T19:33:29.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.403+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b6530 con 0x5619886a7a60 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667662909568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b6950 con 0x5619886a7a60 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 add_watcher() i=0 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 add_watcher() i=1 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 add_watcher() i=2 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 add_watcher() i=3 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 add_watcher() i=4 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 add_watcher() i=5 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667662894464] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 add_watcher() i=6 2024-09-13T19:33:29.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667662909568] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 add_watcher() i=7 2024-09-13T19:33:29.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:29.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886b56c0 con 0x5619886a3080 2024-09-13T19:33:29.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667662907072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b6ea0 con 0x5619886a3080 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667662907072] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f07477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f0893698980 5 note: GC not initialized 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.407+0000 7f07467e4640 20 reqs_thread_entry: start 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 20 Filter name: none 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f06b7fff640 20 reqs_thread_entry: start 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886dcff0 con 0x5619886a3080 2024-09-13T19:33:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T19:33:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886e36a0 con 0x5619886a3080 2024-09-13T19:33:29.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:29.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:29.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94667663094032 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886ded90 con 0x5619886a3080 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94667662902432 notify 128849018884 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5619884e8ef0 con 0x5619886a3080 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0774ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94667662902432 notifier 4349 bl.length()=567 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0774ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0774ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0774ff9640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0754003eb0 con 0x5619886a3080 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(64 notify.4 [notify cookie 94667663094032 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94667663094032 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f087c0bfd90 con 0x5619886a3080 2024-09-13T19:33:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.411+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886e3110 con 0x5619886a7a60 2024-09-13T19:33:29.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f0893698980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94667663094032 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5619886de8e0 con 0x5619886ac3f0 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== watch-notify(notify (1) cookie 94667662885056 notify 128849018881 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f0884050040 con 0x5619886ac3f0 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f0767fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94667662885056 notifier 4349 bl.length()=170 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f0767fff640 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f06c40032d0 con 0x5619886ac3f0 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 notify.2 [notify cookie 94667663094032 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== watch-notify(notify_complete (2) cookie 94667663094032 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56198866c500 con 0x5619886ac3f0 2024-09-13T19:33:29.418 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:29.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f07477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667662907072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886dadd0 con 0x5619886a3080 2024-09-13T19:33:29.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94667662907072] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.415+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667662887536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886dadd0 con 0x7f088404a070 2024-09-13T19:33:29.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.419+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94667662887536] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.419+0000 7f0893698980 20 remove_watcher() i=0 2024-09-13T19:33:29.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.419+0000 7f0893698980 2 removed watcher, disabling cache 2024-09-13T19:33:29.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.419+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667662891904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886dadd0 con 0x5619886a3080 2024-09-13T19:33:29.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.419+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94667662891904] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.419+0000 7f0893698980 20 remove_watcher() i=1 2024-09-13T19:33:29.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.419+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667662885056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886dadd0 con 0x5619886ac3f0 2024-09-13T19:33:29.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f08911a8640 1 -- 172.21.15.144:0/4212617612 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94667662885056] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088402e070 con 0x5619886ac3f0 2024-09-13T19:33:29.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f0893698980 20 remove_watcher() i=2 2024-09-13T19:33:29.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667662898304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b00c0 con 0x7f088404a070 2024-09-13T19:33:29.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94667662898304] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x7f088404a070 2024-09-13T19:33:29.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f0893698980 20 remove_watcher() i=3 2024-09-13T19:33:29.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667662902432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b3480 con 0x5619886a3080 2024-09-13T19:33:29.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94667662902432] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c0aaa40 con 0x5619886a3080 2024-09-13T19:33:29.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f0893698980 20 remove_watcher() i=4 2024-09-13T19:33:29.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.423+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667662899456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b3480 con 0x5619886a7a60 2024-09-13T19:33:29.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.427+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94667662899456] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.427+0000 7f0893698980 20 remove_watcher() i=5 2024-09-13T19:33:29.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.427+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667662894464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b3480 con 0x5619886a7a60 2024-09-13T19:33:29.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.427+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94667662894464] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.427+0000 7f0893698980 20 remove_watcher() i=6 2024-09-13T19:33:29.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.427+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667662909568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5619886b2580 con 0x5619886a7a60 2024-09-13T19:33:29.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f08919a9640 1 -- 172.21.15.144:0/4212617612 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94667662909568] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f088c02a070 con 0x5619886a7a60 2024-09-13T19:33:29.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 20 remove_watcher() i=7 2024-09-13T19:33:29.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886a7a60 msgr2=0x5619886a9e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886a7a60 0x5619886a9e50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619886a3080 msgr2=0x5619886a5510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5619886a3080 0x5619886a5510 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f088404a070 msgr2=0x7f088401d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f088404a070 0x7f088401d5f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619886ac3f0 msgr2=0x5619886ae800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5619886ac3f0 0x5619886ae800 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f075c034650 msgr2=0x7f075c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f075c034650 0x7f075c036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f088400fed0 tx=0x7f088403a000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 msgr2=0x561988697a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f088bfff640 1 -- 172.21.15.144:0/4212617612 reap_dead start 2024-09-13T19:33:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988697a50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f088c03f040 tx=0x7f088c04a0b0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 shutdown_connections 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/4212617612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619886906d0 0x561988697a50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 >> 172.21.15.144:0/4212617612 conn(0x56198868ca60 msgr2=0x56198868ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 shutdown_connections 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/4212617612 wait complete. 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1337186229 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0768034650 msgr2=0x7f0768036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1337186229 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0768034650 0x7f0768036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x561988670b50 tx=0x7f0884048dd0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1337186229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561988683b80 msgr2=0x561988683fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1337186229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561988683b80 0x561988683fa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x561988670ab0 tx=0x7f088c018830 comp rx=0 tx=0).stop 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1337186229 shutdown_connections 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1337186229 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0768034650 0x7f0768036b10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1337186229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561988683b80 0x561988683fa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1337186229 >> 172.21.15.144:0/1337186229 conn(0x561988678cd0 msgr2=0x56198867b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1337186229 shutdown_connections 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1337186229 wait complete. 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886729e0 msgr2=0x561988674dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886729e0 0x561988674dd0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56198857ae60 msgr2=0x561988670040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56198857ae60 0x561988670040 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0778034650 msgr2=0x7f0778036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0778034650 0x7f0778036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f087c0ae000 tx=0x7f087c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 msgr2=0x561988669050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988669050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x561988662e60 tx=0x7f0884000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 shutdown_connections 2024-09-13T19:33:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56198857ae60 0x561988670040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5619886729e0 0x561988674dd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0778034650 0x7f0778036b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 --2- 172.21.15.144:0/1667848764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619884e8b10 0x561988669050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 >> 172.21.15.144:0/1667848764 conn(0x56198856f070 msgr2=0x56198865c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 shutdown_connections 2024-09-13T19:33:29.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.431+0000 7f0893698980 1 -- 172.21.15.144:0/1667848764 wait complete. 2024-09-13T19:33:29.444 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:29.444 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T19:33:29.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T19:33:29.444 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-13T19:33:29.524 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:29.524 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23da858980 1 Processor -- start 2024-09-13T19:33:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23da858980 1 -- start start 2024-09-13T19:33:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23da858980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f63601e900 0x55f636020cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23da858980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f635ea3ae0 con 0x55f63601a580 2024-09-13T19:33:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23da858980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55f635ec7e30 con 0x55f63601e900 2024-09-13T19:33:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23d7b67640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f63601e900 0x55f636020cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23d7b67640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f63601e900 0x55f636020cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49096/0 (socket says 172.21.15.144:49096) 2024-09-13T19:33:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23d7b67640 1 -- 172.21.15.144:0/1406123213 learned_addr learned my addr 172.21.15.144:0/1406123213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23d8368640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55f63601a580 0x55f63601a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:42328/0 (socket says 172.21.15.144:42328) 2024-09-13T19:33:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23d7b67640 1 -- 172.21.15.144:0/1406123213 >> v1:172.21.15.18:6789/0 conn(0x55f63601a580 legacy=0x55f63601a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23d7b67640 1 -- 172.21.15.144:0/1406123213 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f635f8f8f0 con 0x55f63601e900 2024-09-13T19:33:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23d7b67640 1 --2- 172.21.15.144:0/1406123213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601e900 0x55f636020cf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f23c000a5c0 tx=0x7f23c001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d2563d52f0244d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.523+0000 7f23d7366640 1 -- 172.21.15.144:0/1406123213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c00a6070 con 0x55f63601e900 2024-09-13T19:33:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23d7366640 1 -- 172.21.15.144:0/1406123213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c00af070 con 0x55f63601e900 2024-09-13T19:33:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23d7366640 1 -- 172.21.15.144:0/1406123213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c00aa5c0 con 0x55f63601e900 2024-09-13T19:33:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23da858980 1 -- 172.21.15.144:0/1406123213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601e900 msgr2=0x55f636020cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23da858980 1 --2- 172.21.15.144:0/1406123213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601e900 0x55f636020cf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f23c000a5c0 tx=0x7f23c001b340 comp rx=0 tx=0).stop 2024-09-13T19:33:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23da858980 1 -- 172.21.15.144:0/1406123213 shutdown_connections 2024-09-13T19:33:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23da858980 1 --2- 172.21.15.144:0/1406123213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601e900 0x55f636020cf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23da858980 1 -- 172.21.15.144:0/1406123213 >> 172.21.15.144:0/1406123213 conn(0x55f6360160a0 msgr2=0x55f6360184c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23da858980 1 -- 172.21.15.144:0/1406123213 shutdown_connections 2024-09-13T19:33:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.527+0000 7f23da858980 1 -- 172.21.15.144:0/1406123213 wait complete. 2024-09-13T19:33:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23da858980 1 Processor -- start 2024-09-13T19:33:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23da858980 1 -- start start 2024-09-13T19:33:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23da858980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636106a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23da858980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f635ec9200 con 0x55f63601a580 2024-09-13T19:33:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23d8368640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636106a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23d8368640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636106a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49108/0 (socket says 172.21.15.144:49108) 2024-09-13T19:33:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23d8368640 1 -- 172.21.15.144:0/1249644679 learned_addr learned my addr 172.21.15.144:0/1249644679 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23d8368640 1 -- 172.21.15.144:0/1249644679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f636107050 con 0x55f63601a580 2024-09-13T19:33:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f23d8368640 1 --2- 172.21.15.144:0/1249644679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636106a80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f23c80015f0 tx=0x7f23c8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fb44220680d4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f22c660c640 1 -- 172.21.15.144:0/1249644679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c8013420 con 0x55f63601a580 2024-09-13T19:33:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f22c660c640 1 -- 172.21.15.144:0/1249644679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c80135e0 con 0x55f63601a580 2024-09-13T19:33:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.539+0000 7f22c660c640 1 -- 172.21.15.144:0/1249644679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c8013940 con 0x55f63601a580 2024-09-13T19:33:29.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- 172.21.15.144:0/1249644679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 msgr2=0x55f636106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 --2- 172.21.15.144:0/1249644679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636106a80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f23c80015f0 tx=0x7f23c8001ab0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- 172.21.15.144:0/1249644679 shutdown_connections 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 --2- 172.21.15.144:0/1249644679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636106a80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- 172.21.15.144:0/1249644679 >> 172.21.15.144:0/1249644679 conn(0x55f6360160a0 msgr2=0x55f6361026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- 172.21.15.144:0/1249644679 shutdown_connections 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- 172.21.15.144:0/1249644679 wait complete. 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 Processor -- start 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- start start 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636023ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f635f905d0 con 0x55f63601a580 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23d8368640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636023ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23d8368640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636023ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49122/0 (socket says 172.21.15.144:49122) 2024-09-13T19:33:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23d8368640 1 -- 172.21.15.144:0/1608574037 learned_addr learned my addr 172.21.15.144:0/1608574037 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23d8368640 1 -- 172.21.15.144:0/1608574037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f636024220 con 0x55f63601a580 2024-09-13T19:33:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23d8368640 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636023ce0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f23c8006640 tx=0x7f23c8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f22c4e09640 1 -- 172.21.15.144:0/1608574037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c8022020 con 0x55f63601a580 2024-09-13T19:33:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f636022400 con 0x55f63601a580 2024-09-13T19:33:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f22c4e09640 1 -- 172.21.15.144:0/1608574037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c8006320 con 0x55f63601a580 2024-09-13T19:33:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f22c4e09640 1 -- 172.21.15.144:0/1608574037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c8004af0 con 0x55f63601a580 2024-09-13T19:33:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6360228f0 con 0x55f63601a580 2024-09-13T19:33:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f22c4e09640 1 -- 172.21.15.144:0/1608574037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f23c8025020 con 0x55f63601a580 2024-09-13T19:33:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f22c4e09640 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22c0034650 0x7f22c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f22c4e09640 1 -- 172.21.15.144:0/1608574037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f23c8018030 con 0x55f63601a580 2024-09-13T19:33:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.543+0000 7f23d7b67640 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22c0034650 0x7f22c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f63601e900 0x55f636117210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636117750 con 0x55f63601e900 2024-09-13T19:33:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8b69640 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f63601e900 0x55f636117210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d7b67640 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22c0034650 0x7f22c0036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f23c00ae000 tx=0x7f23c00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8b69640 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f63601e900 0x55f636117210 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8b69640 1 -- 172.21.15.144:0/1608574037 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23d00083f0 con 0x55f63601e900 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636117af0 con 0x55f63601e900 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8b69640 1 -- 172.21.15.144:0/1608574037 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23d00083f0 con 0x55f63601e900 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6361198e0 0x55f63611bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f63611c3a0 con 0x55f6361198e0 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8368640 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6361198e0 0x55f63611bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8368640 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6361198e0 0x55f63611bcd0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8368640 1 -- 172.21.15.144:0/1608574037 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361198e0 2024-09-13T19:33:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636118780 con 0x55f63601e900 2024-09-13T19:33:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8b69640 1 -- 172.21.15.144:0/1608574037 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23d00083f0 con 0x55f63601e900 2024-09-13T19:33:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636118c60 con 0x55f63601e900 2024-09-13T19:33:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23d8b69640 1 -- 172.21.15.144:0/1608574037 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f23d00083f0 con 0x55f63601e900 2024-09-13T19:33:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 Processor -- start 2024-09-13T19:33:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.547+0000 7f23da858980 1 -- start start 2024-09-13T19:33:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23da858980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63612aa80 0x55f63612aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23da858980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f635f22800 con 0x55f63612aa80 2024-09-13T19:33:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23d8b69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63612aa80 0x55f63612aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23d8b69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63612aa80 0x55f63612aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49126/0 (socket says 172.21.15.144:49126) 2024-09-13T19:33:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23d8b69640 1 -- 172.21.15.144:0/1983149157 learned_addr learned my addr 172.21.15.144:0/1983149157 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23d8b69640 1 -- 172.21.15.144:0/1983149157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f63612b3e0 con 0x55f63612aa80 2024-09-13T19:33:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23d8b69640 1 --2- 172.21.15.144:0/1983149157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63612aa80 0x55f63612aea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f636023310 tx=0x7f23d000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f22bdffb640 1 -- 172.21.15.144:0/1983149157 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d0007e00 con 0x55f63612aa80 2024-09-13T19:33:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f22bdffb640 1 -- 172.21.15.144:0/1983149157 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d001e020 con 0x55f63612aa80 2024-09-13T19:33:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23da858980 1 -- 172.21.15.144:0/1983149157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f63612b670 con 0x55f63612aa80 2024-09-13T19:33:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f22bdffb640 1 -- 172.21.15.144:0/1983149157 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d0019590 con 0x55f63612aa80 2024-09-13T19:33:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23da858980 1 -- 172.21.15.144:0/1983149157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f63612e2f0 con 0x55f63612aa80 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f22bdffb640 1 -- 172.21.15.144:0/1983149157 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f23d0016040 con 0x55f63612aa80 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f22bdffb640 1 --2- 172.21.15.144:0/1983149157 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22b0034650 0x7f22b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f22bdffb640 1 -- 172.21.15.144:0/1983149157 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f23d001f030 con 0x55f63612aa80 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23d8368640 1 --2- 172.21.15.144:0/1983149157 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22b0034650 0x7f22b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23da858980 1 Processor -- start 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23da858980 1 -- start start 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23d8368640 1 --2- 172.21.15.144:0/1983149157 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22b0034650 0x7f22b0036b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55f636022be0 tx=0x7f23c8033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23da858980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f636137900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.551+0000 7f23da858980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6361073d0 con 0x55f636137520 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f636137900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f636137900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49132/0 (socket says 172.21.15.144:49132) 2024-09-13T19:33:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 -- 172.21.15.144:0/2629771745 learned_addr learned my addr 172.21.15.144:0/2629771745 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 -- 172.21.15.144:0/2629771745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f636137ed0 con 0x55f636137520 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 --2- 172.21.15.144:0/2629771745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f636137900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f23d004a360 tx=0x7f23d0023570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5061c128c21b29e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f22b77fe640 1 -- 172.21.15.144:0/2629771745 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d0047040 con 0x55f636137520 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f22b77fe640 1 -- 172.21.15.144:0/2629771745 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d00173b0 con 0x55f636137520 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f22b77fe640 1 -- 172.21.15.144:0/2629771745 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d001d040 con 0x55f636137520 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- 172.21.15.144:0/2629771745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 msgr2=0x55f636137900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 --2- 172.21.15.144:0/2629771745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f636137900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f23d004a360 tx=0x7f23d0023570 comp rx=0 tx=0).stop 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- 172.21.15.144:0/2629771745 shutdown_connections 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 --2- 172.21.15.144:0/2629771745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f636137900 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- 172.21.15.144:0/2629771745 >> 172.21.15.144:0/2629771745 conn(0x55f636133900 msgr2=0x55f636131a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- 172.21.15.144:0/2629771745 shutdown_connections 2024-09-13T19:33:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- 172.21.15.144:0/2629771745 wait complete. 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 Processor -- start 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- start start 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f63613e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6361384f0 con 0x55f636137520 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f63613e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f63613e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:49134/0 (socket says 172.21.15.144:49134) 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 learned_addr learned my addr 172.21.15.144:0/2890598743 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f63613eda0 con 0x55f636137520 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23d8b69640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f63613e860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f23d00237c0 tx=0x7f23d004a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f22b5ffb640 1 -- 172.21.15.144:0/2890598743 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d001d070 con 0x55f636137520 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f63613f030 con 0x55f636137520 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f22b5ffb640 1 -- 172.21.15.144:0/2890598743 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0015870 con 0x55f636137520 2024-09-13T19:33:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f22b5ffb640 1 -- 172.21.15.144:0/2890598743 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d0032040 con 0x55f636137520 2024-09-13T19:33:29.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.555+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f636141d10 con 0x55f636137520 2024-09-13T19:33:29.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f22b5ffb640 1 -- 172.21.15.144:0/2890598743 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f23d0022a80 con 0x55f636137520 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f22b5ffb640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22a8034600 0x7f22a8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f22b5ffb640 1 -- 172.21.15.144:0/2890598743 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f23d0040030 con 0x55f636137520 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d8368640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22a8034600 0x7f22a8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f636149d10 0x55f63614c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f63614c900 con 0x55f636149d10 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d7b67640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f636149d10 0x55f63614c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d8368640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22a8034600 0x7f22a8036ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23c80486a0 tx=0x7f23c8035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d7b67640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f636149d10 0x55f63614c1b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 realm 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f63614cd80 con 0x55f636149d10 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f63614d620 con 0x55f636149d10 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f63614d9c0 con 0x55f636149d10 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f63614e770 0x55f636150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636151200 con 0x55f63614e770 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d8b69640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f63614e770 0x55f636150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.559+0000 7f23d8b69640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f63614e770 0x55f636150b60 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23da858980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23da858980 20 searching for the correct realm 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6361530e0 0x55f636155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f6361530e0 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8368640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6361530e0 0x55f636155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8368640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6361530e0 0x55f636155550 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8368640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f23c8027020 0x7f23c80410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x7f23c8027020 2024-09-13T19:33:29.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d7b67640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f23c8027020 0x7f23c80410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d7b67640 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f23c8027020 0x7f23c80410d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f63614e770 2024-09-13T19:33:29.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f636149d10 2024-09-13T19:33:29.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f636149d10 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f63614e770 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f63614e770 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.563+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x7f23c8027020 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f6361530e0 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f636149d10 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f63614e770 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f636149d10 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x7f23c8027020 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f6361530e0 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f6361530e0 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f63614e770 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f6361530e0 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f636155c20 con 0x55f6361530e0 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f636149d10 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f636149d10 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.567+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f63614e770 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f6361530e0 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x7f23c8027020 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f636149d10 2024-09-13T19:33:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f63614e770 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f6361530e0 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f63614e770 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x7f23c8027020 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f6361530e0 2024-09-13T19:33:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.571+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f63614e770 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x55f636149d10 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f23c8061040 con 0x7f23c8027020 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636151b50 con 0x55f636149d10 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636151790 con 0x55f636149d10 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636152470 con 0x55f636149d10 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 zone default found 2024-09-13T19:33:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 4 Realm: () 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 zonegroup default 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636152470 con 0x55f63614e770 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636157f80 con 0x55f6361530e0 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636158320 con 0x55f6361530e0 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 started sync module instance, tier type = 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6361573c0 con 0x7f23c8027020 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94515957692688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6361573c0 con 0x7f23c8027020 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.575+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636158d20 con 0x55f636149d10 2024-09-13T19:33:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.579+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94515957692688] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.579+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.579+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94515957696560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6361573c0 con 0x55f636149d10 2024-09-13T19:33:29.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.579+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636159730 con 0x55f6361530e0 2024-09-13T19:33:29.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.579+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94515957696560] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.579+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.579+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94515957690128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636157330 con 0x55f6361530e0 2024-09-13T19:33:29.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.579+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615a430 con 0x7f23c8027020 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.583+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.583+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94515957702800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615ab20 con 0x7f23c8027020 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.583+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615b620 con 0x55f636149d10 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.583+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94515957690128] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.583+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94515957702800] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.583+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.583+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94515957707024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615b5e0 con 0x55f636149d10 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.583+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615ba40 con 0x55f63614e770 2024-09-13T19:33:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.587+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94515957707024] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.587+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.587+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94515957704048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615be30 con 0x55f63614e770 2024-09-13T19:33:29.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.587+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615c700 con 0x55f63614e770 2024-09-13T19:33:29.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.587+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94515957704048] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.587+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.587+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94515957701328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615c8e0 con 0x55f63614e770 2024-09-13T19:33:29.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.587+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615d170 con 0x55f63614e770 2024-09-13T19:33:29.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94515957701328] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94515957710304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615d350 con 0x55f63614e770 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 20 add_watcher() i=0 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 20 add_watcher() i=1 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 20 add_watcher() i=2 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 20 add_watcher() i=3 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 20 add_watcher() i=4 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 20 add_watcher() i=5 2024-09-13T19:33:29.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 20 add_watcher() i=6 2024-09-13T19:33:29.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94515957710304] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 20 add_watcher() i=7 2024-09-13T19:33:29.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:29.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636160720 con 0x55f636149d10 2024-09-13T19:33:29.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.591+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94515957715520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f63615db10 con 0x55f636149d10 2024-09-13T19:33:29.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94515957715520] v30'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f228e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 5 note: GC not initialized 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f228d7e2640 20 reqs_thread_entry: start 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 20 Filter name: none 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f21feffd640 20 reqs_thread_entry: start 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636183af0 con 0x55f636149d10 2024-09-13T19:33:29.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636184560 con 0x55f636149d10 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-13T19:33:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636189f30 con 0x55f636149d10 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94515957897632 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f636185570 con 0x55f636149d10 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== watch-notify(notify (1) cookie 94515957707024 notify 128849018885 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55f635f8f8f0 con 0x55f636149d10 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f22b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94515957707024 notifier 4356 bl.length()=732 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f22b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f22b77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f22b77fe640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f229c003eb0 con 0x55f636149d10 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.595+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(65 notify.4 [notify cookie 94515957897632 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== watch-notify(notify_complete (2) cookie 94515957897632 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f23c00bfd90 con 0x55f636149d10 2024-09-13T19:33:29.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6361899a0 con 0x55f636149d10 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23da858980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23da858980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23da858980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94515957897632 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6361850c0 con 0x7f23c8027020 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== watch-notify(notify (1) cookie 94515957692688 notify 128849018882 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f23c00bfd90 con 0x7f23c8027020 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f22b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94515957692688 notifier 4356 bl.length()=166 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f22b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f22b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f22b6ffd640 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f220c003410 con 0x7f23c8027020 2024-09-13T19:33:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.0 [notify cookie 94515957897632 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== watch-notify(notify_complete (2) cookie 94515957897632 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f23c00e04f0 con 0x7f23c8027020 2024-09-13T19:33:29.605 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"kC4GujrEp89CdzzLprqPVnlTwFdDC9uSrJ1WaODD","active":true,"create_date":"2024-09-13T19:33:29.600068Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f228e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94515957715520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x55f636149d10 2024-09-13T19:33:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94515957715520] v30'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.599+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94515957692688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x7f23c8027020 2024-09-13T19:33:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.603+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94515957692688] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.603+0000 7f23da858980 20 remove_watcher() i=0 2024-09-13T19:33:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.603+0000 7f23da858980 2 removed watcher, disabling cache 2024-09-13T19:33:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.603+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94515957696560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x55f636149d10 2024-09-13T19:33:29.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.603+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94515957696560] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.603+0000 7f23da858980 20 remove_watcher() i=1 2024-09-13T19:33:29.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.603+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94515957690128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x55f6361530e0 2024-09-13T19:33:29.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23d8368640 1 -- 172.21.15.144:0/2890598743 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94515957690128] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c801b070 con 0x55f6361530e0 2024-09-13T19:33:29.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23da858980 20 remove_watcher() i=2 2024-09-13T19:33:29.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94515957702800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x7f23c8027020 2024-09-13T19:33:29.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94515957702800] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x7f23c8027020 2024-09-13T19:33:29.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23da858980 20 remove_watcher() i=3 2024-09-13T19:33:29.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94515957707024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x55f636149d10 2024-09-13T19:33:29.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94515957707024] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c00aaa40 con 0x55f636149d10 2024-09-13T19:33:29.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23da858980 20 remove_watcher() i=4 2024-09-13T19:33:29.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.607+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94515957704048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x55f63614e770 2024-09-13T19:33:29.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.611+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94515957704048] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.611+0000 7f23da858980 20 remove_watcher() i=5 2024-09-13T19:33:29.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.611+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94515957701328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x55f63614e770 2024-09-13T19:33:29.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.611+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94515957701328] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 20 remove_watcher() i=6 2024-09-13T19:33:29.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94515957710304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f636181950 con 0x55f63614e770 2024-09-13T19:33:29.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23d8b69640 1 -- 172.21.15.144:0/2890598743 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94515957710304] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d002a070 con 0x55f63614e770 2024-09-13T19:33:29.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 20 remove_watcher() i=7 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f63614e770 msgr2=0x55f636150b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f63614e770 0x55f636150b60 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f636149d10 msgr2=0x55f63614c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f636149d10 0x55f63614c1b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f23c8027020 msgr2=0x7f23c80410d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f23c8027020 0x7f23c80410d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6361530e0 msgr2=0x55f636155550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6361530e0 0x55f636155550 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22a8034600 msgr2=0x7f22a8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22a8034600 0x7f22a8036ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23c80486a0 tx=0x7f23c8035000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 msgr2=0x55f63613e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23d7b67640 1 -- 172.21.15.144:0/2890598743 reap_dead start 2024-09-13T19:33:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f63613e860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f23d00237c0 tx=0x7f23d004a2f0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 shutdown_connections 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/2890598743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f636137520 0x55f63613e860 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 >> 172.21.15.144:0/2890598743 conn(0x55f636133900 msgr2=0x55f6361319d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 shutdown_connections 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/2890598743 wait complete. 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1983149157 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22b0034650 msgr2=0x7f22b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1983149157 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22b0034650 0x7f22b0036b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55f636022be0 tx=0x7f23c8033040 comp rx=0 tx=0).stop 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1983149157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63612aa80 msgr2=0x55f63612aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1983149157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63612aa80 0x55f63612aea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f636023310 tx=0x7f23d000af40 comp rx=0 tx=0).stop 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1983149157 shutdown_connections 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1983149157 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22b0034650 0x7f22b0036b10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1983149157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63612aa80 0x55f63612aea0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1983149157 >> 172.21.15.144:0/1983149157 conn(0x55f63611fbd0 msgr2=0x55f636122650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1983149157 shutdown_connections 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1983149157 wait complete. 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6361198e0 msgr2=0x55f63611bcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6361198e0 0x55f63611bcd0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f63601e900 msgr2=0x55f636117210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f63601e900 0x55f636117210 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22c0034650 msgr2=0x7f22c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22c0034650 0x7f22c0036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f23c00ae000 tx=0x7f23c00a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 msgr2=0x55f636023ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636023ce0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f23c8006640 tx=0x7f23c8000f50 comp rx=0 tx=0).stop 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 shutdown_connections 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f63601e900 0x55f636117210 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6361198e0 0x55f63611bcd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f22c0034650 0x7f22c0036b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 --2- 172.21.15.144:0/1608574037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f63601a580 0x55f636023ce0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 >> 172.21.15.144:0/1608574037 conn(0x55f6360160a0 msgr2=0x55f636101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 shutdown_connections 2024-09-13T19:33:29.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.615+0000 7f23da858980 1 -- 172.21.15.144:0/1608574037 wait complete. 2024-09-13T19:33:29.629 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'kC4GujrEp89CdzzLprqPVnlTwFdDC9uSrJ1WaODD', 'active': True, 'create_date': '2024-09-13T19:33:29.600068Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:29.629 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T19:33:29.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T19:33:29.629 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-13T19:33:29.713 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:29.713 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:29.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73ffd1980 1 Processor -- start 2024-09-13T19:33:29.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73ffd1980 1 -- start start 2024-09-13T19:33:29.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73ffd1980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5606adc24c00 0x5606adc26ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73ffd1980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606adaa6ae0 con 0x5606adc20880 2024-09-13T19:33:29.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73ffd1980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5606adacae30 con 0x5606adc24c00 2024-09-13T19:33:29.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73d2e0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5606adc24c00 0x5606adc26ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73d2e0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5606adc24c00 0x5606adc26ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56666/0 (socket says 172.21.15.144:56666) 2024-09-13T19:33:29.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73d2e0640 1 -- 172.21.15.144:0/170583343 learned_addr learned my addr 172.21.15.144:0/170583343 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73dae1640 1 --1- 172.21.15.144:0/170583343 >> v1:172.21.15.18:6789/0 conn(0x5606adc20880 0x5606adc20c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44442/0 (socket says 172.21.15.144:44442) 2024-09-13T19:33:29.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73d2e0640 1 -- 172.21.15.144:0/170583343 >> v1:172.21.15.18:6789/0 conn(0x5606adc20880 legacy=0x5606adc20c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.711+0000 7fc73d2e0640 1 -- 172.21.15.144:0/170583343 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606adc28540 con 0x5606adc24c00 2024-09-13T19:33:29.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73d2e0640 1 --2- 172.21.15.144:0/170583343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc24c00 0x5606adc26ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc73000a4e0 tx=0x7fc73001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e058dab1d19bc411 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73cadf640 1 -- 172.21.15.144:0/170583343 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7300aa540 con 0x5606adc24c00 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73cadf640 1 -- 172.21.15.144:0/170583343 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7300aa6e0 con 0x5606adc24c00 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73cadf640 1 -- 172.21.15.144:0/170583343 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7300aaa40 con 0x5606adc24c00 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73ffd1980 1 -- 172.21.15.144:0/170583343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc24c00 msgr2=0x5606adc26ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/170583343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc24c00 0x5606adc26ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc73000a4e0 tx=0x7fc73001b090 comp rx=0 tx=0).stop 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73ffd1980 1 -- 172.21.15.144:0/170583343 shutdown_connections 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/170583343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc24c00 0x5606adc26ff0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73ffd1980 1 -- 172.21.15.144:0/170583343 >> 172.21.15.144:0/170583343 conn(0x5606adb941d0 msgr2=0x5606adb945e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73ffd1980 1 -- 172.21.15.144:0/170583343 shutdown_connections 2024-09-13T19:33:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.715+0000 7fc73ffd1980 1 -- 172.21.15.144:0/170583343 wait complete. 2024-09-13T19:33:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.727+0000 7fc73ffd1980 1 Processor -- start 2024-09-13T19:33:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.727+0000 7fc73ffd1980 1 -- start start 2024-09-13T19:33:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.727+0000 7fc73ffd1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add0bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.727+0000 7fc73ffd1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606adacc200 con 0x5606adc20880 2024-09-13T19:33:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add0bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add0bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56672/0 (socket says 172.21.15.144:56672) 2024-09-13T19:33:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 -- 172.21.15.144:0/676433595 learned_addr learned my addr 172.21.15.144:0/676433595 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 -- 172.21.15.144:0/676433595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606add0c230 con 0x5606adc20880 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 --2- 172.21.15.144:0/676433595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add0bc60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc734001e50 tx=0x7fc734001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991ef89f1c3275c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc62be07640 1 -- 172.21.15.144:0/676433595 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73400e5d0 con 0x5606adc20880 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc62be07640 1 -- 172.21.15.144:0/676433595 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73400e770 con 0x5606adc20880 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc62be07640 1 -- 172.21.15.144:0/676433595 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73400eab0 con 0x5606adc20880 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 -- 172.21.15.144:0/676433595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 msgr2=0x5606add0bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/676433595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add0bc60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc734001e50 tx=0x7fc734001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 -- 172.21.15.144:0/676433595 shutdown_connections 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/676433595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add0bc60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 -- 172.21.15.144:0/676433595 >> 172.21.15.144:0/676433595 conn(0x5606adb941d0 msgr2=0x5606add07890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 -- 172.21.15.144:0/676433595 shutdown_connections 2024-09-13T19:33:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 -- 172.21.15.144:0/676433595 wait complete. 2024-09-13T19:33:29.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 Processor -- start 2024-09-13T19:33:29.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 -- start start 2024-09-13T19:33:29.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add13050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73ffd1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606adc28040 con 0x5606adc20880 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add13050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add13050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56688/0 (socket says 172.21.15.144:56688) 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 -- 172.21.15.144:0/3587694478 learned_addr learned my addr 172.21.15.144:0/3587694478 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 -- 172.21.15.144:0/3587694478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606add13590 con 0x5606adc20880 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.731+0000 7fc73dae1640 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add13050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5606add0ce40 tx=0x7fc734000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc62a604640 1 -- 172.21.15.144:0/3587694478 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc734001260 con 0x5606adc20880 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606add13820 con 0x5606adc20880 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc62a604640 1 -- 172.21.15.144:0/3587694478 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73400fa40 con 0x5606adc20880 2024-09-13T19:33:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc62a604640 1 -- 172.21.15.144:0/3587694478 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73402c060 con 0x5606adc20880 2024-09-13T19:33:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606add16500 con 0x5606adc20880 2024-09-13T19:33:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc62a604640 1 -- 172.21.15.144:0/3587694478 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc734017070 con 0x5606adc20880 2024-09-13T19:33:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc62a604640 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc624034650 0x7fc624036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc62a604640 1 -- 172.21.15.144:0/3587694478 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc734015020 con 0x5606adc20880 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73d2e0640 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc624034650 0x7fc624036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606adc24c00 0x5606add1a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add1a6b0 con 0x5606adc24c00 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73e2e2640 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606adc24c00 0x5606add1a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73d2e0640 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc624034650 0x7fc624036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc7300ab000 tx=0x7fc7300a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73e2e2640 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606adc24c00 0x5606add1a040 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73e2e2640 1 -- 172.21.15.144:0/3587694478 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7380083f0 con 0x5606adc24c00 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add17720 con 0x5606adc24c00 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73e2e2640 1 -- 172.21.15.144:0/3587694478 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7380083f0 con 0x5606adc24c00 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add1c9e0 0x5606add1edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add1f4a0 con 0x5606add1c9e0 2024-09-13T19:33:29.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.735+0000 7fc73dae1640 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add1c9e0 0x5606add1edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73dae1640 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add1c9e0 0x5606add1edd0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73dae1640 1 -- 172.21.15.144:0/3587694478 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc73402e070 con 0x5606add1c9e0 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add1b880 con 0x5606adc24c00 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73e2e2640 1 -- 172.21.15.144:0/3587694478 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7380083f0 con 0x5606adc24c00 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add1bd60 con 0x5606adc24c00 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73e2e2640 1 -- 172.21.15.144:0/3587694478 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7380083f0 con 0x5606adc24c00 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73ffd1980 1 Processor -- start 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73ffd1980 1 -- start start 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73ffd1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add2db80 0x5606add2dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73ffd1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606adb25800 con 0x5606add2db80 2024-09-13T19:33:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73e2e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add2db80 0x5606add2dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73e2e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add2db80 0x5606add2dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56698/0 (socket says 172.21.15.144:56698) 2024-09-13T19:33:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73e2e2640 1 -- 172.21.15.144:0/1545577456 learned_addr learned my addr 172.21.15.144:0/1545577456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73e2e2640 1 -- 172.21.15.144:0/1545577456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606add2e4e0 con 0x5606add2db80 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73e2e2640 1 --2- 172.21.15.144:0/1545577456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add2db80 0x5606add2dfa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5606add1aa90 tx=0x7fc73800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc6237fe640 1 -- 172.21.15.144:0/1545577456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738007e00 con 0x5606add2db80 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73ffd1980 1 -- 172.21.15.144:0/1545577456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606add2e770 con 0x5606add2db80 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc6237fe640 1 -- 172.21.15.144:0/1545577456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73801e020 con 0x5606add2db80 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc6237fe640 1 -- 172.21.15.144:0/1545577456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738019590 con 0x5606add2db80 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.739+0000 7fc73ffd1980 1 -- 172.21.15.144:0/1545577456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606add313f0 con 0x5606add2db80 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc6237fe640 1 -- 172.21.15.144:0/1545577456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc738016040 con 0x5606add2db80 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc6237fe640 1 --2- 172.21.15.144:0/1545577456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc618034650 0x7fc618036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc6237fe640 1 -- 172.21.15.144:0/1545577456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc73801f030 con 0x5606add2db80 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73dae1640 1 --2- 172.21.15.144:0/1545577456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc618034650 0x7fc618036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 Processor -- start 2024-09-13T19:33:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- start start 2024-09-13T19:33:29.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73dae1640 1 --2- 172.21.15.144:0/1545577456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc618034650 0x7fc618036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5606add1ab30 tx=0x7fc734048e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606add0c5b0 con 0x5606add3a700 2024-09-13T19:33:29.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73e2e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73e2e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add3ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56706/0 (socket says 172.21.15.144:56706) 2024-09-13T19:33:29.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73e2e2640 1 -- 172.21.15.144:0/2232921888 learned_addr learned my addr 172.21.15.144:0/2232921888 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73e2e2640 1 -- 172.21.15.144:0/2232921888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606add3b0d0 con 0x5606add3a700 2024-09-13T19:33:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73e2e2640 1 --2- 172.21.15.144:0/2232921888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add3ab00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc73804a390 tx=0x7fc7380234b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437449bc0159d022 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc6217fa640 1 -- 172.21.15.144:0/2232921888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738047040 con 0x5606add3a700 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc6217fa640 1 -- 172.21.15.144:0/2232921888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738019d80 con 0x5606add3a700 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc6217fa640 1 -- 172.21.15.144:0/2232921888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73801d040 con 0x5606add3a700 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- 172.21.15.144:0/2232921888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 msgr2=0x5606add3ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/2232921888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add3ab00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc73804a390 tx=0x7fc7380234b0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- 172.21.15.144:0/2232921888 shutdown_connections 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/2232921888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add3ab00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- 172.21.15.144:0/2232921888 >> 172.21.15.144:0/2232921888 conn(0x5606add36a80 msgr2=0x5606add34b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- 172.21.15.144:0/2232921888 shutdown_connections 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- 172.21.15.144:0/2232921888 wait complete. 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 Processor -- start 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- start start 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.743+0000 7fc73ffd1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606add3b610 con 0x5606add3a700 2024-09-13T19:33:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73e2e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73e2e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56716/0 (socket says 172.21.15.144:56716) 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 learned_addr learned my addr 172.21.15.144:0/230578020 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606add41f20 con 0x5606add3a700 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73e2e2640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add419e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc7380234f0 tx=0x7fc73804a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc60f7fe640 1 -- 172.21.15.144:0/230578020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73801d070 con 0x5606add3a700 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606add421b0 con 0x5606add3a700 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc60f7fe640 1 -- 172.21.15.144:0/230578020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738018b90 con 0x5606add3a700 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc60f7fe640 1 -- 172.21.15.144:0/230578020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc738032040 con 0x5606add3a700 2024-09-13T19:33:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606add425c0 con 0x5606add3a700 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc60f7fe640 1 -- 172.21.15.144:0/230578020 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc73802b350 con 0x5606add3a700 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc60f7fe640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc608034620 0x7fc608036ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc60f7fe640 1 -- 172.21.15.144:0/230578020 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc738040030 con 0x5606add3a700 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73dae1640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc608034620 0x7fc608036ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606add4cea0 0x5606add4f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add4fa80 con 0x5606add4cea0 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73d2e0640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606add4cea0 0x5606add4f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73dae1640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc608034620 0x7fc608036ae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc734027820 tx=0x7fc734036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73d2e0640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606add4cea0 0x5606add4f330 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 20 realm 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add4feb0 con 0x5606add4cea0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.747+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add50780 con 0x5606add4cea0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add50b20 con 0x5606add4cea0 2024-09-13T19:33:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add51880 0x5606add53c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add54280 con 0x5606add51880 2024-09-13T19:33:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73e2e2640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add51880 0x5606add53c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73e2e2640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add51880 0x5606add53c70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 20 searching for the correct realm 2024-09-13T19:33:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5606add561d0 0x5606add58600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add561d0 2024-09-13T19:33:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73dae1640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5606add561d0 0x5606add58600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73dae1640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5606add561d0 0x5606add58600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73dae1640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc734027890 0x7fc73401d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x7fc734027890 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73d2e0640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc734027890 0x7fc73401d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73d2e0640 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc734027890 0x7fc73401d5f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.751+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add51880 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add4cea0 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add4cea0 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add51880 2024-09-13T19:33:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add51880 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x7fc734027890 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add561d0 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add4cea0 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add51880 2024-09-13T19:33:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add4cea0 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x7fc734027890 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add561d0 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.755+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add561d0 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add51880 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add561d0 2024-09-13T19:33:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606add58cd0 con 0x5606add561d0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add4cea0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add4cea0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add51880 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add561d0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x7fc734027890 2024-09-13T19:33:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add4cea0 2024-09-13T19:33:29.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.759+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add51880 2024-09-13T19:33:29.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add561d0 2024-09-13T19:33:29.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add51880 2024-09-13T19:33:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x7fc734027890 2024-09-13T19:33:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add561d0 2024-09-13T19:33:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add51880 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x5606add4cea0 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc734061040 con 0x7fc734027890 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add54c40 con 0x5606add4cea0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add54850 con 0x5606add4cea0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add548a0 con 0x5606add4cea0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 zone default found 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 4 Realm: () 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 zonegroup default 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.763+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add59150 con 0x5606add51880 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add5af00 con 0x5606add561d0 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add5b370 con 0x5606add561d0 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 20 started sync module instance, tier type = 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5a370 con 0x7fc734027890 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94586686253168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5a370 con 0x7fc734027890 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5bed0 con 0x5606add4cea0 2024-09-13T19:33:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94586686253168] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94586686257568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5a370 con 0x5606add4cea0 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.767+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5c8e0 con 0x5606add561d0 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94586686260272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5d180 con 0x5606add561d0 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5db40 con 0x7fc734027890 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94586686257568] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94586686264976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5dab0 con 0x7fc734027890 2024-09-13T19:33:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5e890 con 0x5606add4cea0 2024-09-13T19:33:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94586686260272] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.771+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94586686264976] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.775+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.775+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94586686262480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5e350 con 0x5606add4cea0 2024-09-13T19:33:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.775+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5ebe0 con 0x5606add51880 2024-09-13T19:33:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.775+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94586686262480] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.775+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.775+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94586686267312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5efd0 con 0x5606add51880 2024-09-13T19:33:29.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.775+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5f990 con 0x5606add51880 2024-09-13T19:33:29.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94586686272736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5fdb0 con 0x5606add51880 2024-09-13T19:33:29.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add60880 con 0x5606add51880 2024-09-13T19:33:29.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94586686267312] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94586686276464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add60840 con 0x5606add51880 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 20 add_watcher() i=0 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 20 add_watcher() i=1 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 20 add_watcher() i=2 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 20 add_watcher() i=3 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 20 add_watcher() i=4 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 20 add_watcher() i=5 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94586686272736] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.779+0000 7fc73ffd1980 20 add_watcher() i=6 2024-09-13T19:33:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94586686276464] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 20 add_watcher() i=7 2024-09-13T19:33:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add5f900 con 0x5606add4cea0 2024-09-13T19:33:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94586686273792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add60ca0 con 0x5606add4cea0 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94586686273792] v30'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc5ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 5 note: GC not initialized 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc5ee7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 20 Filter name: none 2024-09-13T19:33:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc55ffff640 20 reqs_thread_entry: start 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add86df0 con 0x5606add4cea0 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.783+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add8d5a0 con 0x5606add4cea0 2024-09-13T19:33:29.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:29.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:29.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94586686459920 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606add88c70 con 0x5606add4cea0 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94586686262480 notify 128849018886 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5606adc28540 con 0x5606add4cea0 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc6217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94586686262480 notifier 4363 bl.length()=732 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc6217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc6217fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc6217fa640 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc600003eb0 con 0x5606add4cea0 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(64 notify.4 [notify cookie 94586686459920 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94586686459920 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc7300cd9f0 con 0x5606add4cea0 2024-09-13T19:33:29.790 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc5ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94586686273792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add887c0 con 0x5606add4cea0 2024-09-13T19:33:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94586686273792] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94586686253168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add84be0 con 0x7fc734027890 2024-09-13T19:33:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94586686253168] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 20 remove_watcher() i=0 2024-09-13T19:33:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 2 removed watcher, disabling cache 2024-09-13T19:33:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.787+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94586686257568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add84be0 con 0x5606add4cea0 2024-09-13T19:33:29.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.791+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94586686257568] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.791+0000 7fc73ffd1980 20 remove_watcher() i=1 2024-09-13T19:33:29.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.791+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94586686260272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5b9a0 con 0x5606add561d0 2024-09-13T19:33:29.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.791+0000 7fc73dae1640 1 -- 172.21.15.144:0/230578020 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94586686260272] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73402e070 con 0x5606add561d0 2024-09-13T19:33:29.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.791+0000 7fc73ffd1980 20 remove_watcher() i=2 2024-09-13T19:33:29.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.791+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94586686264976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add84be0 con 0x7fc734027890 2024-09-13T19:33:29.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.795+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94586686264976] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x7fc734027890 2024-09-13T19:33:29.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.795+0000 7fc73ffd1980 20 remove_watcher() i=3 2024-09-13T19:33:29.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.795+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94586686262480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5c430 con 0x5606add4cea0 2024-09-13T19:33:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.795+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94586686262480] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7300bc040 con 0x5606add4cea0 2024-09-13T19:33:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.795+0000 7fc73ffd1980 20 remove_watcher() i=4 2024-09-13T19:33:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.795+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94586686267312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5d690 con 0x5606add51880 2024-09-13T19:33:29.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.799+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94586686267312] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.799+0000 7fc73ffd1980 20 remove_watcher() i=5 2024-09-13T19:33:29.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.799+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94586686272736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add84be0 con 0x5606add51880 2024-09-13T19:33:29.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.799+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94586686272736] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.799+0000 7fc73ffd1980 20 remove_watcher() i=6 2024-09-13T19:33:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.799+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94586686276464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606add5f990 con 0x5606add51880 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73e2e2640 1 -- 172.21.15.144:0/230578020 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94586686276464] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc73805d040 con 0x5606add51880 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 20 remove_watcher() i=7 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add51880 msgr2=0x5606add53c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add51880 0x5606add53c70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606add4cea0 msgr2=0x5606add4f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606add4cea0 0x5606add4f330 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc734027890 msgr2=0x7fc73401d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc734027890 0x7fc73401d5f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5606add561d0 msgr2=0x5606add58600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5606add561d0 0x5606add58600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc608034620 msgr2=0x7fc608036ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc608034620 0x7fc608036ae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc734027820 tx=0x7fc734036000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 msgr2=0x5606add419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73d2e0640 1 -- 172.21.15.144:0/230578020 reap_dead start 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add419e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc7380234f0 tx=0x7fc73804a2f0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 shutdown_connections 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/230578020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add3a700 0x5606add419e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 >> 172.21.15.144:0/230578020 conn(0x5606add36a80 msgr2=0x5606add34b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 shutdown_connections 2024-09-13T19:33:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/230578020 wait complete. 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/1545577456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc618034650 msgr2=0x7fc618036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/1545577456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc618034650 0x7fc618036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5606add1ab30 tx=0x7fc734048e00 comp rx=0 tx=0).stop 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/1545577456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add2db80 msgr2=0x5606add2dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/1545577456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add2db80 0x5606add2dfa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5606add1aa90 tx=0x7fc73800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/1545577456 shutdown_connections 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/1545577456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc618034650 0x7fc618036b10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/1545577456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606add2db80 0x5606add2dfa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/1545577456 >> 172.21.15.144:0/1545577456 conn(0x5606add22cd0 msgr2=0x5606add25750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/1545577456 shutdown_connections 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/1545577456 wait complete. 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add1c9e0 msgr2=0x5606add1edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add1c9e0 0x5606add1edd0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606adc24c00 msgr2=0x5606add1a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606adc24c00 0x5606add1a040 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc624034650 msgr2=0x7fc624036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc624034650 0x7fc624036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc7300ab000 tx=0x7fc7300a5000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 msgr2=0x5606add13050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add13050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5606add0ce40 tx=0x7fc734000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 shutdown_connections 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5606adc24c00 0x5606add1a040 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5606add1c9e0 0x5606add1edd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc624034650 0x7fc624036b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 --2- 172.21.15.144:0/3587694478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606adc20880 0x5606add13050 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 >> 172.21.15.144:0/3587694478 conn(0x5606adb941d0 msgr2=0x5606add06410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 shutdown_connections 2024-09-13T19:33:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.803+0000 7fc73ffd1980 1 -- 172.21.15.144:0/3587694478 wait complete. 2024-09-13T19:33:29.815 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:29.816 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:33:29.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:33:29.816 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:33:29.884 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:29.885 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:29.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f2904d3d980 1 Processor -- start 2024-09-13T19:33:29.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f2904d3d980 1 -- start start 2024-09-13T19:33:29.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f2904d3d980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b30f292ac0 0x55b30f294eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f2904d3d980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b30f116ae0 con 0x55b30f203290 2024-09-13T19:33:29.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f2904d3d980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55b30f13ae30 con 0x55b30f292ac0 2024-09-13T19:33:29.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f290204c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b30f292ac0 0x55b30f294eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f290284d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55b30f203290 0x55b30f2913a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44450/0 (socket says 172.21.15.144:44450) 2024-09-13T19:33:29.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f290284d640 1 -- 172.21.15.144:0/2960726609 learned_addr learned my addr 172.21.15.144:0/2960726609 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:29.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f290204c640 1 -- 172.21.15.144:0/2960726609 >> v1:172.21.15.18:6789/0 conn(0x55b30f203290 legacy=0x55b30f2913a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.883+0000 7f290204c640 1 -- 172.21.15.144:0/2960726609 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30f203820 con 0x55b30f292ac0 2024-09-13T19:33:29.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f290204c640 1 --2- 172.21.15.144:0/2960726609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f292ac0 0x55b30f294eb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f28f800a480 tx=0x7f28f801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d008da16aa3570e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f290184b640 1 -- 172.21.15.144:0/2960726609 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f80b0070 con 0x55b30f292ac0 2024-09-13T19:33:29.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f290184b640 1 -- 172.21.15.144:0/2960726609 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f80ab540 con 0x55b30f292ac0 2024-09-13T19:33:29.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f290184b640 1 -- 172.21.15.144:0/2960726609 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f80ab840 con 0x55b30f292ac0 2024-09-13T19:33:29.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f2904d3d980 1 -- 172.21.15.144:0/2960726609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f292ac0 msgr2=0x55b30f294eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f2904d3d980 1 --2- 172.21.15.144:0/2960726609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f292ac0 0x55b30f294eb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f28f800a480 tx=0x7f28f801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:29.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f2904d3d980 1 -- 172.21.15.144:0/2960726609 shutdown_connections 2024-09-13T19:33:29.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f2904d3d980 1 --2- 172.21.15.144:0/2960726609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f292ac0 0x55b30f294eb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f2904d3d980 1 -- 172.21.15.144:0/2960726609 >> 172.21.15.144:0/2960726609 conn(0x55b30f289090 msgr2=0x55b30f28b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f2904d3d980 1 -- 172.21.15.144:0/2960726609 shutdown_connections 2024-09-13T19:33:29.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.887+0000 7f2904d3d980 1 -- 172.21.15.144:0/2960726609 wait complete. 2024-09-13T19:33:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.899+0000 7f2904d3d980 1 Processor -- start 2024-09-13T19:33:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.899+0000 7f2904d3d980 1 -- start start 2024-09-13T19:33:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.899+0000 7f2904d3d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f379b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.899+0000 7f2904d3d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b30f13c200 con 0x55b30f203290 2024-09-13T19:33:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.899+0000 7f290284d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f379b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.899+0000 7f290284d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f379b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56726/0 (socket says 172.21.15.144:56726) 2024-09-13T19:33:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.899+0000 7f290284d640 1 -- 172.21.15.144:0/28335242 learned_addr learned my addr 172.21.15.144:0/28335242 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.899+0000 7f290284d640 1 -- 172.21.15.144:0/28335242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30f37a130 con 0x55b30f203290 2024-09-13T19:33:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f290284d640 1 --2- 172.21.15.144:0/28335242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f379b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28f40015f0 tx=0x7f28f4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c84c54d6f587247 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f27f0e09640 1 -- 172.21.15.144:0/28335242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f4004530 con 0x55b30f203290 2024-09-13T19:33:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f27f0e09640 1 -- 172.21.15.144:0/28335242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f40046f0 con 0x55b30f203290 2024-09-13T19:33:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f27f0e09640 1 -- 172.21.15.144:0/28335242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f4004a90 con 0x55b30f203290 2024-09-13T19:33:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- 172.21.15.144:0/28335242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 msgr2=0x55b30f379b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 --2- 172.21.15.144:0/28335242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f379b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28f40015f0 tx=0x7f28f4001ab0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- 172.21.15.144:0/28335242 shutdown_connections 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 --2- 172.21.15.144:0/28335242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f379b60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- 172.21.15.144:0/28335242 >> 172.21.15.144:0/28335242 conn(0x55b30f289090 msgr2=0x55b30f3756f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- 172.21.15.144:0/28335242 shutdown_connections 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- 172.21.15.144:0/28335242 wait complete. 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 Processor -- start 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- start start 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f380eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b30f295f00 con 0x55b30f203290 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f290284d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f380eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f290284d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f380eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56732/0 (socket says 172.21.15.144:56732) 2024-09-13T19:33:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f290284d640 1 -- 172.21.15.144:0/3947107269 learned_addr learned my addr 172.21.15.144:0/3947107269 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f290284d640 1 -- 172.21.15.144:0/3947107269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30f3813f0 con 0x55b30f203290 2024-09-13T19:33:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f290284d640 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f380eb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55b30f37ad40 tx=0x7f28f4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f27ef606640 1 -- 172.21.15.144:0/3947107269 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f4013760 con 0x55b30f203290 2024-09-13T19:33:29.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b30f381680 con 0x55b30f203290 2024-09-13T19:33:29.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f27ef606640 1 -- 172.21.15.144:0/3947107269 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f4013900 con 0x55b30f203290 2024-09-13T19:33:29.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f27ef606640 1 -- 172.21.15.144:0/3947107269 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f4013be0 con 0x55b30f203290 2024-09-13T19:33:29.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.903+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b30f384360 con 0x55b30f203290 2024-09-13T19:33:29.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f27ef606640 1 -- 172.21.15.144:0/3947107269 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f28f4010070 con 0x55b30f203290 2024-09-13T19:33:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f27ef606640 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27e8034650 0x7f27e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f27ef606640 1 -- 172.21.15.144:0/3947107269 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f28f4018070 con 0x55b30f203290 2024-09-13T19:33:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290204c640 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27e8034650 0x7f27e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f385e30 0x55b30f388280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3888f0 con 0x55b30f385e30 2024-09-13T19:33:29.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290304e640 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f385e30 0x55b30f388280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290204c640 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27e8034650 0x7f27e8036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ad000 tx=0x7f28f80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290304e640 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f385e30 0x55b30f388280 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290304e640 1 -- 172.21.15.144:0/3947107269 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28fc0083f0 con 0x55b30f385e30 2024-09-13T19:33:29.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f385560 con 0x55b30f385e30 2024-09-13T19:33:29.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290304e640 1 -- 172.21.15.144:0/3947107269 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28fc0083f0 con 0x55b30f385e30 2024-09-13T19:33:29.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f38ac20 0x55b30f38d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f38d6e0 con 0x55b30f38ac20 2024-09-13T19:33:29.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290284d640 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f38ac20 0x55b30f38d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290284d640 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f38ac20 0x55b30f38d010 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f290284d640 1 -- 172.21.15.144:0/3947107269 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f38ac20 2024-09-13T19:33:29.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.907+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f389ac0 con 0x55b30f385e30 2024-09-13T19:33:29.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f290304e640 1 -- 172.21.15.144:0/3947107269 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28fc0083f0 con 0x55b30f385e30 2024-09-13T19:33:29.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f389fa0 con 0x55b30f385e30 2024-09-13T19:33:29.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f290304e640 1 -- 172.21.15.144:0/3947107269 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f28fc0083f0 con 0x55b30f385e30 2024-09-13T19:33:29.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f2904d3d980 1 Processor -- start 2024-09-13T19:33:29.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f2904d3d980 1 -- start start 2024-09-13T19:33:29.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f2904d3d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f39bdc0 0x55b30f39c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f2904d3d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b30f195800 con 0x55b30f39bdc0 2024-09-13T19:33:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f290304e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f39bdc0 0x55b30f39c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f290304e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f39bdc0 0x55b30f39c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56748/0 (socket says 172.21.15.144:56748) 2024-09-13T19:33:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f290304e640 1 -- 172.21.15.144:0/3621216025 learned_addr learned my addr 172.21.15.144:0/3621216025 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f290304e640 1 -- 172.21.15.144:0/3621216025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30f39c720 con 0x55b30f39bdc0 2024-09-13T19:33:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f290304e640 1 --2- 172.21.15.144:0/3621216025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f39bdc0 0x55b30f39c1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55b30f388cf0 tx=0x7f28fc00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f27ece01640 1 -- 172.21.15.144:0/3621216025 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28fc007e00 con 0x55b30f39bdc0 2024-09-13T19:33:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f2904d3d980 1 -- 172.21.15.144:0/3621216025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b30f39c9b0 con 0x55b30f39bdc0 2024-09-13T19:33:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f27ece01640 1 -- 172.21.15.144:0/3621216025 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28fc01e020 con 0x55b30f39bdc0 2024-09-13T19:33:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f27ece01640 1 -- 172.21.15.144:0/3621216025 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28fc019590 con 0x55b30f39bdc0 2024-09-13T19:33:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f2904d3d980 1 -- 172.21.15.144:0/3621216025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b30f39f630 con 0x55b30f39bdc0 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.911+0000 7f27ece01640 1 -- 172.21.15.144:0/3621216025 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f28fc016040 con 0x55b30f39bdc0 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f27ece01640 1 --2- 172.21.15.144:0/3621216025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27dc034650 0x7f27dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f27ece01640 1 -- 172.21.15.144:0/3621216025 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f28fc01f030 con 0x55b30f39bdc0 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290284d640 1 --2- 172.21.15.144:0/3621216025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27dc034650 0x7f27dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 Processor -- start 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- start start 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290284d640 1 --2- 172.21.15.144:0/3621216025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27dc034650 0x7f27dc036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55b30f388d90 tx=0x7f28f402af00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f3a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b30f37a4b0 con 0x55b30f3a8940 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f3a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f3a8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56752/0 (socket says 172.21.15.144:56752) 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 -- 172.21.15.144:0/2616187724 learned_addr learned my addr 172.21.15.144:0/2616187724 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 -- 172.21.15.144:0/2616187724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30f3a9310 con 0x55b30f3a8940 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 --2- 172.21.15.144:0/2616187724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f3a8d40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f28fc04a390 tx=0x7f28fc0236b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c434dbb7c3bb8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f27e67fc640 1 -- 172.21.15.144:0/2616187724 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28fc047040 con 0x55b30f3a8940 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f27e67fc640 1 -- 172.21.15.144:0/2616187724 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28fc022ca0 con 0x55b30f3a8940 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f27e67fc640 1 -- 172.21.15.144:0/2616187724 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28fc01d040 con 0x55b30f3a8940 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- 172.21.15.144:0/2616187724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 msgr2=0x55b30f3a8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 --2- 172.21.15.144:0/2616187724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f3a8d40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f28fc04a390 tx=0x7f28fc0236b0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- 172.21.15.144:0/2616187724 shutdown_connections 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 --2- 172.21.15.144:0/2616187724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f3a8d40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- 172.21.15.144:0/2616187724 >> 172.21.15.144:0/2616187724 conn(0x55b30f3a4cc0 msgr2=0x55b30f3a2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- 172.21.15.144:0/2616187724 shutdown_connections 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- 172.21.15.144:0/2616187724 wait complete. 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 Processor -- start 2024-09-13T19:33:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- start start 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f28ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f2904d3d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b30f3a9850 con 0x55b30f3a8940 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f28ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f28ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56764/0 (socket says 172.21.15.144:56764) 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 learned_addr learned my addr 172.21.15.144:0/3970471128 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.915+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30f28f1a0 con 0x55b30f3a8940 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290304e640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f28ec60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28fc02bfd0 tx=0x7f28fc04a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f27e4ff9640 1 -- 172.21.15.144:0/3970471128 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28fc01d070 con 0x55b30f3a8940 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b30f28d380 con 0x55b30f3a8940 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f27e4ff9640 1 -- 172.21.15.144:0/3970471128 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28fc02b350 con 0x55b30f3a8940 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f27e4ff9640 1 -- 172.21.15.144:0/3970471128 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28fc032040 con 0x55b30f3a8940 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b30f28d7f0 con 0x55b30f3a8940 2024-09-13T19:33:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f27e4ff9640 1 -- 172.21.15.144:0/3970471128 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f28fc02b630 con 0x55b30f3a8940 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f27e4ff9640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27cc034650 0x7f27cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f27e4ff9640 1 -- 172.21.15.144:0/3970471128 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f28fc040030 con 0x55b30f3a8940 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290284d640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27cc034650 0x7f27cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f3bd280 0x55b30f3bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3bfe70 con 0x55b30f3bd280 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290204c640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f3bd280 0x55b30f3bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290284d640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27cc034650 0x7f27cc036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f28f404afd0 tx=0x7f28f4036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290204c640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f3bd280 0x55b30f3bf720 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 realm 2024-09-13T19:33:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c02a0 con 0x55b30f3bd280 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c0b40 con 0x55b30f3bd280 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c0ee0 con 0x55b30f3bd280 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f3c1c40 0x55b30f3c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.919+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c4570 con 0x55b30f3c1c40 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290304e640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f3c1c40 0x55b30f3c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290304e640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f3c1c40 0x55b30f3c4030 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f2904d3d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f2904d3d980 20 searching for the correct realm 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b30f3c64e0 0x55b30f3c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290284d640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b30f3c64e0 0x55b30f3c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290284d640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b30f3c64e0 0x55b30f3c89a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290284d640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f28f40287f0 0x7f28f4048790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x7f28f40287f0 2024-09-13T19:33:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290204c640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f28f40287f0 0x7f28f4048790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290204c640 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f28f40287f0 0x7f28f4048790 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3bd280 2024-09-13T19:33:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3bd280 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.923+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x7f28f40287f0 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3bd280 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3bd280 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x7f28f40287f0 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.927+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3bd280 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3bd280 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x7f28f40287f0 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3bd280 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.931+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x7f28f40287f0 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c64e0 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3c1c40 2024-09-13T19:33:29.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x55b30f3bd280 2024-09-13T19:33:29.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9070 con 0x7f28f40287f0 2024-09-13T19:33:29.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c4ec0 con 0x55b30f3bd280 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c52b0 con 0x55b30f3bd280 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c52b0 con 0x55b30f3bd280 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 zone default found 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 4 Realm: () 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 zonegroup default 2024-09-13T19:33:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c4a10 con 0x55b30f3c1c40 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3caed0 con 0x55b30f3c64e0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cb270 con 0x55b30f3c64e0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 started sync module instance, tier type = 2024-09-13T19:33:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.935+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ca370 con 0x7f28f40287f0 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.939+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.939+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94227543140512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ca370 con 0x7f28f40287f0 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.939+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cbc30 con 0x55b30f3bd280 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.939+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94227543140512] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.939+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.939+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94227543144592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ca370 con 0x55b30f3bd280 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.939+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cc640 con 0x55b30f3c64e0 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94227543146896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cce90 con 0x55b30f3c64e0 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cd850 con 0x7f28f40287f0 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94227543144592] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94227543137984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cd850 con 0x7f28f40287f0 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ce210 con 0x55b30f3bd280 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94227543146896] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94227543137984] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94227543151520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ccaf0 con 0x55b30f3bd280 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.943+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ce6c0 con 0x55b30f3c1c40 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.947+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94227543151520] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.947+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.947+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94227543154016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cea60 con 0x55b30f3c1c40 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.947+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cf2b0 con 0x55b30f3c1c40 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.947+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.947+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94227543157616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cf680 con 0x55b30f3c1c40 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.947+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3d01a0 con 0x55b30f3c1c40 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94227543154016] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94227543157616] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94227543161968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cf0d0 con 0x55b30f3c1c40 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 20 add_watcher() i=0 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 20 add_watcher() i=1 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 20 add_watcher() i=2 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 20 add_watcher() i=3 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 20 add_watcher() i=4 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 20 add_watcher() i=5 2024-09-13T19:33:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 20 add_watcher() i=6 2024-09-13T19:33:29.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94227543161968] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 20 add_watcher() i=7 2024-09-13T19:33:29.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3d3190 con 0x55b30f3bd280 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.951+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94227543155072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3d0610 con 0x55b30f3bd280 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94227543155072] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f27b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 5 note: GC not initialized 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2733fff640 20 reqs_thread_entry: start 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 20 Filter name: none 2024-09-13T19:33:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2731ffb640 20 reqs_thread_entry: start 2024-09-13T19:33:29.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:29.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3f6220 con 0x55b30f3bd280 2024-09-13T19:33:29.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:33:29.964 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f27b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94227543155072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3f4dd0 con 0x55b30f3bd280 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.955+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94227543155072] v30'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.959+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94227543140512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ce180 con 0x7f28f40287f0 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.959+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94227543140512] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.959+0000 7f2904d3d980 20 remove_watcher() i=0 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.959+0000 7f2904d3d980 2 removed watcher, disabling cache 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.959+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94227543144592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ca8a0 con 0x55b30f3bd280 2024-09-13T19:33:29.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.959+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94227543144592] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.959+0000 7f2904d3d980 20 remove_watcher() i=1 2024-09-13T19:33:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.959+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94227543146896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3ca8a0 con 0x55b30f3c64e0 2024-09-13T19:33:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f290284d640 1 -- 172.21.15.144:0/3970471128 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94227543146896] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f401b030 con 0x55b30f3c64e0 2024-09-13T19:33:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f2904d3d980 20 remove_watcher() i=2 2024-09-13T19:33:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94227543137984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cc190 con 0x7f28f40287f0 2024-09-13T19:33:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94227543137984] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x7f28f40287f0 2024-09-13T19:33:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f2904d3d980 20 remove_watcher() i=3 2024-09-13T19:33:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94227543151520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3c9ec0 con 0x55b30f3bd280 2024-09-13T19:33:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94227543151520] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f80b3040 con 0x55b30f3bd280 2024-09-13T19:33:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f2904d3d980 20 remove_watcher() i=4 2024-09-13T19:33:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.963+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94227543154016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cd3a0 con 0x55b30f3c1c40 2024-09-13T19:33:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.967+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94227543154016] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.967+0000 7f2904d3d980 20 remove_watcher() i=5 2024-09-13T19:33:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.967+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94227543157616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cd3a0 con 0x55b30f3c1c40 2024-09-13T19:33:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.967+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94227543157616] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.967+0000 7f2904d3d980 20 remove_watcher() i=6 2024-09-13T19:33:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.967+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94227543161968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b30f3cd3a0 con 0x55b30f3c1c40 2024-09-13T19:33:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f290304e640 1 -- 172.21.15.144:0/3970471128 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94227543161968] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28fc05d040 con 0x55b30f3c1c40 2024-09-13T19:33:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 20 remove_watcher() i=7 2024-09-13T19:33:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f3c1c40 msgr2=0x55b30f3c4030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f3c1c40 0x55b30f3c4030 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f3bd280 msgr2=0x55b30f3bf720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f3bd280 0x55b30f3bf720 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f28f40287f0 msgr2=0x7f28f4048790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f28f40287f0 0x7f28f4048790 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b30f3c64e0 msgr2=0x55b30f3c89a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b30f3c64e0 0x55b30f3c89a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27cc034650 msgr2=0x7f27cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27cc034650 0x7f27cc036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f28f404afd0 tx=0x7f28f4036000 comp rx=0 tx=0).stop 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 msgr2=0x55b30f28ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f290204c640 1 -- 172.21.15.144:0/3970471128 reap_dead start 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f28ec60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28fc02bfd0 tx=0x7f28fc04a2f0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 shutdown_connections 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3970471128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f3a8940 0x55b30f28ec60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 >> 172.21.15.144:0/3970471128 conn(0x55b30f3a4cc0 msgr2=0x55b30f3a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 shutdown_connections 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3970471128 wait complete. 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3621216025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27dc034650 msgr2=0x7f27dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3621216025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27dc034650 0x7f27dc036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55b30f388d90 tx=0x7f28f402af00 comp rx=0 tx=0).stop 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3621216025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f39bdc0 msgr2=0x55b30f39c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3621216025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f39bdc0 0x55b30f39c1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55b30f388cf0 tx=0x7f28fc00af40 comp rx=0 tx=0).stop 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3621216025 shutdown_connections 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3621216025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27dc034650 0x7f27dc036b10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3621216025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f39bdc0 0x55b30f39c1e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3621216025 >> 172.21.15.144:0/3621216025 conn(0x55b30f390f10 msgr2=0x55b30f393990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3621216025 shutdown_connections 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3621216025 wait complete. 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f38ac20 msgr2=0x55b30f38d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f38ac20 0x55b30f38d010 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f385e30 msgr2=0x55b30f388280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f385e30 0x55b30f388280 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27e8034650 msgr2=0x7f27e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27e8034650 0x7f27e8036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ad000 tx=0x7f28f80a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 msgr2=0x55b30f380eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f380eb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55b30f37ad40 tx=0x7f28f4000f50 comp rx=0 tx=0).stop 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 shutdown_connections 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b30f385e30 0x55b30f388280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b30f38ac20 0x55b30f38d010 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f27e8034650 0x7f27e8036b10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 --2- 172.21.15.144:0/3947107269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b30f203290 0x55b30f380eb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:29.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 >> 172.21.15.144:0/3947107269 conn(0x55b30f289090 msgr2=0x55b30f374270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:29.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 shutdown_connections 2024-09-13T19:33:29.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:29.971+0000 7f2904d3d980 1 -- 172.21.15.144:0/3947107269 wait complete. 2024-09-13T19:33:29.984 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:29.984 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:33:29.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:33:29.984 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:33:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:30.066 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:30.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0bef77b980 1 Processor -- start 2024-09-13T19:33:30.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0bef77b980 1 -- start start 2024-09-13T19:33:30.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0bef77b980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5615678ff8f0 0x561567901ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0bef77b980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561567784ae0 con 0x5615678fb570 2024-09-13T19:33:30.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0bef77b980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5615677a8e30 con 0x5615678ff8f0 2024-09-13T19:33:30.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0beca8a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5615678ff8f0 0x561567901ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0bed28b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5615678fb570 0x5615678fb950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44466/0 (socket says 172.21.15.144:44466) 2024-09-13T19:33:30.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0beca8a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5615678ff8f0 0x561567901ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56778/0 (socket says 172.21.15.144:56778) 2024-09-13T19:33:30.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0bed28b640 1 -- 172.21.15.144:0/4074093419 learned_addr learned my addr 172.21.15.144:0/4074093419 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:30.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0beca8a640 1 -- 172.21.15.144:0/4074093419 >> v1:172.21.15.18:6789/0 conn(0x5615678fb570 legacy=0x5615678fb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.063+0000 7f0beca8a640 1 -- 172.21.15.144:0/4074093419 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561567903230 con 0x5615678ff8f0 2024-09-13T19:33:30.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0beca8a640 1 --2- 172.21.15.144:0/4074093419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678ff8f0 0x561567901ce0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0be400a420 tx=0x7f0be401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d3c3f0367e8457 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bdffff640 1 -- 172.21.15.144:0/4074093419 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be40af070 con 0x5615678ff8f0 2024-09-13T19:33:30.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bdffff640 1 -- 172.21.15.144:0/4074093419 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be40aa530 con 0x5615678ff8f0 2024-09-13T19:33:30.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bdffff640 1 -- 172.21.15.144:0/4074093419 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be40aa850 con 0x5615678ff8f0 2024-09-13T19:33:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bef77b980 1 -- 172.21.15.144:0/4074093419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678ff8f0 msgr2=0x561567901ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bef77b980 1 --2- 172.21.15.144:0/4074093419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678ff8f0 0x561567901ce0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0be400a420 tx=0x7f0be401afd0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bef77b980 1 -- 172.21.15.144:0/4074093419 shutdown_connections 2024-09-13T19:33:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bef77b980 1 --2- 172.21.15.144:0/4074093419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678ff8f0 0x561567901ce0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bef77b980 1 -- 172.21.15.144:0/4074093419 >> 172.21.15.144:0/4074093419 conn(0x5615678f7090 msgr2=0x5615678f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bef77b980 1 -- 172.21.15.144:0/4074093419 shutdown_connections 2024-09-13T19:33:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.067+0000 7f0bef77b980 1 -- 172.21.15.144:0/4074093419 wait complete. 2024-09-13T19:33:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.079+0000 7f0bef77b980 1 Processor -- start 2024-09-13T19:33:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.079+0000 7f0bef77b980 1 -- start start 2024-09-13T19:33:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x561567904d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5615677aa200 con 0x5615678fb570 2024-09-13T19:33:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x561567904d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x561567904d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56786/0 (socket says 172.21.15.144:56786) 2024-09-13T19:33:30.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 -- 172.21.15.144:0/915846706 learned_addr learned my addr 172.21.15.144:0/915846706 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 -- 172.21.15.144:0/915846706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561567905350 con 0x5615678fb570 2024-09-13T19:33:30.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 --2- 172.21.15.144:0/915846706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x561567904d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0be0001e20 tx=0x7f0be000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11eaa49dc010c3b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0adb606640 1 -- 172.21.15.144:0/915846706 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be0012020 con 0x5615678fb570 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0adb606640 1 -- 172.21.15.144:0/915846706 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be000e7c0 con 0x5615678fb570 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0adb606640 1 -- 172.21.15.144:0/915846706 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be000eb00 con 0x5615678fb570 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 -- 172.21.15.144:0/915846706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 msgr2=0x561567904d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 --2- 172.21.15.144:0/915846706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x561567904d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0be0001e20 tx=0x7f0be000b790 comp rx=0 tx=0).stop 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 -- 172.21.15.144:0/915846706 shutdown_connections 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 --2- 172.21.15.144:0/915846706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x561567904d80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 -- 172.21.15.144:0/915846706 >> 172.21.15.144:0/915846706 conn(0x5615678f7090 msgr2=0x5615679e3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 -- 172.21.15.144:0/915846706 shutdown_connections 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 -- 172.21.15.144:0/915846706 wait complete. 2024-09-13T19:33:30.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 Processor -- start 2024-09-13T19:33:30.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 -- start start 2024-09-13T19:33:30.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x5615679f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bef77b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561567902d30 con 0x5615678fb570 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x5615679f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x5615679f0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56792/0 (socket says 172.21.15.144:56792) 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 -- 172.21.15.144:0/3318980401 learned_addr learned my addr 172.21.15.144:0/3318980401 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.083+0000 7f0bed28b640 1 -- 172.21.15.144:0/3318980401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615679f1510 con 0x5615678fb570 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x5615679f0fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0be0001e20 tx=0x7f0be0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0ad9e03640 1 -- 172.21.15.144:0/3318980401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be0012030 con 0x5615678fb570 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615679f17a0 con 0x5615678fb570 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0ad9e03640 1 -- 172.21.15.144:0/3318980401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0001480 con 0x5615678fb570 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0ad9e03640 1 -- 172.21.15.144:0/3318980401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be001a920 con 0x5615678fb570 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615679f4480 con 0x5615678fb570 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0ad9e03640 1 -- 172.21.15.144:0/3318980401 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0be0015020 con 0x5615678fb570 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0ad9e03640 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ad4034650 0x7f0ad4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0ad9e03640 1 -- 172.21.15.144:0/3318980401 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0be0020030 con 0x5615678fb570 2024-09-13T19:33:30.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0beca8a640 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ad4034650 0x7f0ad4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5615678ff8f0 0x5615679f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5615679f85b0 con 0x5615678ff8f0 2024-09-13T19:33:30.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0beda8c640 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5615678ff8f0 0x5615679f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0beca8a640 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ad4034650 0x7f0ad4036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0be40ac000 tx=0x7f0be40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0beda8c640 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5615678ff8f0 0x5615679f7f60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0beda8c640 1 -- 172.21.15.144:0/3318980401 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be80083f0 con 0x5615678ff8f0 2024-09-13T19:33:30.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5615679f56a0 con 0x5615678ff8f0 2024-09-13T19:33:30.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0beda8c640 1 -- 172.21.15.144:0/3318980401 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0be80083f0 con 0x5615678ff8f0 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5615679fa8c0 0x5615679fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5615679fd3a0 con 0x5615679fa8c0 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.087+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5615679fa8c0 0x5615679fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5615679fa8c0 0x5615679fccb0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bed28b640 1 -- 172.21.15.144:0/3318980401 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0be0008030 con 0x5615679fa8c0 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5615679f9760 con 0x5615678ff8f0 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0beda8c640 1 -- 172.21.15.144:0/3318980401 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0be80083f0 con 0x5615678ff8f0 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5615679f9c40 con 0x5615678ff8f0 2024-09-13T19:33:30.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0beda8c640 1 -- 172.21.15.144:0/3318980401 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0be80083f0 con 0x5615678ff8f0 2024-09-13T19:33:30.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bef77b980 1 Processor -- start 2024-09-13T19:33:30.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bef77b980 1 -- start start 2024-09-13T19:33:30.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bef77b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a0bac0 0x561567a0bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bef77b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561567803800 con 0x561567a0bac0 2024-09-13T19:33:30.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0beda8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a0bac0 0x561567a0bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0beda8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a0bac0 0x561567a0bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56804/0 (socket says 172.21.15.144:56804) 2024-09-13T19:33:30.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0beda8c640 1 -- 172.21.15.144:0/3651908385 learned_addr learned my addr 172.21.15.144:0/3651908385 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0beda8c640 1 -- 172.21.15.144:0/3651908385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561567a0c420 con 0x561567a0bac0 2024-09-13T19:33:30.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0beda8c640 1 --2- 172.21.15.144:0/3651908385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a0bac0 0x561567a0bee0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5615679f2400 tx=0x7f0be800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0ad2ffd640 1 -- 172.21.15.144:0/3651908385 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8007dd0 con 0x561567a0bac0 2024-09-13T19:33:30.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0ad2ffd640 1 -- 172.21.15.144:0/3651908385 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be801e020 con 0x561567a0bac0 2024-09-13T19:33:30.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bef77b980 1 -- 172.21.15.144:0/3651908385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561567a0c6b0 con 0x561567a0bac0 2024-09-13T19:33:30.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0ad2ffd640 1 -- 172.21.15.144:0/3651908385 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8019590 con 0x561567a0bac0 2024-09-13T19:33:30.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.091+0000 7f0bef77b980 1 -- 172.21.15.144:0/3651908385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561567a0f330 con 0x561567a0bac0 2024-09-13T19:33:30.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0ad2ffd640 1 -- 172.21.15.144:0/3651908385 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0be8016040 con 0x561567a0bac0 2024-09-13T19:33:30.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0ad2ffd640 1 --2- 172.21.15.144:0/3651908385 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ac40346a0 0x7f0ac4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0ad2ffd640 1 -- 172.21.15.144:0/3651908385 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0be801f030 con 0x561567a0bac0 2024-09-13T19:33:30.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3651908385 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ac40346a0 0x7f0ac4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 Processor -- start 2024-09-13T19:33:30.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 -- start start 2024-09-13T19:33:30.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3651908385 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ac40346a0 0x7f0ac4036b60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5615679f8a10 tx=0x7f0be0004040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a18920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561567903570 con 0x561567a18540 2024-09-13T19:33:30.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0beda8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a18920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0beda8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a18920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56806/0 (socket says 172.21.15.144:56806) 2024-09-13T19:33:30.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0beda8c640 1 -- 172.21.15.144:0/3977670492 learned_addr learned my addr 172.21.15.144:0/3977670492 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0beda8c640 1 -- 172.21.15.144:0/3977670492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561567a18ef0 con 0x561567a18540 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0beda8c640 1 --2- 172.21.15.144:0/3977670492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a18920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0be804a2f0 tx=0x7f0be80234d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844758103eb1f7da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0ad0ff9640 1 -- 172.21.15.144:0/3977670492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be801d040 con 0x561567a18540 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0ad0ff9640 1 -- 172.21.15.144:0/3977670492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be80173b0 con 0x561567a18540 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0ad0ff9640 1 -- 172.21.15.144:0/3977670492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be80153e0 con 0x561567a18540 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 -- 172.21.15.144:0/3977670492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 msgr2=0x561567a18920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3977670492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a18920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0be804a2f0 tx=0x7f0be80234d0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 -- 172.21.15.144:0/3977670492 shutdown_connections 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3977670492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a18920 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 -- 172.21.15.144:0/3977670492 >> 172.21.15.144:0/3977670492 conn(0x561567a14920 msgr2=0x561567a12a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 -- 172.21.15.144:0/3977670492 shutdown_connections 2024-09-13T19:33:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 -- 172.21.15.144:0/3977670492 wait complete. 2024-09-13T19:33:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 Processor -- start 2024-09-13T19:33:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.095+0000 7f0bef77b980 1 -- start start 2024-09-13T19:33:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a1f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561567a194b0 con 0x561567a18540 2024-09-13T19:33:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0beda8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a1f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0beda8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a1f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56818/0 (socket says 172.21.15.144:56818) 2024-09-13T19:33:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 learned_addr learned my addr 172.21.15.144:0/3540113393 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561567a1fe30 con 0x561567a18540 2024-09-13T19:33:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0beda8c640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a1f8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0be8049190 tx=0x7f0be804a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0ac2ffd640 1 -- 172.21.15.144:0/3540113393 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be801d070 con 0x561567a18540 2024-09-13T19:33:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561567a200c0 con 0x561567a18540 2024-09-13T19:33:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0ac2ffd640 1 -- 172.21.15.144:0/3540113393 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be804a400 con 0x561567a18540 2024-09-13T19:33:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0ac2ffd640 1 -- 172.21.15.144:0/3540113393 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8022bb0 con 0x561567a18540 2024-09-13T19:33:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561567a22da0 con 0x561567a18540 2024-09-13T19:33:30.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0ac2ffd640 1 -- 172.21.15.144:0/3540113393 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0be802b7d0 con 0x561567a18540 2024-09-13T19:33:30.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0ac2ffd640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ab8034650 0x7f0ab8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0ac2ffd640 1 -- 172.21.15.144:0/3540113393 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0be80310a0 con 0x561567a18540 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ab8034650 0x7f0ab8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561567a2acc0 0x561567a2d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a2d8b0 con 0x561567a2acc0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0beca8a640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561567a2acc0 0x561567a2d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ab8034650 0x7f0ab8036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0be002ded0 tx=0x7f0be003b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0beca8a640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561567a2acc0 0x561567a2d160 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 20 realm 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.099+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a2dce0 con 0x561567a2acc0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:30.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a2e5b0 con 0x561567a2acc0 2024-09-13T19:33:30.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a2e950 con 0x561567a2acc0 2024-09-13T19:33:30.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561567a2f6b0 0x561567a31aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a31fe0 con 0x561567a2f6b0 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beda8c640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561567a2f6b0 0x561567a31aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beda8c640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561567a2f6b0 0x561567a31aa0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 20 searching for the correct realm 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561567a33f50 0x561567a36410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561567a33f50 0x561567a36410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561567a33f50 0x561567a36410 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bed28b640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f0be0039030 0x7f0be0048780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x7f0be0039030 2024-09-13T19:33:30.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beca8a640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f0be0039030 0x7f0be0048780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beca8a640 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f0be0039030 0x7f0be0048780 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.103+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2acc0 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2acc0 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x7f0be0039030 2024-09-13T19:33:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2acc0 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2acc0 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.107+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x7f0be0039030 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2acc0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2acc0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x7f0be0039030 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2acc0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.111+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x7f0be0039030 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a33f50 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2f6b0 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x561567a2acc0 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561567a36ae0 con 0x7f0be0039030 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a32930 con 0x561567a2acc0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a32d80 con 0x561567a2acc0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a331e0 con 0x561567a2acc0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:30.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 zone default found 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 4 Realm: () 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 zonegroup default 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.115+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a36f60 con 0x561567a2f6b0 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a39190 con 0x561567a33f50 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a39530 con 0x561567a33f50 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 20 started sync module instance, tier type = 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a385d0 con 0x7f0be0039030 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94649933072832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a385d0 con 0x7f0be0039030 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a39ef0 con 0x561567a2acc0 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.119+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94649933072832] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94649933070896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a39ef0 con 0x561567a2acc0 2024-09-13T19:33:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3a780 con 0x561567a33f50 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94649933070896] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94649933077328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3ab70 con 0x561567a33f50 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3b530 con 0x7f0be0039030 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94649933083024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3bba0 con 0x7f0be0039030 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.123+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3c6a0 con 0x561567a2acc0 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94649933077328] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94649933087120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3c660 con 0x561567a2acc0 2024-09-13T19:33:30.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3d0e0 con 0x561567a2f6b0 2024-09-13T19:33:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94649933083024] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94649933089840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3d480 con 0x561567a2f6b0 2024-09-13T19:33:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3dd10 con 0x561567a2f6b0 2024-09-13T19:33:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.127+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94649933087120] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94649933078448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3def0 con 0x561567a2f6b0 2024-09-13T19:33:30.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3e740 con 0x561567a2f6b0 2024-09-13T19:33:30.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94649933089840] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94649933078448] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94649933084144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3e3a0 con 0x561567a2f6b0 2024-09-13T19:33:30.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 20 add_watcher() i=0 2024-09-13T19:33:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 20 add_watcher() i=1 2024-09-13T19:33:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 20 add_watcher() i=2 2024-09-13T19:33:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 20 add_watcher() i=3 2024-09-13T19:33:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 20 add_watcher() i=4 2024-09-13T19:33:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 20 add_watcher() i=5 2024-09-13T19:33:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.131+0000 7f0bef77b980 20 add_watcher() i=6 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94649933084144] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 20 add_watcher() i=7 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a41550 con 0x561567a2acc0 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94649933094640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3e7c0 con 0x561567a2acc0 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94649933094640] v30'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0aa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 5 note: GC not initialized 2024-09-13T19:33:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0aa27e4640 20 reqs_thread_entry: start 2024-09-13T19:33:30.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:30.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 20 Filter name: none 2024-09-13T19:33:30.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0a13fff640 20 reqs_thread_entry: start 2024-09-13T19:33:30.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561567a64730 con 0x561567a2acc0 2024-09-13T19:33:30.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.135+0000 7f0bef77b980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:33:30.144 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0aa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94649933094640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a632e0 con 0x561567a2acc0 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94649933094640] v30'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94649933072832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3def0 con 0x7f0be0039030 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94649933072832] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0bef77b980 20 remove_watcher() i=0 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0bef77b980 2 removed watcher, disabling cache 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94649933070896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3def0 con 0x561567a2acc0 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.139+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94649933070896] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.143+0000 7f0bef77b980 20 remove_watcher() i=1 2024-09-13T19:33:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.143+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94649933077328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3def0 con 0x561567a33f50 2024-09-13T19:33:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.143+0000 7f0bed28b640 1 -- 172.21.15.144:0/3540113393 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94649933077328] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be0008030 con 0x561567a33f50 2024-09-13T19:33:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.143+0000 7f0bef77b980 20 remove_watcher() i=2 2024-09-13T19:33:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.143+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94649933083024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a39b50 con 0x7f0be0039030 2024-09-13T19:33:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.143+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94649933083024] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x7f0be0039030 2024-09-13T19:33:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.143+0000 7f0bef77b980 20 remove_watcher() i=3 2024-09-13T19:33:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.143+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94649933087120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3b190 con 0x561567a2acc0 2024-09-13T19:33:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.147+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94649933087120] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be40b2070 con 0x561567a2acc0 2024-09-13T19:33:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.147+0000 7f0bef77b980 20 remove_watcher() i=4 2024-09-13T19:33:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.147+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94649933089840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3c190 con 0x561567a2f6b0 2024-09-13T19:33:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.147+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94649933089840] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.147+0000 7f0bef77b980 20 remove_watcher() i=5 2024-09-13T19:33:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.147+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94649933078448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3cc30 con 0x561567a2f6b0 2024-09-13T19:33:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94649933078448] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 20 remove_watcher() i=6 2024-09-13T19:33:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94649933084144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561567a3a000 con 0x561567a2f6b0 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0beda8c640 1 -- 172.21.15.144:0/3540113393 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94649933084144] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8042020 con 0x561567a2f6b0 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 20 remove_watcher() i=7 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561567a2f6b0 msgr2=0x561567a31aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561567a2f6b0 0x561567a31aa0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561567a2acc0 msgr2=0x561567a2d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561567a2acc0 0x561567a2d160 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f0be0039030 msgr2=0x7f0be0048780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f0be0039030 0x7f0be0048780 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561567a33f50 msgr2=0x561567a36410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x561567a33f50 0x561567a36410 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ab8034650 msgr2=0x7f0ab8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ab8034650 0x7f0ab8036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0be002ded0 tx=0x7f0be003b000 comp rx=0 tx=0).stop 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 msgr2=0x561567a1f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0beca8a640 1 -- 172.21.15.144:0/3540113393 reap_dead start 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a1f8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0be8049190 tx=0x7f0be804a250 comp rx=0 tx=0).stop 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 shutdown_connections 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3540113393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a18540 0x561567a1f8f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 >> 172.21.15.144:0/3540113393 conn(0x561567a14920 msgr2=0x561567a19c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 shutdown_connections 2024-09-13T19:33:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3540113393 wait complete. 2024-09-13T19:33:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3651908385 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ac40346a0 msgr2=0x7f0ac4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3651908385 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ac40346a0 0x7f0ac4036b60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5615679f8a10 tx=0x7f0be0004040 comp rx=0 tx=0).stop 2024-09-13T19:33:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3651908385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a0bac0 msgr2=0x561567a0bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3651908385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a0bac0 0x561567a0bee0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5615679f2400 tx=0x7f0be800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3651908385 shutdown_connections 2024-09-13T19:33:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3651908385 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ac40346a0 0x7f0ac4036b60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3651908385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561567a0bac0 0x561567a0bee0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3651908385 >> 172.21.15.144:0/3651908385 conn(0x561567a00c10 msgr2=0x561567a03690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3651908385 shutdown_connections 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3651908385 wait complete. 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5615679fa8c0 msgr2=0x5615679fccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5615679fa8c0 0x5615679fccb0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5615678ff8f0 msgr2=0x5615679f7f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5615678ff8f0 0x5615679f7f60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ad4034650 msgr2=0x7f0ad4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ad4034650 0x7f0ad4036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0be40ac000 tx=0x7f0be40a5000 comp rx=0 tx=0).stop 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 msgr2=0x5615679f0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x5615679f0fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0be0001e20 tx=0x7f0be0000ee0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 shutdown_connections 2024-09-13T19:33:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5615678ff8f0 0x5615679f7f60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5615679fa8c0 0x5615679fccb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0ad4034650 0x7f0ad4036b10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 --2- 172.21.15.144:0/3318980401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5615678fb570 0x5615679f0fd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.151+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 >> 172.21.15.144:0/3318980401 conn(0x5615678f7090 msgr2=0x5615679e32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.155+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 shutdown_connections 2024-09-13T19:33:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.155+0000 7f0bef77b980 1 -- 172.21.15.144:0/3318980401 wait complete. 2024-09-13T19:33:30.165 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:30.165 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T19:33:30.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T19:33:30.166 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-13T19:33:30.250 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:30.250 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:30.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ecd24980 1 Processor -- start 2024-09-13T19:33:30.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ecd24980 1 -- start start 2024-09-13T19:33:30.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ecd24980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b5f61d5970 0x55b5f61d7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ecd24980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b5f6059ae0 con 0x55b5f61d15f0 2024-09-13T19:33:30.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ecd24980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55b5f607de30 con 0x55b5f61d5970 2024-09-13T19:33:30.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ea033640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b5f61d5970 0x55b5f61d7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ea033640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b5f61d5970 0x55b5f61d7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56824/0 (socket says 172.21.15.144:56824) 2024-09-13T19:33:30.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ea834640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55b5f61d15f0 0x55b5f61d19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44468/0 (socket says 172.21.15.144:44468) 2024-09-13T19:33:30.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ea033640 1 -- 172.21.15.144:0/3390592982 learned_addr learned my addr 172.21.15.144:0/3390592982 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ea033640 1 -- 172.21.15.144:0/3390592982 >> v1:172.21.15.18:6789/0 conn(0x55b5f61d15f0 legacy=0x55b5f61d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.247+0000 7f92ea033640 1 -- 172.21.15.144:0/3390592982 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f61d92b0 con 0x55b5f61d5970 2024-09-13T19:33:30.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92ea033640 1 --2- 172.21.15.144:0/3390592982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d5970 0x55b5f61d7d60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f92e000a5c0 tx=0x7f92e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c13b7dcd4f0e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92e9832640 1 -- 172.21.15.144:0/3390592982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e00a6070 con 0x55b5f61d5970 2024-09-13T19:33:30.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92e9832640 1 -- 172.21.15.144:0/3390592982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e00af070 con 0x55b5f61d5970 2024-09-13T19:33:30.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92e9832640 1 -- 172.21.15.144:0/3390592982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e00aa5c0 con 0x55b5f61d5970 2024-09-13T19:33:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92ecd24980 1 -- 172.21.15.144:0/3390592982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d5970 msgr2=0x55b5f61d7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3390592982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d5970 0x55b5f61d7d60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f92e000a5c0 tx=0x7f92e001b340 comp rx=0 tx=0).stop 2024-09-13T19:33:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92ecd24980 1 -- 172.21.15.144:0/3390592982 shutdown_connections 2024-09-13T19:33:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3390592982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d5970 0x55b5f61d7d60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92ecd24980 1 -- 172.21.15.144:0/3390592982 >> 172.21.15.144:0/3390592982 conn(0x55b5f61cd110 msgr2=0x55b5f61cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92ecd24980 1 -- 172.21.15.144:0/3390592982 shutdown_connections 2024-09-13T19:33:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.251+0000 7f92ecd24980 1 -- 172.21.15.144:0/3390592982 wait complete. 2024-09-13T19:33:30.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 Processor -- start 2024-09-13T19:33:30.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- start start 2024-09-13T19:33:30.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62bca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b5f607f200 con 0x55b5f61d15f0 2024-09-13T19:33:30.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ea834640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ea834640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62bca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56838/0 (socket says 172.21.15.144:56838) 2024-09-13T19:33:30.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ea834640 1 -- 172.21.15.144:0/27112795 learned_addr learned my addr 172.21.15.144:0/27112795 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ea834640 1 -- 172.21.15.144:0/27112795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f62bcff0 con 0x55b5f61d15f0 2024-09-13T19:33:30.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ea834640 1 --2- 172.21.15.144:0/27112795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62bca20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00b240 tx=0x7f92dc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f482bb6397269a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f91d8e09640 1 -- 172.21.15.144:0/27112795 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92dc00e700 con 0x55b5f61d15f0 2024-09-13T19:33:30.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f91d8e09640 1 -- 172.21.15.144:0/27112795 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92dc00e8a0 con 0x55b5f61d15f0 2024-09-13T19:33:30.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f91d8e09640 1 -- 172.21.15.144:0/27112795 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92dc00eb80 con 0x55b5f61d15f0 2024-09-13T19:33:30.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- 172.21.15.144:0/27112795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 msgr2=0x55b5f62bca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 --2- 172.21.15.144:0/27112795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62bca20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00b240 tx=0x7f92dc00b700 comp rx=0 tx=0).stop 2024-09-13T19:33:30.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- 172.21.15.144:0/27112795 shutdown_connections 2024-09-13T19:33:30.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 --2- 172.21.15.144:0/27112795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62bca20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- 172.21.15.144:0/27112795 >> 172.21.15.144:0/27112795 conn(0x55b5f61cd110 msgr2=0x55b5f62b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- 172.21.15.144:0/27112795 shutdown_connections 2024-09-13T19:33:30.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- 172.21.15.144:0/27112795 wait complete. 2024-09-13T19:33:30.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 Processor -- start 2024-09-13T19:33:30.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- start start 2024-09-13T19:33:30.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ecd24980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b5f61d8db0 con 0x55b5f61d15f0 2024-09-13T19:33:30.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ea834640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ea834640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56842/0 (socket says 172.21.15.144:56842) 2024-09-13T19:33:30.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.267+0000 7f92ea834640 1 -- 172.21.15.144:0/3581897401 learned_addr learned my addr 172.21.15.144:0/3581897401 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ea834640 1 -- 172.21.15.144:0/3581897401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f62c4380 con 0x55b5f61d15f0 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ea834640 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62c3e40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f92dc000c10 tx=0x7f92dc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f91d7606640 1 -- 172.21.15.144:0/3581897401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92dc00fa90 con 0x55b5f61d15f0 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5f62c4610 con 0x55b5f61d15f0 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f91d7606640 1 -- 172.21.15.144:0/3581897401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92dc00fc50 con 0x55b5f61d15f0 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f91d7606640 1 -- 172.21.15.144:0/3581897401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92dc01a480 con 0x55b5f61d15f0 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f62c72f0 con 0x55b5f61d15f0 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f91d7606640 1 -- 172.21.15.144:0/3581897401 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f92dc017070 con 0x55b5f61d15f0 2024-09-13T19:33:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f91d7606640 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91d0034650 0x7f91d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f91d7606640 1 -- 172.21.15.144:0/3581897401 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f92dc015020 con 0x55b5f61d15f0 2024-09-13T19:33:30.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ea033640 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91d0034650 0x7f91d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f61d5970 0x55b5f62cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f62cb410 con 0x55b5f61d5970 2024-09-13T19:33:30.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92eb035640 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f61d5970 0x55b5f62cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ea033640 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91d0034650 0x7f91d0036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92e00ae000 tx=0x7f92e00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92eb035640 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f61d5970 0x55b5f62cadd0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92eb035640 1 -- 172.21.15.144:0/3581897401 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92e400a4d0 con 0x55b5f61d5970 2024-09-13T19:33:30.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f62c84f0 con 0x55b5f61d5970 2024-09-13T19:33:30.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.271+0000 7f92eb035640 1 -- 172.21.15.144:0/3581897401 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92e400a4d0 con 0x55b5f61d5970 2024-09-13T19:33:30.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f62cd740 0x55b5f62cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f62d0200 con 0x55b5f62cd740 2024-09-13T19:33:30.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ea834640 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f62cd740 0x55b5f62cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ea834640 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f62cd740 0x55b5f62cfb30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ea834640 1 -- 172.21.15.144:0/3581897401 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f62cd740 2024-09-13T19:33:30.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f62cc5e0 con 0x55b5f61d5970 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92eb035640 1 -- 172.21.15.144:0/3581897401 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92e400a4d0 con 0x55b5f61d5970 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f62ccac0 con 0x55b5f61d5970 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92eb035640 1 -- 172.21.15.144:0/3581897401 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f92e400a4d0 con 0x55b5f61d5970 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ecd24980 1 Processor -- start 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ecd24980 1 -- start start 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ecd24980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f62de8e0 0x55b5f62ded00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92ecd24980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b5f60d8800 con 0x55b5f62de8e0 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92eb035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f62de8e0 0x55b5f62ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92eb035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f62de8e0 0x55b5f62ded00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56858/0 (socket says 172.21.15.144:56858) 2024-09-13T19:33:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92eb035640 1 -- 172.21.15.144:0/469279303 learned_addr learned my addr 172.21.15.144:0/469279303 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.275+0000 7f92eb035640 1 -- 172.21.15.144:0/469279303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f62df240 con 0x55b5f62de8e0 2024-09-13T19:33:30.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92eb035640 1 --2- 172.21.15.144:0/469279303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f62de8e0 0x55b5f62ded00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55b5f62cb810 tx=0x7f92e4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91d4e01640 1 -- 172.21.15.144:0/469279303 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e4014450 con 0x55b5f62de8e0 2024-09-13T19:33:30.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92ecd24980 1 -- 172.21.15.144:0/469279303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5f62df4d0 con 0x55b5f62de8e0 2024-09-13T19:33:30.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91d4e01640 1 -- 172.21.15.144:0/469279303 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e40145f0 con 0x55b5f62de8e0 2024-09-13T19:33:30.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91d4e01640 1 -- 172.21.15.144:0/469279303 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e4014910 con 0x55b5f62de8e0 2024-09-13T19:33:30.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92ecd24980 1 -- 172.21.15.144:0/469279303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f62e2150 con 0x55b5f62de8e0 2024-09-13T19:33:30.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91d4e01640 1 -- 172.21.15.144:0/469279303 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f92e4011040 con 0x55b5f62de8e0 2024-09-13T19:33:30.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91d4e01640 1 --2- 172.21.15.144:0/469279303 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91c40346a0 0x7f91c4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91d4e01640 1 -- 172.21.15.144:0/469279303 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f92e401e070 con 0x55b5f62de8e0 2024-09-13T19:33:30.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92ea834640 1 --2- 172.21.15.144:0/469279303 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91c40346a0 0x7f91c4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92ecd24980 1 Processor -- start 2024-09-13T19:33:30.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92ecd24980 1 -- start start 2024-09-13T19:33:30.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92ea834640 1 --2- 172.21.15.144:0/469279303 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91c40346a0 0x7f91c4036b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55b5f62cb8b0 tx=0x7f92dc01af10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92ecd24980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f6146750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92ecd24980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b5f62bd370 con 0x55b5f6146350 2024-09-13T19:33:30.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92eb035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f6146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92eb035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f6146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56872/0 (socket says 172.21.15.144:56872) 2024-09-13T19:33:30.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92eb035640 1 -- 172.21.15.144:0/257497117 learned_addr learned my addr 172.21.15.144:0/257497117 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92eb035640 1 -- 172.21.15.144:0/257497117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f6146c90 con 0x55b5f6146350 2024-09-13T19:33:30.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f92eb035640 1 --2- 172.21.15.144:0/257497117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f6146750 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f92e404a130 tx=0x7f92e4013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b065cf471b432 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91ce7fc640 1 -- 172.21.15.144:0/257497117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e4041070 con 0x55b5f6146350 2024-09-13T19:33:30.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91ce7fc640 1 -- 172.21.15.144:0/257497117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e4014ab0 con 0x55b5f6146350 2024-09-13T19:33:30.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.279+0000 7f91ce7fc640 1 -- 172.21.15.144:0/257497117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e4028070 con 0x55b5f6146350 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- 172.21.15.144:0/257497117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 msgr2=0x55b5f6146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 --2- 172.21.15.144:0/257497117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f6146750 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f92e404a130 tx=0x7f92e4013dd0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- 172.21.15.144:0/257497117 shutdown_connections 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 --2- 172.21.15.144:0/257497117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f6146750 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- 172.21.15.144:0/257497117 >> 172.21.15.144:0/257497117 conn(0x55b5f62e7760 msgr2=0x55b5f62e5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- 172.21.15.144:0/257497117 shutdown_connections 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- 172.21.15.144:0/257497117 wait complete. 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 Processor -- start 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- start start 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f62f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b5f6147300 con 0x55b5f6146350 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92eb035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f62f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92eb035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f62f48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56884/0 (socket says 172.21.15.144:56884) 2024-09-13T19:33:30.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 learned_addr learned my addr 172.21.15.144:0/725883285 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f62f4e10 con 0x55b5f6146350 2024-09-13T19:33:30.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92eb035640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f62f48d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f92e403f040 tx=0x7f92e404a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f91ccff9640 1 -- 172.21.15.144:0/725883285 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e4041030 con 0x55b5f6146350 2024-09-13T19:33:30.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5f62f50a0 con 0x55b5f6146350 2024-09-13T19:33:30.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f91ccff9640 1 -- 172.21.15.144:0/725883285 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e40133b0 con 0x55b5f6146350 2024-09-13T19:33:30.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f91ccff9640 1 -- 172.21.15.144:0/725883285 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e4013690 con 0x55b5f6146350 2024-09-13T19:33:30.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f62f7d80 con 0x55b5f6146350 2024-09-13T19:33:30.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f91ccff9640 1 -- 172.21.15.144:0/725883285 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f92e40138c0 con 0x55b5f6146350 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f91ccff9640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91b4034650 0x7f91b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f91ccff9640 1 -- 172.21.15.144:0/725883285 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f92e4042070 con 0x55b5f6146350 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ea834640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91b4034650 0x7f91b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f62fff80 0x55b5f6302420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6302b70 con 0x55b5f62fff80 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.283+0000 7f92ea033640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f62fff80 0x55b5f6302420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea834640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91b4034650 0x7f91b4036b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00f700 tx=0x7f92dc035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea033640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f62fff80 0x55b5f6302420 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 realm 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6302fa0 con 0x55b5f62fff80 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6303870 con 0x55b5f62fff80 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6303c10 con 0x55b5f62fff80 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f6304970 0x55b5f6306d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f63073b0 con 0x55b5f6304970 2024-09-13T19:33:30.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92eb035640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f6304970 0x55b5f6306d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92eb035640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f6304970 0x55b5f6306d60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 20 searching for the correct realm 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b5f6309300 0x55b5f630b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6309300 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea834640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b5f6309300 0x55b5f630b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea834640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b5f6309300 0x55b5f630b6f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea834640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f92dc01d7c0 0x7f92dc01b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x7f92dc01d7c0 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.287+0000 7f92ea033640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f92dc01d7c0 0x7f92dc01b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f92dc01d7c0 0x7f92dc01b730 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6304970 2024-09-13T19:33:30.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f62fff80 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f62fff80 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6304970 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6304970 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x7f92dc01d7c0 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6309300 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f62fff80 2024-09-13T19:33:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.291+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6304970 2024-09-13T19:33:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f62fff80 2024-09-13T19:33:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x7f92dc01d7c0 2024-09-13T19:33:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6309300 2024-09-13T19:33:30.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6309300 2024-09-13T19:33:30.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6304970 2024-09-13T19:33:30.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6309300 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630bdc0 con 0x55b5f6309300 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f62fff80 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f62fff80 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f6304970 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f6309300 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x7f92dc01d7c0 2024-09-13T19:33:30.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.295+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f62fff80 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f6304970 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f6309300 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f6304970 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x7f92dc01d7c0 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f6309300 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f6304970 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x55b5f62fff80 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f92dc061040 con 0x7f92dc01d7c0 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:30.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6307d70 con 0x55b5f62fff80 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f63079b0 con 0x55b5f62fff80 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.299+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6308690 con 0x55b5f62fff80 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:30.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 zone default found 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 4 Realm: () 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 zonegroup default 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630c240 con 0x55b5f6304970 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630dfc0 con 0x55b5f6309300 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630e430 con 0x55b5f6309300 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 started sync module instance, tier type = 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630d460 con 0x7f92dc01d7c0 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94240007838096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630d460 con 0x7f92dc01d7c0 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630efa0 con 0x55b5f62fff80 2024-09-13T19:33:30.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.303+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94240007838096] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94240007842432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630d460 con 0x55b5f62fff80 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630f9b0 con 0x55b5f6309300 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94240007845120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6310250 con 0x55b5f6309300 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6310c10 con 0x7f92dc01d7c0 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94240007842432] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.307+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94240007849824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6310b80 con 0x7f92dc01d7c0 2024-09-13T19:33:30.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.311+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6311960 con 0x55b5f62fff80 2024-09-13T19:33:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.311+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94240007845120] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.311+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94240007849824] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.311+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.311+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94240007847328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6311420 con 0x55b5f62fff80 2024-09-13T19:33:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.311+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6311c70 con 0x55b5f6304970 2024-09-13T19:33:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.311+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94240007847328] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.311+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.315+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94240007852160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6312060 con 0x55b5f6304970 2024-09-13T19:33:30.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.315+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6312a20 con 0x55b5f6304970 2024-09-13T19:33:30.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.315+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.315+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94240007857520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6312e40 con 0x55b5f6304970 2024-09-13T19:33:30.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.315+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6313930 con 0x55b5f6304970 2024-09-13T19:33:30.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.315+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94240007852160] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.315+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94240007857520] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.315+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94240007861248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f63129d0 con 0x55b5f6304970 2024-09-13T19:33:30.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 add_watcher() i=0 2024-09-13T19:33:30.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 add_watcher() i=1 2024-09-13T19:33:30.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 add_watcher() i=2 2024-09-13T19:33:30.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 add_watcher() i=3 2024-09-13T19:33:30.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 add_watcher() i=4 2024-09-13T19:33:30.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 add_watcher() i=5 2024-09-13T19:33:30.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 add_watcher() i=6 2024-09-13T19:33:30.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94240007861248] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 add_watcher() i=7 2024-09-13T19:33:30.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:30.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6316a30 con 0x55b5f62fff80 2024-09-13T19:33:30.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94240007853280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6313eb0 con 0x55b5f62fff80 2024-09-13T19:33:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94240007853280] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f91a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 5 note: GC not initialized 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f911bfff640 20 reqs_thread_entry: start 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 Filter name: none 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f9119ffb640 20 reqs_thread_entry: start 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.319+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6339e80 con 0x55b5f62fff80 2024-09-13T19:33:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f633ac10 con 0x7f92dc01d7c0 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6340970 con 0x55b5f62fff80 2024-09-13T19:33:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94240008045568 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f633d500 con 0x55b5f62fff80 2024-09-13T19:33:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94240007847328 notify 128849018887 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55b5f61d92b0 con 0x55b5f62fff80 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f91ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94240007847328 notifier 4384 bl.length()=849 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f91ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f91ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f91ce7fc640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f91b0003eb0 con 0x55b5f62fff80 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify cookie 94240008045568 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94240008045568 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f92e00bfd70 con 0x55b5f62fff80 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.323+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6340400 con 0x7f92dc01d7c0 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ecd24980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ecd24980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ecd24980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T19:33:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94240008045568 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b5f633d4b0 con 0x7f92dc01d7c0 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== watch-notify(notify (1) cookie 94240007838096 notify 128849018883 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f92e00bfd70 con 0x7f92dc01d7c0 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f91cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94240007838096 notifier 4384 bl.length()=166 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f91cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f91cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f91cdffb640 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9120003410 con 0x7f92dc01d7c0 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(68 notify.0 [notify cookie 94240008045568 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== watch-notify(notify_complete (2) cookie 94240008045568 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f92e00d75c0 con 0x7f92dc01d7c0 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.331 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:33:30.326363Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:30.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f91a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94240007853280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6337c70 con 0x55b5f62fff80 2024-09-13T19:33:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94240007853280] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.327+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94240007838096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6337c70 con 0x7f92dc01d7c0 2024-09-13T19:33:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.331+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94240007838096] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.331+0000 7f92ecd24980 20 remove_watcher() i=0 2024-09-13T19:33:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.331+0000 7f92ecd24980 2 removed watcher, disabling cache 2024-09-13T19:33:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.331+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94240007842432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6337c70 con 0x55b5f62fff80 2024-09-13T19:33:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.331+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94240007842432] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.331+0000 7f92ecd24980 20 remove_watcher() i=1 2024-09-13T19:33:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.331+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94240007845120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6337c70 con 0x55b5f6309300 2024-09-13T19:33:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.331+0000 7f92ea834640 1 -- 172.21.15.144:0/725883285 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94240007845120] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92dc02e070 con 0x55b5f6309300 2024-09-13T19:33:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.335+0000 7f92ecd24980 20 remove_watcher() i=2 2024-09-13T19:33:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.335+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94240007849824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630f500 con 0x7f92dc01d7c0 2024-09-13T19:33:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.335+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94240007849824] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x7f92dc01d7c0 2024-09-13T19:33:30.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.335+0000 7f92ecd24980 20 remove_watcher() i=3 2024-09-13T19:33:30.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.335+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94240007847328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6310760 con 0x55b5f62fff80 2024-09-13T19:33:30.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.335+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94240007847328] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e00aaa30 con 0x55b5f62fff80 2024-09-13T19:33:30.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.335+0000 7f92ecd24980 20 remove_watcher() i=4 2024-09-13T19:33:30.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.335+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94240007852160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630f500 con 0x55b5f6304970 2024-09-13T19:33:30.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.339+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94240007852160] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.339+0000 7f92ecd24980 20 remove_watcher() i=5 2024-09-13T19:33:30.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.339+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94240007857520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f630fda0 con 0x55b5f6304970 2024-09-13T19:33:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.339+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94240007857520] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.339+0000 7f92ecd24980 20 remove_watcher() i=6 2024-09-13T19:33:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.339+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94240007861248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b5f6311530 con 0x55b5f6304970 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92eb035640 1 -- 172.21.15.144:0/725883285 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94240007861248] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92e402a070 con 0x55b5f6304970 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 20 remove_watcher() i=7 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f6304970 msgr2=0x55b5f6306d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f6304970 0x55b5f6306d60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f62fff80 msgr2=0x55b5f6302420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f62fff80 0x55b5f6302420 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f92dc01d7c0 msgr2=0x7f92dc01b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f92dc01d7c0 0x7f92dc01b730 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b5f6309300 msgr2=0x55b5f630b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b5f6309300 0x55b5f630b6f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91b4034650 msgr2=0x7f91b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91b4034650 0x7f91b4036b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00f700 tx=0x7f92dc035000 comp rx=0 tx=0).stop 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 msgr2=0x55b5f62f48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f62f48d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f92e403f040 tx=0x7f92e404a090 comp rx=0 tx=0).stop 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ea033640 1 -- 172.21.15.144:0/725883285 reap_dead start 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 shutdown_connections 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/725883285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f6146350 0x55b5f62f48d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 >> 172.21.15.144:0/725883285 conn(0x55b5f62e7760 msgr2=0x55b5f62e5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 shutdown_connections 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/725883285 wait complete. 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/469279303 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91c40346a0 msgr2=0x7f91c4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/469279303 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91c40346a0 0x7f91c4036b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55b5f62cb8b0 tx=0x7f92dc01af10 comp rx=0 tx=0).stop 2024-09-13T19:33:30.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/469279303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f62de8e0 msgr2=0x55b5f62ded00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/469279303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f62de8e0 0x55b5f62ded00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55b5f62cb810 tx=0x7f92e4018830 comp rx=0 tx=0).stop 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/469279303 shutdown_connections 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/469279303 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91c40346a0 0x7f91c4036b60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/469279303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f62de8e0 0x55b5f62ded00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/469279303 >> 172.21.15.144:0/469279303 conn(0x55b5f62d3a30 msgr2=0x55b5f62d64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/469279303 shutdown_connections 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/469279303 wait complete. 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f62cd740 msgr2=0x55b5f62cfb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f62cd740 0x55b5f62cfb30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f61d5970 msgr2=0x55b5f62cadd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f61d5970 0x55b5f62cadd0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91d0034650 msgr2=0x7f91d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91d0034650 0x7f91d0036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92e00ae000 tx=0x7f92e00a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 msgr2=0x55b5f62c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62c3e40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f92dc000c10 tx=0x7f92dc000ee0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 shutdown_connections 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b5f61d5970 0x55b5f62cadd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b5f62cd740 0x55b5f62cfb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f91d0034650 0x7f91d0036b10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 --2- 172.21.15.144:0/3581897401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5f61d15f0 0x55b5f62c3e40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 >> 172.21.15.144:0/3581897401 conn(0x55b5f61cd110 msgr2=0x55b5f62b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 shutdown_connections 2024-09-13T19:33:30.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.343+0000 7f92ecd24980 1 -- 172.21.15.144:0/3581897401 wait complete. 2024-09-13T19:33:30.355 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:33:30.326363Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:30.356 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:33:30.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:33:30.356 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:33:30.429 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:30.429 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:30.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f64e88980 1 Processor -- start 2024-09-13T19:33:30.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f64e88980 1 -- start start 2024-09-13T19:33:30.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f64e88980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5589731a23b0 0x5589731a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f64e88980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589730b3ae0 con 0x5589731a27c0 2024-09-13T19:33:30.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f64e88980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5589730d7e30 con 0x5589731a23b0 2024-09-13T19:33:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f62998640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5589731a23b0 0x5589731a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f62998640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5589731a23b0 0x5589731a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56892/0 (socket says 172.21.15.144:56892) 2024-09-13T19:33:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f62998640 1 -- 172.21.15.144:0/2139215405 learned_addr learned my addr 172.21.15.144:0/2139215405 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f62998640 1 -- 172.21.15.144:0/2139215405 >> v1:172.21.15.18:6789/0 conn(0x5589731a27c0 legacy=0x5589731a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.427+0000 7f2f62998640 1 -- 172.21.15.144:0/2139215405 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589731a18e0 con 0x5589731a23b0 2024-09-13T19:33:30.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f62998640 1 --2- 172.21.15.144:0/2139215405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x5589731a0b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400a4e0 tx=0x7f2f5401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c79575572c4b022 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f61996640 1 -- 172.21.15.144:0/2139215405 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540aa540 con 0x5589731a23b0 2024-09-13T19:33:30.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f61996640 1 -- 172.21.15.144:0/2139215405 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540aa6e0 con 0x5589731a23b0 2024-09-13T19:33:30.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f61996640 1 -- 172.21.15.144:0/2139215405 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540aaa40 con 0x5589731a23b0 2024-09-13T19:33:30.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f64e88980 1 -- 172.21.15.144:0/2139215405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 msgr2=0x5589731a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2139215405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x5589731a0b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400a4e0 tx=0x7f2f5401b090 comp rx=0 tx=0).stop 2024-09-13T19:33:30.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f64e88980 1 -- 172.21.15.144:0/2139215405 shutdown_connections 2024-09-13T19:33:30.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2139215405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x5589731a0b70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f64e88980 1 -- 172.21.15.144:0/2139215405 >> 172.21.15.144:0/2139215405 conn(0x5589732271b0 msgr2=0x5589732295d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f64e88980 1 -- 172.21.15.144:0/2139215405 shutdown_connections 2024-09-13T19:33:30.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.431+0000 7f2f64e88980 1 -- 172.21.15.144:0/2139215405 wait complete. 2024-09-13T19:33:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.443+0000 7f2f64e88980 1 Processor -- start 2024-09-13T19:33:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.443+0000 7f2f64e88980 1 -- start start 2024-09-13T19:33:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.443+0000 7f2f64e88980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x558973318b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.443+0000 7f2f64e88980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589730d9200 con 0x5589731a23b0 2024-09-13T19:33:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.443+0000 7f2f62998640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x558973318b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.443+0000 7f2f62998640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x558973318b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56906/0 (socket says 172.21.15.144:56906) 2024-09-13T19:33:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.443+0000 7f2f62998640 1 -- 172.21.15.144:0/3830145054 learned_addr learned my addr 172.21.15.144:0/3830145054 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f62998640 1 -- 172.21.15.144:0/3830145054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558973319160 con 0x5589731a23b0 2024-09-13T19:33:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f62998640 1 --2- 172.21.15.144:0/3830145054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x558973318b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f54018cc0 tx=0x7f2f540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eefd15e29784f64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2e50e09640 1 -- 172.21.15.144:0/3830145054 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540b9070 con 0x5589731a23b0 2024-09-13T19:33:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2e50e09640 1 -- 172.21.15.144:0/3830145054 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540aab00 con 0x5589731a23b0 2024-09-13T19:33:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2e50e09640 1 -- 172.21.15.144:0/3830145054 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540aae20 con 0x5589731a23b0 2024-09-13T19:33:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- 172.21.15.144:0/3830145054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 msgr2=0x558973318b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3830145054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x558973318b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f54018cc0 tx=0x7f2f540033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- 172.21.15.144:0/3830145054 shutdown_connections 2024-09-13T19:33:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3830145054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a23b0 0x558973318b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- 172.21.15.144:0/3830145054 >> 172.21.15.144:0/3830145054 conn(0x5589732271b0 msgr2=0x5589733147c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- 172.21.15.144:0/3830145054 shutdown_connections 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- 172.21.15.144:0/3830145054 wait complete. 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 Processor -- start 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- start start 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a27c0 0x55897331ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558973237200 con 0x5589731a27c0 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f62998640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a27c0 0x55897331ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f62998640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a27c0 0x55897331ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56908/0 (socket says 172.21.15.144:56908) 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f62998640 1 -- 172.21.15.144:0/2726712375 learned_addr learned my addr 172.21.15.144:0/2726712375 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f62998640 1 -- 172.21.15.144:0/2726712375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589733204e0 con 0x5589731a27c0 2024-09-13T19:33:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f62998640 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a27c0 0x55897331ffa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400a4e0 tx=0x7f2f54017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2e4f606640 1 -- 172.21.15.144:0/2726712375 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540b9050 con 0x5589731a27c0 2024-09-13T19:33:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558973320770 con 0x5589731a27c0 2024-09-13T19:33:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558973323450 con 0x5589731a27c0 2024-09-13T19:33:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2e4f606640 1 -- 172.21.15.144:0/2726712375 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540c6410 con 0x5589731a27c0 2024-09-13T19:33:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.447+0000 7f2e4f606640 1 -- 172.21.15.144:0/2726712375 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540c65c0 con 0x5589731a27c0 2024-09-13T19:33:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2e4f606640 1 -- 172.21.15.144:0/2726712375 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f540b3040 con 0x5589731a27c0 2024-09-13T19:33:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2e4f606640 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e480346a0 0x7f2e48036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2e4f606640 1 -- 172.21.15.144:0/2726712375 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2f540c3070 con 0x5589731a27c0 2024-09-13T19:33:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f62197640 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e480346a0 0x7f2e48036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558973324f20 0x558973327370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589733279b0 con 0x558973324f20 2024-09-13T19:33:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f63199640 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558973324f20 0x558973327370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f62197640 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e480346a0 0x7f2e48036b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c000f70 tx=0x7f2f4c001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f63199640 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558973324f20 0x558973327370 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f63199640 1 -- 172.21.15.144:0/2726712375 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5c0083f0 con 0x558973324f20 2024-09-13T19:33:30.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973324670 con 0x558973324f20 2024-09-13T19:33:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f63199640 1 -- 172.21.15.144:0/2726712375 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f5c0083f0 con 0x558973324f20 2024-09-13T19:33:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x558973329d00 0x55897332c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897332c7c0 con 0x558973329d00 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f62998640 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x558973329d00 0x55897332c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.451+0000 7f2f62998640 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x558973329d00 0x55897332c0f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f62998640 1 -- 172.21.15.144:0/2726712375 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f540cc020 con 0x558973329d00 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973328ba0 con 0x558973324f20 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f63199640 1 -- 172.21.15.144:0/2726712375 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f5c0083f0 con 0x558973324f20 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973329080 con 0x558973324f20 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f63199640 1 -- 172.21.15.144:0/2726712375 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f5c0083f0 con 0x558973324f20 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f64e88980 1 Processor -- start 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f64e88980 1 -- start start 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f64e88980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897333aea0 0x55897333b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f64e88980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558973132800 con 0x55897333aea0 2024-09-13T19:33:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f63199640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897333aea0 0x55897333b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f63199640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897333aea0 0x55897333b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56914/0 (socket says 172.21.15.144:56914) 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f63199640 1 -- 172.21.15.144:0/287437729 learned_addr learned my addr 172.21.15.144:0/287437729 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f63199640 1 -- 172.21.15.144:0/287437729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897333b800 con 0x55897333aea0 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f63199640 1 --2- 172.21.15.144:0/287437729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897333aea0 0x55897333b2c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x558973327db0 tx=0x7f2f5c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2e4ce01640 1 -- 172.21.15.144:0/287437729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c007e00 con 0x55897333aea0 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2e4ce01640 1 -- 172.21.15.144:0/287437729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c01e020 con 0x55897333aea0 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f64e88980 1 -- 172.21.15.144:0/287437729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55897333ba90 con 0x55897333aea0 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2e4ce01640 1 -- 172.21.15.144:0/287437729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c019590 con 0x55897333aea0 2024-09-13T19:33:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2f64e88980 1 -- 172.21.15.144:0/287437729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897333e710 con 0x55897333aea0 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.455+0000 7f2e4ce01640 1 -- 172.21.15.144:0/287437729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f5c016040 con 0x55897333aea0 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2e4ce01640 1 --2- 172.21.15.144:0/287437729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e3c034650 0x7f2e3c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2e4ce01640 1 -- 172.21.15.144:0/287437729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2f5c01f030 con 0x55897333aea0 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f62998640 1 --2- 172.21.15.144:0/287437729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e3c034650 0x7f2e3c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 Processor -- start 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- start start 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f62998640 1 --2- 172.21.15.144:0/287437729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e3c034650 0x7f2e3c036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x558973327e50 tx=0x7f2f540c5a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x558973347d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558973319420 con 0x558973347990 2024-09-13T19:33:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x558973347d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x558973347d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56918/0 (socket says 172.21.15.144:56918) 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 -- 172.21.15.144:0/3313172984 learned_addr learned my addr 172.21.15.144:0/3313172984 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 -- 172.21.15.144:0/3313172984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558973348360 con 0x558973347990 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 --2- 172.21.15.144:0/3313172984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x558973347d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c04a360 tx=0x7f2f5c017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7a668c11df0f39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2e467fc640 1 -- 172.21.15.144:0/3313172984 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c01d070 con 0x558973347990 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2e467fc640 1 -- 172.21.15.144:0/3313172984 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0153e0 con 0x558973347990 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2e467fc640 1 -- 172.21.15.144:0/3313172984 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c02b350 con 0x558973347990 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- 172.21.15.144:0/3313172984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 msgr2=0x558973347d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3313172984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x558973347d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c04a360 tx=0x7f2f5c017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- 172.21.15.144:0/3313172984 shutdown_connections 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3313172984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x558973347d90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- 172.21.15.144:0/3313172984 >> 172.21.15.144:0/3313172984 conn(0x558973343d70 msgr2=0x558973341e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- 172.21.15.144:0/3313172984 shutdown_connections 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- 172.21.15.144:0/3313172984 wait complete. 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 Processor -- start 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- start start 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x55897334ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f64e88980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558973348900 con 0x558973347990 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x55897334ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x55897334ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56934/0 (socket says 172.21.15.144:56934) 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 learned_addr learned my addr 172.21.15.144:0/3785594010 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.459+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897334f1d0 con 0x558973347990 2024-09-13T19:33:30.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f63199640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x55897334ec90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c017fe0 tx=0x7f2f5c04a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2e44ff9640 1 -- 172.21.15.144:0/3785594010 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c015590 con 0x558973347990 2024-09-13T19:33:30.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55897334f460 con 0x558973347990 2024-09-13T19:33:30.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2e44ff9640 1 -- 172.21.15.144:0/3785594010 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c022a60 con 0x558973347990 2024-09-13T19:33:30.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2e44ff9640 1 -- 172.21.15.144:0/3785594010 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c022d40 con 0x558973347990 2024-09-13T19:33:30.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897334f870 con 0x558973347990 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2e44ff9640 1 -- 172.21.15.144:0/3785594010 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f5c052020 con 0x558973347990 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2e44ff9640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e2c034650 0x7f2e2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2e44ff9640 1 -- 172.21.15.144:0/3785594010 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2f5c047070 con 0x558973347990 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f62998640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e2c034650 0x7f2e2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897335a140 0x55897335c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897335cd50 con 0x55897335a140 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f62197640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897335a140 0x55897335c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f62998640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e2c034650 0x7f2e2c036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2f540e3560 tx=0x7f2f540e0000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f62197640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897335a140 0x55897335c600 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f4c00d040 con 0x55897335a140 2024-09-13T19:33:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 realm 2024-09-13T19:33:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589733595d0 con 0x55897335a140 2024-09-13T19:33:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f4c00d040 con 0x55897335a140 2024-09-13T19:33:30.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897335d850 con 0x55897335a140 2024-09-13T19:33:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f4c00d040 con 0x55897335a140 2024-09-13T19:33:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897335e120 con 0x55897335a140 2024-09-13T19:33:30.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f4c00d040 con 0x55897335a140 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897335ea20 0x558973360e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973361550 con 0x55897335ea20 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.463+0000 7f2f63199640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897335ea20 0x558973360e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f63199640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897335ea20 0x558973360e10 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f64e88980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f64e88980 20 searching for the correct realm 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589733634f0 0x558973365990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x5589733634f0 2024-09-13T19:33:30.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62998640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589733634f0 0x558973365990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62998640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589733634f0 0x558973365990 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62998640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f2f540c6030 0x7f2f540b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x7f2f540c6030 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62197640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f2f540c6030 0x7f2f540b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62197640 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f2f540c6030 0x7f2f540b4730 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c00d040 con 0x7f2f540c6030 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x55897335ea20 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x55897335a140 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f4c00d040 con 0x55897335a140 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x55897335a140 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.467+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x55897335ea20 2024-09-13T19:33:30.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x55897335ea20 2024-09-13T19:33:30.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x7f2f540c6030 2024-09-13T19:33:30.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x5589733634f0 2024-09-13T19:33:30.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x55897335a140 2024-09-13T19:33:30.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x55897335ea20 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x55897335a140 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x7f2f540c6030 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558973366060 con 0x5589733634f0 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x5589733634f0 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.471+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335ea20 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x5589733634f0 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x5589733634f0 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335a140 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335a140 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335ea20 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x5589733634f0 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x7f2f540c6030 2024-09-13T19:33:30.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335a140 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335ea20 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x5589733634f0 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.475+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335ea20 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x7f2f540c6030 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x5589733634f0 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335ea20 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x55897335a140 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2f540fd040 con 0x7f2f540c6030 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973361f10 con 0x55897335a140 2024-09-13T19:33:30.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973362390 con 0x55897335a140 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589733623a0 con 0x55897335a140 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 zone default found 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 4 Realm: () 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:30.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 zonegroup default 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973362840 con 0x55897335ea20 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.479+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973361b50 con 0x5589733634f0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589733688c0 con 0x5589733634f0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 20 started sync module instance, tier type = 2024-09-13T19:33:30.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:30.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973367360 con 0x7f2f540c6030 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94048831829888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973367360 con 0x7f2f540c6030 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973369110 con 0x55897335a140 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94048831829888] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94048831827632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973369110 con 0x55897335a140 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.483+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973369ad0 con 0x5589733634f0 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94048831837728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336a370 con 0x5589733634f0 2024-09-13T19:33:30.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336ad70 con 0x7f2f540c6030 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94048831827632] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94048831835232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336b160 con 0x7f2f540c6030 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336bb20 con 0x55897335a140 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94048831837728] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.487+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94048831835232] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.491+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.491+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94048831842432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336b670 con 0x55897335a140 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.491+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336bec0 con 0x55897335ea20 2024-09-13T19:33:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.491+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94048831842432] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.491+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.491+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94048831846000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336bf40 con 0x55897335ea20 2024-09-13T19:33:30.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.491+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336c790 con 0x55897335ea20 2024-09-13T19:33:30.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94048831848768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336cc10 con 0x55897335ea20 2024-09-13T19:33:30.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336d730 con 0x55897335ea20 2024-09-13T19:33:30.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94048831846000] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94048831848768] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94048831853056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336c660 con 0x55897335ea20 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 20 add_watcher() i=0 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 20 add_watcher() i=1 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 20 add_watcher() i=2 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 20 add_watcher() i=3 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 20 add_watcher() i=4 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 20 add_watcher() i=5 2024-09-13T19:33:30.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.495+0000 7f2f64e88980 20 add_watcher() i=6 2024-09-13T19:33:30.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94048831853056] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 20 add_watcher() i=7 2024-09-13T19:33:30.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:30.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973370720 con 0x55897335a140 2024-09-13T19:33:30.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94048831847056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336dc10 con 0x55897335a140 2024-09-13T19:33:30.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94048831847056] v30'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2e197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 5 note: GC not initialized 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2d93fff640 20 reqs_thread_entry: start 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 20 Filter name: none 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2d91ffb640 20 reqs_thread_entry: start 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558973393840 con 0x55897335a140 2024-09-13T19:33:30.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T19:33:30.504 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:33:30.326363Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:30.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2e197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.499+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94048831847056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973393d80 con 0x55897335a140 2024-09-13T19:33:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94048831847056] v30'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94048831829888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973393d80 con 0x7f2f540c6030 2024-09-13T19:33:30.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94048831829888] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f64e88980 20 remove_watcher() i=0 2024-09-13T19:33:30.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f64e88980 2 removed watcher, disabling cache 2024-09-13T19:33:30.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94048831827632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973367780 con 0x55897335a140 2024-09-13T19:33:30.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94048831827632] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f64e88980 20 remove_watcher() i=1 2024-09-13T19:33:30.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.503+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94048831837728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973366eb0 con 0x5589733634f0 2024-09-13T19:33:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.507+0000 7f2f62998640 1 -- 172.21.15.144:0/3785594010 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94048831837728] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f540ee070 con 0x5589733634f0 2024-09-13T19:33:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.507+0000 7f2f64e88980 20 remove_watcher() i=2 2024-09-13T19:33:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.507+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94048831835232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973369620 con 0x7f2f540c6030 2024-09-13T19:33:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.507+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94048831835232] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x7f2f540c6030 2024-09-13T19:33:30.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.507+0000 7f2f64e88980 20 remove_watcher() i=3 2024-09-13T19:33:30.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.507+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94048831842432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558973369620 con 0x55897335a140 2024-09-13T19:33:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.511+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94048831842432] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c02a040 con 0x55897335a140 2024-09-13T19:33:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.511+0000 7f2f64e88980 20 remove_watcher() i=4 2024-09-13T19:33:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.511+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94048831846000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336a880 con 0x55897335ea20 2024-09-13T19:33:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.511+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94048831846000] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.511+0000 7f2f64e88980 20 remove_watcher() i=5 2024-09-13T19:33:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.511+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94048831848768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336bb20 con 0x55897335ea20 2024-09-13T19:33:30.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94048831848768] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 20 remove_watcher() i=6 2024-09-13T19:33:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94048831853056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897336bb20 con 0x55897335ea20 2024-09-13T19:33:30.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f63199640 1 -- 172.21.15.144:0/3785594010 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94048831853056] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c036030 con 0x55897335ea20 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 20 remove_watcher() i=7 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897335ea20 msgr2=0x558973360e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897335ea20 0x558973360e10 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897335a140 msgr2=0x55897335c600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897335a140 0x55897335c600 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f2f540c6030 msgr2=0x7f2f540b4730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f2f540c6030 0x7f2f540b4730 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589733634f0 msgr2=0x558973365990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589733634f0 0x558973365990 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e2c034650 msgr2=0x7f2e2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e2c034650 0x7f2e2c036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2f540e3560 tx=0x7f2f540e0000 comp rx=0 tx=0).stop 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 msgr2=0x55897334ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f62197640 1 -- 172.21.15.144:0/3785594010 reap_dead start 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x55897334ec90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c017fe0 tx=0x7f2f5c04a2f0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 shutdown_connections 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/3785594010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558973347990 0x55897334ec90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 >> 172.21.15.144:0/3785594010 conn(0x558973343d70 msgr2=0x558973341e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 shutdown_connections 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/3785594010 wait complete. 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/287437729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e3c034650 msgr2=0x7f2e3c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/287437729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e3c034650 0x7f2e3c036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x558973327e50 tx=0x7f2f540c5a20 comp rx=0 tx=0).stop 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/287437729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897333aea0 msgr2=0x55897333b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/287437729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897333aea0 0x55897333b2c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x558973327db0 tx=0x7f2f5c00af40 comp rx=0 tx=0).stop 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/287437729 shutdown_connections 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/287437729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e3c034650 0x7f2e3c036b10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/287437729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897333aea0 0x55897333b2c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/287437729 >> 172.21.15.144:0/287437729 conn(0x55897332fff0 msgr2=0x558973332a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/287437729 shutdown_connections 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/287437729 wait complete. 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x558973329d00 msgr2=0x55897332c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x558973329d00 0x55897332c0f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558973324f20 msgr2=0x558973327370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558973324f20 0x558973327370 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e480346a0 msgr2=0x7f2e48036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e480346a0 0x7f2e48036b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c000f70 tx=0x7f2f4c001420 comp rx=0 tx=0).stop 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a27c0 msgr2=0x55897331ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a27c0 0x55897331ffa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400a4e0 tx=0x7f2f54017e30 comp rx=0 tx=0).stop 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 shutdown_connections 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558973324f20 0x558973327370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x558973329d00 0x55897332c0f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f2e480346a0 0x7f2e48036b60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 --2- 172.21.15.144:0/2726712375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589731a27c0 0x55897331ffa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 >> 172.21.15.144:0/2726712375 conn(0x5589732271b0 msgr2=0x558973313340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.515+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 shutdown_connections 2024-09-13T19:33:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.519+0000 7f2f64e88980 1 -- 172.21.15.144:0/2726712375 wait complete. 2024-09-13T19:33:30.530 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:33:30.326363Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:30.531 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T19:33:30.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T19:33:30.531 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-13T19:33:30.609 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:30.609 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:30.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577f390980 1 Processor -- start 2024-09-13T19:33:30.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577f390980 1 -- start start 2024-09-13T19:33:30.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577f390980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e10d9096a0 0x55e10d909a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577f390980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e10d791ae0 con 0x55e10d909ff0 2024-09-13T19:33:30.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577f390980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55e10d7b5e30 con 0x55e10d9096a0 2024-09-13T19:33:30.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577cea0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e10d9096a0 0x55e10d909a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577cea0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e10d9096a0 0x55e10d909a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56940/0 (socket says 172.21.15.144:56940) 2024-09-13T19:33:30.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577c69f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55e10d909ff0 0x55e10d90ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44486/0 (socket says 172.21.15.144:44486) 2024-09-13T19:33:30.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577cea0640 1 -- 172.21.15.144:0/2657890604 learned_addr learned my addr 172.21.15.144:0/2657890604 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577be9e640 1 -- 172.21.15.144:0/2657890604 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 798059653 0 0) 0x55e10d791ae0 con 0x55e10d909ff0 2024-09-13T19:33:30.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577cea0640 1 -- 172.21.15.144:0/2657890604 >> v1:172.21.15.18:6789/0 conn(0x55e10d909ff0 legacy=0x55e10d90ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.607+0000 7f577cea0640 1 -- 172.21.15.144:0/2657890604 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e10d911270 con 0x55e10d9096a0 2024-09-13T19:33:30.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577cea0640 1 --2- 172.21.15.144:0/2657890604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d909a80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f576c00a5c0 tx=0x7f576c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cecd0e30b59f088 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577be9e640 1 -- 172.21.15.144:0/2657890604 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c0a6070 con 0x55e10d9096a0 2024-09-13T19:33:30.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577be9e640 1 -- 172.21.15.144:0/2657890604 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c0af070 con 0x55e10d9096a0 2024-09-13T19:33:30.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577be9e640 1 -- 172.21.15.144:0/2657890604 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c0aa5c0 con 0x55e10d9096a0 2024-09-13T19:33:30.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577f390980 1 -- 172.21.15.144:0/2657890604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 msgr2=0x55e10d909a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577f390980 1 --2- 172.21.15.144:0/2657890604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d909a80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f576c00a5c0 tx=0x7f576c01b340 comp rx=0 tx=0).stop 2024-09-13T19:33:30.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577f390980 1 -- 172.21.15.144:0/2657890604 shutdown_connections 2024-09-13T19:33:30.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577f390980 1 --2- 172.21.15.144:0/2657890604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d909a80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577f390980 1 -- 172.21.15.144:0/2657890604 >> 172.21.15.144:0/2657890604 conn(0x55e10d9051c0 msgr2=0x55e10d9075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577f390980 1 -- 172.21.15.144:0/2657890604 shutdown_connections 2024-09-13T19:33:30.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.611+0000 7f577f390980 1 -- 172.21.15.144:0/2657890604 wait complete. 2024-09-13T19:33:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 Processor -- start 2024-09-13T19:33:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- start start 2024-09-13T19:33:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e10d7b7200 con 0x55e10d9096a0 2024-09-13T19:33:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577cea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577cea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9f47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56950/0 (socket says 172.21.15.144:56950) 2024-09-13T19:33:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577cea0640 1 -- 172.21.15.144:0/4053972281 learned_addr learned my addr 172.21.15.144:0/4053972281 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577cea0640 1 -- 172.21.15.144:0/4053972281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e10d9f4db0 con 0x55e10d9096a0 2024-09-13T19:33:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577cea0640 1 --2- 172.21.15.144:0/4053972281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9f47e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f576c00a5c0 tx=0x7f576c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30da5a15db38852 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f566ae0d640 1 -- 172.21.15.144:0/4053972281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c0aa9b0 con 0x55e10d9096a0 2024-09-13T19:33:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f566ae0d640 1 -- 172.21.15.144:0/4053972281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c0aab50 con 0x55e10d9096a0 2024-09-13T19:33:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f566ae0d640 1 -- 172.21.15.144:0/4053972281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c0aae50 con 0x55e10d9096a0 2024-09-13T19:33:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- 172.21.15.144:0/4053972281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 msgr2=0x55e10d9f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 --2- 172.21.15.144:0/4053972281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9f47e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f576c00a5c0 tx=0x7f576c003030 comp rx=0 tx=0).stop 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- 172.21.15.144:0/4053972281 shutdown_connections 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 --2- 172.21.15.144:0/4053972281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9f47e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- 172.21.15.144:0/4053972281 >> 172.21.15.144:0/4053972281 conn(0x55e10d9051c0 msgr2=0x55e10d9f0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- 172.21.15.144:0/4053972281 shutdown_connections 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- 172.21.15.144:0/4053972281 wait complete. 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 Processor -- start 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- start start 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.627+0000 7f577f390980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e10d910cb0 con 0x55e10d9096a0 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577cea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577cea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9fba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56964/0 (socket says 172.21.15.144:56964) 2024-09-13T19:33:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577cea0640 1 -- 172.21.15.144:0/998695055 learned_addr learned my addr 172.21.15.144:0/998695055 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577cea0640 1 -- 172.21.15.144:0/998695055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e10d9fbf70 con 0x55e10d9096a0 2024-09-13T19:33:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577cea0640 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9fba30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f576c01bbe0 tx=0x7f576c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f566960a640 1 -- 172.21.15.144:0/998695055 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c0c6750 con 0x55e10d9096a0 2024-09-13T19:33:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e10d9fc200 con 0x55e10d9096a0 2024-09-13T19:33:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f566960a640 1 -- 172.21.15.144:0/998695055 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c0c68f0 con 0x55e10d9096a0 2024-09-13T19:33:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f566960a640 1 -- 172.21.15.144:0/998695055 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c0c6c10 con 0x55e10d9096a0 2024-09-13T19:33:30.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e10d9feee0 con 0x55e10d9096a0 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f566960a640 1 -- 172.21.15.144:0/998695055 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f576c0ce020 con 0x55e10d9096a0 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f566960a640 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5664034650 0x7f5664036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f566960a640 1 -- 172.21.15.144:0/998695055 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f576c0cc020 con 0x55e10d9096a0 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577c69f640 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5664034650 0x7f5664036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10d909ff0 0x55e10da029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da03000 con 0x55e10d909ff0 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577d6a1640 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10d909ff0 0x55e10da029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577c69f640 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5664034650 0x7f5664036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5770000c10 tx=0x7f57700013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577d6a1640 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10d909ff0 0x55e10da029c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577d6a1640 1 -- 172.21.15.144:0/998695055 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577400a4d0 con 0x55e10d909ff0 2024-09-13T19:33:30.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.631+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da000e0 con 0x55e10d909ff0 2024-09-13T19:33:30.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577d6a1640 1 -- 172.21.15.144:0/998695055 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f577400a4d0 con 0x55e10d909ff0 2024-09-13T19:33:30.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da052f0 0x55e10da076e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da07db0 con 0x55e10da052f0 2024-09-13T19:33:30.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577cea0640 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da052f0 0x55e10da076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577cea0640 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da052f0 0x55e10da076e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577cea0640 1 -- 172.21.15.144:0/998695055 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da052f0 2024-09-13T19:33:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da04190 con 0x55e10d909ff0 2024-09-13T19:33:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577d6a1640 1 -- 172.21.15.144:0/998695055 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f577400a4d0 con 0x55e10d909ff0 2024-09-13T19:33:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da04670 con 0x55e10d909ff0 2024-09-13T19:33:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577d6a1640 1 -- 172.21.15.144:0/998695055 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f577400a4d0 con 0x55e10d909ff0 2024-09-13T19:33:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577f390980 1 Processor -- start 2024-09-13T19:33:30.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577f390980 1 -- start start 2024-09-13T19:33:30.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577f390980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10da16490 0x55e10da168b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577f390980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e10d810800 con 0x55e10da16490 2024-09-13T19:33:30.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577d6a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10da16490 0x55e10da168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577d6a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10da16490 0x55e10da168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56980/0 (socket says 172.21.15.144:56980) 2024-09-13T19:33:30.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.635+0000 7f577d6a1640 1 -- 172.21.15.144:0/4018463082 learned_addr learned my addr 172.21.15.144:0/4018463082 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577d6a1640 1 -- 172.21.15.144:0/4018463082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e10da16df0 con 0x55e10da16490 2024-09-13T19:33:30.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577d6a1640 1 --2- 172.21.15.144:0/4018463082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10da16490 0x55e10da168b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55e10da033c0 tx=0x7f5774018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f56627fc640 1 -- 172.21.15.144:0/4018463082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774014450 con 0x55e10da16490 2024-09-13T19:33:30.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f56627fc640 1 -- 172.21.15.144:0/4018463082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57740145f0 con 0x55e10da16490 2024-09-13T19:33:30.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f56627fc640 1 -- 172.21.15.144:0/4018463082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774014910 con 0x55e10da16490 2024-09-13T19:33:30.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577f390980 1 -- 172.21.15.144:0/4018463082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e10da17080 con 0x55e10da16490 2024-09-13T19:33:30.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577f390980 1 -- 172.21.15.144:0/4018463082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e10da19d00 con 0x55e10da16490 2024-09-13T19:33:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f56627fc640 1 -- 172.21.15.144:0/4018463082 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5774011040 con 0x55e10da16490 2024-09-13T19:33:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f56627fc640 1 --2- 172.21.15.144:0/4018463082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5654034650 0x7f5654036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f56627fc640 1 -- 172.21.15.144:0/4018463082 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f577401e070 con 0x55e10da16490 2024-09-13T19:33:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577cea0640 1 --2- 172.21.15.144:0/4018463082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5654034650 0x7f5654036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577f390980 1 Processor -- start 2024-09-13T19:33:30.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577f390980 1 -- start start 2024-09-13T19:33:30.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577cea0640 1 --2- 172.21.15.144:0/4018463082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5654034650 0x7f5654036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55e10da03460 tx=0x7f576c0c6db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577f390980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10d87efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.639+0000 7f577f390980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e10d9f5070 con 0x55e10d87ebe0 2024-09-13T19:33:30.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10d87efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10d87efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:56994/0 (socket says 172.21.15.144:56994) 2024-09-13T19:33:30.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 -- 172.21.15.144:0/3680295355 learned_addr learned my addr 172.21.15.144:0/3680295355 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 -- 172.21.15.144:0/3680295355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e10d87f5b0 con 0x55e10d87ebe0 2024-09-13T19:33:30.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 --2- 172.21.15.144:0/3680295355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10d87efe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f577404a160 tx=0x7f5774016a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750449eb05125f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f5653fff640 1 -- 172.21.15.144:0/3680295355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577403f070 con 0x55e10d87ebe0 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f5653fff640 1 -- 172.21.15.144:0/3680295355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57740433b0 con 0x55e10d87ebe0 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f5653fff640 1 -- 172.21.15.144:0/3680295355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774022a50 con 0x55e10d87ebe0 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- 172.21.15.144:0/3680295355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 msgr2=0x55e10d87efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 --2- 172.21.15.144:0/3680295355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10d87efe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f577404a160 tx=0x7f5774016a90 comp rx=0 tx=0).stop 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- 172.21.15.144:0/3680295355 shutdown_connections 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 --2- 172.21.15.144:0/3680295355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10d87efe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- 172.21.15.144:0/3680295355 >> 172.21.15.144:0/3680295355 conn(0x55e10da1f370 msgr2=0x55e10da1d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- 172.21.15.144:0/3680295355 shutdown_connections 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- 172.21.15.144:0/3680295355 wait complete. 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 Processor -- start 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- start start 2024-09-13T19:33:30.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10da2c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e10d87fd60 con 0x55e10d87ebe0 2024-09-13T19:33:30.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10da2c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10da2c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57002/0 (socket says 172.21.15.144:57002) 2024-09-13T19:33:30.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 learned_addr learned my addr 172.21.15.144:0/2621740873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e10da2ca60 con 0x55e10d87ebe0 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577d6a1640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10da2c520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57740118c0 tx=0x7f577404a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f56527fc640 1 -- 172.21.15.144:0/2621740873 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774031030 con 0x55e10d87ebe0 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e10da2ccf0 con 0x55e10d87ebe0 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f56527fc640 1 -- 172.21.15.144:0/2621740873 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57740133b0 con 0x55e10d87ebe0 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f56527fc640 1 -- 172.21.15.144:0/2621740873 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57740136b0 con 0x55e10d87ebe0 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.643+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e10da2f9d0 con 0x55e10d87ebe0 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f56527fc640 1 -- 172.21.15.144:0/2621740873 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5774042070 con 0x55e10d87ebe0 2024-09-13T19:33:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f56527fc640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5648034650 0x7f5648036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f56527fc640 1 -- 172.21.15.144:0/2621740873 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5774035070 con 0x55e10d87ebe0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577cea0640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5648034650 0x7f5648036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10da37bb0 0x55e10da3a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da3a790 con 0x55e10da37bb0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577c69f640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10da37bb0 0x55e10da3a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577cea0640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5648034650 0x7f5648036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f576c0bd700 tx=0x7f576c0e8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577c69f640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10da37bb0 0x55e10da3a040 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577000f600 con 0x55e10da37bb0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 realm 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da370c0 con 0x55e10da37bb0 2024-09-13T19:33:30.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577000f600 con 0x55e10da37bb0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da3b290 con 0x55e10da37bb0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577000f600 con 0x55e10da37bb0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da3bb60 con 0x55e10da37bb0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f577000f600 con 0x55e10da37bb0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da3c580 0x55e10da3e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da3f0b0 con 0x55e10da3c580 2024-09-13T19:33:30.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577d6a1640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da3c580 0x55e10da3e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.647+0000 7f577d6a1640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da3c580 0x55e10da3e970 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577f390980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577f390980 20 searching for the correct realm 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e10da41000 0x55e10da43430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577cea0640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e10da41000 0x55e10da43430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577cea0640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e10da41000 0x55e10da43430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577cea0640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f576c0f8040 0x7f576c0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x7f576c0f8040 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577c69f640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f576c0f8040 0x7f576c0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577c69f640 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f576c0f8040 0x7f576c0c5ac0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577000f600 con 0x7f576c0f8040 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f577000f600 con 0x55e10da37bb0 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.651+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x7f576c0f8040 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x7f576c0f8040 2024-09-13T19:33:30.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.655+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x7f576c0f8040 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x7f576c0f8040 2024-09-13T19:33:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da41000 2024-09-13T19:33:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.659+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da3c580 2024-09-13T19:33:30.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43ab0 con 0x7f576c0f8040 2024-09-13T19:33:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da3fa70 con 0x55e10da37bb0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da3fef0 con 0x55e10da37bb0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da3f610 con 0x55e10da37bb0 2024-09-13T19:33:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 zone default found 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 4 Realm: () 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 zonegroup default 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da43f30 con 0x55e10da3c580 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da461b0 con 0x55e10da41000 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da46550 con 0x55e10da41000 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 started sync module instance, tier type = 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.663+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da45640 con 0x7f576c0f8040 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.667+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.667+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94425084877680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da45640 con 0x7f576c0f8040 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.667+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da46f70 con 0x55e10da37bb0 2024-09-13T19:33:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.667+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94425084877680] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.667+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.667+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94425084881504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da45640 con 0x55e10da37bb0 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.667+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da47980 con 0x55e10da41000 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94425084881504] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94425084875152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da455b0 con 0x55e10da41000 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da486d0 con 0x7f576c0f8040 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94425084887856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da48dc0 con 0x7f576c0f8040 2024-09-13T19:33:30.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da498b0 con 0x55e10da37bb0 2024-09-13T19:33:30.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94425084875152] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94425084887856] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94425084892032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da49870 con 0x55e10da37bb0 2024-09-13T19:33:30.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.671+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da49ca0 con 0x55e10da3c580 2024-09-13T19:33:30.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.675+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94425084892032] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.675+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.675+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94425084886384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da4a090 con 0x55e10da3c580 2024-09-13T19:33:30.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.675+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da4aa50 con 0x55e10da3c580 2024-09-13T19:33:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.675+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.675+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94425084886384] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.675+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94425084896672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da4ae70 con 0x55e10da3c580 2024-09-13T19:33:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.675+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da48830 con 0x55e10da3c580 2024-09-13T19:33:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94425084896672] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94425084897728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da4ade0 con 0x55e10da3c580 2024-09-13T19:33:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 20 add_watcher() i=0 2024-09-13T19:33:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 20 add_watcher() i=1 2024-09-13T19:33:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 20 add_watcher() i=2 2024-09-13T19:33:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 20 add_watcher() i=3 2024-09-13T19:33:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 20 add_watcher() i=4 2024-09-13T19:33:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 20 add_watcher() i=5 2024-09-13T19:33:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 20 add_watcher() i=6 2024-09-13T19:33:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94425084897728] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 20 add_watcher() i=7 2024-09-13T19:33:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.679+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da4e910 con 0x55e10da37bb0 2024-09-13T19:33:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94425084900400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da4bda0 con 0x55e10da37bb0 2024-09-13T19:33:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94425084900400] v30'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f56337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 5 note: GC not initialized 2024-09-13T19:33:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f56327e4640 20 reqs_thread_entry: start 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 20 Filter name: none 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f562b7fe640 20 reqs_thread_entry: start 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da71ed0 con 0x55e10da37bb0 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da78ab0 con 0x55e10da37bb0 2024-09-13T19:33:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94425085084960 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da741e0 con 0x55e10da37bb0 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94425084892032 notify 128849018888 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f5770018040 con 0x55e10da37bb0 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f5653fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94425084892032 notifier 4398 bl.length()=758 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f5653fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f5653fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(64 notify.4 [notify cookie 94425085084960 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f5653fff640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5640003eb0 con 0x55e10da37bb0 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.683+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94425085084960 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f577000a040 con 0x55e10da37bb0 2024-09-13T19:33:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da78520 con 0x55e10da37bb0 2024-09-13T19:33:30.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577f390980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94425085084960 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e10da73d30 con 0x7f576c0f8040 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== watch-notify(notify (1) cookie 94425084877680 notify 128849018884 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f577000a040 con 0x7f576c0f8040 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f5653fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94425084877680 notifier 4398 bl.length()=159 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f5653fff640 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5640003eb0 con 0x7f576c0f8040 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.0 [notify cookie 94425085084960 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== watch-notify(notify_complete (2) cookie 94425085084960 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f577003db10 con 0x7f576c0f8040 2024-09-13T19:33:30.691 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:33:30.326363Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:30.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f56337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94425084900400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da6fd00 con 0x55e10da37bb0 2024-09-13T19:33:30.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94425084900400] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.687+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94425084877680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da6fd00 con 0x7f576c0f8040 2024-09-13T19:33:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.691+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94425084877680] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.691+0000 7f577f390980 20 remove_watcher() i=0 2024-09-13T19:33:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.691+0000 7f577f390980 2 removed watcher, disabling cache 2024-09-13T19:33:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.691+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94425084881504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da45b70 con 0x55e10da37bb0 2024-09-13T19:33:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.691+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94425084881504] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.691+0000 7f577f390980 20 remove_watcher() i=1 2024-09-13T19:33:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.691+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94425084875152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da6fd00 con 0x55e10da41000 2024-09-13T19:33:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577cea0640 1 -- 172.21.15.144:0/2621740873 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94425084875152] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0bd3f0 con 0x55e10da41000 2024-09-13T19:33:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577f390980 20 remove_watcher() i=2 2024-09-13T19:33:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94425084887856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da46a60 con 0x7f576c0f8040 2024-09-13T19:33:30.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94425084887856] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x7f576c0f8040 2024-09-13T19:33:30.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577f390980 20 remove_watcher() i=3 2024-09-13T19:33:30.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94425084892032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da45190 con 0x55e10da37bb0 2024-09-13T19:33:30.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94425084892032] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577002b040 con 0x55e10da37bb0 2024-09-13T19:33:30.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577f390980 20 remove_watcher() i=4 2024-09-13T19:33:30.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.695+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94425084886384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da46a60 con 0x55e10da3c580 2024-09-13T19:33:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.699+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94425084886384] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.699+0000 7f577f390980 20 remove_watcher() i=5 2024-09-13T19:33:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.699+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94425084896672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da45190 con 0x55e10da3c580 2024-09-13T19:33:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.699+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94425084896672] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.699+0000 7f577f390980 20 remove_watcher() i=6 2024-09-13T19:33:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.699+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94425084897728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e10da46a60 con 0x55e10da3c580 2024-09-13T19:33:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577d6a1640 1 -- 172.21.15.144:0/2621740873 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94425084897728] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774041030 con 0x55e10da3c580 2024-09-13T19:33:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 20 remove_watcher() i=7 2024-09-13T19:33:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da3c580 msgr2=0x55e10da3e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da3c580 0x55e10da3e970 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10da37bb0 msgr2=0x55e10da3a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10da37bb0 0x55e10da3a040 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f576c0f8040 msgr2=0x7f576c0c5ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f576c0f8040 0x7f576c0c5ac0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e10da41000 msgr2=0x55e10da43430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e10da41000 0x55e10da43430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5648034650 msgr2=0x7f5648036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5648034650 0x7f5648036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f576c0bd700 tx=0x7f576c0e8000 comp rx=0 tx=0).stop 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 msgr2=0x55e10da2c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10da2c520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57740118c0 tx=0x7f577404a0c0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 shutdown_connections 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f576c0f8040 0x7f576c0c5ac0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577c69f640 1 -- 172.21.15.144:0/2621740873 reap_dead start 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e10da41000 0x55e10da43430 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10da37bb0 0x55e10da3a040 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da3c580 0x55e10da3e970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5648034650 0x7f5648036b10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/2621740873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d87ebe0 0x55e10da2c520 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 >> 172.21.15.144:0/2621740873 conn(0x55e10da1f370 msgr2=0x55e10da1d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 shutdown_connections 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/2621740873 wait complete. 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/4018463082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5654034650 msgr2=0x7f5654036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/4018463082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5654034650 0x7f5654036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55e10da03460 tx=0x7f576c0c6db0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/4018463082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10da16490 msgr2=0x55e10da168b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/4018463082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10da16490 0x55e10da168b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55e10da033c0 tx=0x7f5774018830 comp rx=0 tx=0).stop 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/4018463082 shutdown_connections 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/4018463082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5654034650 0x7f5654036b10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/4018463082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10da16490 0x55e10da168b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/4018463082 >> 172.21.15.144:0/4018463082 conn(0x55e10da0b5e0 msgr2=0x55e10da0e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/4018463082 shutdown_connections 2024-09-13T19:33:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/4018463082 wait complete. 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da052f0 msgr2=0x55e10da076e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da052f0 0x55e10da076e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10d909ff0 msgr2=0x55e10da029c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10d909ff0 0x55e10da029c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5664034650 msgr2=0x7f5664036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5664034650 0x7f5664036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5770000c10 tx=0x7f57700013c0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 msgr2=0x55e10d9fba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9fba30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f576c01bbe0 tx=0x7f576c0180e0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 shutdown_connections 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e10d909ff0 0x55e10da029c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e10da052f0 0x55e10da076e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5664034650 0x7f5664036b10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 --2- 172.21.15.144:0/998695055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d9096a0 0x55e10d9fba30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 >> 172.21.15.144:0/998695055 conn(0x55e10d9051c0 msgr2=0x55e10d9eef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 shutdown_connections 2024-09-13T19:33:30.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.703+0000 7f577f390980 1 -- 172.21.15.144:0/998695055 wait complete. 2024-09-13T19:33:30.717 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:33:30.326363Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:30.717 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T19:33:30.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T19:33:30.717 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-13T19:33:30.792 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:30.792 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce769f980 1 Processor -- start 2024-09-13T19:33:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce769f980 1 -- start start 2024-09-13T19:33:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce769f980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556e97d10870 0x556e97d12c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce769f980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e97b96ae0 con 0x556e97c832d0 2024-09-13T19:33:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce769f980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x556e97bbae30 con 0x556e97d10870 2024-09-13T19:33:30.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce49ae640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556e97d10870 0x556e97d12c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce49ae640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556e97d10870 0x556e97d12c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57004/0 (socket says 172.21.15.144:57004) 2024-09-13T19:33:30.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1877266809 learned_addr learned my addr 172.21.15.144:0/1877266809 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1877266809 >> v1:172.21.15.18:6789/0 conn(0x556e97c832d0 legacy=0x556e97d0f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.791+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1877266809 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e97d131d0 con 0x556e97d10870 2024-09-13T19:33:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1ce49ae640 1 --2- 172.21.15.144:0/1877266809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97d10870 0x556e97d12c90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00a5c0 tx=0x7f1cdc01b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7f0dcdaccac461 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1cd7fff640 1 -- 172.21.15.144:0/1877266809 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cdc0af070 con 0x556e97d10870 2024-09-13T19:33:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1cd7fff640 1 -- 172.21.15.144:0/1877266809 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cdc0aa530 con 0x556e97d10870 2024-09-13T19:33:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1cd7fff640 1 -- 172.21.15.144:0/1877266809 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cdc0aa830 con 0x556e97d10870 2024-09-13T19:33:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1ce769f980 1 -- 172.21.15.144:0/1877266809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97d10870 msgr2=0x556e97d12c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1877266809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97d10870 0x556e97d12c90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00a5c0 tx=0x7f1cdc01b1d0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1ce769f980 1 -- 172.21.15.144:0/1877266809 shutdown_connections 2024-09-13T19:33:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1877266809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97d10870 0x556e97d12c90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1ce769f980 1 -- 172.21.15.144:0/1877266809 >> 172.21.15.144:0/1877266809 conn(0x556e97d09090 msgr2=0x556e97d0b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1ce769f980 1 -- 172.21.15.144:0/1877266809 shutdown_connections 2024-09-13T19:33:30.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.795+0000 7f1ce769f980 1 -- 172.21.15.144:0/1877266809 wait complete. 2024-09-13T19:33:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce769f980 1 Processor -- start 2024-09-13T19:33:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce769f980 1 -- start start 2024-09-13T19:33:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce769f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce769f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556e97bbc200 con 0x556e97c832d0 2024-09-13T19:33:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce51af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce51af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57006/0 (socket says 172.21.15.144:57006) 2024-09-13T19:33:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce51af640 1 -- 172.21.15.144:0/1083263089 learned_addr learned my addr 172.21.15.144:0/1083263089 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce51af640 1 -- 172.21.15.144:0/1083263089 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e97e009c0 con 0x556e97c832d0 2024-09-13T19:33:30.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1ce51af640 1 --2- 172.21.15.144:0/1083263089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e003f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0001860 tx=0x7f1ce0006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f9f4635651f6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1bd3606640 1 -- 172.21.15.144:0/1083263089 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ce0016070 con 0x556e97c832d0 2024-09-13T19:33:30.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1bd3606640 1 -- 172.21.15.144:0/1083263089 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce000b6f0 con 0x556e97c832d0 2024-09-13T19:33:30.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.807+0000 7f1bd3606640 1 -- 172.21.15.144:0/1083263089 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ce000b9f0 con 0x556e97c832d0 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- 172.21.15.144:0/1083263089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 msgr2=0x556e97e003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1083263089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e003f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0001860 tx=0x7f1ce0006f90 comp rx=0 tx=0).stop 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- 172.21.15.144:0/1083263089 shutdown_connections 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1083263089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e003f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- 172.21.15.144:0/1083263089 >> 172.21.15.144:0/1083263089 conn(0x556e97d09090 msgr2=0x556e97dfc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- 172.21.15.144:0/1083263089 shutdown_connections 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- 172.21.15.144:0/1083263089 wait complete. 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 Processor -- start 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- start start 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e07810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556e97d1ea00 con 0x556e97c832d0 2024-09-13T19:33:30.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce51af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e07810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce51af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e07810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57020/0 (socket says 172.21.15.144:57020) 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce51af640 1 -- 172.21.15.144:0/3929419913 learned_addr learned my addr 172.21.15.144:0/3929419913 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce51af640 1 -- 172.21.15.144:0/3929419913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e97e07d50 con 0x556e97c832d0 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce51af640 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e07810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x556e97e015d0 tx=0x7f1ce0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1bd1e03640 1 -- 172.21.15.144:0/3929419913 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ce0022070 con 0x556e97c832d0 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1bd1e03640 1 -- 172.21.15.144:0/3929419913 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce0006160 con 0x556e97c832d0 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1bd1e03640 1 -- 172.21.15.144:0/3929419913 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ce0016070 con 0x556e97c832d0 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e97e07fe0 con 0x556e97c832d0 2024-09-13T19:33:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.811+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e97e0acc0 con 0x556e97c832d0 2024-09-13T19:33:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1bd1e03640 1 -- 172.21.15.144:0/3929419913 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ce0025070 con 0x556e97c832d0 2024-09-13T19:33:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1bd1e03640 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bcc0346a0 0x7f1bcc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1bd1e03640 1 -- 172.21.15.144:0/3929419913 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1ce0048da0 con 0x556e97c832d0 2024-09-13T19:33:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce49ae640 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bcc0346a0 0x7f1bcc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97d10870 0x556e97e0e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e0ee90 con 0x556e97d10870 2024-09-13T19:33:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce59b0640 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97d10870 0x556e97e0e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce49ae640 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bcc0346a0 0x7f1bcc036b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0ac000 tx=0x7f1cdc0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce59b0640 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97d10870 0x556e97e0e910 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce59b0640 1 -- 172.21.15.144:0/3929419913 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97d10870 2024-09-13T19:33:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e0bee0 con 0x556e97d10870 2024-09-13T19:33:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce59b0640 1 -- 172.21.15.144:0/3929419913 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97d10870 2024-09-13T19:33:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e111c0 0x556e97e135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e13ca0 con 0x556e97e111c0 2024-09-13T19:33:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce51af640 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e111c0 0x556e97e135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce51af640 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e111c0 0x556e97e135b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce51af640 1 -- 172.21.15.144:0/3929419913 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e111c0 2024-09-13T19:33:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e10060 con 0x556e97d10870 2024-09-13T19:33:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce59b0640 1 -- 172.21.15.144:0/3929419913 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97d10870 2024-09-13T19:33:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.815+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e10540 con 0x556e97d10870 2024-09-13T19:33:30.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce59b0640 1 -- 172.21.15.144:0/3929419913 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97d10870 2024-09-13T19:33:30.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 Processor -- start 2024-09-13T19:33:30.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 -- start start 2024-09-13T19:33:30.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e223c0 0x556e97e227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556e97c15800 con 0x556e97e223c0 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce59b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e223c0 0x556e97e227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce59b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e223c0 0x556e97e227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57026/0 (socket says 172.21.15.144:57026) 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce59b0640 1 -- 172.21.15.144:0/766870400 learned_addr learned my addr 172.21.15.144:0/766870400 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce59b0640 1 -- 172.21.15.144:0/766870400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e97e22d20 con 0x556e97e223c0 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce59b0640 1 --2- 172.21.15.144:0/766870400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e223c0 0x556e97e227e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x556e97e08c40 tx=0x7f1cd800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1bcaffd640 1 -- 172.21.15.144:0/766870400 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8007dd0 con 0x556e97e223c0 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 -- 172.21.15.144:0/766870400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e97e22fb0 con 0x556e97e223c0 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1bcaffd640 1 -- 172.21.15.144:0/766870400 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd801e020 con 0x556e97e223c0 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 -- 172.21.15.144:0/766870400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e97e25c30 con 0x556e97e223c0 2024-09-13T19:33:30.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1bcaffd640 1 -- 172.21.15.144:0/766870400 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8019550 con 0x556e97e223c0 2024-09-13T19:33:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1bcaffd640 1 -- 172.21.15.144:0/766870400 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1cd8016040 con 0x556e97e223c0 2024-09-13T19:33:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1bcaffd640 1 --2- 172.21.15.144:0/766870400 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bc0034650 0x7f1bc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1bcaffd640 1 -- 172.21.15.144:0/766870400 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1cd801f030 con 0x556e97e223c0 2024-09-13T19:33:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce51af640 1 --2- 172.21.15.144:0/766870400 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bc0034650 0x7f1bc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 Processor -- start 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 -- start start 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce51af640 1 --2- 172.21.15.144:0/766870400 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bc0034650 0x7f1bc0036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x556e97e0f310 tx=0x7f1ce003a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e2f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.819+0000 7f1ce769f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556e97e00d40 con 0x556e97e2ee90 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e2f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e2f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57042/0 (socket says 172.21.15.144:57042) 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 -- 172.21.15.144:0/301081679 learned_addr learned my addr 172.21.15.144:0/301081679 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 -- 172.21.15.144:0/301081679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e97e2f840 con 0x556e97e2ee90 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 --2- 172.21.15.144:0/301081679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e2f270 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1cd804a010 tx=0x7f1cd8015800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5288ddabe50179a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1bc8ff9640 1 -- 172.21.15.144:0/301081679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd801d070 con 0x556e97e2ee90 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1bc8ff9640 1 -- 172.21.15.144:0/301081679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd80224f0 con 0x556e97e2ee90 2024-09-13T19:33:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1bc8ff9640 1 -- 172.21.15.144:0/301081679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8014470 con 0x556e97e2ee90 2024-09-13T19:33:30.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- 172.21.15.144:0/301081679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 msgr2=0x556e97e2f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 --2- 172.21.15.144:0/301081679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e2f270 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1cd804a010 tx=0x7f1cd8015800 comp rx=0 tx=0).stop 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- 172.21.15.144:0/301081679 shutdown_connections 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 --2- 172.21.15.144:0/301081679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e2f270 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- 172.21.15.144:0/301081679 >> 172.21.15.144:0/301081679 conn(0x556e97e2b300 msgr2=0x556e97e29400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- 172.21.15.144:0/301081679 shutdown_connections 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- 172.21.15.144:0/301081679 wait complete. 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 Processor -- start 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- start start 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e36230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556e97e2fe90 con 0x556e97e2ee90 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e36230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e36230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57058/0 (socket says 172.21.15.144:57058) 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 learned_addr learned my addr 172.21.15.144:0/1050854083 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e97e36770 con 0x556e97e2ee90 2024-09-13T19:33:30.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce59b0640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e36230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8014880 tx=0x7f1cd8049f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1bb6ffd640 1 -- 172.21.15.144:0/1050854083 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8019900 con 0x556e97e2ee90 2024-09-13T19:33:30.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1bb6ffd640 1 -- 172.21.15.144:0/1050854083 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8019aa0 con 0x556e97e2ee90 2024-09-13T19:33:30.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e97e36a00 con 0x556e97e2ee90 2024-09-13T19:33:30.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1bb6ffd640 1 -- 172.21.15.144:0/1050854083 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd804b190 con 0x556e97e2ee90 2024-09-13T19:33:30.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.823+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e97e396e0 con 0x556e97e2ee90 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1bb6ffd640 1 -- 172.21.15.144:0/1050854083 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1cd8043050 con 0x556e97e2ee90 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1bb6ffd640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bb00346a0 0x7f1bb0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1bb6ffd640 1 -- 172.21.15.144:0/1050854083 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1cd8041020 con 0x556e97e2ee90 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce51af640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bb00346a0 0x7f1bb0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97e41700 0x556e97e43ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e442f0 con 0x556e97e41700 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce49ae640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97e41700 0x556e97e43ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce51af640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bb00346a0 0x7f1bb0036b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0025520 tx=0x7f1ce003c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce49ae640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97e41700 0x556e97e43ba0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 realm 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e44720 con 0x556e97e41700 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e44ff0 con 0x556e97e41700 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e45390 con 0x556e97e41700 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e460f0 0x556e97e484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e48af0 con 0x556e97e460f0 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.827+0000 7f1ce59b0640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e460f0 0x556e97e484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce59b0640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e460f0 0x556e97e484e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce769f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:30.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce769f980 20 searching for the correct realm 2024-09-13T19:33:30.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556e97e4aa40 0x556e97e4ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e4aa40 2024-09-13T19:33:30.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce51af640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556e97e4aa40 0x556e97e4ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce51af640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556e97e4aa40 0x556e97e4ce70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce51af640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1ce0027060 0x7f1ce00103a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x7f1ce0027060 2024-09-13T19:33:30.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce49ae640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1ce0027060 0x7f1ce00103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce49ae640 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1ce0027060 0x7f1ce00103a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e460f0 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e41700 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e41700 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.831+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e460f0 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e460f0 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x7f1ce0027060 2024-09-13T19:33:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e4aa40 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e41700 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e460f0 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e41700 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x7f1ce0027060 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e4aa40 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4d540 con 0x556e97e4aa40 2024-09-13T19:33:30.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.835+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e460f0 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e4aa40 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e4aa40 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e41700 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e41700 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e460f0 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e4aa40 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x7f1ce0027060 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e41700 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e460f0 2024-09-13T19:33:30.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e4aa40 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.839+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e460f0 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x7f1ce0027060 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e4aa40 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e460f0 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x556e97e41700 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1ce0056040 con 0x7f1ce0027060 2024-09-13T19:33:30.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e494b0 con 0x556e97e41700 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e498a0 con 0x556e97e41700 2024-09-13T19:33:30.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e498a0 con 0x556e97e41700 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 zone default found 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 4 Realm: () 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 zonegroup default 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e49cc0 con 0x556e97e460f0 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4f3a0 con 0x556e97e4aa40 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4f7c0 con 0x556e97e4aa40 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.843+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce769f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce769f980 20 started sync module instance, tier type = 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce769f980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4e840 con 0x7f1ce0027060 2024-09-13T19:33:30.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93933483126112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4e840 con 0x7f1ce0027060 2024-09-13T19:33:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e50280 con 0x556e97e41700 2024-09-13T19:33:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93933483126112] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93933483130256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e4e840 con 0x556e97e41700 2024-09-13T19:33:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.847+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e50c90 con 0x556e97e4aa40 2024-09-13T19:33:30.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93933483132896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e514e0 con 0x556e97e4aa40 2024-09-13T19:33:30.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e51ee0 con 0x7f1ce0027060 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93933483130256] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93933483123600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e522d0 con 0x7f1ce0027060 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e52ba0 con 0x556e97e41700 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93933483132896] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93933483123600] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93933483137520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e52280 con 0x556e97e41700 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.851+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e53440 con 0x556e97e460f0 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.855+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93933483137520] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.855+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.855+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93933483143056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e52280 con 0x556e97e460f0 2024-09-13T19:33:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.855+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e53c90 con 0x556e97e460f0 2024-09-13T19:33:30.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93933483143056] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93933483135024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e53c90 con 0x556e97e460f0 2024-09-13T19:33:30.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e546d0 con 0x556e97e460f0 2024-09-13T19:33:30.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93933483135024] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93933483147680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e548b0 con 0x556e97e460f0 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 20 add_watcher() i=0 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 20 add_watcher() i=1 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 20 add_watcher() i=2 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 20 add_watcher() i=3 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 20 add_watcher() i=4 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 20 add_watcher() i=5 2024-09-13T19:33:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.859+0000 7f1ce769f980 20 add_watcher() i=6 2024-09-13T19:33:30.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93933483147680] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 20 add_watcher() i=7 2024-09-13T19:33:30.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:30.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e57c80 con 0x556e97e41700 2024-09-13T19:33:30.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93933483149216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e55070 con 0x556e97e41700 2024-09-13T19:33:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93933483149216] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1b9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 5 note: GC not initialized 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1b9a7e4640 20 reqs_thread_entry: start 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 20 Filter name: none 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1b0bfff640 20 reqs_thread_entry: start 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e7b1f0 con 0x556e97e41700 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 20 rados_obj.operate() r=0 bl.length=582 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.863+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e81830 con 0x556e97e41700 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce769f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce769f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce769f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93933483332256 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e97e7d1f0 con 0x556e97e41700 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 93933483137520 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x556e97d131d0 con 0x556e97e41700 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1bc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 93933483137520 notifier 4405 bl.length()=732 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1bc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1bc8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(64 notify.4 [notify cookie 93933483332256 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1bc8ff9640 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1ba8003eb0 con 0x556e97e41700 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 93933483332256 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e97b96ae0 con 0x556e97e41700 2024-09-13T19:33:30.871 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:33:30.326363Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1b9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93933483149216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e7d9b0 con 0x556e97e41700 2024-09-13T19:33:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93933483149216] v30'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.867+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93933483126112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e7d9b0 con 0x7f1ce0027060 2024-09-13T19:33:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.871+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93933483126112] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.871+0000 7f1ce769f980 20 remove_watcher() i=0 2024-09-13T19:33:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.871+0000 7f1ce769f980 2 removed watcher, disabling cache 2024-09-13T19:33:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.871+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93933483130256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e7d9b0 con 0x556e97e41700 2024-09-13T19:33:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.871+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93933483130256] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.871+0000 7f1ce769f980 20 remove_watcher() i=1 2024-09-13T19:33:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.871+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93933483132896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e7d9b0 con 0x556e97e4aa40 2024-09-13T19:33:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce51af640 1 -- 172.21.15.144:0/1050854083 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93933483132896] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ce0024030 con 0x556e97e4aa40 2024-09-13T19:33:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce769f980 20 remove_watcher() i=2 2024-09-13T19:33:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93933483123600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e547a0 con 0x7f1ce0027060 2024-09-13T19:33:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93933483123600] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x7f1ce0027060 2024-09-13T19:33:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce769f980 20 remove_watcher() i=3 2024-09-13T19:33:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93933483137520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e507e0 con 0x556e97e41700 2024-09-13T19:33:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93933483137520] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cdc0b2040 con 0x556e97e41700 2024-09-13T19:33:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce769f980 20 remove_watcher() i=4 2024-09-13T19:33:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.875+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93933483143056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e547a0 con 0x556e97e460f0 2024-09-13T19:33:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.879+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93933483143056] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.879+0000 7f1ce769f980 20 remove_watcher() i=5 2024-09-13T19:33:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.879+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93933483135024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e519f0 con 0x556e97e460f0 2024-09-13T19:33:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.879+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93933483135024] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.879+0000 7f1ce769f980 20 remove_watcher() i=6 2024-09-13T19:33:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.879+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93933483147680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e97e507e0 con 0x556e97e460f0 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce59b0640 1 -- 172.21.15.144:0/1050854083 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93933483147680] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x556e97e460f0 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 20 remove_watcher() i=7 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e460f0 msgr2=0x556e97e484e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e460f0 0x556e97e484e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97e41700 msgr2=0x556e97e43ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97e41700 0x556e97e43ba0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1ce0027060 msgr2=0x7f1ce00103a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1ce0027060 0x7f1ce00103a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556e97e4aa40 msgr2=0x556e97e4ce70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556e97e4aa40 0x556e97e4ce70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bb00346a0 msgr2=0x7f1bb0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bb00346a0 0x7f1bb0036b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0025520 tx=0x7f1ce003c000 comp rx=0 tx=0).stop 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 msgr2=0x556e97e36230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce49ae640 1 -- 172.21.15.144:0/1050854083 reap_dead start 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e36230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8014880 tx=0x7f1cd8049f70 comp rx=0 tx=0).stop 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 shutdown_connections 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/1050854083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e2ee90 0x556e97e36230 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 >> 172.21.15.144:0/1050854083 conn(0x556e97e2b300 msgr2=0x556e97e293d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 shutdown_connections 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/1050854083 wait complete. 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/766870400 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bc0034650 msgr2=0x7f1bc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/766870400 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bc0034650 0x7f1bc0036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x556e97e0f310 tx=0x7f1ce003a040 comp rx=0 tx=0).stop 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/766870400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e223c0 msgr2=0x556e97e227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/766870400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e223c0 0x556e97e227e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x556e97e08c40 tx=0x7f1cd800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/766870400 shutdown_connections 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/766870400 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bc0034650 0x7f1bc0036b10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/766870400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97e223c0 0x556e97e227e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/766870400 >> 172.21.15.144:0/766870400 conn(0x556e97e17510 msgr2=0x556e97e19f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/766870400 shutdown_connections 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/766870400 wait complete. 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e111c0 msgr2=0x556e97e135b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e111c0 0x556e97e135b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97d10870 msgr2=0x556e97e0e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97d10870 0x556e97e0e910 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bcc0346a0 msgr2=0x7f1bcc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bcc0346a0 0x7f1bcc036b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0ac000 tx=0x7f1cdc0a5000 comp rx=0 tx=0).stop 2024-09-13T19:33:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 msgr2=0x556e97e07810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e07810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x556e97e015d0 tx=0x7f1ce0001260 comp rx=0 tx=0).stop 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 shutdown_connections 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556e97d10870 0x556e97e0e910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556e97e111c0 0x556e97e135b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1bcc0346a0 0x7f1bcc036b60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 --2- 172.21.15.144:0/3929419913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556e97c832d0 0x556e97e07810 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 >> 172.21.15.144:0/3929419913 conn(0x556e97d09090 msgr2=0x556e97dfaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 shutdown_connections 2024-09-13T19:33:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.883+0000 7f1ce769f980 1 -- 172.21.15.144:0/3929419913 wait complete. 2024-09-13T19:33:30.896 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:33:30.326363Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:30.896 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T19:33:30.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T19:33:30.896 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-13T19:33:30.973 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:30.973 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bd908980 1 Processor -- start 2024-09-13T19:33:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bd908980 1 -- start start 2024-09-13T19:33:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bd908980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55844a154510 0x55844a1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bd908980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558449fddae0 con 0x55844a154e60 2024-09-13T19:33:30.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bd908980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55844a001e30 con 0x55844a154510 2024-09-13T19:33:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bb418640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55844a154510 0x55844a1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bac17640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55844a154e60 0x55844a159890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44512/0 (socket says 172.21.15.144:44512) 2024-09-13T19:33:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bac17640 1 -- 172.21.15.144:0/1039913355 learned_addr learned my addr 172.21.15.144:0/1039913355 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bb418640 1 -- 172.21.15.144:0/1039913355 >> v1:172.21.15.18:6789/0 conn(0x55844a154e60 legacy=0x55844a159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.971+0000 7f16bb418640 1 -- 172.21.15.144:0/1039913355 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844a15c0e0 con 0x55844a154510 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16bb418640 1 --2- 172.21.15.144:0/1039913355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a1548f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00a480 tx=0x7f16ac01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9983fb4a69c02c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16ba416640 1 -- 172.21.15.144:0/1039913355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16ac0b0070 con 0x55844a154510 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16ba416640 1 -- 172.21.15.144:0/1039913355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac0ab540 con 0x55844a154510 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16ba416640 1 -- 172.21.15.144:0/1039913355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16ac0ab840 con 0x55844a154510 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16bd908980 1 -- 172.21.15.144:0/1039913355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 msgr2=0x55844a1548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16bd908980 1 --2- 172.21.15.144:0/1039913355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a1548f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00a480 tx=0x7f16ac01b280 comp rx=0 tx=0).stop 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16bd908980 1 -- 172.21.15.144:0/1039913355 shutdown_connections 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16bd908980 1 --2- 172.21.15.144:0/1039913355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a1548f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16bd908980 1 -- 172.21.15.144:0/1039913355 >> 172.21.15.144:0/1039913355 conn(0x55844a150030 msgr2=0x55844a152450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16bd908980 1 -- 172.21.15.144:0/1039913355 shutdown_connections 2024-09-13T19:33:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.975+0000 7f16bd908980 1 -- 172.21.15.144:0/1039913355 wait complete. 2024-09-13T19:33:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.987+0000 7f16bd908980 1 Processor -- start 2024-09-13T19:33:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.987+0000 7f16bd908980 1 -- start start 2024-09-13T19:33:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.987+0000 7f16bd908980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.987+0000 7f16bd908980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55844a003200 con 0x55844a154510 2024-09-13T19:33:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.987+0000 7f16bb418640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.987+0000 7f16bb418640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a0c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57086/0 (socket says 172.21.15.144:57086) 2024-09-13T19:33:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.987+0000 7f16bb418640 1 -- 172.21.15.144:0/4040847745 learned_addr learned my addr 172.21.15.144:0/4040847745 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bb418640 1 -- 172.21.15.144:0/4040847745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844a0ca170 con 0x55844a154510 2024-09-13T19:33:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bb418640 1 --2- 172.21.15.144:0/4040847745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a0c9ba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0ae040 tx=0x7f16ac003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c15385959f96b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f15a960a640 1 -- 172.21.15.144:0/4040847745 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16ac0b0040 con 0x55844a154510 2024-09-13T19:33:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f15a960a640 1 -- 172.21.15.144:0/4040847745 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac0ab9d0 con 0x55844a154510 2024-09-13T19:33:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f15a960a640 1 -- 172.21.15.144:0/4040847745 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16ac0abcf0 con 0x55844a154510 2024-09-13T19:33:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- 172.21.15.144:0/4040847745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 msgr2=0x55844a0c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 --2- 172.21.15.144:0/4040847745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a0c9ba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0ae040 tx=0x7f16ac003030 comp rx=0 tx=0).stop 2024-09-13T19:33:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- 172.21.15.144:0/4040847745 shutdown_connections 2024-09-13T19:33:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 --2- 172.21.15.144:0/4040847745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a0c9ba0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- 172.21.15.144:0/4040847745 >> 172.21.15.144:0/4040847745 conn(0x55844a150030 msgr2=0x55844a23b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- 172.21.15.144:0/4040847745 shutdown_connections 2024-09-13T19:33:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- 172.21.15.144:0/4040847745 wait complete. 2024-09-13T19:33:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 Processor -- start 2024-09-13T19:33:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- start start 2024-09-13T19:33:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a249e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55844a15bb20 con 0x55844a154510 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bb418640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a249e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bb418640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a249e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57096/0 (socket says 172.21.15.144:57096) 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bb418640 1 -- 172.21.15.144:0/2078159954 learned_addr learned my addr 172.21.15.144:0/2078159954 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bb418640 1 -- 172.21.15.144:0/2078159954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844a24a3b0 con 0x55844a154510 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bb418640 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a249e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f16ac019930 tx=0x7f16ac018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f15a7e07640 1 -- 172.21.15.144:0/2078159954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16ac0b0070 con 0x55844a154510 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55844a24a640 con 0x55844a154510 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f15a7e07640 1 -- 172.21.15.144:0/2078159954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac0b68b0 con 0x55844a154510 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844a24d320 con 0x55844a154510 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.991+0000 7f15a7e07640 1 -- 172.21.15.144:0/2078159954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16ac0b6b90 con 0x55844a154510 2024-09-13T19:33:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f15a7e07640 1 -- 172.21.15.144:0/2078159954 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f16ac0b7420 con 0x55844a154510 2024-09-13T19:33:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f15a7e07640 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f15a00346a0 0x7f15a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f15a7e07640 1 -- 172.21.15.144:0/2078159954 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f16ac0bc070 con 0x55844a154510 2024-09-13T19:33:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bac17640 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f15a00346a0 0x7f15a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a154e60 0x55844a250e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a251460 con 0x55844a154e60 2024-09-13T19:33:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bbc19640 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a154e60 0x55844a250e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bac17640 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f15a00346a0 0x7f15a0036b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16b0001650 tx=0x7f16b0006740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bbc19640 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a154e60 0x55844a250e40 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bbc19640 1 -- 172.21.15.144:0/2078159954 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16b40083f0 con 0x55844a154e60 2024-09-13T19:33:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a251d20 con 0x55844a154e60 2024-09-13T19:33:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bbc19640 1 -- 172.21.15.144:0/2078159954 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16b40083f0 con 0x55844a154e60 2024-09-13T19:33:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a253630 0x55844a255ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a256260 con 0x55844a253630 2024-09-13T19:33:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bb418640 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a253630 0x55844a255ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.995+0000 7f16bb418640 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a253630 0x55844a255ad0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bb418640 1 -- 172.21.15.144:0/2078159954 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a253630 2024-09-13T19:33:31.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a252570 con 0x55844a154e60 2024-09-13T19:33:31.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bbc19640 1 -- 172.21.15.144:0/2078159954 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16b40083f0 con 0x55844a154e60 2024-09-13T19:33:31.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a252910 con 0x55844a154e60 2024-09-13T19:33:31.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bbc19640 1 -- 172.21.15.144:0/2078159954 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16b40083f0 con 0x55844a154e60 2024-09-13T19:33:31.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bd908980 1 Processor -- start 2024-09-13T19:33:31.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bd908980 1 -- start start 2024-09-13T19:33:31.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bd908980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a264980 0x55844a264da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bd908980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55844a05c800 con 0x55844a264980 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bbc19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a264980 0x55844a264da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bbc19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a264980 0x55844a264da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57104/0 (socket says 172.21.15.144:57104) 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bbc19640 1 -- 172.21.15.144:0/288706292 learned_addr learned my addr 172.21.15.144:0/288706292 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bbc19640 1 -- 172.21.15.144:0/288706292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844a2652e0 con 0x55844a264980 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bbc19640 1 --2- 172.21.15.144:0/288706292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a264980 0x55844a264da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55844a24b2a0 tx=0x7f16b400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f15a5602640 1 -- 172.21.15.144:0/288706292 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b4007dd0 con 0x55844a264980 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bd908980 1 -- 172.21.15.144:0/288706292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55844a265570 con 0x55844a264980 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f15a5602640 1 -- 172.21.15.144:0/288706292 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b401e020 con 0x55844a264980 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f16bd908980 1 -- 172.21.15.144:0/288706292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844a2681f0 con 0x55844a264980 2024-09-13T19:33:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:30.999+0000 7f15a5602640 1 -- 172.21.15.144:0/288706292 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b4019550 con 0x55844a264980 2024-09-13T19:33:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f15a5602640 1 -- 172.21.15.144:0/288706292 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f16b4016040 con 0x55844a264980 2024-09-13T19:33:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f15a5602640 1 --2- 172.21.15.144:0/288706292 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1594034650 0x7f1594036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f15a5602640 1 -- 172.21.15.144:0/288706292 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f16b401f030 con 0x55844a264980 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bb418640 1 --2- 172.21.15.144:0/288706292 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1594034650 0x7f1594036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 Processor -- start 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- start start 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bb418640 1 --2- 172.21.15.144:0/288706292 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1594034650 0x7f1594036b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0e2d10 tx=0x7f16ac0d3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a2718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55844a0ca430 con 0x55844a2714c0 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bbc19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a2718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bbc19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a2718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57118/0 (socket says 172.21.15.144:57118) 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bbc19640 1 -- 172.21.15.144:0/2738434005 learned_addr learned my addr 172.21.15.144:0/2738434005 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bbc19640 1 -- 172.21.15.144:0/2738434005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844a271e70 con 0x55844a2714c0 2024-09-13T19:33:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bbc19640 1 --2- 172.21.15.144:0/2738434005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a2718a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f16b4049fe0 tx=0x7f16b4015500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8374a225aeb261b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f159effd640 1 -- 172.21.15.144:0/2738434005 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b401d070 con 0x55844a2714c0 2024-09-13T19:33:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f159effd640 1 -- 172.21.15.144:0/2738434005 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b40224f0 con 0x55844a2714c0 2024-09-13T19:33:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f159effd640 1 -- 172.21.15.144:0/2738434005 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b4014470 con 0x55844a2714c0 2024-09-13T19:33:31.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- 172.21.15.144:0/2738434005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 msgr2=0x55844a2718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 --2- 172.21.15.144:0/2738434005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a2718a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f16b4049fe0 tx=0x7f16b4015500 comp rx=0 tx=0).stop 2024-09-13T19:33:31.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- 172.21.15.144:0/2738434005 shutdown_connections 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 --2- 172.21.15.144:0/2738434005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a2718a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- 172.21.15.144:0/2738434005 >> 172.21.15.144:0/2738434005 conn(0x55844a26d8a0 msgr2=0x55844a26b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- 172.21.15.144:0/2738434005 shutdown_connections 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- 172.21.15.144:0/2738434005 wait complete. 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 Processor -- start 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- start start 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a278890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bd908980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55844a272430 con 0x55844a2714c0 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bbc19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a278890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bbc19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a278890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57128/0 (socket says 172.21.15.144:57128) 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.003+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 learned_addr learned my addr 172.21.15.144:0/2890946120 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844a278dd0 con 0x55844a2714c0 2024-09-13T19:33:31.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bbc19640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a278890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f16b4015a50 tx=0x7f16b4049f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f159d7fa640 1 -- 172.21.15.144:0/2890946120 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b404bbe0 con 0x55844a2714c0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55844a279060 con 0x55844a2714c0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f159d7fa640 1 -- 172.21.15.144:0/2890946120 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b404bd80 con 0x55844a2714c0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f159d7fa640 1 -- 172.21.15.144:0/2890946120 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b4019900 con 0x55844a2714c0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844a27bd40 con 0x55844a2714c0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f159d7fa640 1 -- 172.21.15.144:0/2890946120 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f16b4043050 con 0x55844a2714c0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f159d7fa640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1584034650 0x7f1584036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f159d7fa640 1 -- 172.21.15.144:0/2890946120 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f16b4041020 con 0x55844a2714c0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bb418640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1584034650 0x7f1584036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a283c60 0x55844a2860f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a286840 con 0x55844a283c60 2024-09-13T19:33:31.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bac17640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a283c60 0x55844a2860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bb418640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1584034650 0x7f1584036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0e4010 tx=0x7f16ac01b280 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bac17640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a283c60 0x55844a2860f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 realm 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a283170 con 0x55844a283c60 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a287340 con 0x55844a283c60 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a287c10 con 0x55844a283c60 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a288550 0x55844a28a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.007+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a28b0f0 con 0x55844a288550 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bbc19640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a288550 0x55844a28a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bbc19640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a288550 0x55844a28a960 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bd908980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bd908980 20 searching for the correct realm 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55844a28d040 0x55844a28f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bb418640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55844a28d040 0x55844a28f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bb418640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55844a28d040 0x55844a28f470 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bb418640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f16ac0f1040 0x7f16ac0aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x7f16ac0f1040 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bac17640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f16ac0f1040 0x7f16ac0aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bac17640 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f16ac0f1040 0x7f16ac0aa3b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a283c60 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.011+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a283c60 2024-09-13T19:33:31.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x7f16ac0f1040 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a283c60 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a283c60 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x7f16ac0f1040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.015+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a283c60 2024-09-13T19:33:31.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a283c60 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x7f16ac0f1040 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a283c60 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.019+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x7f16ac0f1040 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a28d040 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a288550 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x55844a283c60 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55844a28fb40 con 0x7f16ac0f1040 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:31.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a28bab0 con 0x55844a283c60 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a28b6f0 con 0x55844a283c60 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a28c450 con 0x55844a283c60 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 zone default found 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 4 Realm: () 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 zonegroup default 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a290070 con 0x55844a288550 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.023+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a292340 con 0x55844a28d040 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a2926e0 con 0x55844a28d040 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 20 started sync module instance, tier type = 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2917d0 con 0x7f16ac0f1040 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94026668252368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2917d0 con 0x7f16ac0f1040 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2930a0 con 0x55844a283c60 2024-09-13T19:33:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94026668252368] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94026668256512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2917d0 con 0x55844a283c60 2024-09-13T19:33:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.027+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a293ae0 con 0x55844a28d040 2024-09-13T19:33:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.031+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94026668256512] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.031+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.031+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94026668249888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a291740 con 0x55844a28d040 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.031+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2947e0 con 0x7f16ac0f1040 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.031+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.031+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94026668262464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a294e90 con 0x7f16ac0f1040 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.031+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2959b0 con 0x55844a283c60 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.031+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94026668249888] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.035+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94026668262464] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.035+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.035+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94026668266624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a295970 con 0x55844a283c60 2024-09-13T19:33:31.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.035+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a296250 con 0x55844a288550 2024-09-13T19:33:31.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.035+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94026668266624] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.035+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.035+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94026668268960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a295970 con 0x55844a288550 2024-09-13T19:33:31.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.035+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a296ac0 con 0x55844a288550 2024-09-13T19:33:31.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94026668268960] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94026668271088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a296ac0 con 0x55844a288550 2024-09-13T19:33:31.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2974e0 con 0x55844a288550 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94026668273616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a297950 con 0x55844a288550 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 20 add_watcher() i=0 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 20 add_watcher() i=1 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 20 add_watcher() i=2 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 20 add_watcher() i=3 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 20 add_watcher() i=4 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 20 add_watcher() i=5 2024-09-13T19:33:31.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94026668271088] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.039+0000 7f16bd908980 20 add_watcher() i=6 2024-09-13T19:33:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94026668273616] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 20 add_watcher() i=7 2024-09-13T19:33:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a297950 con 0x55844a283c60 2024-09-13T19:33:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94026668274848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2978c0 con 0x55844a283c60 2024-09-13T19:33:31.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94026668274848] v30'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f1571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:31.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 5 note: GC not initialized 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f1570fe1640 20 reqs_thread_entry: start 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 20 Filter name: none 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f14ea7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a2be0b0 con 0x55844a283c60 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:31.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:31.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.043+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2c4720 con 0x55844a283c60 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bd908980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bd908980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bd908980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94026668458384 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a2bfe50 con 0x55844a283c60 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94026668266624 notify 128849018890 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f16b001b040 con 0x55844a283c60 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f159effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94026668266624 notifier 4412 bl.length()=567 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f159effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:31.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f159effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:31.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f159effd640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1580003eb0 con 0x55844a283c60 2024-09-13T19:33:31.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(64 notify.4 [notify cookie 94026668458384 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94026668458384 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558449fddae0 con 0x55844a283c60 2024-09-13T19:33:31.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2c4190 con 0x7f16ac0f1040 2024-09-13T19:33:31.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bd908980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T19:33:31.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.047+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94026668458384 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55844a2bf9a0 con 0x7f16ac0f1040 2024-09-13T19:33:31.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== watch-notify(notify (1) cookie 94026668252368 notify 128849018885 ret 0) ==== 201+0+0 (crc 0 0 0) 0x558449fddae0 con 0x7f16ac0f1040 2024-09-13T19:33:31.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f159e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94026668252368 notifier 4412 bl.length()=159 2024-09-13T19:33:31.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(67 notify.0 [notify cookie 94026668458384 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f159e7fc640 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f14f00032d0 con 0x7f16ac0f1040 2024-09-13T19:33:31.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== watch-notify(notify_complete (2) cookie 94026668458384 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f16b0036450 con 0x7f16ac0f1040 2024-09-13T19:33:31.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.054 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:31.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f1571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94026668274848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2bfe50 con 0x55844a283c60 2024-09-13T19:33:31.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94026668274848] v30'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94026668252368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2974a0 con 0x7f16ac0f1040 2024-09-13T19:33:31.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94026668252368] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bd908980 20 remove_watcher() i=0 2024-09-13T19:33:31.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bd908980 2 removed watcher, disabling cache 2024-09-13T19:33:31.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.051+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94026668256512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a291cd0 con 0x55844a283c60 2024-09-13T19:33:31.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94026668256512] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bd908980 20 remove_watcher() i=1 2024-09-13T19:33:31.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94026668249888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a2974a0 con 0x55844a28d040 2024-09-13T19:33:31.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bb418640 1 -- 172.21.15.144:0/2890946120 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94026668249888] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16ac0b3040 con 0x55844a28d040 2024-09-13T19:33:31.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bd908980 20 remove_watcher() i=2 2024-09-13T19:33:31.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94026668262464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a292d00 con 0x7f16ac0f1040 2024-09-13T19:33:31.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94026668262464] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x7f16ac0f1040 2024-09-13T19:33:31.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bd908980 20 remove_watcher() i=3 2024-09-13T19:33:31.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.055+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94026668266624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a291cd0 con 0x55844a283c60 2024-09-13T19:33:31.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.059+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94026668266624] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b000f070 con 0x55844a283c60 2024-09-13T19:33:31.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.059+0000 7f16bd908980 20 remove_watcher() i=4 2024-09-13T19:33:31.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.059+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94026668268960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a291320 con 0x55844a288550 2024-09-13T19:33:31.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.063+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94026668268960] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.063+0000 7f16bd908980 20 remove_watcher() i=5 2024-09-13T19:33:31.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.063+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94026668271088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a294440 con 0x55844a288550 2024-09-13T19:33:31.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.063+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94026668271088] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.063+0000 7f16bd908980 20 remove_watcher() i=6 2024-09-13T19:33:31.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.063+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94026668273616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55844a292d00 con 0x55844a288550 2024-09-13T19:33:31.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bbc19640 1 -- 172.21.15.144:0/2890946120 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94026668273616] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b4052070 con 0x55844a288550 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 20 remove_watcher() i=7 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a288550 msgr2=0x55844a28a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a288550 0x55844a28a960 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a283c60 msgr2=0x55844a2860f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a283c60 0x55844a2860f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f16ac0f1040 msgr2=0x7f16ac0aa3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f16ac0f1040 0x7f16ac0aa3b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55844a28d040 msgr2=0x55844a28f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55844a28d040 0x55844a28f470 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1584034650 msgr2=0x7f1584036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1584034650 0x7f1584036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0e4010 tx=0x7f16ac01b280 comp rx=0 tx=0).stop 2024-09-13T19:33:31.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 msgr2=0x55844a278890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2890946120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a2714c0 0x55844a278890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f16b4015a50 tx=0x7f16b4049f70 comp rx=0 tx=0).stop 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bac17640 1 -- 172.21.15.144:0/2890946120 reap_dead start 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 shutdown_connections 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 >> 172.21.15.144:0/2890946120 conn(0x55844a26d8a0 msgr2=0x55844a272b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 shutdown_connections 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2890946120 wait complete. 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/288706292 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1594034650 msgr2=0x7f1594036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/288706292 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1594034650 0x7f1594036b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0e2d10 tx=0x7f16ac0d3040 comp rx=0 tx=0).stop 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/288706292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a264980 msgr2=0x55844a264da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/288706292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a264980 0x55844a264da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55844a24b2a0 tx=0x7f16b400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/288706292 shutdown_connections 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/288706292 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1594034650 0x7f1594036b10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/288706292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a264980 0x55844a264da0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/288706292 >> 172.21.15.144:0/288706292 conn(0x55844a259ad0 msgr2=0x55844a25c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/288706292 shutdown_connections 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/288706292 wait complete. 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a253630 msgr2=0x55844a255ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a253630 0x55844a255ad0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a154e60 msgr2=0x55844a250e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a154e60 0x55844a250e40 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f15a00346a0 msgr2=0x7f15a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f15a00346a0 0x7f15a0036b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16b0001650 tx=0x7f16b0006740 comp rx=0 tx=0).stop 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 msgr2=0x55844a249e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a249e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f16ac019930 tx=0x7f16ac018020 comp rx=0 tx=0).stop 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 shutdown_connections 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55844a154e60 0x55844a250e40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55844a253630 0x55844a255ad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f15a00346a0 0x7f15a0036b60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 --2- 172.21.15.144:0/2078159954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55844a154510 0x55844a249e70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 >> 172.21.15.144:0/2078159954 conn(0x55844a150030 msgr2=0x55844a23a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 shutdown_connections 2024-09-13T19:33:31.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.067+0000 7f16bd908980 1 -- 172.21.15.144:0/2078159954 wait complete. 2024-09-13T19:33:31.079 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:31.079 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:33:31.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:33:31.080 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T19:33:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafcbbcf980 1 Processor -- start 2024-09-13T19:33:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafcbbcf980 1 -- start start 2024-09-13T19:33:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafcbbcf980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5601a1969fa0 0x5601a1968a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafcbbcf980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601a187bae0 con 0x5601a1969b90 2024-09-13T19:33:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafcbbcf980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5601a189fe30 con 0x5601a1969fa0 2024-09-13T19:33:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafc8ede640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5601a1969fa0 0x5601a1968a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafc8ede640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5601a1969fa0 0x5601a1968a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57138/0 (socket says 172.21.15.144:57138) 2024-09-13T19:33:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafc8ede640 1 -- 172.21.15.144:0/316677318 learned_addr learned my addr 172.21.15.144:0/316677318 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafc8ede640 1 -- 172.21.15.144:0/316677318 >> v1:172.21.15.18:6789/0 conn(0x5601a1969b90 legacy=0x5601a1968350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafbbfff640 1 -- 172.21.15.144:0/316677318 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101206320 0 0) 0x5601a187bae0 con 0x5601a1969b90 2024-09-13T19:33:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.151+0000 7fafc8ede640 1 -- 172.21.15.144:0/316677318 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a19690c0 con 0x5601a1969fa0 2024-09-13T19:33:31.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafc8ede640 1 --2- 172.21.15.144:0/316677318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1968a60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fafc000a4e0 tx=0x7fafc001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d5d73be8f7b798 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafbbfff640 1 -- 172.21.15.144:0/316677318 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc00aa540 con 0x5601a1969fa0 2024-09-13T19:33:31.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafbbfff640 1 -- 172.21.15.144:0/316677318 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc00aa6e0 con 0x5601a1969fa0 2024-09-13T19:33:31.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafbbfff640 1 -- 172.21.15.144:0/316677318 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc00aaa00 con 0x5601a1969fa0 2024-09-13T19:33:31.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafcbbcf980 1 -- 172.21.15.144:0/316677318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 msgr2=0x5601a1968a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/316677318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1968a60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fafc000a4e0 tx=0x7fafc001b090 comp rx=0 tx=0).stop 2024-09-13T19:33:31.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafcbbcf980 1 -- 172.21.15.144:0/316677318 shutdown_connections 2024-09-13T19:33:31.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/316677318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1968a60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafcbbcf980 1 -- 172.21.15.144:0/316677318 >> 172.21.15.144:0/316677318 conn(0x5601a19ef170 msgr2=0x5601a19f1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafcbbcf980 1 -- 172.21.15.144:0/316677318 shutdown_connections 2024-09-13T19:33:31.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.155+0000 7fafcbbcf980 1 -- 172.21.15.144:0/316677318 wait complete. 2024-09-13T19:33:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.167+0000 7fafcbbcf980 1 Processor -- start 2024-09-13T19:33:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.167+0000 7fafcbbcf980 1 -- start start 2024-09-13T19:33:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.167+0000 7fafcbbcf980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969b90 0x5601a1ae5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.167+0000 7fafcbbcf980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601a18a1200 con 0x5601a1969b90 2024-09-13T19:33:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.167+0000 7fafc96df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969b90 0x5601a1ae5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.167+0000 7fafc96df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969b90 0x5601a1ae5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57154/0 (socket says 172.21.15.144:57154) 2024-09-13T19:33:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.167+0000 7fafc96df640 1 -- 172.21.15.144:0/2311508036 learned_addr learned my addr 172.21.15.144:0/2311508036 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafc96df640 1 -- 172.21.15.144:0/2311508036 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a1ae5750 con 0x5601a1969b90 2024-09-13T19:33:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafc96df640 1 --2- 172.21.15.144:0/2311508036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969b90 0x5601a1ae5180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00b200 tx=0x7fafbc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d716b23ec9ec109 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7faeb7606640 1 -- 172.21.15.144:0/2311508036 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc016070 con 0x5601a1969b90 2024-09-13T19:33:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7faeb7606640 1 -- 172.21.15.144:0/2311508036 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc00d5f0 con 0x5601a1969b90 2024-09-13T19:33:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7faeb7606640 1 -- 172.21.15.144:0/2311508036 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc00d950 con 0x5601a1969b90 2024-09-13T19:33:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2311508036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969b90 msgr2=0x5601a1ae5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2311508036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969b90 0x5601a1ae5180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00b200 tx=0x7fafbc00b6c0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2311508036 shutdown_connections 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2311508036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969b90 0x5601a1ae5180 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2311508036 >> 172.21.15.144:0/2311508036 conn(0x5601a19ef170 msgr2=0x5601a1ae0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2311508036 shutdown_connections 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2311508036 wait complete. 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 Processor -- start 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- start start 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1aec800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601a19f6d90 con 0x5601a1969fa0 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafc96df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1aec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafc96df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1aec800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57156/0 (socket says 172.21.15.144:57156) 2024-09-13T19:33:31.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafc96df640 1 -- 172.21.15.144:0/2214855586 learned_addr learned my addr 172.21.15.144:0/2214855586 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafc96df640 1 -- 172.21.15.144:0/2214855586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a1aecd40 con 0x5601a1969fa0 2024-09-13T19:33:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafc96df640 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1aec800 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00c010 tx=0x7fafbc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7faeb5e03640 1 -- 172.21.15.144:0/2214855586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc016070 con 0x5601a1969fa0 2024-09-13T19:33:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601a1aecfd0 con 0x5601a1969fa0 2024-09-13T19:33:31.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a1aefcb0 con 0x5601a1969fa0 2024-09-13T19:33:31.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7faeb5e03640 1 -- 172.21.15.144:0/2214855586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc017040 con 0x5601a1969fa0 2024-09-13T19:33:31.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.171+0000 7faeb5e03640 1 -- 172.21.15.144:0/2214855586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc0012e0 con 0x5601a1969fa0 2024-09-13T19:33:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7faeb5e03640 1 -- 172.21.15.144:0/2214855586 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fafbc025020 con 0x5601a1969fa0 2024-09-13T19:33:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7faeb5e03640 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faeb00346a0 0x7faeb0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7faeb5e03640 1 -- 172.21.15.144:0/2214855586 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fafbc023020 con 0x5601a1969fa0 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafc8ede640 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faeb00346a0 0x7faeb0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1af1780 0x5601a1af3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1af41a0 con 0x5601a1af1780 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafc9ee0640 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1af1780 0x5601a1af3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafc8ede640 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faeb00346a0 0x7faeb0036b60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ab000 tx=0x7fafc00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafc9ee0640 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1af1780 0x5601a1af3bb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafc9ee0640 1 -- 172.21.15.144:0/2214855586 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x5601a1af1780 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1af0ed0 con 0x5601a1af1780 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafc9ee0640 1 -- 172.21.15.144:0/2214855586 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafc40083f0 con 0x5601a1af1780 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1af64f0 0x5601a1af88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1af8fb0 con 0x5601a1af64f0 2024-09-13T19:33:31.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafc96df640 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1af64f0 0x5601a1af88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.175+0000 7fafc96df640 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1af64f0 0x5601a1af88e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafc96df640 1 -- 172.21.15.144:0/2214855586 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1af64f0 2024-09-13T19:33:31.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1af5390 con 0x5601a1af1780 2024-09-13T19:33:31.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafc9ee0640 1 -- 172.21.15.144:0/2214855586 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafc40083f0 con 0x5601a1af1780 2024-09-13T19:33:31.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1af5870 con 0x5601a1af1780 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafc9ee0640 1 -- 172.21.15.144:0/2214855586 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafc40083f0 con 0x5601a1af1780 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafcbbcf980 1 Processor -- start 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafcbbcf980 1 -- start start 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafcbbcf980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b07690 0x5601a1b07ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafcbbcf980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601a18fa800 con 0x5601a1b07690 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafc9ee0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b07690 0x5601a1b07ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafc9ee0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b07690 0x5601a1b07ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57172/0 (socket says 172.21.15.144:57172) 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafc9ee0640 1 -- 172.21.15.144:0/207285031 learned_addr learned my addr 172.21.15.144:0/207285031 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafc9ee0640 1 -- 172.21.15.144:0/207285031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a1b07ff0 con 0x5601a1b07690 2024-09-13T19:33:31.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafc9ee0640 1 --2- 172.21.15.144:0/207285031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b07690 0x5601a1b07ab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5601a1af45a0 tx=0x7fafc400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7faeaeffd640 1 -- 172.21.15.144:0/207285031 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4007e00 con 0x5601a1b07690 2024-09-13T19:33:31.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7faeaeffd640 1 -- 172.21.15.144:0/207285031 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc401e020 con 0x5601a1b07690 2024-09-13T19:33:31.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7faeaeffd640 1 -- 172.21.15.144:0/207285031 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4019590 con 0x5601a1b07690 2024-09-13T19:33:31.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafcbbcf980 1 -- 172.21.15.144:0/207285031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601a1b08280 con 0x5601a1b07690 2024-09-13T19:33:31.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.179+0000 7fafcbbcf980 1 -- 172.21.15.144:0/207285031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a1b0af00 con 0x5601a1b07690 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7faeaeffd640 1 -- 172.21.15.144:0/207285031 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fafc4016040 con 0x5601a1b07690 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7faeaeffd640 1 --2- 172.21.15.144:0/207285031 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faea00346a0 0x7faea0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7faeaeffd640 1 -- 172.21.15.144:0/207285031 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fafc401f030 con 0x5601a1b07690 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafc96df640 1 --2- 172.21.15.144:0/207285031 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faea00346a0 0x7faea0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 Processor -- start 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- start start 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafc96df640 1 --2- 172.21.15.144:0/207285031 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faea00346a0 0x7faea0036b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5601a1af4640 tx=0x7fafbc00fef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b14540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601a1ae5ad0 con 0x5601a1b14140 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafc9ee0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b14540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafc9ee0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b14540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57182/0 (socket says 172.21.15.144:57182) 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1888405068 learned_addr learned my addr 172.21.15.144:0/1888405068 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1888405068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a1b14b10 con 0x5601a1b14140 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafc9ee0640 1 --2- 172.21.15.144:0/1888405068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b14540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fafc404a390 tx=0x7fafc40236b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7534d4b5ea205f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7faeacff9640 1 -- 172.21.15.144:0/1888405068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4047040 con 0x5601a1b14140 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7faeacff9640 1 -- 172.21.15.144:0/1888405068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc4022ca0 con 0x5601a1b14140 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7faeacff9640 1 -- 172.21.15.144:0/1888405068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc401d040 con 0x5601a1b14140 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1888405068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 msgr2=0x5601a1b14540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1888405068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b14540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fafc404a390 tx=0x7fafc40236b0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1888405068 shutdown_connections 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1888405068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b14540 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1888405068 >> 172.21.15.144:0/1888405068 conn(0x5601a1b10570 msgr2=0x5601a1b0e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1888405068 shutdown_connections 2024-09-13T19:33:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1888405068 wait complete. 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 Processor -- start 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- start start 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b1b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.183+0000 7fafcbbcf980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601a1b15160 con 0x5601a1b14140 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc9ee0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b1b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc9ee0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b1b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57198/0 (socket says 172.21.15.144:57198) 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 learned_addr learned my addr 172.21.15.144:0/1088331407 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a1b1ba60 con 0x5601a1b14140 2024-09-13T19:33:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc9ee0640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b1b520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fafc402bfd0 tx=0x7fafc404a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fae9effd640 1 -- 172.21.15.144:0/1088331407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc401d070 con 0x5601a1b14140 2024-09-13T19:33:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601a1b1bcf0 con 0x5601a1b14140 2024-09-13T19:33:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fae9effd640 1 -- 172.21.15.144:0/1088331407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc402b350 con 0x5601a1b14140 2024-09-13T19:33:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fae9effd640 1 -- 172.21.15.144:0/1088331407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4032040 con 0x5601a1b14140 2024-09-13T19:33:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a1b1e9d0 con 0x5601a1b14140 2024-09-13T19:33:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fae9effd640 1 -- 172.21.15.144:0/1088331407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fafc402b630 con 0x5601a1b14140 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fae9effd640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fae94034650 0x7fae94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fae9effd640 1 -- 172.21.15.144:0/1088331407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fafc4040030 con 0x5601a1b14140 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc96df640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fae94034650 0x7fae94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1b26980 0x5601a1b28e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b29570 con 0x5601a1b26980 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc8ede640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1b26980 0x5601a1b28e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc96df640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fae94034650 0x7fae94036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafbc027c40 tx=0x7fafbc033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc8ede640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1b26980 0x5601a1b28e20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 20 realm 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b299a0 con 0x5601a1b26980 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.187+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b2a240 con 0x5601a1b26980 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b2a5e0 con 0x5601a1b26980 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1b2b340 0x5601a1b2d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b2dcb0 con 0x5601a1b2b340 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc9ee0640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1b2b340 0x5601a1b2d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc9ee0640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1b2b340 0x5601a1b2d730 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 20 searching for the correct realm 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5601a1b2fc20 0x5601a1b320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc96df640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5601a1b2fc20 0x5601a1b320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc96df640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5601a1b2fc20 0x5601a1b320e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc96df640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5601a1969b90 0x7fafbc0119a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1969b90 2024-09-13T19:33:31.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc8ede640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5601a1969b90 0x7fafbc0119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc8ede640 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5601a1969b90 0x7fafbc0119a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.191+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b26980 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b26980 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1969b90 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b26980 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b26980 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1969b90 2024-09-13T19:33:31.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.195+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b26980 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b26980 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1969b90 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b26980 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.199+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1969b90 2024-09-13T19:33:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2fc20 2024-09-13T19:33:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b2b340 2024-09-13T19:33:31.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1b26980 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b327b0 con 0x5601a1969b90 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b2e600 con 0x5601a1b26980 2024-09-13T19:33:31.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b2ea50 con 0x5601a1b26980 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b2ea60 con 0x5601a1b26980 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 zone default found 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 4 Realm: () 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:31.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 zonegroup default 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.203+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b2ef00 con 0x5601a1b2b340 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b34ac0 con 0x5601a1b2fc20 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b34e60 con 0x5601a1b2fc20 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 20 started sync module instance, tier type = 2024-09-13T19:33:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b33f00 con 0x5601a1969b90 2024-09-13T19:33:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94565007835936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b33f00 con 0x5601a1969b90 2024-09-13T19:33:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b35820 con 0x5601a1b26980 2024-09-13T19:33:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.207+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94565007835936] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94565007833952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b35820 con 0x5601a1b26980 2024-09-13T19:33:31.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b360d0 con 0x5601a1b2fc20 2024-09-13T19:33:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94565007833952] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94565007840112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b36470 con 0x5601a1b2fc20 2024-09-13T19:33:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b36e30 con 0x5601a1969b90 2024-09-13T19:33:31.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94565007845760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b36da0 con 0x5601a1969b90 2024-09-13T19:33:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.211+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b37d30 con 0x5601a1b26980 2024-09-13T19:33:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94565007840112] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94565007845760] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94565007841664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b37840 con 0x5601a1b26980 2024-09-13T19:33:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b385d0 con 0x5601a1b2b340 2024-09-13T19:33:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94565007841664] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94565007851808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b37840 con 0x5601a1b2b340 2024-09-13T19:33:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.215+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b38e60 con 0x5601a1b2b340 2024-09-13T19:33:31.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.219+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94565007851808] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.219+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.219+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94565007847888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b38e20 con 0x5601a1b2b340 2024-09-13T19:33:31.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.219+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b39880 con 0x5601a1b2b340 2024-09-13T19:33:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.219+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94565007847888] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94565007856480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b39a60 con 0x5601a1b2b340 2024-09-13T19:33:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 add_watcher() i=0 2024-09-13T19:33:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 add_watcher() i=1 2024-09-13T19:33:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 add_watcher() i=2 2024-09-13T19:33:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 add_watcher() i=3 2024-09-13T19:33:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 add_watcher() i=4 2024-09-13T19:33:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 add_watcher() i=5 2024-09-13T19:33:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 add_watcher() i=6 2024-09-13T19:33:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94565007856480] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 add_watcher() i=7 2024-09-13T19:33:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:31.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b3ce30 con 0x5601a1b26980 2024-09-13T19:33:31.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94565007858000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b3a220 con 0x5601a1b26980 2024-09-13T19:33:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94565007858000] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fae7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:31.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 5 note: GC not initialized 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fae7e7e4640 20 reqs_thread_entry: start 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.223+0000 7fafcbbcf980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 20 Filter name: none 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fadeffff640 20 reqs_thread_entry: start 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5fe60 con 0x5601a1b26980 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b60850 con 0x5601a1b26980 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b61860 con 0x5601a1969b90 2024-09-13T19:33:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fae7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94565007858000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1b26980 2024-09-13T19:33:31.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94565007858000] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.227+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94565007835936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1969b90 2024-09-13T19:33:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94565007835936] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafcbbcf980 20 remove_watcher() i=0 2024-09-13T19:33:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafcbbcf980 2 removed watcher, disabling cache 2024-09-13T19:33:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94565007833952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1b26980 2024-09-13T19:33:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94565007833952] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafcbbcf980 20 remove_watcher() i=1 2024-09-13T19:33:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94565007840112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1b2fc20 2024-09-13T19:33:31.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafc96df640 1 -- 172.21.15.144:0/1088331407 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94565007840112] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc027930 con 0x5601a1b2fc20 2024-09-13T19:33:31.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafcbbcf980 20 remove_watcher() i=2 2024-09-13T19:33:31.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.231+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94565007845760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1969b90 2024-09-13T19:33:31.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.235+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94565007845760] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1969b90 2024-09-13T19:33:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.235+0000 7fafcbbcf980 20 remove_watcher() i=3 2024-09-13T19:33:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.235+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94565007841664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1b26980 2024-09-13T19:33:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.235+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94565007841664] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc00bc040 con 0x5601a1b26980 2024-09-13T19:33:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.235+0000 7fafcbbcf980 20 remove_watcher() i=4 2024-09-13T19:33:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.235+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94565007851808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1b2b340 2024-09-13T19:33:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.239+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94565007851808] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.239+0000 7fafcbbcf980 20 remove_watcher() i=5 2024-09-13T19:33:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.239+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94565007847888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1b2b340 2024-09-13T19:33:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.239+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94565007847888] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.239+0000 7fafcbbcf980 20 remove_watcher() i=6 2024-09-13T19:33:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.239+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94565007856480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601a1b5dd40 con 0x5601a1b2b340 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafc9ee0640 1 -- 172.21.15.144:0/1088331407 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94565007856480] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc405d040 con 0x5601a1b2b340 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 20 remove_watcher() i=7 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1b2b340 msgr2=0x5601a1b2d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1b2b340 0x5601a1b2d730 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1b26980 msgr2=0x5601a1b28e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1b26980 0x5601a1b28e20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5601a1969b90 msgr2=0x7fafbc0119a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x5601a1969b90 0x7fafbc0119a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5601a1b2fc20 msgr2=0x5601a1b320e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5601a1b2fc20 0x5601a1b320e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fae94034650 msgr2=0x7fae94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fae94034650 0x7fae94036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafbc027c40 tx=0x7fafbc033000 comp rx=0 tx=0).stop 2024-09-13T19:33:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafc8ede640 1 -- 172.21.15.144:0/1088331407 reap_dead start 2024-09-13T19:33:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 msgr2=0x5601a1b1b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b1b520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fafc402bfd0 tx=0x7fafc404a2f0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 shutdown_connections 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/1088331407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b14140 0x5601a1b1b520 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 >> 172.21.15.144:0/1088331407 conn(0x5601a1b10570 msgr2=0x5601a1b0e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 shutdown_connections 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/1088331407 wait complete. 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/207285031 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faea00346a0 msgr2=0x7faea0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/207285031 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faea00346a0 0x7faea0036b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5601a1af4640 tx=0x7fafbc00fef0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/207285031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b07690 msgr2=0x5601a1b07ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/207285031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b07690 0x5601a1b07ab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5601a1af45a0 tx=0x7fafc400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/207285031 shutdown_connections 2024-09-13T19:33:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/207285031 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faea00346a0 0x7faea0036b60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/207285031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1b07690 0x5601a1b07ab0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/207285031 >> 172.21.15.144:0/207285031 conn(0x5601a1afc7e0 msgr2=0x5601a1aff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/207285031 shutdown_connections 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/207285031 wait complete. 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1af64f0 msgr2=0x5601a1af88e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1af64f0 0x5601a1af88e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1af1780 msgr2=0x5601a1af3bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1af1780 0x5601a1af3bb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faeb00346a0 msgr2=0x7faeb0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faeb00346a0 0x7faeb0036b60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ab000 tx=0x7fafc00a5000 comp rx=0 tx=0).stop 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 msgr2=0x5601a1aec800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1aec800 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00c010 tx=0x7fafbc000ee0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 shutdown_connections 2024-09-13T19:33:31.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5601a1af1780 0x5601a1af3bb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5601a1af64f0 0x5601a1af88e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7faeb00346a0 0x7faeb0036b60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 --2- 172.21.15.144:0/2214855586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601a1969fa0 0x5601a1aec800 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 >> 172.21.15.144:0/2214855586 conn(0x5601a19ef170 msgr2=0x5601a1adf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 shutdown_connections 2024-09-13T19:33:31.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.243+0000 7fafcbbcf980 1 -- 172.21.15.144:0/2214855586 wait complete. 2024-09-13T19:33:31.255 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-13T19:33:31.255 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:33:31.256 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T19:33:31.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T19:33:31.256 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T19:33:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:31.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.327+0000 7f1e8bee9980 1 Processor -- start 2024-09-13T19:33:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.327+0000 7f1e8bee9980 1 -- start start 2024-09-13T19:33:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.327+0000 7f1e8bee9980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5591f20fc910 0x5591f20fed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.327+0000 7f1e8bee9980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591f1f81ae0 con 0x5591f20f8540 2024-09-13T19:33:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.327+0000 7f1e8bee9980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5591f1fa5e30 con 0x5591f20fc910 2024-09-13T19:33:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.327+0000 7f1e891f8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5591f20fc910 0x5591f20fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.327+0000 7f1e891f8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5591f20fc910 0x5591f20fed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57212/0 (socket says 172.21.15.144:57212) 2024-09-13T19:33:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.327+0000 7f1e891f8640 1 -- 172.21.15.144:0/1014185757 learned_addr learned my addr 172.21.15.144:0/1014185757 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e891f8640 1 -- 172.21.15.144:0/1014185757 >> v1:172.21.15.18:6789/0 conn(0x5591f20f8540 legacy=0x5591f20f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e891f8640 1 -- 172.21.15.144:0/1014185757 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f2100250 con 0x5591f20fc910 2024-09-13T19:33:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e891f8640 1 --2- 172.21.15.144:0/1014185757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20fc910 0x5591f20fed00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000a4e0 tx=0x7f1e8001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da0f13febfae323 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e889f7640 1 -- 172.21.15.144:0/1014185757 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e800aa540 con 0x5591f20fc910 2024-09-13T19:33:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e889f7640 1 -- 172.21.15.144:0/1014185757 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e800aa6e0 con 0x5591f20fc910 2024-09-13T19:33:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e889f7640 1 -- 172.21.15.144:0/1014185757 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e800aaa40 con 0x5591f20fc910 2024-09-13T19:33:31.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1014185757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20fc910 msgr2=0x5591f20fed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1014185757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20fc910 0x5591f20fed00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000a4e0 tx=0x7f1e8001b090 comp rx=0 tx=0).stop 2024-09-13T19:33:31.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1014185757 shutdown_connections 2024-09-13T19:33:31.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1014185757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20fc910 0x5591f20fed00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1014185757 >> 172.21.15.144:0/1014185757 conn(0x5591f20f4060 msgr2=0x5591f20f6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1014185757 shutdown_connections 2024-09-13T19:33:31.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.331+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1014185757 wait complete. 2024-09-13T19:33:31.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.347+0000 7f1e8bee9980 1 Processor -- start 2024-09-13T19:33:31.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.347+0000 7f1e8bee9980 1 -- start start 2024-09-13T19:33:31.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.347+0000 7f1e8bee9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f206d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.347+0000 7f1e8bee9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591f1fa7200 con 0x5591f20f8540 2024-09-13T19:33:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.347+0000 7f1e899f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f206d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.347+0000 7f1e899f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f206d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57228/0 (socket says 172.21.15.144:57228) 2024-09-13T19:33:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.347+0000 7f1e899f9640 1 -- 172.21.15.144:0/1992850557 learned_addr learned my addr 172.21.15.144:0/1992850557 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e899f9640 1 -- 172.21.15.144:0/1992850557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f206d9b0 con 0x5591f20f8540 2024-09-13T19:33:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e899f9640 1 --2- 172.21.15.144:0/1992850557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f206d3e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1e84001ea0 tx=0x7f1e8400b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58191881ceccfc8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1d77e07640 1 -- 172.21.15.144:0/1992850557 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e8400a040 con 0x5591f20f8540 2024-09-13T19:33:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1d77e07640 1 -- 172.21.15.144:0/1992850557 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8400f620 con 0x5591f20f8540 2024-09-13T19:33:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1d77e07640 1 -- 172.21.15.144:0/1992850557 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e8400f890 con 0x5591f20f8540 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1992850557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 msgr2=0x5591f206d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1992850557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f206d3e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1e84001ea0 tx=0x7f1e8400b680 comp rx=0 tx=0).stop 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1992850557 shutdown_connections 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1992850557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f206d3e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1992850557 >> 172.21.15.144:0/1992850557 conn(0x5591f20f4060 msgr2=0x5591f21df590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1992850557 shutdown_connections 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1992850557 wait complete. 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 Processor -- start 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- start start 2024-09-13T19:33:31.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f21ebe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591f20ffd50 con 0x5591f20f8540 2024-09-13T19:33:31.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e899f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f21ebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e899f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f21ebe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57234/0 (socket says 172.21.15.144:57234) 2024-09-13T19:33:31.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e899f9640 1 -- 172.21.15.144:0/2359702299 learned_addr learned my addr 172.21.15.144:0/2359702299 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e899f9640 1 -- 172.21.15.144:0/2359702299 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f21ec350 con 0x5591f20f8540 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e899f9640 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f21ebe10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1e84001fd0 tx=0x7f1e84000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1d76604640 1 -- 172.21.15.144:0/2359702299 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e84001520 con 0x5591f20f8540 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591f21ec5e0 con 0x5591f20f8540 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591f21ef2c0 con 0x5591f20f8540 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1d76604640 1 -- 172.21.15.144:0/2359702299 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8401ca10 con 0x5591f20f8540 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.351+0000 7f1d76604640 1 -- 172.21.15.144:0/2359702299 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e8402c060 con 0x5591f20f8540 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1d76604640 1 -- 172.21.15.144:0/2359702299 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e84017050 con 0x5591f20f8540 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1d76604640 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d700346a0 0x7f1d70036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1d76604640 1 -- 172.21.15.144:0/2359702299 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e84015020 con 0x5591f20f8540 2024-09-13T19:33:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e891f8640 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d700346a0 0x7f1d70036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f20fc910 0x5591f21f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f21f3490 con 0x5591f20fc910 2024-09-13T19:33:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8a1fa640 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f20fc910 0x5591f21f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e891f8640 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d700346a0 0x7f1d70036b60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e800ab000 tx=0x7f1e800a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8a1fa640 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f20fc910 0x5591f21f2f10 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/2359702299 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e7c0083f0 con 0x5591f20fc910 2024-09-13T19:33:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f21f04e0 con 0x5591f20fc910 2024-09-13T19:33:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/2359702299 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e7c0083f0 con 0x5591f20fc910 2024-09-13T19:33:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f21f57a0 0x5591f21f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f21f8280 con 0x5591f21f57a0 2024-09-13T19:33:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e899f9640 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f21f57a0 0x5591f21f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.355+0000 7f1e899f9640 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f21f57a0 0x5591f21f7b90 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e899f9640 1 -- 172.21.15.144:0/2359702299 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f21f57a0 2024-09-13T19:33:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f21f4610 con 0x5591f20fc910 2024-09-13T19:33:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/2359702299 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e7c0083f0 con 0x5591f20fc910 2024-09-13T19:33:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f21f4af0 con 0x5591f20fc910 2024-09-13T19:33:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/2359702299 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e7c0083f0 con 0x5591f20fc910 2024-09-13T19:33:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8bee9980 1 Processor -- start 2024-09-13T19:33:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8bee9980 1 -- start start 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8bee9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2206960 0x5591f2206d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8bee9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591f2000800 con 0x5591f2206960 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8a1fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2206960 0x5591f2206d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8a1fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2206960 0x5591f2206d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57246/0 (socket says 172.21.15.144:57246) 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/2977751726 learned_addr learned my addr 172.21.15.144:0/2977751726 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/2977751726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f22072c0 con 0x5591f2206960 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8a1fa640 1 --2- 172.21.15.144:0/2977751726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2206960 0x5591f2206d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5591f21ed240 tx=0x7f1e7c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1d6f7fe640 1 -- 172.21.15.144:0/2977751726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e7c007dd0 con 0x5591f2206960 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2977751726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591f2207550 con 0x5591f2206960 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1d6f7fe640 1 -- 172.21.15.144:0/2977751726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e7c01e020 con 0x5591f2206960 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1d6f7fe640 1 -- 172.21.15.144:0/2977751726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e7c019590 con 0x5591f2206960 2024-09-13T19:33:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.359+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2977751726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591f220a1d0 con 0x5591f2206960 2024-09-13T19:33:31.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1d6f7fe640 1 -- 172.21.15.144:0/2977751726 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e7c016040 con 0x5591f2206960 2024-09-13T19:33:31.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1d6f7fe640 1 --2- 172.21.15.144:0/2977751726 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d64034650 0x7f1d64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1d6f7fe640 1 -- 172.21.15.144:0/2977751726 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e7c01f030 con 0x5591f2206960 2024-09-13T19:33:31.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e899f9640 1 --2- 172.21.15.144:0/2977751726 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d64034650 0x7f1d64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 Processor -- start 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- start start 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f2213930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591f206dd30 con 0x5591f2213550 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e899f9640 1 --2- 172.21.15.144:0/2977751726 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d64034650 0x7f1d64036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e8401dfd0 tx=0x7f1e84028fc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8a1fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f2213930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8a1fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f2213930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57252/0 (socket says 172.21.15.144:57252) 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/111259091 learned_addr learned my addr 172.21.15.144:0/111259091 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/111259091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f2213f00 con 0x5591f2213550 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8a1fa640 1 --2- 172.21.15.144:0/111259091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f2213930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c04a330 tx=0x7f1e7c017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5c4db502737cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1d6d7fa640 1 -- 172.21.15.144:0/111259091 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e7c040070 con 0x5591f2213550 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1d6d7fa640 1 -- 172.21.15.144:0/111259091 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e7c048070 con 0x5591f2213550 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1d6d7fa640 1 -- 172.21.15.144:0/111259091 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e7c01d040 con 0x5591f2213550 2024-09-13T19:33:31.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- 172.21.15.144:0/111259091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 msgr2=0x5591f2213930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/111259091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f2213930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c04a330 tx=0x7f1e7c017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- 172.21.15.144:0/111259091 shutdown_connections 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/111259091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f2213930 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- 172.21.15.144:0/111259091 >> 172.21.15.144:0/111259091 conn(0x5591f220f880 msgr2=0x5591f220d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- 172.21.15.144:0/111259091 shutdown_connections 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- 172.21.15.144:0/111259091 wait complete. 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 Processor -- start 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- start start 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f221a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8bee9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591f22144a0 con 0x5591f2213550 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8a1fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f221a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8a1fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f221a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57262/0 (socket says 172.21.15.144:57262) 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.363+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 learned_addr learned my addr 172.21.15.144:0/1029315398 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f221ad50 con 0x5591f2213550 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8a1fa640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f221a810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c017930 tx=0x7f1e7c04a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1d5b7fe640 1 -- 172.21.15.144:0/1029315398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e7c01d070 con 0x5591f2213550 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591f221afe0 con 0x5591f2213550 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1d5b7fe640 1 -- 172.21.15.144:0/1029315398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e7c019730 con 0x5591f2213550 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591f221dcc0 con 0x5591f2213550 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1d5b7fe640 1 -- 172.21.15.144:0/1029315398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e7c032040 con 0x5591f2213550 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1d5b7fe640 1 -- 172.21.15.144:0/1029315398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e7c0198e0 con 0x5591f2213550 2024-09-13T19:33:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1d5b7fe640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d54034650 0x7f1d54036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1d5b7fe640 1 -- 172.21.15.144:0/1029315398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e7c056af0 con 0x5591f2213550 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e899f9640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d54034650 0x7f1d54036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f2225d10 0x5591f22281d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f2228920 con 0x5591f2225d10 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e891f8640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f2225d10 0x5591f22281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e899f9640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d54034650 0x7f1d54036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400c010 tx=0x7f1e84047000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e891f8640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f2225d10 0x5591f22281d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 realm 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f2228d50 con 0x5591f2225d10 2024-09-13T19:33:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f22295f0 con 0x5591f2225d10 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f2229990 con 0x5591f2225d10 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f222a6f0 0x5591f222cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f222d020 con 0x5591f222a6f0 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.367+0000 7f1e8a1fa640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f222a6f0 0x5591f222cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e8a1fa640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f222a6f0 0x5591f222cae0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e8bee9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e8bee9980 20 searching for the correct realm 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5591f222ef70 0x5591f2231430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e899f9640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5591f222ef70 0x5591f2231430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e899f9640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5591f222ef70 0x5591f2231430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e899f9640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1e84048860 0x7f1e8400aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x7f1e84048860 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e891f8640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1e84048860 0x7f1e8400aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e891f8640 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1e84048860 0x7f1e8400aa20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f2225d10 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f2225d10 2024-09-13T19:33:31.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.371+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x7f1e84048860 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f2225d10 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f2225d10 2024-09-13T19:33:31.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x7f1e84048860 2024-09-13T19:33:31.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.375+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f2225d10 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f2225d10 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x7f1e84048860 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f2225d10 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.379+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x7f1e84048860 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222ef70 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f222a6f0 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x5591f2225d10 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5591f2231b00 con 0x7f1e84048860 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:31.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f222d9e0 con 0x5591f2225d10 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f222de30 con 0x5591f2225d10 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f222e250 con 0x5591f2225d10 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 zone default found 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 4 Realm: () 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 zonegroup default 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f222e250 con 0x5591f222a6f0 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.383+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f222d620 con 0x5591f222ef70 2024-09-13T19:33:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f2233f00 con 0x5591f222ef70 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 20 started sync module instance, tier type = 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22332a0 con 0x7f1e84048860 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94085321013184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22332a0 con 0x7f1e84048860 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2234a40 con 0x5591f2225d10 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94085321013184] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94085321016624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22332a0 con 0x5591f2225d10 2024-09-13T19:33:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.387+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2235450 con 0x5591f222ef70 2024-09-13T19:33:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94085321019296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2235ca0 con 0x5591f222ef70 2024-09-13T19:33:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22366a0 con 0x7f1e84048860 2024-09-13T19:33:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94085321016624] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94085321010672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2236a90 con 0x7f1e84048860 2024-09-13T19:33:31.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2237450 con 0x5591f2225d10 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94085321019296] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.391+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94085321010672] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.395+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.395+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94085321023920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2236fa0 con 0x5591f2225d10 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.395+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22377f0 con 0x5591f222a6f0 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.395+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94085321023920] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.395+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.395+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94085321027488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2235900 con 0x5591f222a6f0 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.395+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2238110 con 0x5591f222a6f0 2024-09-13T19:33:31.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94085321027488] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94085321030544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22385c0 con 0x5591f222a6f0 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2238b80 con 0x5591f222a6f0 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94085321028544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2239030 con 0x5591f222a6f0 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 20 add_watcher() i=0 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 20 add_watcher() i=1 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 20 add_watcher() i=2 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 20 add_watcher() i=3 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 20 add_watcher() i=4 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 20 add_watcher() i=5 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94085321030544] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.399+0000 7f1e8bee9980 20 add_watcher() i=6 2024-09-13T19:33:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94085321028544] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 add_watcher() i=7 2024-09-13T19:33:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f22380d0 con 0x5591f2225d10 2024-09-13T19:33:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94085321031888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2239550 con 0x5591f2225d10 2024-09-13T19:33:31.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94085321031888] v30'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1d3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 5 note: GC not initialized 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1d3a7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 Filter name: none 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1cabfff640 20 reqs_thread_entry: start 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f225f1a0 con 0x5591f2225d10 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f225fb90 con 0x5591f2225d10 2024-09-13T19:33:31.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5591f2260ba0 con 0x7f1e84048860 2024-09-13T19:33:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.403+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1d3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94085321031888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f225d080 con 0x5591f2225d10 2024-09-13T19:33:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94085321031888] v30'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94085321013184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f225d080 con 0x7f1e84048860 2024-09-13T19:33:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94085321013184] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e8bee9980 20 remove_watcher() i=0 2024-09-13T19:33:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e8bee9980 2 removed watcher, disabling cache 2024-09-13T19:33:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94085321016624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f225d080 con 0x5591f2225d10 2024-09-13T19:33:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94085321016624] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e8bee9980 20 remove_watcher() i=1 2024-09-13T19:33:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.407+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94085321019296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f225d080 con 0x5591f222ef70 2024-09-13T19:33:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.411+0000 7f1e899f9640 1 -- 172.21.15.144:0/1029315398 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94085321019296] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8402e070 con 0x5591f222ef70 2024-09-13T19:33:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.411+0000 7f1e8bee9980 20 remove_watcher() i=2 2024-09-13T19:33:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.411+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94085321010672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22337c0 con 0x7f1e84048860 2024-09-13T19:33:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.411+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94085321010672] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x7f1e84048860 2024-09-13T19:33:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.411+0000 7f1e8bee9980 20 remove_watcher() i=3 2024-09-13T19:33:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.411+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94085321023920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22337c0 con 0x5591f2225d10 2024-09-13T19:33:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.415+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94085321023920] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e800bc040 con 0x5591f2225d10 2024-09-13T19:33:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.415+0000 7f1e8bee9980 20 remove_watcher() i=4 2024-09-13T19:33:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.415+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94085321027488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22361b0 con 0x5591f222a6f0 2024-09-13T19:33:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.415+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94085321027488] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.415+0000 7f1e8bee9980 20 remove_watcher() i=5 2024-09-13T19:33:31.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.415+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94085321030544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f22337c0 con 0x5591f222a6f0 2024-09-13T19:33:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94085321030544] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 20 remove_watcher() i=6 2024-09-13T19:33:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94085321028544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5591f2236fa0 con 0x5591f222a6f0 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8a1fa640 1 -- 172.21.15.144:0/1029315398 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94085321028544] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7c05e040 con 0x5591f222a6f0 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 20 remove_watcher() i=7 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f222a6f0 msgr2=0x5591f222cae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f222a6f0 0x5591f222cae0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f2225d10 msgr2=0x5591f22281d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f2225d10 0x5591f22281d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1e84048860 msgr2=0x7f1e8400aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1e84048860 0x7f1e8400aa20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5591f222ef70 msgr2=0x5591f2231430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5591f222ef70 0x5591f2231430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d54034650 msgr2=0x7f1d54036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d54034650 0x7f1d54036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400c010 tx=0x7f1e84047000 comp rx=0 tx=0).stop 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 msgr2=0x5591f221a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e891f8640 1 -- 172.21.15.144:0/1029315398 reap_dead start 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f221a810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c017930 tx=0x7f1e7c04a290 comp rx=0 tx=0).stop 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 shutdown_connections 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/1029315398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2213550 0x5591f221a810 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 >> 172.21.15.144:0/1029315398 conn(0x5591f220f880 msgr2=0x5591f2214b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 shutdown_connections 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/1029315398 wait complete. 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2977751726 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d64034650 msgr2=0x7f1d64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2977751726 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d64034650 0x7f1d64036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e8401dfd0 tx=0x7f1e84028fc0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2977751726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2206960 msgr2=0x5591f2206d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2977751726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2206960 0x5591f2206d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5591f21ed240 tx=0x7f1e7c00af40 comp rx=0 tx=0).stop 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2977751726 shutdown_connections 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2977751726 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d64034650 0x7f1d64036b10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2977751726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f2206960 0x5591f2206d80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2977751726 >> 172.21.15.144:0/2977751726 conn(0x5591f21fbab0 msgr2=0x5591f21fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2977751726 shutdown_connections 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2977751726 wait complete. 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f21f57a0 msgr2=0x5591f21f7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f21f57a0 0x5591f21f7b90 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f20fc910 msgr2=0x5591f21f2f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f20fc910 0x5591f21f2f10 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d700346a0 msgr2=0x7f1d70036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d700346a0 0x7f1d70036b60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e800ab000 tx=0x7f1e800a5000 comp rx=0 tx=0).stop 2024-09-13T19:33:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 msgr2=0x5591f21ebe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f21ebe10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1e84001fd0 tx=0x7f1e84000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 shutdown_connections 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5591f20fc910 0x5591f21f2f10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5591f21f57a0 0x5591f21f7b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1d700346a0 0x7f1d70036b60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 --2- 172.21.15.144:0/2359702299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591f20f8540 0x5591f21ebe10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 >> 172.21.15.144:0/2359702299 conn(0x5591f20f4060 msgr2=0x5591f21de110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 shutdown_connections 2024-09-13T19:33:31.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.419+0000 7f1e8bee9980 1 -- 172.21.15.144:0/2359702299 wait complete. 2024-09-13T19:33:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-13T19:33:31.433 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:33:31.461 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:31.461 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T19:33:31.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T19:33:31.461 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T19:33:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e9b01980 1 Processor -- start 2024-09-13T19:33:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e9b01980 1 -- start start 2024-09-13T19:33:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e9b01980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56403da6be50 0x56403da6e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e9b01980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56403d8edae0 con 0x56403d9d9b00 2024-09-13T19:33:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e9b01980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56403d911e30 con 0x56403da6be50 2024-09-13T19:33:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e6e10640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56403da6be50 0x56403da6e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e6e10640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56403da6be50 0x56403da6e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57264/0 (socket says 172.21.15.144:57264) 2024-09-13T19:33:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e6e10640 1 -- 172.21.15.144:0/3764068632 learned_addr learned my addr 172.21.15.144:0/3764068632 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e6e10640 1 -- 172.21.15.144:0/3764068632 >> v1:172.21.15.18:6789/0 conn(0x56403d9d9b00 legacy=0x56403da6a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.503+0000 7f06e6e10640 1 -- 172.21.15.144:0/3764068632 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403d9d9ee0 con 0x56403da6be50 2024-09-13T19:33:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e6e10640 1 --2- 172.21.15.144:0/3764068632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403da6be50 0x56403da6e240 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f06d000a5c0 tx=0x7f06d001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb340bb3df0bdef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e660f640 1 -- 172.21.15.144:0/3764068632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d00a6070 con 0x56403da6be50 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e660f640 1 -- 172.21.15.144:0/3764068632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00af070 con 0x56403da6be50 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e660f640 1 -- 172.21.15.144:0/3764068632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d00aa5c0 con 0x56403da6be50 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e9b01980 1 -- 172.21.15.144:0/3764068632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403da6be50 msgr2=0x56403da6e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e9b01980 1 --2- 172.21.15.144:0/3764068632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403da6be50 0x56403da6e240 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f06d000a5c0 tx=0x7f06d001b340 comp rx=0 tx=0).stop 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e9b01980 1 -- 172.21.15.144:0/3764068632 shutdown_connections 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e9b01980 1 --2- 172.21.15.144:0/3764068632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403da6be50 0x56403da6e240 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e9b01980 1 -- 172.21.15.144:0/3764068632 >> 172.21.15.144:0/3764068632 conn(0x56403da60060 msgr2=0x56403da62480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e9b01980 1 -- 172.21.15.144:0/3764068632 shutdown_connections 2024-09-13T19:33:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.507+0000 7f06e9b01980 1 -- 172.21.15.144:0/3764068632 wait complete. 2024-09-13T19:33:31.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.519+0000 7f06e9b01980 1 Processor -- start 2024-09-13T19:33:31.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.519+0000 7f06e9b01980 1 -- start start 2024-09-13T19:33:31.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.519+0000 7f06e9b01980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db52c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.519+0000 7f06e9b01980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56403d913200 con 0x56403d9d9b00 2024-09-13T19:33:31.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db52c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db52c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57270/0 (socket says 172.21.15.144:57270) 2024-09-13T19:33:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 -- 172.21.15.144:0/230287934 learned_addr learned my addr 172.21.15.144:0/230287934 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 -- 172.21.15.144:0/230287934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403db531e0 con 0x56403d9d9b00 2024-09-13T19:33:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 --2- 172.21.15.144:0/230287934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db52c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f06d80015f0 tx=0x7f06d8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6f8cd81754f3b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f05d560a640 1 -- 172.21.15.144:0/230287934 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8016070 con 0x56403d9d9b00 2024-09-13T19:33:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f05d560a640 1 -- 172.21.15.144:0/230287934 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d800f640 con 0x56403d9d9b00 2024-09-13T19:33:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f05d560a640 1 -- 172.21.15.144:0/230287934 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d800f960 con 0x56403d9d9b00 2024-09-13T19:33:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 -- 172.21.15.144:0/230287934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 msgr2=0x56403db52c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 --2- 172.21.15.144:0/230287934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db52c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f06d80015f0 tx=0x7f06d8001ab0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 -- 172.21.15.144:0/230287934 shutdown_connections 2024-09-13T19:33:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 --2- 172.21.15.144:0/230287934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db52c10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 -- 172.21.15.144:0/230287934 >> 172.21.15.144:0/230287934 conn(0x56403da60060 msgr2=0x56403db4e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 -- 172.21.15.144:0/230287934 shutdown_connections 2024-09-13T19:33:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 -- 172.21.15.144:0/230287934 wait complete. 2024-09-13T19:33:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 Processor -- start 2024-09-13T19:33:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 -- start start 2024-09-13T19:33:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db5a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e9b01980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56403da71210 con 0x56403d9d9b00 2024-09-13T19:33:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db5a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db5a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57286/0 (socket says 172.21.15.144:57286) 2024-09-13T19:33:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 -- 172.21.15.144:0/4271826100 learned_addr learned my addr 172.21.15.144:0/4271826100 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 -- 172.21.15.144:0/4271826100 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403db5a540 con 0x56403d9d9b00 2024-09-13T19:33:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.523+0000 7f06e7611640 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db5a000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f06d8001af0 tx=0x7f06d8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f05d3e07640 1 -- 172.21.15.144:0/4271826100 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8016040 con 0x56403d9d9b00 2024-09-13T19:33:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403db5a7d0 con 0x56403d9d9b00 2024-09-13T19:33:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f05d3e07640 1 -- 172.21.15.144:0/4271826100 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8022070 con 0x56403d9d9b00 2024-09-13T19:33:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f05d3e07640 1 -- 172.21.15.144:0/4271826100 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8006180 con 0x56403d9d9b00 2024-09-13T19:33:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403db5d4b0 con 0x56403d9d9b00 2024-09-13T19:33:31.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f05d3e07640 1 -- 172.21.15.144:0/4271826100 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06d80117c0 con 0x56403d9d9b00 2024-09-13T19:33:31.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f05d3e07640 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05cc034650 0x7f05cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f05d3e07640 1 -- 172.21.15.144:0/4271826100 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06d80497c0 con 0x56403d9d9b00 2024-09-13T19:33:31.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e6e10640 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05cc034650 0x7f05cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403da6be50 0x56403db60f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db615b0 con 0x56403da6be50 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e7e12640 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403da6be50 0x56403db60f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e6e10640 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05cc034650 0x7f05cc036b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ae000 tx=0x7f06d00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e7e12640 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403da6be50 0x56403db60f90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e7e12640 1 -- 172.21.15.144:0/4271826100 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e00083f0 con 0x56403da6be50 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db5e6d0 con 0x56403da6be50 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e7e12640 1 -- 172.21.15.144:0/4271826100 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06e00083f0 con 0x56403da6be50 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db63900 0x56403db65cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db663c0 con 0x56403db63900 2024-09-13T19:33:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.527+0000 7f06e7611640 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db63900 0x56403db65cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7611640 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db63900 0x56403db65cf0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7611640 1 -- 172.21.15.144:0/4271826100 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06d800f070 con 0x56403db63900 2024-09-13T19:33:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db627a0 con 0x56403da6be50 2024-09-13T19:33:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7e12640 1 -- 172.21.15.144:0/4271826100 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06e00083f0 con 0x56403da6be50 2024-09-13T19:33:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db62c80 con 0x56403da6be50 2024-09-13T19:33:31.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7e12640 1 -- 172.21.15.144:0/4271826100 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06e00083f0 con 0x56403da6be50 2024-09-13T19:33:31.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e9b01980 1 Processor -- start 2024-09-13T19:33:31.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e9b01980 1 -- start start 2024-09-13T19:33:31.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e9b01980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db74aa0 0x56403db74ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e9b01980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56403d96c800 con 0x56403db74aa0 2024-09-13T19:33:31.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7e12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db74aa0 0x56403db74ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7e12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db74aa0 0x56403db74ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57296/0 (socket says 172.21.15.144:57296) 2024-09-13T19:33:31.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7e12640 1 -- 172.21.15.144:0/1254964456 learned_addr learned my addr 172.21.15.144:0/1254964456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7e12640 1 -- 172.21.15.144:0/1254964456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403db75400 con 0x56403db74aa0 2024-09-13T19:33:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e7e12640 1 --2- 172.21.15.144:0/1254964456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db74aa0 0x56403db74ec0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x56403db619b0 tx=0x7f06e000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f05d1602640 1 -- 172.21.15.144:0/1254964456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e0007e00 con 0x56403db74aa0 2024-09-13T19:33:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f05d1602640 1 -- 172.21.15.144:0/1254964456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e001e020 con 0x56403db74aa0 2024-09-13T19:33:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e9b01980 1 -- 172.21.15.144:0/1254964456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403db75690 con 0x56403db74aa0 2024-09-13T19:33:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f05d1602640 1 -- 172.21.15.144:0/1254964456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e0019590 con 0x56403db74aa0 2024-09-13T19:33:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.531+0000 7f06e9b01980 1 -- 172.21.15.144:0/1254964456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403db78310 con 0x56403db74aa0 2024-09-13T19:33:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f05d1602640 1 -- 172.21.15.144:0/1254964456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06e0016040 con 0x56403db74aa0 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f05d1602640 1 --2- 172.21.15.144:0/1254964456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05c00346a0 0x7f05c0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f05d1602640 1 -- 172.21.15.144:0/1254964456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06e001f030 con 0x56403db74aa0 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e7611640 1 --2- 172.21.15.144:0/1254964456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05c00346a0 0x7f05c0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 Processor -- start 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- start start 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e7611640 1 --2- 172.21.15.144:0/1254964456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05c00346a0 0x7f05c0036b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x56403db61a50 tx=0x7f06d801cf00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db81940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56403db53560 con 0x56403db81540 2024-09-13T19:33:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e7e12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db81940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e7e12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db81940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57298/0 (socket says 172.21.15.144:57298) 2024-09-13T19:33:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e7e12640 1 -- 172.21.15.144:0/780802031 learned_addr learned my addr 172.21.15.144:0/780802031 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e7e12640 1 -- 172.21.15.144:0/780802031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403db81f10 con 0x56403db81540 2024-09-13T19:33:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e7e12640 1 --2- 172.21.15.144:0/780802031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db81940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f06e004a340 tx=0x7f06e0023730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fc434d995dc173 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f05caffd640 1 -- 172.21.15.144:0/780802031 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e001d040 con 0x56403db81540 2024-09-13T19:33:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f05caffd640 1 -- 172.21.15.144:0/780802031 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e002b350 con 0x56403db81540 2024-09-13T19:33:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f05caffd640 1 -- 172.21.15.144:0/780802031 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e0015cb0 con 0x56403db81540 2024-09-13T19:33:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- 172.21.15.144:0/780802031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 msgr2=0x56403db81940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 --2- 172.21.15.144:0/780802031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db81940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f06e004a340 tx=0x7f06e0023730 comp rx=0 tx=0).stop 2024-09-13T19:33:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- 172.21.15.144:0/780802031 shutdown_connections 2024-09-13T19:33:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 --2- 172.21.15.144:0/780802031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db81940 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- 172.21.15.144:0/780802031 >> 172.21.15.144:0/780802031 conn(0x56403db7d8d0 msgr2=0x56403db7b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- 172.21.15.144:0/780802031 shutdown_connections 2024-09-13T19:33:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- 172.21.15.144:0/780802031 wait complete. 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 Processor -- start 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- start start 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db888a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.535+0000 7f06e9b01980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56403db824f0 con 0x56403db81540 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e7e12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e7e12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db888a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57300/0 (socket says 172.21.15.144:57300) 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 learned_addr learned my addr 172.21.15.144:0/2013212997 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403db88de0 con 0x56403db81540 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e7e12640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db888a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06e0017930 tx=0x7f06e004a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f05c97fa640 1 -- 172.21.15.144:0/2013212997 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e001d030 con 0x56403db81540 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403db89070 con 0x56403db81540 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403db89070 con 0x56403db81540 2024-09-13T19:33:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f05c97fa640 1 -- 172.21.15.144:0/2013212997 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e002b500 con 0x56403db81540 2024-09-13T19:33:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f05c97fa640 1 -- 172.21.15.144:0/2013212997 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e00223c0 con 0x56403db81540 2024-09-13T19:33:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f05c97fa640 1 -- 172.21.15.144:0/2013212997 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06e0022560 con 0x56403db81540 2024-09-13T19:33:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f05c97fa640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05b00346a0 0x7f05b0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f05c97fa640 1 -- 172.21.15.144:0/2013212997 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06e0034070 con 0x56403db81540 2024-09-13T19:33:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e7611640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05b00346a0 0x7f05b0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403db93b60 0x56403db96000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db96750 con 0x56403db93b60 2024-09-13T19:33:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e6e10640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403db93b60 0x56403db96000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e7611640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05b00346a0 0x7f05b0036b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f06d8027040 tx=0x7f06d8035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e6e10640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403db93b60 0x56403db96000 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 20 realm 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db96b80 con 0x56403db93b60 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db97420 con 0x56403db93b60 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.539+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db977c0 con 0x56403db93b60 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e9b01980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db98520 0x56403db9a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e7e12640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db98520 0x56403db9a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e7e12640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db98520 0x56403db9a910 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e9b01980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e9b01980 20 searching for the correct realm 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56403db9cda0 0x56403db9f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9f930 con 0x56403db9cda0 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e7611640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56403db9cda0 0x56403db9f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e7611640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56403db9cda0 0x56403db9f260 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e7611640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f06d8056040 0x7f06d801c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9f930 con 0x7f06d8056040 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e6e10640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f06d8056040 0x7f06d801c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e6e10640 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f06d8056040 0x7f06d801c580 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.543+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9f930 con 0x56403db98520 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db93b60 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db93b60 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x7f06d8056040 2024-09-13T19:33:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db9cda0 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db93b60 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db93b60 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x7f06d8056040 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db9cda0 2024-09-13T19:33:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db9cda0 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.547+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db9cda0 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db9cda0 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db93b60 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db93b60 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db9cda0 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x7f06d8056040 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db93b60 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db9cda0 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.551+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x7f06d8056040 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db9cda0 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db98520 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x56403db93b60 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56403db9ae50 con 0x7f06d8056040 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db9b710 con 0x56403db93b60 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db9bb00 con 0x56403db93b60 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db9bb00 con 0x56403db93b60 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 zone default found 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 4 Realm: () 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 zonegroup default 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403db9bf20 con 0x56403db98520 2024-09-13T19:33:31.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403dba1790 con 0x56403db9cda0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.555+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403dba1b30 con 0x56403db9cda0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e9b01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e9b01980 20 started sync module instance, tier type = 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e9b01980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba0c30 con 0x7f06d8056040 2024-09-13T19:33:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94833913499984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba0c30 con 0x7f06d8056040 2024-09-13T19:33:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba2530 con 0x56403db93b60 2024-09-13T19:33:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94833913499984] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94833913503808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba0c30 con 0x56403db93b60 2024-09-13T19:33:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.559+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba2f70 con 0x56403db9cda0 2024-09-13T19:33:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94833913503808] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94833913497472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba0ba0 con 0x56403db9cda0 2024-09-13T19:33:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba3c70 con 0x7f06d8056040 2024-09-13T19:33:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94833913510160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba4510 con 0x7f06d8056040 2024-09-13T19:33:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba4f10 con 0x56403db93b60 2024-09-13T19:33:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94833913497472] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.563+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94833913510160] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.567+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.567+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94833913508624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba4010 con 0x56403db93b60 2024-09-13T19:33:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.567+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba57b0 con 0x56403db98520 2024-09-13T19:33:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.567+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94833913508624] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.567+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.567+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94833913514528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba4010 con 0x56403db98520 2024-09-13T19:33:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.567+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba5c60 con 0x56403db98520 2024-09-13T19:33:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94833913514528] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94833913516800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba5bd0 con 0x56403db98520 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba6690 con 0x56403db98520 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94833913520480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba6b00 con 0x56403db98520 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 20 add_watcher() i=0 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 20 add_watcher() i=1 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 20 add_watcher() i=2 2024-09-13T19:33:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 20 add_watcher() i=3 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 20 add_watcher() i=4 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 20 add_watcher() i=5 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94833913516800] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.571+0000 7f06e9b01980 20 add_watcher() i=6 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94833913520480] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 add_watcher() i=7 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403dba5720 con 0x56403db93b60 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94833913517856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba7010 con 0x56403db93b60 2024-09-13T19:33:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94833913517856] v30'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f059dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 5 note: GC not initialized 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f059cfe1640 20 reqs_thread_entry: start 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 Filter name: none 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f05167fc640 20 reqs_thread_entry: start 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403dbccc20 con 0x56403db93b60 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:31.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403dbcd610 con 0x56403db93b60 2024-09-13T19:33:31.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:31.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56403dbce620 con 0x7f06d8056040 2024-09-13T19:33:31.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.575+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.579+0000 7f059dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.579+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94833913517856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dbcaae0 con 0x56403db93b60 2024-09-13T19:33:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.579+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94833913517856] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.579+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94833913499984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dbcaae0 con 0x7f06d8056040 2024-09-13T19:33:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.579+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94833913499984] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.579+0000 7f06e9b01980 20 remove_watcher() i=0 2024-09-13T19:33:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.579+0000 7f06e9b01980 2 removed watcher, disabling cache 2024-09-13T19:33:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.579+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94833913503808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dbcaae0 con 0x56403db93b60 2024-09-13T19:33:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94833913503808] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e9b01980 20 remove_watcher() i=1 2024-09-13T19:33:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94833913497472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dbcaae0 con 0x56403db9cda0 2024-09-13T19:33:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e7611640 1 -- 172.21.15.144:0/2013212997 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94833913497472] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d803b030 con 0x56403db9cda0 2024-09-13T19:33:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e9b01980 20 remove_watcher() i=2 2024-09-13T19:33:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94833913510160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba0780 con 0x7f06d8056040 2024-09-13T19:33:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94833913510160] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x7f06d8056040 2024-09-13T19:33:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e9b01980 20 remove_watcher() i=3 2024-09-13T19:33:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.583+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94833913508624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba0780 con 0x56403db93b60 2024-09-13T19:33:31.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.587+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94833913508624] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d00aaa40 con 0x56403db93b60 2024-09-13T19:33:31.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.587+0000 7f06e9b01980 20 remove_watcher() i=4 2024-09-13T19:33:31.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.587+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94833913514528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba3310 con 0x56403db98520 2024-09-13T19:33:31.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.587+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94833913514528] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.587+0000 7f06e9b01980 20 remove_watcher() i=5 2024-09-13T19:33:31.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.587+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94833913516800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba0780 con 0x56403db98520 2024-09-13T19:33:31.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.591+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94833913516800] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.591+0000 7f06e9b01980 20 remove_watcher() i=6 2024-09-13T19:33:31.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.591+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94833913520480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56403dba0780 con 0x56403db98520 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.591+0000 7f06e7e12640 1 -- 172.21.15.144:0/2013212997 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94833913520480] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e0042020 con 0x56403db98520 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.591+0000 7f06e9b01980 20 remove_watcher() i=7 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db98520 msgr2=0x56403db9a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db98520 0x56403db9a910 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403db93b60 msgr2=0x56403db96000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403db93b60 0x56403db96000 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f06d8056040 msgr2=0x7f06d801c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f06d8056040 0x7f06d801c580 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56403db9cda0 msgr2=0x56403db9f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56403db9cda0 0x56403db9f260 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05b00346a0 msgr2=0x7f05b0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05b00346a0 0x7f05b0036b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f06d8027040 tx=0x7f06d8035000 comp rx=0 tx=0).stop 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 msgr2=0x56403db888a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/2013212997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db81540 0x56403db888a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06e0017930 tx=0x7f06e004a2a0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 reap_dead start 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e6e10640 1 -- 172.21.15.144:0/2013212997 reap_dead start 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 shutdown_connections 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 >> 172.21.15.144:0/2013212997 conn(0x56403db7d8d0 msgr2=0x56403db7b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 shutdown_connections 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/2013212997 wait complete. 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/1254964456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05c00346a0 msgr2=0x7f05c0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/1254964456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05c00346a0 0x7f05c0036b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x56403db61a50 tx=0x7f06d801cf00 comp rx=0 tx=0).stop 2024-09-13T19:33:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/1254964456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db74aa0 msgr2=0x56403db74ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/1254964456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db74aa0 0x56403db74ec0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x56403db619b0 tx=0x7f06e000af40 comp rx=0 tx=0).stop 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/1254964456 shutdown_connections 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/1254964456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05c00346a0 0x7f05c0036b60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/1254964456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403db74aa0 0x56403db74ec0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/1254964456 >> 172.21.15.144:0/1254964456 conn(0x56403db69bf0 msgr2=0x56403db6c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/1254964456 shutdown_connections 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/1254964456 wait complete. 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db63900 msgr2=0x56403db65cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db63900 0x56403db65cf0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403da6be50 msgr2=0x56403db60f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403da6be50 0x56403db60f90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05cc034650 msgr2=0x7f05cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05cc034650 0x7f05cc036b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ae000 tx=0x7f06d00a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 msgr2=0x56403db5a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db5a000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f06d8001af0 tx=0x7f06d8000f50 comp rx=0 tx=0).stop 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 shutdown_connections 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56403da6be50 0x56403db60f90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56403db63900 0x56403db65cf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f05cc034650 0x7f05cc036b10 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ae000 tx=0x7f06d00a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 --2- 172.21.15.144:0/4271826100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56403d9d9b00 0x56403db5a000 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 >> 172.21.15.144:0/4271826100 conn(0x56403da60060 msgr2=0x56403db4d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 shutdown_connections 2024-09-13T19:33:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.595+0000 7f06e9b01980 1 -- 172.21.15.144:0/4271826100 wait complete. 2024-09-13T19:33:31.606 INFO:teuthology.orchestra.run.smithi144.stdout:["myfoo"] 2024-09-13T19:33:31.607 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T19:33:31.612 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:31.612 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T19:33:31.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T19:33:31.613 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T19:33:31.675 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:31.676 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:31.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3542cf1980 1 Processor -- start 2024-09-13T19:33:31.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3542cf1980 1 -- start start 2024-09-13T19:33:31.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3542cf1980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55c3ae03f680 0x55c3ae03fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3542cf1980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3adec7ae0 con 0x55c3ae03ffd0 2024-09-13T19:33:31.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3542cf1980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55c3adeebe30 con 0x55c3ae03f680 2024-09-13T19:33:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3540801640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55c3ae03f680 0x55c3ae03fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3540801640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55c3ae03f680 0x55c3ae03fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57310/0 (socket says 172.21.15.144:57310) 2024-09-13T19:33:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3540000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55c3ae03ffd0 0x55c3ae044a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44556/0 (socket says 172.21.15.144:44556) 2024-09-13T19:33:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3540801640 1 -- 172.21.15.144:0/38195268 learned_addr learned my addr 172.21.15.144:0/38195268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3540801640 1 -- 172.21.15.144:0/38195268 >> v1:172.21.15.18:6789/0 conn(0x55c3ae03ffd0 legacy=0x55c3ae044a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3540801640 1 -- 172.21.15.144:0/38195268 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ae047250 con 0x55c3ae03f680 2024-09-13T19:33:31.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.675+0000 7f3540801640 1 --2- 172.21.15.144:0/38195268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae03fa60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f353000a4e0 tx=0x7f353001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd14275898214ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f353f7ff640 1 -- 172.21.15.144:0/38195268 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35300aa540 con 0x55c3ae03f680 2024-09-13T19:33:31.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f353f7ff640 1 -- 172.21.15.144:0/38195268 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35300aa6e0 con 0x55c3ae03f680 2024-09-13T19:33:31.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f353f7ff640 1 -- 172.21.15.144:0/38195268 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35300aaa40 con 0x55c3ae03f680 2024-09-13T19:33:31.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f3542cf1980 1 -- 172.21.15.144:0/38195268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 msgr2=0x55c3ae03fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f3542cf1980 1 --2- 172.21.15.144:0/38195268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae03fa60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f353000a4e0 tx=0x7f353001b090 comp rx=0 tx=0).stop 2024-09-13T19:33:31.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f3542cf1980 1 -- 172.21.15.144:0/38195268 shutdown_connections 2024-09-13T19:33:31.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f3542cf1980 1 --2- 172.21.15.144:0/38195268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae03fa60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f3542cf1980 1 -- 172.21.15.144:0/38195268 >> 172.21.15.144:0/38195268 conn(0x55c3ae03b1a0 msgr2=0x55c3ae03d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f3542cf1980 1 -- 172.21.15.144:0/38195268 shutdown_connections 2024-09-13T19:33:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.679+0000 7f3542cf1980 1 -- 172.21.15.144:0/38195268 wait complete. 2024-09-13T19:33:31.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3542cf1980 1 Processor -- start 2024-09-13T19:33:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3542cf1980 1 -- start start 2024-09-13T19:33:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3542cf1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae12aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3542cf1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c3adeed200 con 0x55c3ae03f680 2024-09-13T19:33:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3540801640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae12aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3540801640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae12aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57326/0 (socket says 172.21.15.144:57326) 2024-09-13T19:33:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3540801640 1 -- 172.21.15.144:0/2683997463 learned_addr learned my addr 172.21.15.144:0/2683997463 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3540801640 1 -- 172.21.15.144:0/2683997463 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ae12b000 con 0x55c3ae03f680 2024-09-13T19:33:31.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f3540801640 1 --2- 172.21.15.144:0/2683997463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae12aa30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3530017ca0 tx=0x7f35300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff78e934b8609c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f342e60c640 1 -- 172.21.15.144:0/2683997463 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35300b9030 con 0x55c3ae03f680 2024-09-13T19:33:31.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f342e60c640 1 -- 172.21.15.144:0/2683997463 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35300aaac0 con 0x55c3ae03f680 2024-09-13T19:33:31.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.691+0000 7f342e60c640 1 -- 172.21.15.144:0/2683997463 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35300aada0 con 0x55c3ae03f680 2024-09-13T19:33:31.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- 172.21.15.144:0/2683997463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 msgr2=0x55c3ae12aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 --2- 172.21.15.144:0/2683997463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae12aa30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3530017ca0 tx=0x7f35300033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- 172.21.15.144:0/2683997463 shutdown_connections 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 --2- 172.21.15.144:0/2683997463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03f680 0x55c3ae12aa30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- 172.21.15.144:0/2683997463 >> 172.21.15.144:0/2683997463 conn(0x55c3ae03b1a0 msgr2=0x55c3ae126660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- 172.21.15.144:0/2683997463 shutdown_connections 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- 172.21.15.144:0/2683997463 wait complete. 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 Processor -- start 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- start start 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03ffd0 0x55c3ae131e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c3ae046c90 con 0x55c3ae03ffd0 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3540801640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03ffd0 0x55c3ae131e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3540801640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03ffd0 0x55c3ae131e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57342/0 (socket says 172.21.15.144:57342) 2024-09-13T19:33:31.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3540801640 1 -- 172.21.15.144:0/3197835578 learned_addr learned my addr 172.21.15.144:0/3197835578 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3540801640 1 -- 172.21.15.144:0/3197835578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ae132370 con 0x55c3ae03ffd0 2024-09-13T19:33:31.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3540801640 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03ffd0 0x55c3ae131e30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3530005cc0 tx=0x7f3530017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f342ce09640 1 -- 172.21.15.144:0/3197835578 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35300b9030 con 0x55c3ae03ffd0 2024-09-13T19:33:31.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3ae132600 con 0x55c3ae03ffd0 2024-09-13T19:33:31.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ae1352e0 con 0x55c3ae03ffd0 2024-09-13T19:33:31.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f342ce09640 1 -- 172.21.15.144:0/3197835578 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35300c3070 con 0x55c3ae03ffd0 2024-09-13T19:33:31.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f342ce09640 1 -- 172.21.15.144:0/3197835578 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35300cc060 con 0x55c3ae03ffd0 2024-09-13T19:33:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.695+0000 7f342ce09640 1 -- 172.21.15.144:0/3197835578 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f35300c5070 con 0x55c3ae03ffd0 2024-09-13T19:33:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f342ce09640 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3428034650 0x7f3428036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f342ce09640 1 -- 172.21.15.144:0/3197835578 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f35300ba070 con 0x55c3ae03ffd0 2024-09-13T19:33:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3540000640 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3428034650 0x7f3428036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae136db0 0x55c3ae1391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1397f0 con 0x55c3ae136db0 2024-09-13T19:33:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3541002640 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae136db0 0x55c3ae1391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3540000640 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3428034650 0x7f3428036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3528000f70 tx=0x7f3528001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3541002640 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae136db0 0x55c3ae1391a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3541002640 1 -- 172.21.15.144:0/3197835578 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35380083f0 con 0x55c3ae136db0 2024-09-13T19:33:31.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae136500 con 0x55c3ae136db0 2024-09-13T19:33:31.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3541002640 1 -- 172.21.15.144:0/3197835578 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35380083f0 con 0x55c3ae136db0 2024-09-13T19:33:31.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae13bb20 0x55c3ae13df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae13e600 con 0x55c3ae13bb20 2024-09-13T19:33:31.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3540801640 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae13bb20 0x55c3ae13df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3540801640 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae13bb20 0x55c3ae13df10 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3540801640 1 -- 172.21.15.144:0/3197835578 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae13bb20 2024-09-13T19:33:31.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae13a9c0 con 0x55c3ae136db0 2024-09-13T19:33:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3541002640 1 -- 172.21.15.144:0/3197835578 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35380083f0 con 0x55c3ae136db0 2024-09-13T19:33:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae13aea0 con 0x55c3ae136db0 2024-09-13T19:33:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.699+0000 7f3541002640 1 -- 172.21.15.144:0/3197835578 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f35380083f0 con 0x55c3ae136db0 2024-09-13T19:33:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 Processor -- start 2024-09-13T19:33:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 -- start start 2024-09-13T19:33:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3adfb6580 0x55c3adfb4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c3adf46800 con 0x55c3adfb6580 2024-09-13T19:33:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3541002640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3adfb6580 0x55c3adfb4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3541002640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3adfb6580 0x55c3adfb4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57358/0 (socket says 172.21.15.144:57358) 2024-09-13T19:33:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3541002640 1 -- 172.21.15.144:0/2850289525 learned_addr learned my addr 172.21.15.144:0/2850289525 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3541002640 1 -- 172.21.15.144:0/2850289525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3adfb69a0 con 0x55c3adfb6580 2024-09-13T19:33:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3541002640 1 --2- 172.21.15.144:0/2850289525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3adfb6580 0x55c3adfb4c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55c3ae133260 tx=0x7f353800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3425ffb640 1 -- 172.21.15.144:0/2850289525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3538007dd0 con 0x55c3adfb6580 2024-09-13T19:33:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 -- 172.21.15.144:0/2850289525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3adfb51a0 con 0x55c3adfb6580 2024-09-13T19:33:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3425ffb640 1 -- 172.21.15.144:0/2850289525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353801e020 con 0x55c3adfb6580 2024-09-13T19:33:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3425ffb640 1 -- 172.21.15.144:0/2850289525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3538019590 con 0x55c3adfb6580 2024-09-13T19:33:31.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 -- 172.21.15.144:0/2850289525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3adfb5670 con 0x55c3adfb6580 2024-09-13T19:33:31.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3425ffb640 1 -- 172.21.15.144:0/2850289525 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3538016040 con 0x55c3adfb6580 2024-09-13T19:33:31.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3425ffb640 1 --2- 172.21.15.144:0/2850289525 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3418034650 0x7f3418036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3425ffb640 1 -- 172.21.15.144:0/2850289525 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f353801f030 con 0x55c3adfb6580 2024-09-13T19:33:31.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3540801640 1 --2- 172.21.15.144:0/2850289525 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3418034650 0x7f3418036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 Processor -- start 2024-09-13T19:33:31.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 -- start start 2024-09-13T19:33:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3540801640 1 --2- 172.21.15.144:0/2850289525 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3418034650 0x7f3418036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55c3ae139c70 tx=0x7f35300e3520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae15be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.703+0000 7f3542cf1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c3ae12b2c0 con 0x55c3ae15ba70 2024-09-13T19:33:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae15be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57366/0 (socket says 172.21.15.144:57366) 2024-09-13T19:33:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 -- 172.21.15.144:0/1466859719 learned_addr learned my addr 172.21.15.144:0/1466859719 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 -- 172.21.15.144:0/1466859719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ae15c420 con 0x55c3ae15ba70 2024-09-13T19:33:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 --2- 172.21.15.144:0/1466859719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae15be50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f353804a300 tx=0x7f3538017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f422afa551ec42e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f341f7fe640 1 -- 172.21.15.144:0/1466859719 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3538040070 con 0x55c3ae15ba70 2024-09-13T19:33:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f341f7fe640 1 -- 172.21.15.144:0/1466859719 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3538048070 con 0x55c3ae15ba70 2024-09-13T19:33:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f341f7fe640 1 -- 172.21.15.144:0/1466859719 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353801d040 con 0x55c3ae15ba70 2024-09-13T19:33:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- 172.21.15.144:0/1466859719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 msgr2=0x55c3ae15be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 --2- 172.21.15.144:0/1466859719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae15be50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f353804a300 tx=0x7f3538017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- 172.21.15.144:0/1466859719 shutdown_connections 2024-09-13T19:33:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 --2- 172.21.15.144:0/1466859719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae15be50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- 172.21.15.144:0/1466859719 >> 172.21.15.144:0/1466859719 conn(0x55c3ae157e50 msgr2=0x55c3ae155f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- 172.21.15.144:0/1466859719 shutdown_connections 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- 172.21.15.144:0/1466859719 wait complete. 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 Processor -- start 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- start start 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae162e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c3ae15ca40 con 0x55c3ae15ba70 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae162e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57368/0 (socket says 172.21.15.144:57368) 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 learned_addr learned my addr 172.21.15.144:0/169007531 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ae163340 con 0x55c3ae15ba70 2024-09-13T19:33:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3541002640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae162e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f353804a300 tx=0x7f353804a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f341dffb640 1 -- 172.21.15.144:0/169007531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353801d070 con 0x55c3ae15ba70 2024-09-13T19:33:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f341dffb640 1 -- 172.21.15.144:0/169007531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35380227f0 con 0x55c3ae15ba70 2024-09-13T19:33:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3ae1635d0 con 0x55c3ae15ba70 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f341dffb640 1 -- 172.21.15.144:0/169007531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3538032040 con 0x55c3ae15ba70 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.707+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ae1662b0 con 0x55c3ae15ba70 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f341dffb640 1 -- 172.21.15.144:0/169007531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f35380198f0 con 0x55c3ae15ba70 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f341dffb640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3410034650 0x7f3410036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f341dffb640 1 -- 172.21.15.144:0/169007531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3538056af0 con 0x55c3ae15ba70 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3540801640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3410034650 0x7f3410036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae16e1f0 0x55c3ae170680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae170dd0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3540000640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae16e1f0 0x55c3ae170680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3540801640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3410034650 0x7f3410036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3530000f90 tx=0x7f35300da000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3540000640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae16e1f0 0x55c3ae170680 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f352800f620 con 0x55c3ae16e1f0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 realm 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae16d700 con 0x55c3ae16e1f0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f352800f620 con 0x55c3ae16e1f0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1718d0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f352800f620 con 0x55c3ae16e1f0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae171e00 con 0x55c3ae16e1f0 2024-09-13T19:33:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f352800f620 con 0x55c3ae16e1f0 2024-09-13T19:33:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae172c00 0x55c3ae174ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae175570 con 0x55c3ae172c00 2024-09-13T19:33:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3541002640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae172c00 0x55c3ae174ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.711+0000 7f3541002640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae172c00 0x55c3ae174ff0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3542cf1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3542cf1980 20 searching for the correct realm 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c3ae177530 0x55c3ae1799f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540801640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c3ae177530 0x55c3ae1799f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540801640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c3ae177530 0x55c3ae1799f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540801640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f35300c7070 0x7f35300c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x7f35300c7070 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540000640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f35300c7070 0x7f35300c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540000640 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f35300c7070 0x7f35300c7760 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352800f620 con 0x7f35300c7070 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f352800f620 con 0x55c3ae16e1f0 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.715+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x7f35300c7070 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x7f35300c7070 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.719+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x7f35300c7070 2024-09-13T19:33:31.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x7f35300c7070 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae177530 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.723+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae172c00 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a0c0 con 0x7f35300c7070 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae175f30 con 0x55c3ae16e1f0 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae176810 con 0x55c3ae16e1f0 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 zone default found 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 4 Realm: () 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 zonegroup default 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae172c00 2024-09-13T19:33:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17c770 con 0x55c3ae177530 2024-09-13T19:33:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados->read ofs=0 len=0 2024-09-13T19:33:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17cb10 con 0x55c3ae177530 2024-09-13T19:33:31.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 started sync module instance, tier type = 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.727+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17bbb0 con 0x7f35300c7070 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.731+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.731+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94298927775952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17bbb0 con 0x7f35300c7070 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.731+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17d4d0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.731+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94298927775952] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.731+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.731+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94298927780144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17bbb0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.731+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17dee0 con 0x55c3ae177530 2024-09-13T19:33:31.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94298927780144] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94298927773440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17bb20 con 0x55c3ae177530 2024-09-13T19:33:31.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17ebe0 con 0x7f35300c7070 2024-09-13T19:33:31.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94298927786048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17f230 con 0x7f35300c7070 2024-09-13T19:33:31.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17fd50 con 0x55c3ae16e1f0 2024-09-13T19:33:31.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94298927786048] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94298927773440] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94298927784576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17fd10 con 0x55c3ae16e1f0 2024-09-13T19:33:31.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.735+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae180140 con 0x55c3ae172c00 2024-09-13T19:33:31.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.739+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94298927784576] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.739+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.739+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94298927787168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae180140 con 0x55c3ae172c00 2024-09-13T19:33:31.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.739+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae180b50 con 0x55c3ae172c00 2024-09-13T19:33:31.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94298927787168] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94298927790112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae180b50 con 0x55c3ae172c00 2024-09-13T19:33:31.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae181510 con 0x55c3ae172c00 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94298927796320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae181480 con 0x55c3ae172c00 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 20 add_watcher() i=0 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 20 add_watcher() i=1 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 20 add_watcher() i=2 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 20 add_watcher() i=3 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 20 add_watcher() i=4 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 20 add_watcher() i=5 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94298927790112] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.743+0000 7f3542cf1980 20 add_watcher() i=6 2024-09-13T19:33:31.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94298927796320] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 20 add_watcher() i=7 2024-09-13T19:33:31.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:31.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1806a0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94298927793824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae181ee0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94298927793824] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f33f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 5 note: GC not initialized 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f33f57e2640 20 reqs_thread_entry: start 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 20 Filter name: none 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3366ffd640 20 reqs_thread_entry: start 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1a7720 con 0x55c3ae177530 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1a7720 con 0x55c3ae177530 2024-09-13T19:33:31.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1a7720 con 0x55c3ae16e1f0 2024-09-13T19:33:31.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x7f35300c7070 2024-09-13T19:33:31.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.747+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae177530 2024-09-13T19:33:31.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae177530 2024-09-13T19:33:31.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x7f35300c7070 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae177530 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae172c00 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae172c00 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae177530 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae172c00 2024-09-13T19:33:31.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.751+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae172c00 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae172c00 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae177530 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x7f35300c7070 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae16e1f0 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae16e1f0 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae177530 2024-09-13T19:33:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x7f35300c7070 2024-09-13T19:33:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae172c00 2024-09-13T19:33:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae16e1f0 2024-09-13T19:33:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.755+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae172c00 2024-09-13T19:33:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae177530 2024-09-13T19:33:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x7f35300c7070 2024-09-13T19:33:31.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae172c00 2024-09-13T19:33:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae16e1f0 2024-09-13T19:33:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x55c3ae177530 2024-09-13T19:33:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17a540 con 0x7f35300c7070 2024-09-13T19:33:31.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3542cf1980 20 RGWRados::pool_iterate: got myfoo 2024-09-13T19:33:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3542cf1980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f33f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.759+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94298927793824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94298927793824] v30'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94298927775952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x7f35300c7070 2024-09-13T19:33:31.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94298927775952] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3542cf1980 20 remove_watcher() i=0 2024-09-13T19:33:31.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3542cf1980 2 removed watcher, disabling cache 2024-09-13T19:33:31.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94298927780144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae16e1f0 2024-09-13T19:33:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94298927780144] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3542cf1980 20 remove_watcher() i=1 2024-09-13T19:33:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.763+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94298927773440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1763b0 con 0x55c3ae177530 2024-09-13T19:33:31.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.767+0000 7f3540801640 1 -- 172.21.15.144:0/169007531 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94298927773440] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300d0cc0 con 0x55c3ae177530 2024-09-13T19:33:31.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.767+0000 7f3542cf1980 20 remove_watcher() i=2 2024-09-13T19:33:31.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.767+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94298927786048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1a5a40 con 0x7f35300c7070 2024-09-13T19:33:31.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.767+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94298927786048] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x7f35300c7070 2024-09-13T19:33:31.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.767+0000 7f3542cf1980 20 remove_watcher() i=3 2024-09-13T19:33:31.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.767+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94298927784576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1a5a40 con 0x55c3ae16e1f0 2024-09-13T19:33:31.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.771+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94298927784576] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f352802b040 con 0x55c3ae16e1f0 2024-09-13T19:33:31.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.771+0000 7f3542cf1980 20 remove_watcher() i=4 2024-09-13T19:33:31.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.771+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94298927787168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae1a5a40 con 0x55c3ae172c00 2024-09-13T19:33:31.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.771+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94298927787168] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.771+0000 7f3542cf1980 20 remove_watcher() i=5 2024-09-13T19:33:31.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.771+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94298927790112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17e280 con 0x55c3ae172c00 2024-09-13T19:33:31.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94298927790112] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 20 remove_watcher() i=6 2024-09-13T19:33:31.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94298927796320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3ae17f820 con 0x55c3ae172c00 2024-09-13T19:33:31.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3541002640 1 -- 172.21.15.144:0/169007531 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94298927796320] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3538035040 con 0x55c3ae172c00 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 20 remove_watcher() i=7 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae172c00 msgr2=0x55c3ae174ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae172c00 0x55c3ae174ff0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae16e1f0 msgr2=0x55c3ae170680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae16e1f0 0x55c3ae170680 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f35300c7070 msgr2=0x7f35300c7760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f35300c7070 0x7f35300c7760 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c3ae177530 msgr2=0x55c3ae1799f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c3ae177530 0x55c3ae1799f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3410034650 msgr2=0x7f3410036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3410034650 0x7f3410036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3530000f90 tx=0x7f35300da000 comp rx=0 tx=0).stop 2024-09-13T19:33:31.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 msgr2=0x55c3ae162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3540000640 1 -- 172.21.15.144:0/169007531 reap_dead start 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae162e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f353804a300 tx=0x7f353804a290 comp rx=0 tx=0).stop 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 shutdown_connections 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/169007531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae15ba70 0x55c3ae162e00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 >> 172.21.15.144:0/169007531 conn(0x55c3ae157e50 msgr2=0x55c3ae155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 shutdown_connections 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/169007531 wait complete. 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/2850289525 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3418034650 msgr2=0x7f3418036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/2850289525 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3418034650 0x7f3418036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55c3ae139c70 tx=0x7f35300e3520 comp rx=0 tx=0).stop 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/2850289525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3adfb6580 msgr2=0x55c3adfb4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/2850289525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3adfb6580 0x55c3adfb4c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55c3ae133260 tx=0x7f353800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/2850289525 shutdown_connections 2024-09-13T19:33:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/2850289525 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3418034650 0x7f3418036b10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/2850289525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3adfb6580 0x55c3adfb4c00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/2850289525 >> 172.21.15.144:0/2850289525 conn(0x55c3ae141e70 msgr2=0x55c3ae1448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/2850289525 shutdown_connections 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/2850289525 wait complete. 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae13bb20 msgr2=0x55c3ae13df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae13bb20 0x55c3ae13df10 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae136db0 msgr2=0x55c3ae1391a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae136db0 0x55c3ae1391a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3428034650 msgr2=0x7f3428036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3428034650 0x7f3428036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3528000f70 tx=0x7f3528001380 comp rx=0 tx=0).stop 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03ffd0 msgr2=0x55c3ae131e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03ffd0 0x55c3ae131e30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3530005cc0 tx=0x7f3530017e30 comp rx=0 tx=0).stop 2024-09-13T19:33:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 shutdown_connections 2024-09-13T19:33:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c3ae136db0 0x55c3ae1391a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c3ae13bb20 0x55c3ae13df10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3428034650 0x7f3428036b10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 --2- 172.21.15.144:0/3197835578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3ae03ffd0 0x55c3ae131e30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 >> 172.21.15.144:0/3197835578 conn(0x55c3ae03b1a0 msgr2=0x55c3ae1251e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 shutdown_connections 2024-09-13T19:33:31.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:31.775+0000 7f3542cf1980 1 -- 172.21.15.144:0/3197835578 wait complete. 2024-09-13T19:33:31.789 INFO:teuthology.orchestra.run.smithi144.stdout:["myfoo"] 2024-09-13T19:33:31.789 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T19:33:31.804 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:31.821 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:31.836 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:31.881 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-13T19:33:31.952 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:32.026 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:32.098 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:32.098 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:33:32.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:33:32.098 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:33:32.135 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:32.136 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:32.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f5480899980 1 Processor -- start 2024-09-13T19:33:32.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f5480899980 1 -- start start 2024-09-13T19:33:32.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f5480899980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55583be9b8e0 0x55583be9bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f5480899980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55583bd21ae0 con 0x55583be9c230 2024-09-13T19:33:32.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f5480899980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55583bd45e30 con 0x55583be9b8e0 2024-09-13T19:33:32.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f547e3a9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55583be9b8e0 0x55583be9bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f547e3a9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55583be9b8e0 0x55583be9bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57380/0 (socket says 172.21.15.144:57380) 2024-09-13T19:33:32.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f547e3a9640 1 -- 172.21.15.144:0/2474109337 learned_addr learned my addr 172.21.15.144:0/2474109337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f547dba8640 1 --1- 172.21.15.144:0/2474109337 >> v1:172.21.15.18:6789/0 conn(0x55583be9c230 0x55583bea0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44566/0 (socket says 172.21.15.144:44566) 2024-09-13T19:33:32.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f547e3a9640 1 -- 172.21.15.144:0/2474109337 >> v1:172.21.15.18:6789/0 conn(0x55583be9c230 legacy=0x55583bea0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.135+0000 7f547e3a9640 1 -- 172.21.15.144:0/2474109337 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583bea34b0 con 0x55583be9b8e0 2024-09-13T19:33:32.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f547e3a9640 1 --2- 172.21.15.144:0/2474109337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9b8e0 0x55583be9bcc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f547000a5c0 tx=0x7f547001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251f3f0538486fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f547d3a7640 1 -- 172.21.15.144:0/2474109337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54700a6070 con 0x55583be9b8e0 2024-09-13T19:33:32.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f547d3a7640 1 -- 172.21.15.144:0/2474109337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54700af070 con 0x55583be9b8e0 2024-09-13T19:33:32.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f547d3a7640 1 -- 172.21.15.144:0/2474109337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54700aa5c0 con 0x55583be9b8e0 2024-09-13T19:33:32.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f5480899980 1 -- 172.21.15.144:0/2474109337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9b8e0 msgr2=0x55583be9bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f5480899980 1 --2- 172.21.15.144:0/2474109337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9b8e0 0x55583be9bcc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f547000a5c0 tx=0x7f547001b340 comp rx=0 tx=0).stop 2024-09-13T19:33:32.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f5480899980 1 -- 172.21.15.144:0/2474109337 shutdown_connections 2024-09-13T19:33:32.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f5480899980 1 --2- 172.21.15.144:0/2474109337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9b8e0 0x55583be9bcc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f5480899980 1 -- 172.21.15.144:0/2474109337 >> 172.21.15.144:0/2474109337 conn(0x55583be0f230 msgr2=0x55583be0f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f5480899980 1 -- 172.21.15.144:0/2474109337 shutdown_connections 2024-09-13T19:33:32.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.139+0000 7f5480899980 1 -- 172.21.15.144:0/2474109337 wait complete. 2024-09-13T19:33:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.155+0000 7f5480899980 1 Processor -- start 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.155+0000 7f5480899980 1 -- start start 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.155+0000 7f5480899980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf86d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.155+0000 7f5480899980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55583bd47200 con 0x55583be9c230 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.155+0000 7f547e3a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf86d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.155+0000 7f547e3a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf86d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57382/0 (socket says 172.21.15.144:57382) 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.155+0000 7f547e3a9640 1 -- 172.21.15.144:0/3666192151 learned_addr learned my addr 172.21.15.144:0/3666192151 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.155+0000 7f547e3a9640 1 -- 172.21.15.144:0/3666192151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583bf87300 con 0x55583be9c230 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f547e3a9640 1 --2- 172.21.15.144:0/3666192151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf86d30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f547001b380 tx=0x7f5470003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6592b5cf6fa7bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f536c608640 1 -- 172.21.15.144:0/3666192151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54700aa840 con 0x55583be9c230 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f536c608640 1 -- 172.21.15.144:0/3666192151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54700aaa00 con 0x55583be9c230 2024-09-13T19:33:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f536c608640 1 -- 172.21.15.144:0/3666192151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54700aad20 con 0x55583be9c230 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- 172.21.15.144:0/3666192151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 msgr2=0x55583bf86d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 --2- 172.21.15.144:0/3666192151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf86d30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f547001b380 tx=0x7f5470003030 comp rx=0 tx=0).stop 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- 172.21.15.144:0/3666192151 shutdown_connections 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 --2- 172.21.15.144:0/3666192151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf86d30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- 172.21.15.144:0/3666192151 >> 172.21.15.144:0/3666192151 conn(0x55583be0f230 msgr2=0x55583bf828c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- 172.21.15.144:0/3666192151 shutdown_connections 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- 172.21.15.144:0/3666192151 wait complete. 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 Processor -- start 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- start start 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf8dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55583bea2ef0 con 0x55583be9c230 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f547e3a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf8dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f547e3a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf8dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57390/0 (socket says 172.21.15.144:57390) 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f547e3a9640 1 -- 172.21.15.144:0/945782576 learned_addr learned my addr 172.21.15.144:0/945782576 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f547e3a9640 1 -- 172.21.15.144:0/945782576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583bf8e4f0 con 0x55583be9c230 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f547e3a9640 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf8dfb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f547001bbe0 tx=0x7f54700180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f536ae05640 1 -- 172.21.15.144:0/945782576 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54700cb030 con 0x55583be9c230 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f536ae05640 1 -- 172.21.15.144:0/945782576 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5470000e50 con 0x55583be9c230 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55583bf8e780 con 0x55583be9c230 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f536ae05640 1 -- 172.21.15.144:0/945782576 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54700bd9d0 con 0x55583be9c230 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.159+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55583bf91460 con 0x55583be9c230 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f536ae05640 1 -- 172.21.15.144:0/945782576 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f54700ce070 con 0x55583be9c230 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f536ae05640 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53640346a0 0x7f5364036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f536ae05640 1 -- 172.21.15.144:0/945782576 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f54700cc070 con 0x55583be9c230 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f547dba8640 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53640346a0 0x7f5364036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bf92f30 0x55583bf95340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bf959b0 con 0x55583bf92f30 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f547ebaa640 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bf92f30 0x55583bf95340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f547dba8640 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53640346a0 0x7f5364036b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5474000f70 tx=0x7f5474001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f547ebaa640 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bf92f30 0x55583bf95340 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f547ebaa640 1 -- 172.21.15.144:0/945782576 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547800a4d0 con 0x55583bf92f30 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bf92660 con 0x55583bf92f30 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f547ebaa640 1 -- 172.21.15.144:0/945782576 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f547800a4d0 con 0x55583bf92f30 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bf97ce0 0x55583bf9a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bf9a7a0 con 0x55583bf97ce0 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.163+0000 7f547e3a9640 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bf97ce0 0x55583bf9a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547e3a9640 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bf97ce0 0x55583bf9a0d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547e3a9640 1 -- 172.21.15.144:0/945782576 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bf97ce0 2024-09-13T19:33:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bf96b80 con 0x55583bf92f30 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547ebaa640 1 -- 172.21.15.144:0/945782576 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f547800a4d0 con 0x55583bf92f30 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bf97060 con 0x55583bf92f30 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547ebaa640 1 -- 172.21.15.144:0/945782576 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f547800a4d0 con 0x55583bf92f30 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5480899980 1 Processor -- start 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5480899980 1 -- start start 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5480899980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfa8ee0 0x55583bfa9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5480899980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55583bda0800 con 0x55583bfa8ee0 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547ebaa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfa8ee0 0x55583bfa9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547ebaa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfa8ee0 0x55583bfa9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57396/0 (socket says 172.21.15.144:57396) 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547ebaa640 1 -- 172.21.15.144:0/3336583702 learned_addr learned my addr 172.21.15.144:0/3336583702 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547ebaa640 1 -- 172.21.15.144:0/3336583702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583bfa9840 con 0x55583bfa8ee0 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f547ebaa640 1 --2- 172.21.15.144:0/3336583702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfa8ee0 0x55583bfa9300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55583bf8eeb0 tx=0x7f5478018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5363fff640 1 -- 172.21.15.144:0/3336583702 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478014450 con 0x55583bfa8ee0 2024-09-13T19:33:32.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5363fff640 1 -- 172.21.15.144:0/3336583702 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5478014610 con 0x55583bfa8ee0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5480899980 1 -- 172.21.15.144:0/3336583702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55583bfa9ad0 con 0x55583bfa8ee0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.167+0000 7f5363fff640 1 -- 172.21.15.144:0/3336583702 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478014930 con 0x55583bfa8ee0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5480899980 1 -- 172.21.15.144:0/3336583702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55583bfac750 con 0x55583bfa8ee0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5363fff640 1 -- 172.21.15.144:0/3336583702 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5478011040 con 0x55583bfa8ee0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5363fff640 1 --2- 172.21.15.144:0/3336583702 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53580346a0 0x7f5358036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5363fff640 1 -- 172.21.15.144:0/3336583702 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f547801e070 con 0x55583bfa8ee0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f547e3a9640 1 --2- 172.21.15.144:0/3336583702 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53580346a0 0x7f5358036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5480899980 1 Processor -- start 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5480899980 1 -- start start 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f547e3a9640 1 --2- 172.21.15.144:0/3336583702 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53580346a0 0x7f5358036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55583bf95e50 tx=0x7f54700058a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5480899980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfb5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5480899980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55583bf875c0 con 0x55583bfb59c0 2024-09-13T19:33:32.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f547ebaa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfb5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f547ebaa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfb5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57398/0 (socket says 172.21.15.144:57398) 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f547ebaa640 1 -- 172.21.15.144:0/3964956824 learned_addr learned my addr 172.21.15.144:0/3964956824 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f547ebaa640 1 -- 172.21.15.144:0/3964956824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583bfb6370 con 0x55583bfb59c0 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f547ebaa640 1 --2- 172.21.15.144:0/3964956824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfb5da0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f547804a050 tx=0x7f5478013c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996e64ac576fc84a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5361ffb640 1 -- 172.21.15.144:0/3964956824 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478045e60 con 0x55583bfb59c0 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5361ffb640 1 -- 172.21.15.144:0/3964956824 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547800de50 con 0x55583bfb59c0 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.171+0000 7f5361ffb640 1 -- 172.21.15.144:0/3964956824 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478016570 con 0x55583bfb59c0 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- 172.21.15.144:0/3964956824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 msgr2=0x55583bfb5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 --2- 172.21.15.144:0/3964956824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfb5da0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f547804a050 tx=0x7f5478013c60 comp rx=0 tx=0).stop 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- 172.21.15.144:0/3964956824 shutdown_connections 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 --2- 172.21.15.144:0/3964956824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfb5da0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- 172.21.15.144:0/3964956824 >> 172.21.15.144:0/3964956824 conn(0x55583bfb1da0 msgr2=0x55583bfafea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- 172.21.15.144:0/3964956824 shutdown_connections 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- 172.21.15.144:0/3964956824 wait complete. 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 Processor -- start 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- start start 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfbcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55583bfb6990 con 0x55583bfb59c0 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f547ebaa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfbcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f547ebaa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfbcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57408/0 (socket says 172.21.15.144:57408) 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 learned_addr learned my addr 172.21.15.144:0/474807971 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583bfbd290 con 0x55583bfb59c0 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f547ebaa640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfbcd50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5478047040 tx=0x7f5478049fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f534ffff640 1 -- 172.21.15.144:0/474807971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54780135c0 con 0x55583bfb59c0 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55583bfbd520 con 0x55583bfb59c0 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f534ffff640 1 -- 172.21.15.144:0/474807971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5478013760 con 0x55583bfb59c0 2024-09-13T19:33:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f534ffff640 1 -- 172.21.15.144:0/474807971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547804b360 con 0x55583bfb59c0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55583bfc0200 con 0x55583bfb59c0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f534ffff640 1 -- 172.21.15.144:0/474807971 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f547804b550 con 0x55583bfb59c0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f534ffff640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5348034600 0x7f5348036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f534ffff640 1 -- 172.21.15.144:0/474807971 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5478034070 con 0x55583bfb59c0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f547e3a9640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5348034600 0x7f5348036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bfc83d0 0x55583bfca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.175+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfcafc0 con 0x55583bfc83d0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547dba8640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bfc83d0 0x55583bfca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547e3a9640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5348034600 0x7f5348036ac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55583bf9aba0 tx=0x7f54700ea000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547dba8640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bfc83d0 0x55583bfca870 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547400f620 con 0x55583bfc83d0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 realm 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfc78a0 con 0x55583bfc83d0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547400f620 con 0x55583bfc83d0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfcbac0 con 0x55583bfc83d0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547400f620 con 0x55583bfc83d0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfcbff0 con 0x55583bfc83d0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f547400f620 con 0x55583bfc83d0 2024-09-13T19:33:32.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bfccdf0 0x55583bfcf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfcf760 con 0x55583bfccdf0 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547ebaa640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bfccdf0 0x55583bfcf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547ebaa640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bfccdf0 0x55583bfcf1e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 20 searching for the correct realm 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55583bfd1740 0x55583bfd3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547e3a9640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55583bfd1740 0x55583bfd3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.179+0000 7f547e3a9640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55583bfd1740 0x55583bfd3c00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547e3a9640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f54700f2070 0x7f54700cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x7f54700f2070 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f54700f2070 0x7f54700cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f54700f2070 0x7f54700cf5e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547400f620 con 0x7f54700f2070 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfc83d0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f547400f620 con 0x55583bfc83d0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfc83d0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x7f54700f2070 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.183+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfc83d0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfc83d0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x7f54700f2070 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.187+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfc83d0 2024-09-13T19:33:32.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfc83d0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x7f54700f2070 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfc83d0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.191+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x7f54700f2070 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfd1740 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfccdf0 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x55583bfc83d0 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd42d0 con 0x7f54700f2070 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd0120 con 0x55583bfc83d0 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd05a0 con 0x55583bfc83d0 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd0a00 con 0x55583bfc83d0 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 zone default found 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 4 Realm: () 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:32.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 zonegroup default 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd4750 con 0x55583bfccdf0 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd6980 con 0x55583bfd1740 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.195+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd6d20 con 0x55583bfd1740 2024-09-13T19:33:32.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f5480899980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f5480899980 20 started sync module instance, tier type = 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f5480899980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd5dc0 con 0x7f54700f2070 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93837451944368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd5dc0 con 0x7f54700f2070 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd76e0 con 0x55583bfc83d0 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.199+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93837451944368] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93837451942432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd76e0 con 0x55583bfc83d0 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd80a0 con 0x55583bfd1740 2024-09-13T19:33:32.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93837451942432] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93837451948592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd7650 con 0x55583bfd1740 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd8da0 con 0x7f54700f2070 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93837451954720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd9640 con 0x7f54700f2070 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.203+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfda040 con 0x55583bfc83d0 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93837451948592] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93837451954720] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93837451953216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd9120 con 0x55583bfc83d0 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfda8e0 con 0x55583bfccdf0 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93837451953216] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93837451959120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfd9120 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.207+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfdad90 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.211+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93837451959120] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.211+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.211+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93837451961392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfdad00 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.211+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfdb7a0 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93837451961392] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93837451965040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfdb980 con 0x55583bfccdf0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 20 add_watcher() i=0 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 20 add_watcher() i=1 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 20 add_watcher() i=2 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 20 add_watcher() i=3 2024-09-13T19:33:32.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 20 add_watcher() i=4 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 20 add_watcher() i=5 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 20 add_watcher() i=6 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93837451965040] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 20 add_watcher() i=7 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583bfded50 con 0x55583bfc83d0 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.215+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93837451966576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bfdc170 con 0x55583bfc83d0 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93837451966576] v30'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5334fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 5 note: GC not initialized 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f52af7fe640 20 reqs_thread_entry: start 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 Filter name: none 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f52ad7fa640 20 reqs_thread_entry: start 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c0022e0 con 0x7f54700f2070 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:63 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c002b70 con 0x55583bfd1740 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(63 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:33:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c004180 con 0x7f54700f2070 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c004180 con 0x55583bfd1740 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(65 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 4.2e 4:75513853:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c003860 con 0x55583bfd1740 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 4.2a 4:55887a35:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c008c70 con 0x55583bfc83d0 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 4.3 4:c2144c8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c00b4e0 con 0x55583bfc83d0 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 4.14 4:29ca2d96:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c00df10 con 0x55583bfd1740 2024-09-13T19:33:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 4.8 4:113a96eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c010800 con 0x55583bfd1740 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 4.9 4:91094f8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c013360 con 0x55583bfc83d0 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 4.1b 4:d823e2ff:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c0161d0 con 0x7f54700f2070 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 4.38 4:1f552a94:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c019070 con 0x55583bfc83d0 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 4.a 4:53bc6a1b:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c01bd90 con 0x7f54700f2070 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 4.6 4:622ed0b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c01e800 con 0x55583bfd1740 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:76 4.18 4:18667e6d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55583c0211c0 con 0x7f54700f2070 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(67 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(68 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(71 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(73 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.219+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(76 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(66 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(69 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(70 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(75 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f5334fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93837451966576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bff2a70 con 0x55583bfc83d0 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93837451966576] v30'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93837451944368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bff2a70 con 0x7f54700f2070 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.223+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93837451944368] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.227+0000 7f5480899980 20 remove_watcher() i=0 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.227+0000 7f5480899980 2 removed watcher, disabling cache 2024-09-13T19:33:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.227+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93837451942432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bff2a70 con 0x55583bfc83d0 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.227+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93837451942432] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.227+0000 7f5480899980 20 remove_watcher() i=1 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.227+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93837451948592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bff2a70 con 0x55583bfd1740 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f547e3a9640 1 -- 172.21.15.144:0/474807971 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93837451948592] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54700b3cf0 con 0x55583bfd1740 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f5480899980 20 remove_watcher() i=2 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93837451954720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bff2a70 con 0x7f54700f2070 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93837451954720] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x7f54700f2070 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f5480899980 20 remove_watcher() i=3 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93837451953216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583c0133e0 con 0x55583bfc83d0 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93837451953216] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547402b040 con 0x55583bfc83d0 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f5480899980 20 remove_watcher() i=4 2024-09-13T19:33:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.231+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93837451959120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bff2a70 con 0x55583bfccdf0 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.235+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93837451959120] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.235+0000 7f5480899980 20 remove_watcher() i=5 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.235+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93837451961392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583c0133e0 con 0x55583bfccdf0 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.235+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93837451961392] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.235+0000 7f5480899980 20 remove_watcher() i=6 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.235+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93837451965040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55583bff2a70 con 0x55583bfccdf0 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f547ebaa640 1 -- 172.21.15.144:0/474807971 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93837451965040] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547802a070 con 0x55583bfccdf0 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 20 remove_watcher() i=7 2024-09-13T19:33:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bfccdf0 msgr2=0x55583bfcf1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bfccdf0 0x55583bfcf1e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bfc83d0 msgr2=0x55583bfca870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bfc83d0 0x55583bfca870 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f54700f2070 msgr2=0x7f54700cf5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f54700f2070 0x7f54700cf5e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55583bfd1740 msgr2=0x55583bfd3c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55583bfd1740 0x55583bfd3c00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5348034600 msgr2=0x7f5348036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5348034600 0x7f5348036ac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55583bf9aba0 tx=0x7f54700ea000 comp rx=0 tx=0).stop 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 msgr2=0x55583bfbcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/474807971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfb59c0 0x55583bfbcd50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5478047040 tx=0x7f5478049fe0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 reap_dead start 2024-09-13T19:33:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f547dba8640 1 -- 172.21.15.144:0/474807971 reap_dead start 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 shutdown_connections 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 >> 172.21.15.144:0/474807971 conn(0x55583bfb1da0 msgr2=0x55583bfafe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 shutdown_connections 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/474807971 wait complete. 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/3336583702 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53580346a0 msgr2=0x7f5358036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/3336583702 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53580346a0 0x7f5358036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55583bf95e50 tx=0x7f54700058a0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/3336583702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfa8ee0 msgr2=0x55583bfa9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/3336583702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfa8ee0 0x55583bfa9300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55583bf8eeb0 tx=0x7f5478018830 comp rx=0 tx=0).stop 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/3336583702 shutdown_connections 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/3336583702 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53580346a0 0x7f5358036b60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/3336583702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583bfa8ee0 0x55583bfa9300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/3336583702 >> 172.21.15.144:0/3336583702 conn(0x55583bf9e030 msgr2=0x55583bfa0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/3336583702 shutdown_connections 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/3336583702 wait complete. 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bf97ce0 msgr2=0x55583bf9a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bf97ce0 0x55583bf9a0d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bf92f30 msgr2=0x55583bf95340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bf92f30 0x55583bf95340 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53640346a0 msgr2=0x7f5364036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53640346a0 0x7f5364036b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5474000f70 tx=0x7f5474001380 comp rx=0 tx=0).stop 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 msgr2=0x55583bf8dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf8dfb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f547001bbe0 tx=0x7f54700180e0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 shutdown_connections 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55583bf92f30 0x55583bf95340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55583bf97ce0 0x55583bf9a0d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f53640346a0 0x7f5364036b60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 --2- 172.21.15.144:0/945782576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55583be9c230 0x55583bf8dfb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 >> 172.21.15.144:0/945782576 conn(0x55583be0f230 msgr2=0x55583bf81440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.239+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 shutdown_connections 2024-09-13T19:33:32.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.243+0000 7f5480899980 1 -- 172.21.15.144:0/945782576 wait complete. 2024-09-13T19:33:32.271 INFO:teuthology.orchestra.run.smithi144.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b5bcd2ca-839b-4a0e-a5d6-f37391d778b0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","marker":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:33:31.454152Z","creation_time":"2024-09-13T19:33:31.450072Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:33:32.272 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:33:31.454152Z', 'creation_time': '2024-09-13T19:33:31.450072Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:33:32.272 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:33:32.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:33:32.273 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T19:33:32.355 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:32.355 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:32.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.351+0000 7f28027fe980 1 Processor -- start 2024-09-13T19:33:32.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.351+0000 7f28027fe980 1 -- start start 2024-09-13T19:33:32.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f28027fe980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56086d5b5c60 0x56086d5b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f28027fe980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56086d437ae0 con 0x56086d5b18e0 2024-09-13T19:33:32.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f28027fe980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56086d45be30 con 0x56086d5b5c60 2024-09-13T19:33:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f27ffb0d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56086d5b5c60 0x56086d5b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f27ffb0d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56086d5b5c60 0x56086d5b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57414/0 (socket says 172.21.15.144:57414) 2024-09-13T19:33:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f27ffb0d640 1 -- 172.21.15.144:0/2341015924 learned_addr learned my addr 172.21.15.144:0/2341015924 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f27ffb0d640 1 -- 172.21.15.144:0/2341015924 >> v1:172.21.15.18:6789/0 conn(0x56086d5b18e0 legacy=0x56086d5b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f27ffb0d640 1 -- 172.21.15.144:0/2341015924 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086d5b95a0 con 0x56086d5b5c60 2024-09-13T19:33:32.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.355+0000 7f27ffb0d640 1 --2- 172.21.15.144:0/2341015924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b5c60 0x56086d5b8050 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f27f400a5c0 tx=0x7f27f401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc676da163088ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f27ff30c640 1 -- 172.21.15.144:0/2341015924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f40a6070 con 0x56086d5b5c60 2024-09-13T19:33:32.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f27ff30c640 1 -- 172.21.15.144:0/2341015924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f40af070 con 0x56086d5b5c60 2024-09-13T19:33:32.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f27ff30c640 1 -- 172.21.15.144:0/2341015924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f40aa5c0 con 0x56086d5b5c60 2024-09-13T19:33:32.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f28027fe980 1 -- 172.21.15.144:0/2341015924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b5c60 msgr2=0x56086d5b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f28027fe980 1 --2- 172.21.15.144:0/2341015924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b5c60 0x56086d5b8050 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f27f400a5c0 tx=0x7f27f401b340 comp rx=0 tx=0).stop 2024-09-13T19:33:32.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f28027fe980 1 -- 172.21.15.144:0/2341015924 shutdown_connections 2024-09-13T19:33:32.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f28027fe980 1 --2- 172.21.15.144:0/2341015924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b5c60 0x56086d5b8050 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f28027fe980 1 -- 172.21.15.144:0/2341015924 >> 172.21.15.144:0/2341015924 conn(0x56086d525230 msgr2=0x56086d525640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f28027fe980 1 -- 172.21.15.144:0/2341015924 shutdown_connections 2024-09-13T19:33:32.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.359+0000 7f28027fe980 1 -- 172.21.15.144:0/2341015924 wait complete. 2024-09-13T19:33:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 Processor -- start 2024-09-13T19:33:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 -- start start 2024-09-13T19:33:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d69cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56086d45d200 con 0x56086d5b18e0 2024-09-13T19:33:32.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f280030e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d69cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f280030e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d69cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57416/0 (socket says 172.21.15.144:57416) 2024-09-13T19:33:32.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f280030e640 1 -- 172.21.15.144:0/2541855246 learned_addr learned my addr 172.21.15.144:0/2541855246 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f280030e640 1 -- 172.21.15.144:0/2541855246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086d69d200 con 0x56086d5b18e0 2024-09-13T19:33:32.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f280030e640 1 --2- 172.21.15.144:0/2541855246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d69cc30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f27f0001ea0 tx=0x7f27f000b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7dc2654cd47fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f26ee60c640 1 -- 172.21.15.144:0/2541855246 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f000a040 con 0x56086d5b18e0 2024-09-13T19:33:32.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f26ee60c640 1 -- 172.21.15.144:0/2541855246 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f000f620 con 0x56086d5b18e0 2024-09-13T19:33:32.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f26ee60c640 1 -- 172.21.15.144:0/2541855246 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f000f890 con 0x56086d5b18e0 2024-09-13T19:33:32.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 -- 172.21.15.144:0/2541855246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 msgr2=0x56086d69cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 --2- 172.21.15.144:0/2541855246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d69cc30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f27f0001ea0 tx=0x7f27f000b680 comp rx=0 tx=0).stop 2024-09-13T19:33:32.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 -- 172.21.15.144:0/2541855246 shutdown_connections 2024-09-13T19:33:32.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 --2- 172.21.15.144:0/2541855246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d69cc30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 -- 172.21.15.144:0/2541855246 >> 172.21.15.144:0/2541855246 conn(0x56086d525230 msgr2=0x56086d698860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 -- 172.21.15.144:0/2541855246 shutdown_connections 2024-09-13T19:33:32.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 -- 172.21.15.144:0/2541855246 wait complete. 2024-09-13T19:33:32.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.375+0000 7f28027fe980 1 Processor -- start 2024-09-13T19:33:32.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f28027fe980 1 -- start start 2024-09-13T19:33:32.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f28027fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d529cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f28027fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56086d5b90a0 con 0x56086d5b18e0 2024-09-13T19:33:32.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f280030e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d529cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f280030e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d529cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57426/0 (socket says 172.21.15.144:57426) 2024-09-13T19:33:32.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f280030e640 1 -- 172.21.15.144:0/3469807013 learned_addr learned my addr 172.21.15.144:0/3469807013 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f280030e640 1 -- 172.21.15.144:0/3469807013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086d52a1f0 con 0x56086d5b18e0 2024-09-13T19:33:32.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f280030e640 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d529cb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f27f0001fd0 tx=0x7f27f0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f26ece09640 1 -- 172.21.15.144:0/3469807013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f0001520 con 0x56086d5b18e0 2024-09-13T19:33:32.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f26ece09640 1 -- 172.21.15.144:0/3469807013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f001ca10 con 0x56086d5b18e0 2024-09-13T19:33:32.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56086d52a480 con 0x56086d5b18e0 2024-09-13T19:33:32.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f26ece09640 1 -- 172.21.15.144:0/3469807013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f001cd50 con 0x56086d5b18e0 2024-09-13T19:33:32.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086d5269e0 con 0x56086d5b18e0 2024-09-13T19:33:32.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f26ece09640 1 -- 172.21.15.144:0/3469807013 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f27f0017050 con 0x56086d5b18e0 2024-09-13T19:33:32.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f26ece09640 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26e8034650 0x7f26e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f26ece09640 1 -- 172.21.15.144:0/3469807013 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f27f0015020 con 0x56086d5b18e0 2024-09-13T19:33:32.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f27ffb0d640 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26e8034650 0x7f26e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d5b5c60 0x56086d6af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6afd50 con 0x56086d5b5c60 2024-09-13T19:33:32.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.379+0000 7f2800b0f640 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d5b5c60 0x56086d6af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f27ffb0d640 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26e8034650 0x7f26e8036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f27f40ae000 tx=0x7f27f40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f2800b0f640 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d5b5c60 0x56086d6af810 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f2800b0f640 1 -- 172.21.15.144:0/3469807013 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27f800a4d0 con 0x56086d5b5c60 2024-09-13T19:33:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6b00f0 con 0x56086d5b5c60 2024-09-13T19:33:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f2800b0f640 1 -- 172.21.15.144:0/3469807013 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27f800a4d0 con 0x56086d5b5c60 2024-09-13T19:33:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6b1bd0 0x56086d6b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6b4820 con 0x56086d6b1bd0 2024-09-13T19:33:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f280030e640 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6b1bd0 0x56086d6b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f280030e640 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6b1bd0 0x56086d6b4090 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f280030e640 1 -- 172.21.15.144:0/3469807013 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6b1bd0 2024-09-13T19:33:32.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6b0940 con 0x56086d5b5c60 2024-09-13T19:33:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f2800b0f640 1 -- 172.21.15.144:0/3469807013 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27f800a4d0 con 0x56086d5b5c60 2024-09-13T19:33:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6b0d20 con 0x56086d5b5c60 2024-09-13T19:33:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.383+0000 7f2800b0f640 1 -- 172.21.15.144:0/3469807013 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f27f800a4d0 con 0x56086d5b5c60 2024-09-13T19:33:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f28027fe980 1 Processor -- start 2024-09-13T19:33:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f28027fe980 1 -- start start 2024-09-13T19:33:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f28027fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6c2f20 0x56086d6c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f28027fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56086d4b6800 con 0x56086d6c2f20 2024-09-13T19:33:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f2800b0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6c2f20 0x56086d6c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f2800b0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6c2f20 0x56086d6c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57428/0 (socket says 172.21.15.144:57428) 2024-09-13T19:33:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f2800b0f640 1 -- 172.21.15.144:0/2126072298 learned_addr learned my addr 172.21.15.144:0/2126072298 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f2800b0f640 1 -- 172.21.15.144:0/2126072298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086d6c3880 con 0x56086d6c2f20 2024-09-13T19:33:32.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f2800b0f640 1 --2- 172.21.15.144:0/2126072298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6c2f20 0x56086d6c3340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x56086d527a50 tx=0x7f27f8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f26e5ffb640 1 -- 172.21.15.144:0/2126072298 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8014450 con 0x56086d6c2f20 2024-09-13T19:33:32.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f26e5ffb640 1 -- 172.21.15.144:0/2126072298 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f8014610 con 0x56086d6c2f20 2024-09-13T19:33:32.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f26e5ffb640 1 -- 172.21.15.144:0/2126072298 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8014930 con 0x56086d6c2f20 2024-09-13T19:33:32.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f28027fe980 1 -- 172.21.15.144:0/2126072298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56086d6c3b10 con 0x56086d6c2f20 2024-09-13T19:33:32.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f28027fe980 1 -- 172.21.15.144:0/2126072298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086d6c6790 con 0x56086d6c2f20 2024-09-13T19:33:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f26e5ffb640 1 -- 172.21.15.144:0/2126072298 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f27f8011040 con 0x56086d6c2f20 2024-09-13T19:33:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f26e5ffb640 1 --2- 172.21.15.144:0/2126072298 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26d8034650 0x7f26d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f26e5ffb640 1 -- 172.21.15.144:0/2126072298 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f27f801e070 con 0x56086d6c2f20 2024-09-13T19:33:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.387+0000 7f280030e640 1 --2- 172.21.15.144:0/2126072298 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26d8034650 0x7f26d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 Processor -- start 2024-09-13T19:33:32.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- start start 2024-09-13T19:33:32.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f280030e640 1 --2- 172.21.15.144:0/2126072298 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26d8034650 0x7f26d8036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x56086d5275a0 tx=0x7f27f000bf50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56086d69d580 con 0x56086d6cf9f0 2024-09-13T19:33:32.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f2800b0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f2800b0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57444/0 (socket says 172.21.15.144:57444) 2024-09-13T19:33:32.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f2800b0f640 1 -- 172.21.15.144:0/3763451408 learned_addr learned my addr 172.21.15.144:0/3763451408 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f2800b0f640 1 -- 172.21.15.144:0/3763451408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086d6d03c0 con 0x56086d6cf9f0 2024-09-13T19:33:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f2800b0f640 1 --2- 172.21.15.144:0/3763451408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6cfdf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27f800de40 tx=0x7f27f800df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d5274450b77559 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f26d77fe640 1 -- 172.21.15.144:0/3763451408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8043350 con 0x56086d6cf9f0 2024-09-13T19:33:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f26d77fe640 1 -- 172.21.15.144:0/3763451408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f8016440 con 0x56086d6cf9f0 2024-09-13T19:33:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f26d77fe640 1 -- 172.21.15.144:0/3763451408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f802bc50 con 0x56086d6cf9f0 2024-09-13T19:33:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- 172.21.15.144:0/3763451408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 msgr2=0x56086d6cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 --2- 172.21.15.144:0/3763451408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6cfdf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27f800de40 tx=0x7f27f800df30 comp rx=0 tx=0).stop 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- 172.21.15.144:0/3763451408 shutdown_connections 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 --2- 172.21.15.144:0/3763451408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6cfdf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- 172.21.15.144:0/3763451408 >> 172.21.15.144:0/3763451408 conn(0x56086d6cbe20 msgr2=0x56086d6c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- 172.21.15.144:0/3763451408 shutdown_connections 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- 172.21.15.144:0/3763451408 wait complete. 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 Processor -- start 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- start start 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6d6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f28027fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56086d6d0a10 con 0x56086d6cf9f0 2024-09-13T19:33:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f2800b0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6d6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f2800b0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6d6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57454/0 (socket says 172.21.15.144:57454) 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.391+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 learned_addr learned my addr 172.21.15.144:0/3093182806 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086d6d7310 con 0x56086d6cf9f0 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f2800b0f640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6d6dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f27f8048ed0 tx=0x7f27f8049f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f26d5ffb640 1 -- 172.21.15.144:0/3093182806 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8014e20 con 0x56086d6cf9f0 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56086d6d75a0 con 0x56086d6cf9f0 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f26d5ffb640 1 -- 172.21.15.144:0/3093182806 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f804b680 con 0x56086d6cf9f0 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086d6da280 con 0x56086d6cf9f0 2024-09-13T19:33:32.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f26d5ffb640 1 -- 172.21.15.144:0/3093182806 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f804b830 con 0x56086d6cf9f0 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f26d5ffb640 1 -- 172.21.15.144:0/3093182806 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f27f802b350 con 0x56086d6cf9f0 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f26d5ffb640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26c8034650 0x7f26c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f26d5ffb640 1 -- 172.21.15.144:0/3093182806 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f27f8035070 con 0x56086d6cf9f0 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f280030e640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26c8034650 0x7f26c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d6e23c0 0x56086d6e4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6e4fb0 con 0x56086d6e23c0 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f27ffb0d640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d6e23c0 0x56086d6e4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f280030e640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26c8034650 0x7f26c8036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f27f000ffd0 tx=0x7f27f0033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f27ffb0d640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d6e23c0 0x56086d6e4860 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 20 realm 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6e5430 con 0x56086d6e23c0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.395+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6e5cd0 con 0x56086d6e23c0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6e6070 con 0x56086d6e23c0 2024-09-13T19:33:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6e6dd0 0x56086d6e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6e9700 con 0x56086d6e6dd0 2024-09-13T19:33:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f2800b0f640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6e6dd0 0x56086d6e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f2800b0f640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6e6dd0 0x56086d6e91c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 20 searching for the correct realm 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56086d6eb650 0x56086d6edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f280030e640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56086d6eb650 0x56086d6edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f280030e640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56086d6eb650 0x56086d6edb10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f280030e640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f27f0041bd0 0x7f27f000e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x7f27f0041bd0 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f27ffb0d640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f27f0041bd0 0x7f27f000e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f27ffb0d640 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f27f0041bd0 0x7f27f000e7d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.399+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e23c0 2024-09-13T19:33:32.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e23c0 2024-09-13T19:33:32.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x7f27f0041bd0 2024-09-13T19:33:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e23c0 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.403+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e23c0 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x7f27f0041bd0 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e23c0 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e23c0 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.407+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x7f27f0041bd0 2024-09-13T19:33:32.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e23c0 2024-09-13T19:33:32.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x7f27f0041bd0 2024-09-13T19:33:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6eb650 2024-09-13T19:33:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e6dd0 2024-09-13T19:33:32.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.411+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x56086d6e23c0 2024-09-13T19:33:32.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ee1e0 con 0x7f27f0041bd0 2024-09-13T19:33:32.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ea0c0 con 0x56086d6e23c0 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ea510 con 0x56086d6e23c0 2024-09-13T19:33:32.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ea930 con 0x56086d6e23c0 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 zone default found 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 4 Realm: () 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 zonegroup default 2024-09-13T19:33:32.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ea930 con 0x56086d6e6dd0 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f04f0 con 0x56086d6eb650 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f0890 con 0x56086d6eb650 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 started sync module instance, tier type = 2024-09-13T19:33:32.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:32.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.415+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ef930 con 0x7f27f0041bd0 2024-09-13T19:33:32.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.419+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.419+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594195717456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6ef930 con 0x7f27f0041bd0 2024-09-13T19:33:32.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.419+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f1250 con 0x56086d6e23c0 2024-09-13T19:33:32.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.419+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594195717456] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.419+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.419+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594195715472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f1250 con 0x56086d6e23c0 2024-09-13T19:33:32.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.419+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f1b20 con 0x56086d6eb650 2024-09-13T19:33:32.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594195723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f23c0 con 0x56086d6eb650 2024-09-13T19:33:32.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f2d80 con 0x7f27f0041bd0 2024-09-13T19:33:32.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594195715472] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594195721632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f2d80 con 0x7f27f0041bd0 2024-09-13T19:33:32.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f3790 con 0x56086d6e23c0 2024-09-13T19:33:32.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594195723104] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.423+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594195721632] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.427+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.427+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594195728592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f2cf0 con 0x56086d6e23c0 2024-09-13T19:33:32.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.427+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f3c40 con 0x56086d6e6dd0 2024-09-13T19:33:32.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.427+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594195728592] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.427+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.427+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594195731168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f3bb0 con 0x56086d6e6dd0 2024-09-13T19:33:32.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.427+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f4440 con 0x56086d6e6dd0 2024-09-13T19:33:32.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594195733424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f4030 con 0x56086d6e6dd0 2024-09-13T19:33:32.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f53f0 con 0x56086d6e6dd0 2024-09-13T19:33:32.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594195731168] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594195733424] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594195736624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f4ed0 con 0x56086d6e6dd0 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 20 add_watcher() i=0 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 20 add_watcher() i=1 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 20 add_watcher() i=2 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 20 add_watcher() i=3 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 20 add_watcher() i=4 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 20 add_watcher() i=5 2024-09-13T19:33:32.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.431+0000 7f28027fe980 20 add_watcher() i=6 2024-09-13T19:33:32.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594195736624] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 20 add_watcher() i=7 2024-09-13T19:33:32.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:32.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f8420 con 0x56086d6e23c0 2024-09-13T19:33:32.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594195732224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d6f58a0 con 0x56086d6e23c0 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594195732224] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f26b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 5 note: GC not initialized 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f26b57e2640 20 reqs_thread_entry: start 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 20 Filter name: none 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f2626ffd640 20 reqs_thread_entry: start 2024-09-13T19:33:32.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.435+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d71b3c0 con 0x56086d6e23c0 2024-09-13T19:33:32.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:32.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d71bdb0 con 0x56086d6e23c0 2024-09-13T19:33:32.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d71cdc0 con 0x7f27f0041bd0 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d71a670 con 0x7f27f0041bd0 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d71cb40 con 0x56086d6eb650 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:33:32.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 4.2e 4:75513853:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d71c0e0 con 0x56086d6eb650 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 4.2a 4:55887a35:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d7216f0 con 0x56086d6e23c0 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 4.3 4:c2144c8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d723fa0 con 0x56086d6e23c0 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 4.14 4:29ca2d96:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d7269d0 con 0x56086d6eb650 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 4.8 4:113a96eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d723fa0 con 0x56086d6eb650 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 4.9 4:91094f8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d72bcb0 con 0x56086d6e23c0 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 4.1b 4:d823e2ff:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d72e520 con 0x7f27f0041bd0 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:74 4.38 4:1f552a94:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d730ee0 con 0x56086d6e23c0 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:75 4.a 4:53bc6a1b:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d730ee0 con 0x7f27f0041bd0 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:76 4.6 4:622ed0b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d72e520 con 0x56086d6eb650 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:77 4.18 4:18667e6d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56086d738d20 con 0x7f27f0041bd0 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(69 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(70 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(72 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(67 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(74 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(73 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(75 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(76 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.439+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(77 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.443+0000 7f26b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.443+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594195732224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x56086d6e23c0 2024-09-13T19:33:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.443+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94594195732224] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.443+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594195717456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x7f27f0041bd0 2024-09-13T19:33:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.443+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94594195717456] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.443+0000 7f28027fe980 20 remove_watcher() i=0 2024-09-13T19:33:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.443+0000 7f28027fe980 2 removed watcher, disabling cache 2024-09-13T19:33:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.443+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594195715472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x56086d6e23c0 2024-09-13T19:33:32.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.447+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94594195715472] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.447+0000 7f28027fe980 20 remove_watcher() i=1 2024-09-13T19:33:32.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.447+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594195723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x56086d6eb650 2024-09-13T19:33:32.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.447+0000 7f280030e640 1 -- 172.21.15.144:0/3093182806 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94594195723104] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f002e070 con 0x56086d6eb650 2024-09-13T19:33:32.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.447+0000 7f28027fe980 20 remove_watcher() i=2 2024-09-13T19:33:32.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.447+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594195721632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x7f27f0041bd0 2024-09-13T19:33:32.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.451+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94594195721632] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x7f27f0041bd0 2024-09-13T19:33:32.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.451+0000 7f28027fe980 20 remove_watcher() i=3 2024-09-13T19:33:32.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.451+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594195728592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x56086d6e23c0 2024-09-13T19:33:32.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.451+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94594195728592] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f40aaa40 con 0x56086d6e23c0 2024-09-13T19:33:32.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.451+0000 7f28027fe980 20 remove_watcher() i=4 2024-09-13T19:33:32.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.451+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594195731168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x56086d6e6dd0 2024-09-13T19:33:32.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.455+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94594195731168] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.455+0000 7f28027fe980 20 remove_watcher() i=5 2024-09-13T19:33:32.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.455+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594195733424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x56086d6e6dd0 2024-09-13T19:33:32.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.455+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94594195733424] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.455+0000 7f28027fe980 20 remove_watcher() i=6 2024-09-13T19:33:32.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.455+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594195736624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56086d70c0c0 con 0x56086d6e6dd0 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f2800b0f640 1 -- 172.21.15.144:0/3093182806 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94594195736624] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27f802a070 con 0x56086d6e6dd0 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 20 remove_watcher() i=7 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6e6dd0 msgr2=0x56086d6e91c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6e6dd0 0x56086d6e91c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d6e23c0 msgr2=0x56086d6e4860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d6e23c0 0x56086d6e4860 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f27f0041bd0 msgr2=0x7f27f000e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f27f0041bd0 0x7f27f000e7d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56086d6eb650 msgr2=0x56086d6edb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56086d6eb650 0x56086d6edb10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26c8034650 msgr2=0x7f26c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26c8034650 0x7f26c8036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f27f000ffd0 tx=0x7f27f0033000 comp rx=0 tx=0).stop 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 msgr2=0x56086d6d6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6d6dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f27f8048ed0 tx=0x7f27f8049f90 comp rx=0 tx=0).stop 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f27ffb0d640 1 -- 172.21.15.144:0/3093182806 reap_dead start 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 shutdown_connections 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3093182806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6cf9f0 0x56086d6d6dd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 >> 172.21.15.144:0/3093182806 conn(0x56086d6cbe20 msgr2=0x56086d6c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 shutdown_connections 2024-09-13T19:33:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3093182806 wait complete. 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/2126072298 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26d8034650 msgr2=0x7f26d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/2126072298 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26d8034650 0x7f26d8036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x56086d5275a0 tx=0x7f27f000bf50 comp rx=0 tx=0).stop 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/2126072298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6c2f20 msgr2=0x56086d6c3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/2126072298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6c2f20 0x56086d6c3340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x56086d527a50 tx=0x7f27f8018830 comp rx=0 tx=0).stop 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/2126072298 shutdown_connections 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/2126072298 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26d8034650 0x7f26d8036b10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/2126072298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d6c2f20 0x56086d6c3340 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/2126072298 >> 172.21.15.144:0/2126072298 conn(0x56086d6b8070 msgr2=0x56086d6baaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/2126072298 shutdown_connections 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/2126072298 wait complete. 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6b1bd0 msgr2=0x56086d6b4090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6b1bd0 0x56086d6b4090 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d5b5c60 msgr2=0x56086d6af810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d5b5c60 0x56086d6af810 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26e8034650 msgr2=0x7f26e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26e8034650 0x7f26e8036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f27f40ae000 tx=0x7f27f40a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 msgr2=0x56086d529cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d529cb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f27f0001fd0 tx=0x7f27f0000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 shutdown_connections 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56086d5b5c60 0x56086d6af810 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56086d6b1bd0 0x56086d6b4090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f26e8034650 0x7f26e8036b10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 --2- 172.21.15.144:0/3469807013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56086d5b18e0 0x56086d529cb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 >> 172.21.15.144:0/3469807013 conn(0x56086d525230 msgr2=0x56086d6973e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 shutdown_connections 2024-09-13T19:33:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.459+0000 7f28027fe980 1 -- 172.21.15.144:0/3469807013 wait complete. 2024-09-13T19:33:32.473 INFO:teuthology.orchestra.run.smithi144.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b5bcd2ca-839b-4a0e-a5d6-f37391d778b0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","marker":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:33:31.454152Z","creation_time":"2024-09-13T19:33:31.450072Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-13T19:33:32.474 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:33:31.454152Z', 'creation_time': '2024-09-13T19:33:31.450072Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T19:33:32.481 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:33:32.481 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:33:32.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:33:32.482 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:33:32.552 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:32.552 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:32.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe26025f980 1 Processor -- start 2024-09-13T19:33:32.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe26025f980 1 -- start start 2024-09-13T19:33:32.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe26025f980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e768476290 0x55e7685043a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe26025f980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e768389ae0 con 0x55e7685048e0 2024-09-13T19:33:32.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe26025f980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55e7683ade30 con 0x55e768476290 2024-09-13T19:33:32.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe25d56e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55e7685048e0 0x55e768506cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44586/0 (socket says 172.21.15.144:44586) 2024-09-13T19:33:32.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe25dd6f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e768476290 0x55e7685043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe25d56e640 1 -- 172.21.15.144:0/1273052334 learned_addr learned my addr 172.21.15.144:0/1273052334 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:32.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe25dd6f640 1 -- 172.21.15.144:0/1273052334 >> v1:172.21.15.18:6789/0 conn(0x55e7685048e0 legacy=0x55e768506cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.551+0000 7fe25dd6f640 1 -- 172.21.15.144:0/1273052334 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e768476820 con 0x55e768476290 2024-09-13T19:33:32.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/1273052334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685043a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe24800a480 tx=0x7fe24801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768814e1e6093cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe25cd6d640 1 -- 172.21.15.144:0/1273052334 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2480b0070 con 0x55e768476290 2024-09-13T19:33:32.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe25cd6d640 1 -- 172.21.15.144:0/1273052334 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2480ab540 con 0x55e768476290 2024-09-13T19:33:32.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe25cd6d640 1 -- 172.21.15.144:0/1273052334 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2480ab840 con 0x55e768476290 2024-09-13T19:33:32.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe26025f980 1 -- 172.21.15.144:0/1273052334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 msgr2=0x55e7685043a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe26025f980 1 --2- 172.21.15.144:0/1273052334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685043a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe24800a480 tx=0x7fe24801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:32.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe26025f980 1 -- 172.21.15.144:0/1273052334 shutdown_connections 2024-09-13T19:33:32.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe26025f980 1 --2- 172.21.15.144:0/1273052334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685043a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe26025f980 1 -- 172.21.15.144:0/1273052334 >> 172.21.15.144:0/1273052334 conn(0x55e7684fc090 msgr2=0x55e7684fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe26025f980 1 -- 172.21.15.144:0/1273052334 shutdown_connections 2024-09-13T19:33:32.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.555+0000 7fe26025f980 1 -- 172.21.15.144:0/1273052334 wait complete. 2024-09-13T19:33:32.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 Processor -- start 2024-09-13T19:33:32.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 -- start start 2024-09-13T19:33:32.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685eca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e7683af200 con 0x55e768476290 2024-09-13T19:33:32.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe25dd6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe25dd6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685eca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57470/0 (socket says 172.21.15.144:57470) 2024-09-13T19:33:32.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe25dd6f640 1 -- 172.21.15.144:0/3107743486 learned_addr learned my addr 172.21.15.144:0/3107743486 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe25dd6f640 1 -- 172.21.15.144:0/3107743486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7685ed060 con 0x55e768476290 2024-09-13T19:33:32.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/3107743486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685eca90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe2480ae040 tx=0x7fe248003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673820298eb03a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe14be07640 1 -- 172.21.15.144:0/3107743486 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2480b0040 con 0x55e768476290 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe14be07640 1 -- 172.21.15.144:0/3107743486 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2480ab9d0 con 0x55e768476290 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe14be07640 1 -- 172.21.15.144:0/3107743486 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2480abcf0 con 0x55e768476290 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 -- 172.21.15.144:0/3107743486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 msgr2=0x55e7685eca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 --2- 172.21.15.144:0/3107743486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685eca90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe2480ae040 tx=0x7fe248003030 comp rx=0 tx=0).stop 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 -- 172.21.15.144:0/3107743486 shutdown_connections 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 --2- 172.21.15.144:0/3107743486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685eca90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 -- 172.21.15.144:0/3107743486 >> 172.21.15.144:0/3107743486 conn(0x55e7684fc090 msgr2=0x55e7685e86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 -- 172.21.15.144:0/3107743486 shutdown_connections 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 -- 172.21.15.144:0/3107743486 wait complete. 2024-09-13T19:33:32.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 Processor -- start 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.571+0000 7fe26025f980 1 -- start start 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe26025f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe26025f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e768508f00 con 0x55e768476290 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25dd6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25dd6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57476/0 (socket says 172.21.15.144:57476) 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25dd6f640 1 -- 172.21.15.144:0/3201501796 learned_addr learned my addr 172.21.15.144:0/3201501796 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25dd6f640 1 -- 172.21.15.144:0/3201501796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7685f41a0 con 0x55e768476290 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685f3c60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe248019930 tx=0x7fe248018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe14a604640 1 -- 172.21.15.144:0/3201501796 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2480b0070 con 0x55e768476290 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe14a604640 1 -- 172.21.15.144:0/3201501796 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2480b68b0 con 0x55e768476290 2024-09-13T19:33:32.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7685f4430 con 0x55e768476290 2024-09-13T19:33:32.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe14a604640 1 -- 172.21.15.144:0/3201501796 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2480b6b90 con 0x55e768476290 2024-09-13T19:33:32.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7685f7110 con 0x55e768476290 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe14a604640 1 -- 172.21.15.144:0/3201501796 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2480b7420 con 0x55e768476290 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe14a604640 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe144034650 0x7fe144036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe14a604640 1 -- 172.21.15.144:0/3201501796 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe2480bc070 con 0x55e768476290 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25d56e640 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe144034650 0x7fe144036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e7685048e0 0x55e7685fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7685fb230 con 0x55e7685048e0 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25e570640 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e7685048e0 0x55e7685fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25d56e640 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe144034650 0x7fe144036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe250000f70 tx=0x7fe2500012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.575+0000 7fe25e570640 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e7685048e0 0x55e7685fabf0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe25e570640 1 -- 172.21.15.144:0/3201501796 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe25800a4d0 con 0x55e7685048e0 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7685f8330 con 0x55e7685048e0 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe25e570640 1 -- 172.21.15.144:0/3201501796 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe25800a4d0 con 0x55e7685048e0 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e7685fd560 0x55e7685ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768600020 con 0x55e7685fd560 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e7685fd560 0x55e7685ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e7685fd560 0x55e7685ff950 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe25dd6f640 1 -- 172.21.15.144:0/3201501796 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2480b3040 con 0x55e7685fd560 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7685fc400 con 0x55e7685048e0 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe25e570640 1 -- 172.21.15.144:0/3201501796 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe25800a4d0 con 0x55e7685048e0 2024-09-13T19:33:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7685fc8e0 con 0x55e7685048e0 2024-09-13T19:33:32.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe25e570640 1 -- 172.21.15.144:0/3201501796 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe25800a4d0 con 0x55e7685048e0 2024-09-13T19:33:32.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 Processor -- start 2024-09-13T19:33:32.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 -- start start 2024-09-13T19:33:32.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76860e700 0x55e76860eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.579+0000 7fe26025f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e768408800 con 0x55e76860e700 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe25e570640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76860e700 0x55e76860eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe25e570640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76860e700 0x55e76860eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57490/0 (socket says 172.21.15.144:57490) 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe25e570640 1 -- 172.21.15.144:0/68314263 learned_addr learned my addr 172.21.15.144:0/68314263 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe25e570640 1 -- 172.21.15.144:0/68314263 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e76860f060 con 0x55e76860e700 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe25e570640 1 --2- 172.21.15.144:0/68314263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76860e700 0x55e76860eb20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55e7685fb610 tx=0x7fe258018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe1437fe640 1 -- 172.21.15.144:0/68314263 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe258014450 con 0x55e76860e700 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe1437fe640 1 -- 172.21.15.144:0/68314263 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2580145f0 con 0x55e76860e700 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe26025f980 1 -- 172.21.15.144:0/68314263 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e76860f2f0 con 0x55e76860e700 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe1437fe640 1 -- 172.21.15.144:0/68314263 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe258014910 con 0x55e76860e700 2024-09-13T19:33:32.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe26025f980 1 -- 172.21.15.144:0/68314263 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e768611f70 con 0x55e76860e700 2024-09-13T19:33:32.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe1437fe640 1 -- 172.21.15.144:0/68314263 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe258011040 con 0x55e76860e700 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe1437fe640 1 --2- 172.21.15.144:0/68314263 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1380346a0 0x7fe138036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe1437fe640 1 -- 172.21.15.144:0/68314263 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe25801e070 con 0x55e76860e700 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/68314263 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1380346a0 0x7fe138036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe26025f980 1 Processor -- start 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe26025f980 1 -- start start 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/68314263 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1380346a0 0x7fe138036b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55e7685fb6b0 tx=0x7fe2480e2ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe26025f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e76861b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.583+0000 7fe26025f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e7685ed320 con 0x55e76861b170 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e76861b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e76861b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57502/0 (socket says 172.21.15.144:57502) 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 -- 172.21.15.144:0/3965727975 learned_addr learned my addr 172.21.15.144:0/3965727975 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 -- 172.21.15.144:0/3965727975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e76861bb40 con 0x55e76861b170 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 --2- 172.21.15.144:0/3965727975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e76861b570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe25804a130 tx=0x7fe258013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b6f57d108442dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe1417fa640 1 -- 172.21.15.144:0/3965727975 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe258028070 con 0x55e76861b170 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe1417fa640 1 -- 172.21.15.144:0/3965727975 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe258022a80 con 0x55e76861b170 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe1417fa640 1 -- 172.21.15.144:0/3965727975 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe258022d60 con 0x55e76861b170 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 -- 172.21.15.144:0/3965727975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 msgr2=0x55e76861b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 --2- 172.21.15.144:0/3965727975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e76861b570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe25804a130 tx=0x7fe258013dd0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 -- 172.21.15.144:0/3965727975 shutdown_connections 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 --2- 172.21.15.144:0/3965727975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e76861b570 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 -- 172.21.15.144:0/3965727975 >> 172.21.15.144:0/3965727975 conn(0x55e768617550 msgr2=0x55e768615650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 -- 172.21.15.144:0/3965727975 shutdown_connections 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 -- 172.21.15.144:0/3965727975 wait complete. 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 Processor -- start 2024-09-13T19:33:32.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 -- start start 2024-09-13T19:33:32.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e768622530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e76861c0e0 con 0x55e76861b170 2024-09-13T19:33:32.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e768622530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e768622530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57512/0 (socket says 172.21.15.144:57512) 2024-09-13T19:33:32.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 learned_addr learned my addr 172.21.15.144:0/44916152 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e768622a70 con 0x55e76861b170 2024-09-13T19:33:32.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe25e570640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e768622530 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe258011b30 tx=0x7fe25804a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe12f7fe640 1 -- 172.21.15.144:0/44916152 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe25804b770 con 0x55e76861b170 2024-09-13T19:33:32.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.587+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e768622d00 con 0x55e76861b170 2024-09-13T19:33:32.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7686259e0 con 0x55e76861b170 2024-09-13T19:33:32.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe12f7fe640 1 -- 172.21.15.144:0/44916152 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25804b910 con 0x55e76861b170 2024-09-13T19:33:32.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe12f7fe640 1 -- 172.21.15.144:0/44916152 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2580134e0 con 0x55e76861b170 2024-09-13T19:33:32.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe12f7fe640 1 -- 172.21.15.144:0/44916152 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe258043050 con 0x55e76861b170 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe12f7fe640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe128034650 0x7fe128036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe12f7fe640 1 -- 172.21.15.144:0/44916152 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe258034030 con 0x55e76861b170 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe128034650 0x7fe128036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e76862dbe0 0x55e7686300a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686307f0 con 0x55e76862dbe0 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe25d56e640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e76862dbe0 0x55e7686300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe128034650 0x7fe128036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2480b4f90 tx=0x7fe2480d2050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe25d56e640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e76862dbe0 0x55e7686300a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe25000e5a0 con 0x55e76862dbe0 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 realm 2024-09-13T19:33:32.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e76862d070 con 0x55e76862dbe0 2024-09-13T19:33:32.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe25000e5a0 con 0x55e76862dbe0 2024-09-13T19:33:32.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:32.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686312f0 con 0x55e76862dbe0 2024-09-13T19:33:32.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe25000e5a0 con 0x55e76862dbe0 2024-09-13T19:33:32.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768631840 con 0x55e76862dbe0 2024-09-13T19:33:32.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe25000e5a0 con 0x55e76862dbe0 2024-09-13T19:33:32.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:32.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e768632640 0x55e768634a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.591+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768634fb0 con 0x55e768632640 2024-09-13T19:33:32.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25e570640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e768632640 0x55e768634a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25e570640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e768632640 0x55e768634a30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe26025f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:32.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe26025f980 20 searching for the correct realm 2024-09-13T19:33:32.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e768636f90 0x55e768639450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e768636f90 0x55e768639450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e768636f90 0x55e768639450 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25dd6f640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2480f1040 0x7fe2480e4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x7fe2480f1040 2024-09-13T19:33:32.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25d56e640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2480f1040 0x7fe2480e4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25d56e640 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2480f1040 0x7fe2480e4950 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25000e5a0 con 0x7fe2480f1040 2024-09-13T19:33:32.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.595+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e76862dbe0 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe25000e5a0 con 0x55e76862dbe0 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e76862dbe0 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x7fe2480f1040 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e76862dbe0 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e76862dbe0 2024-09-13T19:33:32.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x7fe2480f1040 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.599+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e76862dbe0 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e76862dbe0 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x7fe2480f1040 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e76862dbe0 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.603+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x7fe2480f1040 2024-09-13T19:33:32.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768636f90 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e768632640 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x55e76862dbe0 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e768639b20 con 0x7fe2480f1040 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686359a0 con 0x55e76862dbe0 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.607+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768635dd0 con 0x55e76862dbe0 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768635de0 con 0x55e76862dbe0 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 zone default found 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 4 Realm: () 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:32.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 zonegroup default 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768636280 con 0x55e768632640 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686355b0 con 0x55e768636f90 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e76863bf40 con 0x55e768636f90 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 started sync module instance, tier type = 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863b2c0 con 0x7fe2480f1040 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94452377171936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863b2c0 con 0x7fe2480f1040 2024-09-13T19:33:32.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.611+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863cab0 con 0x55e76862dbe0 2024-09-13T19:33:32.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.615+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94452377171936] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.615+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.615+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94452377175440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863b2c0 con 0x55e76862dbe0 2024-09-13T19:33:32.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.615+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863d4c0 con 0x55e768636f90 2024-09-13T19:33:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.615+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.615+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94452377178128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863dd60 con 0x55e768636f90 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.615+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863e760 con 0x7fe2480f1040 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94452377175440] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94452377169424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863eb50 con 0x7fe2480f1040 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863f510 con 0x55e76862dbe0 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94452377178128] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94452377169424] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94452377182832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863f060 con 0x55e76862dbe0 2024-09-13T19:33:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.619+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863f8b0 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.623+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94452377182832] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.623+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.623+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94452377186400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e76863f480 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.623+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686405b0 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.623+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94452377186400] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.623+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.623+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94452377189456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e768640520 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.623+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e768640f80 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94452377193104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686413e0 con 0x55e768632640 2024-09-13T19:33:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 20 add_watcher() i=0 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 20 add_watcher() i=1 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 20 add_watcher() i=2 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 20 add_watcher() i=3 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 20 add_watcher() i=4 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 20 add_watcher() i=5 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94452377189456] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 20 add_watcher() i=6 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94452377193104] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 20 add_watcher() i=7 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768640070 con 0x55e76862dbe0 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.627+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94452377190512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e768641960 con 0x55e76862dbe0 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94452377190512] v30'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe10f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 5 note: GC not initialized 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe10e7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 Filter name: none 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe07ffff640 20 reqs_thread_entry: start 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768667b20 con 0x7fe2480f1040 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:63 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686683b0 con 0x55e768636f90 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(63 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:33:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686699c0 con 0x7fe2480f1040 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.631+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686699c0 con 0x55e768636f90 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(65 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 4.2e 4:75513853:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e76866b480 con 0x55e768636f90 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 4.2a 4:55887a35:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e76866de70 con 0x55e76862dbe0 2024-09-13T19:33:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 4.3 4:c2144c8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686707d0 con 0x55e76862dbe0 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 4.14 4:29ca2d96:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768673040 con 0x55e768636f90 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 4.8 4:113a96eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686758f0 con 0x55e768636f90 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 4.9 4:91094f8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768678740 con 0x55e76862dbe0 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 4.1b 4:d823e2ff:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e7686758f0 con 0x7fe2480f1040 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 4.38 4:1f552a94:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e76867d790 con 0x55e76862dbe0 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 4.a 4:53bc6a1b:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768680440 con 0x7fe2480f1040 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 4.6 4:622ed0b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768682f20 con 0x55e768636f90 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:76 4.18 4:18667e6d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e768685970 con 0x7fe2480f1040 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(68 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(73 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(66 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(69 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(71 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(70 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(75 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(67 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(76 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe10f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:32.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94452377190512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x55e76862dbe0 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94452377190512] v30'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.635+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94452377171936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x7fe2480f1040 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.639+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94452377171936] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.639+0000 7fe26025f980 20 remove_watcher() i=0 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.639+0000 7fe26025f980 2 removed watcher, disabling cache 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.639+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94452377175440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x55e76862dbe0 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.639+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94452377175440] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.639+0000 7fe26025f980 20 remove_watcher() i=1 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.639+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94452377178128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x55e768636f90 2024-09-13T19:33:32.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.643+0000 7fe25dd6f640 1 -- 172.21.15.144:0/44916152 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94452377178128] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2480da070 con 0x55e768636f90 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.643+0000 7fe26025f980 20 remove_watcher() i=2 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.643+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94452377169424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x7fe2480f1040 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.643+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94452377169424] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x7fe2480f1040 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.643+0000 7fe26025f980 20 remove_watcher() i=3 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.643+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94452377182832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x55e76862dbe0 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.647+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94452377182832] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe250029040 con 0x55e76862dbe0 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.647+0000 7fe26025f980 20 remove_watcher() i=4 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.647+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94452377186400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x55e768632640 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.647+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94452377186400] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.647+0000 7fe26025f980 20 remove_watcher() i=5 2024-09-13T19:33:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.647+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94452377189456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x55e768632640 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94452377189456] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 20 remove_watcher() i=6 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94452377193104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e7686582b0 con 0x55e768632640 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe25e570640 1 -- 172.21.15.144:0/44916152 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94452377193104] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe25802a070 con 0x55e768632640 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 20 remove_watcher() i=7 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e768632640 msgr2=0x55e768634a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e768632640 0x55e768634a30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e76862dbe0 msgr2=0x55e7686300a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e76862dbe0 0x55e7686300a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2480f1040 msgr2=0x7fe2480e4950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2480f1040 0x7fe2480e4950 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e768636f90 msgr2=0x55e768639450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e768636f90 0x55e768639450 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe128034650 msgr2=0x7fe128036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe128034650 0x7fe128036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2480b4f90 tx=0x7fe2480d2050 comp rx=0 tx=0).stop 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 msgr2=0x55e768622530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/44916152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76861b170 0x55e768622530 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe258011b30 tx=0x7fe25804a090 comp rx=0 tx=0).stop 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 reap_dead start 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe25d56e640 1 -- 172.21.15.144:0/44916152 reap_dead start 2024-09-13T19:33:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 shutdown_connections 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 >> 172.21.15.144:0/44916152 conn(0x55e768617550 msgr2=0x55e768615620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 shutdown_connections 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/44916152 wait complete. 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/68314263 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1380346a0 msgr2=0x7fe138036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/68314263 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1380346a0 0x7fe138036b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55e7685fb6b0 tx=0x7fe2480e2ca0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/68314263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76860e700 msgr2=0x55e76860eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/68314263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76860e700 0x55e76860eb20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55e7685fb610 tx=0x7fe258018830 comp rx=0 tx=0).stop 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/68314263 shutdown_connections 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/68314263 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1380346a0 0x7fe138036b60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/68314263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e76860e700 0x55e76860eb20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/68314263 >> 172.21.15.144:0/68314263 conn(0x55e768603850 msgr2=0x55e7686062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/68314263 shutdown_connections 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/68314263 wait complete. 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e7685fd560 msgr2=0x55e7685ff950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e7685fd560 0x55e7685ff950 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e7685048e0 msgr2=0x55e7685fabf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e7685048e0 0x55e7685fabf0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe144034650 msgr2=0x7fe144036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe144034650 0x7fe144036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe250000f70 tx=0x7fe2500012c0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 msgr2=0x55e7685f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685f3c60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe248019930 tx=0x7fe248018020 comp rx=0 tx=0).stop 2024-09-13T19:33:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 shutdown_connections 2024-09-13T19:33:32.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e7685048e0 0x55e7685fabf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e7685fd560 0x55e7685ff950 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe144034650 0x7fe144036b10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 --2- 172.21.15.144:0/3201501796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e768476290 0x55e7685f3c60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 >> 172.21.15.144:0/3201501796 conn(0x55e7684fc090 msgr2=0x55e7685e7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.651+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 shutdown_connections 2024-09-13T19:33:32.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.655+0000 7fe26025f980 1 -- 172.21.15.144:0/3201501796 wait complete. 2024-09-13T19:33:32.683 INFO:teuthology.orchestra.run.smithi144.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b5bcd2ca-839b-4a0e-a5d6-f37391d778b0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","marker":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:33:31.454152Z","creation_time":"2024-09-13T19:33:31.450072Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:33:32.683 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:33:31.454152Z', 'creation_time': '2024-09-13T19:33:31.450072Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:33:32.683 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T19:33:32.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T19:33:32.684 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-13T19:33:32.761 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:32.761 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:32.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbb1340980 1 Processor -- start 2024-09-13T19:33:32.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbb1340980 1 -- start start 2024-09-13T19:33:32.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbb1340980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559e07938b10 0x559e079c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbb1340980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e0784cae0 con 0x559e079c7880 2024-09-13T19:33:32.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbb1340980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x559e07870e30 con 0x559e07938b10 2024-09-13T19:33:32.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbaee50640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559e07938b10 0x559e079c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbae64f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x559e079c7880 0x559e079c9c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44590/0 (socket says 172.21.15.144:44590) 2024-09-13T19:33:32.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbae64f640 1 -- 172.21.15.144:0/2848231019 learned_addr learned my addr 172.21.15.144:0/2848231019 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:32.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbaee50640 1 -- 172.21.15.144:0/2848231019 >> v1:172.21.15.18:6789/0 conn(0x559e079c7880 legacy=0x559e079c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.759+0000 7fdbaee50640 1 -- 172.21.15.144:0/2848231019 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e079cc3a0 con 0x559e07938b10 2024-09-13T19:33:32.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbaee50640 1 --2- 172.21.15.144:0/2848231019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e079c7340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdba000a420 tx=0x7fdba001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd477d44cbec001 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbade4e640 1 -- 172.21.15.144:0/2848231019 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba00af070 con 0x559e07938b10 2024-09-13T19:33:32.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbade4e640 1 -- 172.21.15.144:0/2848231019 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba00aa530 con 0x559e07938b10 2024-09-13T19:33:32.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbade4e640 1 -- 172.21.15.144:0/2848231019 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba00aa850 con 0x559e07938b10 2024-09-13T19:33:32.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbb1340980 1 -- 172.21.15.144:0/2848231019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 msgr2=0x559e079c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbb1340980 1 --2- 172.21.15.144:0/2848231019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e079c7340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdba000a420 tx=0x7fdba001afd0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbb1340980 1 -- 172.21.15.144:0/2848231019 shutdown_connections 2024-09-13T19:33:32.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbb1340980 1 --2- 172.21.15.144:0/2848231019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e079c7340 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbb1340980 1 -- 172.21.15.144:0/2848231019 >> 172.21.15.144:0/2848231019 conn(0x559e079bf070 msgr2=0x559e079c1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbb1340980 1 -- 172.21.15.144:0/2848231019 shutdown_connections 2024-09-13T19:33:32.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.763+0000 7fdbb1340980 1 -- 172.21.15.144:0/2848231019 wait complete. 2024-09-13T19:33:32.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.779+0000 7fdbb1340980 1 Processor -- start 2024-09-13T19:33:32.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.779+0000 7fdbb1340980 1 -- start start 2024-09-13T19:33:32.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.779+0000 7fdbb1340980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07aad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.779+0000 7fdbb1340980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559e07872200 con 0x559e07938b10 2024-09-13T19:33:32.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.779+0000 7fdbaee50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07aad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.779+0000 7fdbaee50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07aad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57520/0 (socket says 172.21.15.144:57520) 2024-09-13T19:33:32.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.779+0000 7fdbaee50640 1 -- 172.21.15.144:0/2617585636 learned_addr learned my addr 172.21.15.144:0/2617585636 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbaee50640 1 -- 172.21.15.144:0/2617585636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e07aade30 con 0x559e07938b10 2024-09-13T19:33:32.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbaee50640 1 --2- 172.21.15.144:0/2617585636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07aad860 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdba00aa500 tx=0x7fdba00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a99bec2dd0f4a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fda9ce09640 1 -- 172.21.15.144:0/2617585636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba00af040 con 0x559e07938b10 2024-09-13T19:33:32.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fda9ce09640 1 -- 172.21.15.144:0/2617585636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba00abb80 con 0x559e07938b10 2024-09-13T19:33:32.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fda9ce09640 1 -- 172.21.15.144:0/2617585636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba00b5470 con 0x559e07938b10 2024-09-13T19:33:32.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 -- 172.21.15.144:0/2617585636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 msgr2=0x559e07aad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 --2- 172.21.15.144:0/2617585636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07aad860 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdba00aa500 tx=0x7fdba00033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 -- 172.21.15.144:0/2617585636 shutdown_connections 2024-09-13T19:33:32.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 --2- 172.21.15.144:0/2617585636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07aad860 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 -- 172.21.15.144:0/2617585636 >> 172.21.15.144:0/2617585636 conn(0x559e079bf070 msgr2=0x559e07aa9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 -- 172.21.15.144:0/2617585636 shutdown_connections 2024-09-13T19:33:32.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 -- 172.21.15.144:0/2617585636 wait complete. 2024-09-13T19:33:32.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 Processor -- start 2024-09-13T19:33:32.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 -- start start 2024-09-13T19:33:32.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07ab4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559e079cbe40 con 0x559e07938b10 2024-09-13T19:33:32.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbaee50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07ab4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbaee50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07ab4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57536/0 (socket says 172.21.15.144:57536) 2024-09-13T19:33:32.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbaee50640 1 -- 172.21.15.144:0/707035448 learned_addr learned my addr 172.21.15.144:0/707035448 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbaee50640 1 -- 172.21.15.144:0/707035448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e07ab4ff0 con 0x559e07938b10 2024-09-13T19:33:32.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbaee50640 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07ab4ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdba00aa500 tx=0x7fdba0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fda9b606640 1 -- 172.21.15.144:0/707035448 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba00b5870 con 0x559e07938b10 2024-09-13T19:33:32.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fda9b606640 1 -- 172.21.15.144:0/707035448 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba00c6070 con 0x559e07938b10 2024-09-13T19:33:32.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fda9b606640 1 -- 172.21.15.144:0/707035448 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba00b5b80 con 0x559e07938b10 2024-09-13T19:33:32.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.783+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e07ab5280 con 0x559e07938b10 2024-09-13T19:33:32.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e07ab7f60 con 0x559e07938b10 2024-09-13T19:33:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fda9b606640 1 -- 172.21.15.144:0/707035448 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdba00c0440 con 0x559e07938b10 2024-09-13T19:33:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fda9b606640 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda94034650 0x7fda94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fda9b606640 1 -- 172.21.15.144:0/707035448 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdba00bb070 con 0x559e07938b10 2024-09-13T19:33:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbae64f640 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda94034650 0x7fda94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e079c7880 0x559e07abba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07abc080 con 0x559e079c7880 2024-09-13T19:33:32.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbaf651640 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e079c7880 0x559e07abba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbae64f640 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda94034650 0x7fda94036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb98001da0 tx=0x7fdb98001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbaf651640 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e079c7880 0x559e07abba40 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbaf651640 1 -- 172.21.15.144:0/707035448 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdba80083f0 con 0x559e079c7880 2024-09-13T19:33:32.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07abc920 con 0x559e079c7880 2024-09-13T19:33:32.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbaf651640 1 -- 172.21.15.144:0/707035448 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdba80083f0 con 0x559e079c7880 2024-09-13T19:33:32.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07abe230 0x559e07ac06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07ac0e60 con 0x559e07abe230 2024-09-13T19:33:32.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.787+0000 7fdbaee50640 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07abe230 0x559e07ac06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaee50640 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07abe230 0x559e07ac06d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaee50640 1 -- 172.21.15.144:0/707035448 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07abe230 2024-09-13T19:33:32.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07abd170 con 0x559e079c7880 2024-09-13T19:33:32.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaf651640 1 -- 172.21.15.144:0/707035448 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdba80083f0 con 0x559e079c7880 2024-09-13T19:33:32.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07abd550 con 0x559e079c7880 2024-09-13T19:33:32.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaf651640 1 -- 172.21.15.144:0/707035448 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdba80083f0 con 0x559e079c7880 2024-09-13T19:33:32.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbb1340980 1 Processor -- start 2024-09-13T19:33:32.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbb1340980 1 -- start start 2024-09-13T19:33:32.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbb1340980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07acf5c0 0x559e07acf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbb1340980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559e078cb800 con 0x559e07acf5c0 2024-09-13T19:33:32.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaf651640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07acf5c0 0x559e07acf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaf651640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07acf5c0 0x559e07acf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57540/0 (socket says 172.21.15.144:57540) 2024-09-13T19:33:32.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaf651640 1 -- 172.21.15.144:0/1263859181 learned_addr learned my addr 172.21.15.144:0/1263859181 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaf651640 1 -- 172.21.15.144:0/1263859181 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e07acff20 con 0x559e07acf5c0 2024-09-13T19:33:32.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbaf651640 1 --2- 172.21.15.144:0/1263859181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07acf5c0 0x559e07acf9e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x559e07ab5ee0 tx=0x7fdba800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fda98e01640 1 -- 172.21.15.144:0/1263859181 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba8007dd0 con 0x559e07acf5c0 2024-09-13T19:33:32.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fda98e01640 1 -- 172.21.15.144:0/1263859181 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba801e020 con 0x559e07acf5c0 2024-09-13T19:33:32.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fdbb1340980 1 -- 172.21.15.144:0/1263859181 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e07ad01b0 con 0x559e07acf5c0 2024-09-13T19:33:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.791+0000 7fda98e01640 1 -- 172.21.15.144:0/1263859181 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba8019590 con 0x559e07acf5c0 2024-09-13T19:33:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbb1340980 1 -- 172.21.15.144:0/1263859181 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e07ad2e30 con 0x559e07acf5c0 2024-09-13T19:33:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fda98e01640 1 -- 172.21.15.144:0/1263859181 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdba8016040 con 0x559e07acf5c0 2024-09-13T19:33:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fda98e01640 1 --2- 172.21.15.144:0/1263859181 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda88034650 0x7fda88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fda98e01640 1 -- 172.21.15.144:0/1263859181 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdba801f030 con 0x559e07acf5c0 2024-09-13T19:33:32.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbaee50640 1 --2- 172.21.15.144:0/1263859181 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda88034650 0x7fda88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbb1340980 1 Processor -- start 2024-09-13T19:33:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbb1340980 1 -- start start 2024-09-13T19:33:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbaee50640 1 --2- 172.21.15.144:0/1263859181 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda88034650 0x7fda88036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x559e07ab92b0 tx=0x7fdba00e3690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbb1340980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07adc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbb1340980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559e07aae0f0 con 0x559e07adc1b0 2024-09-13T19:33:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbaf651640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07adc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbaf651640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07adc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57546/0 (socket says 172.21.15.144:57546) 2024-09-13T19:33:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbaf651640 1 -- 172.21.15.144:0/2389295888 learned_addr learned my addr 172.21.15.144:0/2389295888 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbaf651640 1 -- 172.21.15.144:0/2389295888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e07adcb80 con 0x559e07adc1b0 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fdbaf651640 1 --2- 172.21.15.144:0/2389295888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07adc5b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdba804a300 tx=0x7fdba8017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f5520ae9e7b13c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fda927fc640 1 -- 172.21.15.144:0/2389295888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba8040070 con 0x559e07adc1b0 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fda927fc640 1 -- 172.21.15.144:0/2389295888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba8048070 con 0x559e07adc1b0 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.795+0000 7fda927fc640 1 -- 172.21.15.144:0/2389295888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba801d040 con 0x559e07adc1b0 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- 172.21.15.144:0/2389295888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 msgr2=0x559e07adc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 --2- 172.21.15.144:0/2389295888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07adc5b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdba804a300 tx=0x7fdba8017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- 172.21.15.144:0/2389295888 shutdown_connections 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 --2- 172.21.15.144:0/2389295888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07adc5b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- 172.21.15.144:0/2389295888 >> 172.21.15.144:0/2389295888 conn(0x559e07ad84e0 msgr2=0x559e07ad65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- 172.21.15.144:0/2389295888 shutdown_connections 2024-09-13T19:33:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- 172.21.15.144:0/2389295888 wait complete. 2024-09-13T19:33:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 Processor -- start 2024-09-13T19:33:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- start start 2024-09-13T19:33:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07ae3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559e07add0d0 con 0x559e07adc1b0 2024-09-13T19:33:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbaf651640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07ae3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbaf651640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07ae3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57554/0 (socket says 172.21.15.144:57554) 2024-09-13T19:33:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 learned_addr learned my addr 172.21.15.144:0/606327645 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e07ae3950 con 0x559e07adc1b0 2024-09-13T19:33:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbaf651640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07ae3410 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdba804a300 tx=0x7fdba804a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fda90ff9640 1 -- 172.21.15.144:0/606327645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba801d070 con 0x559e07adc1b0 2024-09-13T19:33:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e07ae3be0 con 0x559e07adc1b0 2024-09-13T19:33:32.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fda90ff9640 1 -- 172.21.15.144:0/606327645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba8022870 con 0x559e07adc1b0 2024-09-13T19:33:32.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fda90ff9640 1 -- 172.21.15.144:0/606327645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba8032040 con 0x559e07adc1b0 2024-09-13T19:33:32.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e07ae68c0 con 0x559e07adc1b0 2024-09-13T19:33:32.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.799+0000 7fda90ff9640 1 -- 172.21.15.144:0/606327645 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdba8019880 con 0x559e07adc1b0 2024-09-13T19:33:32.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fda90ff9640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda78034650 0x7fda78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fda90ff9640 1 -- 172.21.15.144:0/606327645 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdba8038ac0 con 0x559e07adc1b0 2024-09-13T19:33:32.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbaee50640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda78034650 0x7fda78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e07aee8d0 0x559e07af0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07af14b0 con 0x559e07aee8d0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbae64f640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e07aee8d0 0x559e07af0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbaee50640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda78034650 0x7fda78036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdba00e5110 tx=0x7fdba00df000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbae64f640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e07aee8d0 0x559e07af0d60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb9800e640 con 0x559e07aee8d0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 realm 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07aedde0 con 0x559e07aee8d0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb9800e640 con 0x559e07aee8d0 2024-09-13T19:33:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07af1fb0 con 0x559e07aee8d0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb9800e640 con 0x559e07aee8d0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07af24e0 con 0x559e07aee8d0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb9800e640 con 0x559e07aee8d0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07af32e0 0x559e07af56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07af5c50 con 0x559e07af32e0 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbaf651640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07af32e0 0x559e07af56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbaf651640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07af32e0 0x559e07af56d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 20 searching for the correct realm 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559e07af7c10 0x559e07afa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.803+0000 7fdbaee50640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559e07af7c10 0x559e07afa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbaee50640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559e07af7c10 0x559e07afa0d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbaee50640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdba00f6040 0x7fdba00c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x7fdba00f6040 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbae64f640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdba00f6040 0x7fdba00c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbae64f640 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdba00f6040 0x7fdba00c9ab0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9800e640 con 0x7fdba00f6040 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07aee8d0 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb9800e640 con 0x559e07aee8d0 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07aee8d0 2024-09-13T19:33:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.807+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x7fdba00f6040 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07aee8d0 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07aee8d0 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x7fdba00f6040 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.811+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07aee8d0 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07aee8d0 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x7fdba00f6040 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07aee8d0 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.815+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x7fdba00f6040 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af7c10 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07af32e0 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x559e07aee8d0 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e07afa7a0 con 0x7fdba00f6040 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07af6640 con 0x559e07aee8d0 2024-09-13T19:33:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07af6a90 con 0x559e07aee8d0 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07af6aa0 con 0x559e07aee8d0 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 zone default found 2024-09-13T19:33:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 4 Realm: () 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 zonegroup default 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07af6f40 con 0x559e07af32e0 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.819+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07afcab0 con 0x559e07af7c10 2024-09-13T19:33:32.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07afce50 con 0x559e07af7c10 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 20 started sync module instance, tier type = 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afbef0 con 0x7fdba00f6040 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94137222152928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afbef0 con 0x7fdba00f6040 2024-09-13T19:33:32.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afd810 con 0x559e07aee8d0 2024-09-13T19:33:32.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.823+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94137222152928] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.827+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.827+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94137222150992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afd810 con 0x559e07aee8d0 2024-09-13T19:33:32.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.827+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afe0a0 con 0x559e07af7c10 2024-09-13T19:33:32.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.827+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94137222150992] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.827+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.827+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94137222157424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afe490 con 0x559e07af7c10 2024-09-13T19:33:32.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.827+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afee50 con 0x7fdba00f6040 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.831+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.831+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94137222162848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07aff270 con 0x7fdba00f6040 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.831+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07affcc0 con 0x559e07aee8d0 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.831+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94137222157424] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.831+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94137222162848] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.831+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.831+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94137222166448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afedc0 con 0x559e07aee8d0 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.831+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b00560 con 0x559e07af32e0 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.835+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94137222166448] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.835+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.835+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94137222158608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07afedc0 con 0x559e07af32e0 2024-09-13T19:33:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.835+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b00a10 con 0x559e07af32e0 2024-09-13T19:33:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.835+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.835+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94137222169952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b00e30 con 0x559e07af32e0 2024-09-13T19:33:32.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.835+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b01950 con 0x559e07af32e0 2024-09-13T19:33:32.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.835+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94137222158608] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94137222169952] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94137222173728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b009c0 con 0x559e07af32e0 2024-09-13T19:33:32.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 20 add_watcher() i=0 2024-09-13T19:33:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 20 add_watcher() i=1 2024-09-13T19:33:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 20 add_watcher() i=2 2024-09-13T19:33:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 20 add_watcher() i=3 2024-09-13T19:33:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 20 add_watcher() i=4 2024-09-13T19:33:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 20 add_watcher() i=5 2024-09-13T19:33:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 20 add_watcher() i=6 2024-09-13T19:33:32.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94137222173728] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 20 add_watcher() i=7 2024-09-13T19:33:32.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:32.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b04b60 con 0x559e07aee8d0 2024-09-13T19:33:32.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.839+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94137222168672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b01fe0 con 0x559e07aee8d0 2024-09-13T19:33:32.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94137222168672] v30'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fda657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:32.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:32.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:32.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 5 note: GC not initialized 2024-09-13T19:33:32.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fd9dffff640 20 reqs_thread_entry: start 2024-09-13T19:33:32.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:32.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 Filter name: none 2024-09-13T19:33:32.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fd9ddffb640 20 reqs_thread_entry: start 2024-09-13T19:33:32.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b27a70 con 0x559e07aee8d0 2024-09-13T19:33:32.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:32.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b28fc0 con 0x7fdba00f6040 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b28fc0 con 0x559e07af7c10 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 4.2e 4:75513853:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b2a900 con 0x559e07af7c10 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 4.2a 4:55887a35:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b2d5f0 con 0x559e07aee8d0 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 4.3 4:c2144c8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b30340 con 0x559e07aee8d0 2024-09-13T19:33:32.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 4.14 4:29ca2d96:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b32eb0 con 0x559e07af7c10 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 4.8 4:113a96eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35970 con 0x559e07af7c10 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 4.9 4:91094f8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b30340 con 0x559e07aee8d0 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.843+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 4.1b 4:d823e2ff:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35970 con 0x7fdba00f6040 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(66 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(67 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(65 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(70 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(68 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(69 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 4.38 4:1f552a94:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35970 con 0x559e07aee8d0 2024-09-13T19:33:32.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 4.a 4:53bc6a1b:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x7fdba00f6040 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:74 4.6 4:622ed0b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b2cfa0 con 0x559e07af7c10 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:75 4.18 4:18667e6d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x7fdba00f6040 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(71 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(72 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(73 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(75 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(74 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x7fdba00f6040 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.847+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x7fdba00f6040 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fdbb1340980 20 rados->read ofs=0 len=0 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x559e07aee8d0 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fdbb1340980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x7fdba00f6040 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fda657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:32.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.851+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94137222168672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x559e07aee8d0 2024-09-13T19:33:32.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94137222168672] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94137222152928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x7fdba00f6040 2024-09-13T19:33:32.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94137222152928] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbb1340980 20 remove_watcher() i=0 2024-09-13T19:33:32.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbb1340980 2 removed watcher, disabling cache 2024-09-13T19:33:32.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94137222150992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x559e07aee8d0 2024-09-13T19:33:32.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94137222150992] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbb1340980 20 remove_watcher() i=1 2024-09-13T19:33:32.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.855+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94137222157424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x559e07af7c10 2024-09-13T19:33:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.859+0000 7fdbaee50640 1 -- 172.21.15.144:0/606327645 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94137222157424] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba00d2070 con 0x559e07af7c10 2024-09-13T19:33:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.859+0000 7fdbb1340980 20 remove_watcher() i=2 2024-09-13T19:33:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.859+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94137222162848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x7fdba00f6040 2024-09-13T19:33:32.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.859+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94137222162848] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x7fdba00f6040 2024-09-13T19:33:32.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.859+0000 7fdbb1340980 20 remove_watcher() i=3 2024-09-13T19:33:32.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.859+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94137222166448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x559e07aee8d0 2024-09-13T19:33:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.863+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94137222166448] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb98029040 con 0x559e07aee8d0 2024-09-13T19:33:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.863+0000 7fdbb1340980 20 remove_watcher() i=4 2024-09-13T19:33:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.863+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94137222158608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x559e07af32e0 2024-09-13T19:33:32.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.863+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94137222158608] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.863+0000 7fdbb1340980 20 remove_watcher() i=5 2024-09-13T19:33:32.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.863+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94137222169952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x559e07af32e0 2024-09-13T19:33:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94137222169952] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 20 remove_watcher() i=6 2024-09-13T19:33:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94137222173728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e07b35380 con 0x559e07af32e0 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbaf651640 1 -- 172.21.15.144:0/606327645 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94137222173728] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba8035040 con 0x559e07af32e0 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 20 remove_watcher() i=7 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07af32e0 msgr2=0x559e07af56d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07af32e0 0x559e07af56d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e07aee8d0 msgr2=0x559e07af0d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e07aee8d0 0x559e07af0d60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdba00f6040 msgr2=0x7fdba00c9ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdba00f6040 0x7fdba00c9ab0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559e07af7c10 msgr2=0x559e07afa0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559e07af7c10 0x559e07afa0d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda78034650 msgr2=0x7fda78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda78034650 0x7fda78036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdba00e5110 tx=0x7fdba00df000 comp rx=0 tx=0).stop 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 msgr2=0x559e07ae3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbae64f640 1 -- 172.21.15.144:0/606327645 reap_dead start 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07ae3410 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdba804a300 tx=0x7fdba804a290 comp rx=0 tx=0).stop 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 shutdown_connections 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/606327645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07adc1b0 0x559e07ae3410 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 >> 172.21.15.144:0/606327645 conn(0x559e07ad84e0 msgr2=0x559e07add7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 shutdown_connections 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/606327645 wait complete. 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/1263859181 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda88034650 msgr2=0x7fda88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/1263859181 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda88034650 0x7fda88036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x559e07ab92b0 tx=0x7fdba00e3690 comp rx=0 tx=0).stop 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/1263859181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07acf5c0 msgr2=0x559e07acf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 --2- 172.21.15.144:0/1263859181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07acf5c0 0x559e07acf9e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x559e07ab5ee0 tx=0x7fdba800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.867+0000 7fdbb1340980 1 -- 172.21.15.144:0/1263859181 shutdown_connections 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/1263859181 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda88034650 0x7fda88036b10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/1263859181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07acf5c0 0x559e07acf9e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/1263859181 >> 172.21.15.144:0/1263859181 conn(0x559e07ac4710 msgr2=0x559e07ac7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/1263859181 shutdown_connections 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/1263859181 wait complete. 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07abe230 msgr2=0x559e07ac06d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07abe230 0x559e07ac06d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e079c7880 msgr2=0x559e07abba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e079c7880 0x559e07abba40 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda94034650 msgr2=0x7fda94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda94034650 0x7fda94036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb98001da0 tx=0x7fdb98001300 comp rx=0 tx=0).stop 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 msgr2=0x559e07ab4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07ab4ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdba00aa500 tx=0x7fdba0017d70 comp rx=0 tx=0).stop 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 shutdown_connections 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559e079c7880 0x559e07abba40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559e07abe230 0x559e07ac06d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda94034650 0x7fda94036b10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 --2- 172.21.15.144:0/707035448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e07938b10 0x559e07ab4ab0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 >> 172.21.15.144:0/707035448 conn(0x559e079bf070 msgr2=0x559e07aa8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 shutdown_connections 2024-09-13T19:33:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.871+0000 7fdbb1340980 1 -- 172.21.15.144:0/707035448 wait complete. 2024-09-13T19:33:32.883 INFO:teuthology.orchestra.run.smithi144.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-13T19:33:32.853005Z","last_stats_update":"2024-09-13T19:33:32.850855Z"} 2024-09-13T19:33:32.884 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-13T19:33:32.853005Z', 'last_stats_update': '2024-09-13T19:33:32.850855Z'} 2024-09-13T19:33:32.890 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:32.890 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T19:33:32.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T19:33:32.891 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-13T19:33:32.963 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:32.963 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.959+0000 7f84c9a2c980 1 Processor -- start 2024-09-13T19:33:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.959+0000 7f84c9a2c980 1 -- start start 2024-09-13T19:33:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.959+0000 7f84c9a2c980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5632fb01b8f0 0x5632fb01bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.959+0000 7f84c9a2c980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632faea1ae0 con 0x5632fb01c240 2024-09-13T19:33:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.959+0000 7f84c9a2c980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5632faec5e30 con 0x5632fb01b8f0 2024-09-13T19:33:32.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c753c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5632fb01b8f0 0x5632fb01bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c6d3b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5632fb01c240 0x5632fb020c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44596/0 (socket says 172.21.15.144:44596) 2024-09-13T19:33:32.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c6d3b640 1 -- 172.21.15.144:0/2964870586 learned_addr learned my addr 172.21.15.144:0/2964870586 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:32.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c753c640 1 -- 172.21.15.144:0/2964870586 >> v1:172.21.15.18:6789/0 conn(0x5632fb01c240 legacy=0x5632fb020c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c753c640 1 -- 172.21.15.144:0/2964870586 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fb0234c0 con 0x5632fb01b8f0 2024-09-13T19:33:32.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c753c640 1 --2- 172.21.15.144:0/2964870586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb01bcd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f84b800a420 tx=0x7f84b801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dded58ac9b7fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c653a640 1 -- 172.21.15.144:0/2964870586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b80af070 con 0x5632fb01b8f0 2024-09-13T19:33:32.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c653a640 1 -- 172.21.15.144:0/2964870586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b80aa530 con 0x5632fb01b8f0 2024-09-13T19:33:32.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.963+0000 7f84c653a640 1 -- 172.21.15.144:0/2964870586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b80aa850 con 0x5632fb01b8f0 2024-09-13T19:33:32.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.967+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2964870586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 msgr2=0x5632fb01bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.967+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/2964870586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb01bcd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f84b800a420 tx=0x7f84b801afd0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.967+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2964870586 shutdown_connections 2024-09-13T19:33:32.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.967+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/2964870586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb01bcd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.967+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2964870586 >> 172.21.15.144:0/2964870586 conn(0x5632faf8f240 msgr2=0x5632faf8f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.967+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2964870586 shutdown_connections 2024-09-13T19:33:32.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.967+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2964870586 wait complete. 2024-09-13T19:33:32.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.979+0000 7f84c9a2c980 1 Processor -- start 2024-09-13T19:33:32.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.979+0000 7f84c9a2c980 1 -- start start 2024-09-13T19:33:32.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.979+0000 7f84c9a2c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb106be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.979+0000 7f84c9a2c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5632faec7200 con 0x5632fb01b8f0 2024-09-13T19:33:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb106be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb106be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57574/0 (socket says 172.21.15.144:57574) 2024-09-13T19:33:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 -- 172.21.15.144:0/2291423344 learned_addr learned my addr 172.21.15.144:0/2291423344 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 -- 172.21.15.144:0/2291423344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fb1071b0 con 0x5632fb01b8f0 2024-09-13T19:33:32.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 --2- 172.21.15.144:0/2291423344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb106be0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f84b800a420 tx=0x7f84b80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389a6a52e10bf25a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f83b560a640 1 -- 172.21.15.144:0/2291423344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b80af050 con 0x5632fb01b8f0 2024-09-13T19:33:32.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f83b560a640 1 -- 172.21.15.144:0/2291423344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b80b0040 con 0x5632fb01b8f0 2024-09-13T19:33:32.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f83b560a640 1 -- 172.21.15.144:0/2291423344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b80aac60 con 0x5632fb01b8f0 2024-09-13T19:33:32.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2291423344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 msgr2=0x5632fb106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:32.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/2291423344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb106be0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f84b800a420 tx=0x7f84b80033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2291423344 shutdown_connections 2024-09-13T19:33:32.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/2291423344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb106be0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2291423344 >> 172.21.15.144:0/2291423344 conn(0x5632faf8f240 msgr2=0x5632fb102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2291423344 shutdown_connections 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 -- 172.21.15.144:0/2291423344 wait complete. 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 Processor -- start 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 -- start start 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c9a2c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5632fb022f00 con 0x5632fb01b8f0 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57582/0 (socket says 172.21.15.144:57582) 2024-09-13T19:33:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 -- 172.21.15.144:0/3853145353 learned_addr learned my addr 172.21.15.144:0/3853145353 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.983+0000 7f84c753c640 1 -- 172.21.15.144:0/3853145353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fb10e390 con 0x5632fb01b8f0 2024-09-13T19:33:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c753c640 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb10de50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f84b801b870 tx=0x7f84b8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f83b3e07640 1 -- 172.21.15.144:0/3853145353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b80c5020 con 0x5632fb01b8f0 2024-09-13T19:33:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f83b3e07640 1 -- 172.21.15.144:0/3853145353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b80b6cb0 con 0x5632fb01b8f0 2024-09-13T19:33:32.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632fb10e620 con 0x5632fb01b8f0 2024-09-13T19:33:32.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f83b3e07640 1 -- 172.21.15.144:0/3853145353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b80c1480 con 0x5632fb01b8f0 2024-09-13T19:33:32.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632fb111300 con 0x5632fb01b8f0 2024-09-13T19:33:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f83b3e07640 1 -- 172.21.15.144:0/3853145353 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f84b80c8070 con 0x5632fb01b8f0 2024-09-13T19:33:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f83b3e07640 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83ac034650 0x7f83ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f83b3e07640 1 -- 172.21.15.144:0/3853145353 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f84b80bb070 con 0x5632fb01b8f0 2024-09-13T19:33:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c6d3b640 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83ac034650 0x7f83ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb01c240 0x5632fb114f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb115520 con 0x5632fb01c240 2024-09-13T19:33:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c7d3d640 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb01c240 0x5632fb114f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c6d3b640 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83ac034650 0x7f83ac036b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000f70 tx=0x7f84bc0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c7d3d640 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb01c240 0x5632fb114f50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c7d3d640 1 -- 172.21.15.144:0/3853145353 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84c00083f0 con 0x5632fb01c240 2024-09-13T19:33:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb112520 con 0x5632fb01c240 2024-09-13T19:33:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c7d3d640 1 -- 172.21.15.144:0/3853145353 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84c00083f0 con 0x5632fb01c240 2024-09-13T19:33:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb117830 0x5632fb119c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb11a2f0 con 0x5632fb117830 2024-09-13T19:33:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.987+0000 7f84c753c640 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb117830 0x5632fb119c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c753c640 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb117830 0x5632fb119c20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c753c640 1 -- 172.21.15.144:0/3853145353 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb117830 2024-09-13T19:33:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb1166d0 con 0x5632fb01c240 2024-09-13T19:33:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c7d3d640 1 -- 172.21.15.144:0/3853145353 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84c00083f0 con 0x5632fb01c240 2024-09-13T19:33:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb116bb0 con 0x5632fb01c240 2024-09-13T19:33:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c7d3d640 1 -- 172.21.15.144:0/3853145353 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f84c00083f0 con 0x5632fb01c240 2024-09-13T19:33:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c9a2c980 1 Processor -- start 2024-09-13T19:33:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c9a2c980 1 -- start start 2024-09-13T19:33:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c9a2c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb128a30 0x5632fb128e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c9a2c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5632faf20800 con 0x5632fb128a30 2024-09-13T19:33:32.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c7d3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb128a30 0x5632fb128e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:32.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c7d3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb128a30 0x5632fb128e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57596/0 (socket says 172.21.15.144:57596) 2024-09-13T19:33:32.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c7d3d640 1 -- 172.21.15.144:0/3150457016 learned_addr learned my addr 172.21.15.144:0/3150457016 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:32.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.991+0000 7f84c7d3d640 1 -- 172.21.15.144:0/3150457016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fb129390 con 0x5632fb128a30 2024-09-13T19:33:32.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c7d3d640 1 --2- 172.21.15.144:0/3150457016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb128a30 0x5632fb128e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x5632fb10ed50 tx=0x7f84c000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:32.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f83b1602640 1 -- 172.21.15.144:0/3150457016 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c0007dd0 con 0x5632fb128a30 2024-09-13T19:33:32.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3150457016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632fb129620 con 0x5632fb128a30 2024-09-13T19:33:32.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f83b1602640 1 -- 172.21.15.144:0/3150457016 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c001e020 con 0x5632fb128a30 2024-09-13T19:33:32.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f83b1602640 1 -- 172.21.15.144:0/3150457016 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c0019590 con 0x5632fb128a30 2024-09-13T19:33:32.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3150457016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632fb12c2a0 con 0x5632fb128a30 2024-09-13T19:33:32.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f83b1602640 1 -- 172.21.15.144:0/3150457016 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f84c0016040 con 0x5632fb128a30 2024-09-13T19:33:32.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f83b1602640 1 --2- 172.21.15.144:0/3150457016 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83a0034650 0x7f83a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f83b1602640 1 -- 172.21.15.144:0/3150457016 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f84c001f030 con 0x5632fb128a30 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c753c640 1 --2- 172.21.15.144:0/3150457016 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83a0034650 0x7f83a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c9a2c980 1 Processor -- start 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c9a2c980 1 -- start start 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c753c640 1 --2- 172.21.15.144:0/3150457016 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83a0034650 0x7f83a0036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5632fb115980 tx=0x7f84b80b53b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c9a2c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb135970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c9a2c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5632fb107470 con 0x5632fb135570 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c7d3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb135970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c7d3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb135970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57604/0 (socket says 172.21.15.144:57604) 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c7d3d640 1 -- 172.21.15.144:0/172292037 learned_addr learned my addr 172.21.15.144:0/172292037 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c7d3d640 1 -- 172.21.15.144:0/172292037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fb135f40 con 0x5632fb135570 2024-09-13T19:33:33.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.995+0000 7f84c7d3d640 1 --2- 172.21.15.144:0/172292037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb135970 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f84c004a300 tx=0x7f84c0017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e4cde577825502 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f83aaffd640 1 -- 172.21.15.144:0/172292037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c0040070 con 0x5632fb135570 2024-09-13T19:33:33.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f83aaffd640 1 -- 172.21.15.144:0/172292037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c0048070 con 0x5632fb135570 2024-09-13T19:33:33.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f83aaffd640 1 -- 172.21.15.144:0/172292037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c001d040 con 0x5632fb135570 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- 172.21.15.144:0/172292037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 msgr2=0x5632fb135970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/172292037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb135970 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f84c004a300 tx=0x7f84c0017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- 172.21.15.144:0/172292037 shutdown_connections 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/172292037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb135970 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- 172.21.15.144:0/172292037 >> 172.21.15.144:0/172292037 conn(0x5632fb131950 msgr2=0x5632fb12fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- 172.21.15.144:0/172292037 shutdown_connections 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- 172.21.15.144:0/172292037 wait complete. 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 Processor -- start 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- start start 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb13c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5632fb136540 con 0x5632fb135570 2024-09-13T19:33:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c7d3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb13c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c7d3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb13c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57608/0 (socket says 172.21.15.144:57608) 2024-09-13T19:33:33.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 learned_addr learned my addr 172.21.15.144:0/1278593844 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632fb13ce10 con 0x5632fb135570 2024-09-13T19:33:33.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c7d3d640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb13c8d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f84c004a300 tx=0x7f84c004a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f83a97fa640 1 -- 172.21.15.144:0/1278593844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c001d070 con 0x5632fb135570 2024-09-13T19:33:33.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632fb13d0a0 con 0x5632fb135570 2024-09-13T19:33:33.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f83a97fa640 1 -- 172.21.15.144:0/1278593844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c00227f0 con 0x5632fb135570 2024-09-13T19:33:33.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f83a97fa640 1 -- 172.21.15.144:0/1278593844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84c0032040 con 0x5632fb135570 2024-09-13T19:33:33.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:32.999+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632fb13fd80 con 0x5632fb135570 2024-09-13T19:33:33.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f83a97fa640 1 -- 172.21.15.144:0/1278593844 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f84c0019860 con 0x5632fb135570 2024-09-13T19:33:33.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f83a97fa640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8390034600 0x7f8390036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f83a97fa640 1 -- 172.21.15.144:0/1278593844 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f84c0038ac0 con 0x5632fb135570 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c753c640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8390034600 0x7f8390036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb147dc0 0x5632fb14a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb14a9d0 con 0x5632fb147dc0 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c6d3b640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb147dc0 0x5632fb14a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c753c640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8390034600 0x7f8390036ac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84b80b8010 tx=0x7f84b80d5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c6d3b640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb147dc0 0x5632fb14a280 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84bc00e5a0 con 0x5632fb147dc0 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 realm 2024-09-13T19:33:33.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb147250 con 0x5632fb147dc0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84bc00e5a0 con 0x5632fb147dc0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb14b4d0 con 0x5632fb147dc0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84bc00e5a0 con 0x5632fb147dc0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb14bda0 con 0x5632fb147dc0 2024-09-13T19:33:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84bc00e5a0 con 0x5632fb147dc0 2024-09-13T19:33:33.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb14c7c0 0x5632fb14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb14f2a0 con 0x5632fb14c7c0 2024-09-13T19:33:33.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c7d3d640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb14c7c0 0x5632fb14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.003+0000 7f84c7d3d640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb14c7c0 0x5632fb14ebb0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c9a2c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c9a2c980 20 searching for the correct realm 2024-09-13T19:33:33.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5632fb1511f0 0x5632fb153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c753c640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5632fb1511f0 0x5632fb153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c753c640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5632fb1511f0 0x5632fb153620 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c753c640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f84b80f1040 0x7f84b80c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x7f84b80f1040 2024-09-13T19:33:33.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c6d3b640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f84b80f1040 0x7f84b80c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c6d3b640 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f84b80f1040 0x7f84b80c8970 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc00e5a0 con 0x7f84b80f1040 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb147dc0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f84bc00e5a0 con 0x5632fb147dc0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb147dc0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.007+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x7f84b80f1040 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb147dc0 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb147dc0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x7f84b80f1040 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.011+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb147dc0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb147dc0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x7f84b80f1040 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb147dc0 2024-09-13T19:33:33.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.015+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x7f84b80f1040 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb1511f0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb14c7c0 2024-09-13T19:33:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x5632fb147dc0 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632fb153ca0 con 0x7f84b80f1040 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb14fc60 con 0x5632fb147dc0 2024-09-13T19:33:33.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb150500 con 0x5632fb147dc0 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.019+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb14f8a0 con 0x5632fb147dc0 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 zone default found 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 4 Realm: () 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:33.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 zonegroup default 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb154120 con 0x5632fb14c7c0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb150140 con 0x5632fb1511f0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb156450 con 0x5632fb1511f0 2024-09-13T19:33:33.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 started sync module instance, tier type = 2024-09-13T19:33:33.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:33.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb1557e0 con 0x7f84b80f1040 2024-09-13T19:33:33.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94776960834784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb1557e0 con 0x7f84b80f1040 2024-09-13T19:33:33.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.023+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb156f50 con 0x5632fb147dc0 2024-09-13T19:33:33.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.027+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94776960834784] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.027+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.027+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94776960838176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb1557e0 con 0x5632fb147dc0 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.027+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb157960 con 0x5632fb1511f0 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.027+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94776960838176] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.027+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.027+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94776960832304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb155750 con 0x5632fb1511f0 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.027+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb1586a0 con 0x7f84b80f1040 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.031+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.031+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94776960844208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb158f40 con 0x7f84b80f1040 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.031+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb159940 con 0x5632fb147dc0 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.031+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94776960832304] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.031+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94776960844208] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.031+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.031+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94776960843008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb158a10 con 0x5632fb147dc0 2024-09-13T19:33:33.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.031+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb15a1e0 con 0x5632fb14c7c0 2024-09-13T19:33:33.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.035+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94776960843008] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.035+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.035+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94776960848976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb158a10 con 0x5632fb14c7c0 2024-09-13T19:33:33.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.035+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb15a690 con 0x5632fb14c7c0 2024-09-13T19:33:33.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.035+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94776960848976] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.035+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.035+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94776960851248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb15a600 con 0x5632fb14c7c0 2024-09-13T19:33:33.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.035+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb15b020 con 0x5632fb14c7c0 2024-09-13T19:33:33.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94776960851248] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94776960854800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb15a600 con 0x5632fb14c7c0 2024-09-13T19:33:33.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 20 add_watcher() i=0 2024-09-13T19:33:33.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 20 add_watcher() i=1 2024-09-13T19:33:33.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 20 add_watcher() i=2 2024-09-13T19:33:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 20 add_watcher() i=3 2024-09-13T19:33:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 20 add_watcher() i=4 2024-09-13T19:33:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 20 add_watcher() i=5 2024-09-13T19:33:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 20 add_watcher() i=6 2024-09-13T19:33:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94776960854800] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 20 add_watcher() i=7 2024-09-13T19:33:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.039+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb15e470 con 0x5632fb147dc0 2024-09-13T19:33:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94776960852768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb15b990 con 0x5632fb147dc0 2024-09-13T19:33:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94776960852768] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f837dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 5 note: GC not initialized 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f837cfe1640 20 reqs_thread_entry: start 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 Filter name: none 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f82f67fc640 20 reqs_thread_entry: start 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb181b00 con 0x5632fb147dc0 2024-09-13T19:33:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f84bc029040 con 0x5632fb147dc0 2024-09-13T19:33:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb183be0 con 0x7f84b80f1040 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb1853c0 con 0x5632fb1511f0 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:33.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:33.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:33.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:33.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:33:33.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.043+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb186b70 con 0x7f84b80f1040 2024-09-13T19:33:33.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c9a2c980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T19:33:33.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c9a2c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb1866c0 con 0x7f84b80f1040 2024-09-13T19:33:33.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c9a2c980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:33.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c9a2c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T19:33:33.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c9a2c980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:33.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c9a2c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:33.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.047+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb18cb80 con 0x7f84b80f1040 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f84bc029040 con 0x7f84b80f1040 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c9a2c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c9a2c980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c9a2c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94776961042064 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632fb189ff0 con 0x5632fb14c7c0 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== watch-notify(notify (1) cookie 94776960851248 notify 128849018881 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5632fb13d0a0 con 0x5632fb14c7c0 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f83aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94776960851248 notifier 4475 bl.length()=338 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f83aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:33:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f83aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:33.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(68 notify.6 [notify cookie 94776961042064 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f83aaffd640 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f838c003eb0 con 0x5632fb14c7c0 2024-09-13T19:33:33.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== watch-notify(notify_complete (2) cookie 94776961042064 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632fb13ce10 con 0x5632fb14c7c0 2024-09-13T19:33:33.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f837dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.051+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94776960852768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb17f930 con 0x5632fb147dc0 2024-09-13T19:33:33.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.055+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94776960852768] v30'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84bc046040 con 0x5632fb147dc0 2024-09-13T19:33:33.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.055+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94776960834784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb17f930 con 0x7f84b80f1040 2024-09-13T19:33:33.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.055+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94776960834784] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc046040 con 0x7f84b80f1040 2024-09-13T19:33:33.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.055+0000 7f84c9a2c980 20 remove_watcher() i=0 2024-09-13T19:33:33.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.055+0000 7f84c9a2c980 2 removed watcher, disabling cache 2024-09-13T19:33:33.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.055+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94776960838176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb17f930 con 0x5632fb147dc0 2024-09-13T19:33:33.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94776960838176] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc046040 con 0x5632fb147dc0 2024-09-13T19:33:33.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c9a2c980 20 remove_watcher() i=1 2024-09-13T19:33:33.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94776960832304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb156a20 con 0x5632fb1511f0 2024-09-13T19:33:33.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c753c640 1 -- 172.21.15.144:0/1278593844 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94776960832304] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84b80c7030 con 0x5632fb1511f0 2024-09-13T19:33:33.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c9a2c980 20 remove_watcher() i=2 2024-09-13T19:33:33.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94776960844208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb17f930 con 0x7f84b80f1040 2024-09-13T19:33:33.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94776960844208] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc046040 con 0x7f84b80f1040 2024-09-13T19:33:33.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c9a2c980 20 remove_watcher() i=3 2024-09-13T19:33:33.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.059+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94776960843008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb155330 con 0x5632fb147dc0 2024-09-13T19:33:33.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.063+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94776960843008] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84bc046040 con 0x5632fb147dc0 2024-09-13T19:33:33.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.063+0000 7f84c9a2c980 20 remove_watcher() i=4 2024-09-13T19:33:33.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.063+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94776960848976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb156a20 con 0x5632fb14c7c0 2024-09-13T19:33:33.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.063+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94776960848976] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.063+0000 7f84c9a2c980 20 remove_watcher() i=5 2024-09-13T19:33:33.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.063+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94776960851248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb17f930 con 0x5632fb14c7c0 2024-09-13T19:33:33.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.067+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94776960851248] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.067+0000 7f84c9a2c980 20 remove_watcher() i=6 2024-09-13T19:33:33.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.067+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94776960854800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632fb155330 con 0x5632fb14c7c0 2024-09-13T19:33:33.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.067+0000 7f84c7d3d640 1 -- 172.21.15.144:0/1278593844 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94776960854800] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84c0035040 con 0x5632fb14c7c0 2024-09-13T19:33:33.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.067+0000 7f84c9a2c980 20 remove_watcher() i=7 2024-09-13T19:33:33.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb14c7c0 msgr2=0x5632fb14ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb14c7c0 0x5632fb14ebb0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb147dc0 msgr2=0x5632fb14a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb147dc0 0x5632fb14a280 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f84b80f1040 msgr2=0x7f84b80c8970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f84b80f1040 0x7f84b80c8970 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5632fb1511f0 msgr2=0x5632fb153620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5632fb1511f0 0x5632fb153620 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8390034600 msgr2=0x7f8390036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8390034600 0x7f8390036ac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84b80b8010 tx=0x7f84b80d5000 comp rx=0 tx=0).stop 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c6d3b640 1 -- 172.21.15.144:0/1278593844 reap_dead start 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 msgr2=0x5632fb13c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb13c8d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f84c004a300 tx=0x7f84c004a290 comp rx=0 tx=0).stop 2024-09-13T19:33:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 shutdown_connections 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/1278593844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb135570 0x5632fb13c8d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 >> 172.21.15.144:0/1278593844 conn(0x5632fb131950 msgr2=0x5632fb12fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 shutdown_connections 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/1278593844 wait complete. 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3150457016 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83a0034650 msgr2=0x7f83a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3150457016 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83a0034650 0x7f83a0036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5632fb115980 tx=0x7f84b80b53b0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3150457016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb128a30 msgr2=0x5632fb128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3150457016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb128a30 0x5632fb128e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x5632fb10ed50 tx=0x7f84c000af40 comp rx=0 tx=0).stop 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3150457016 shutdown_connections 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3150457016 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83a0034650 0x7f83a0036b10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3150457016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb128a30 0x5632fb128e50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3150457016 >> 172.21.15.144:0/3150457016 conn(0x5632fb11db80 msgr2=0x5632fb120600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3150457016 shutdown_connections 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3150457016 wait complete. 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb117830 msgr2=0x5632fb119c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb117830 0x5632fb119c20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb01c240 msgr2=0x5632fb114f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb01c240 0x5632fb114f50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83ac034650 msgr2=0x7f83ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83ac034650 0x7f83ac036b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000f70 tx=0x7f84bc0012c0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 msgr2=0x5632fb10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb10de50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f84b801b870 tx=0x7f84b8019810 comp rx=0 tx=0).stop 2024-09-13T19:33:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 shutdown_connections 2024-09-13T19:33:33.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5632fb01c240 0x5632fb114f50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5632fb117830 0x5632fb119c20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f83ac034650 0x7f83ac036b10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 --2- 172.21.15.144:0/3853145353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632fb01b8f0 0x5632fb10de50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 >> 172.21.15.144:0/3853145353 conn(0x5632faf8f240 msgr2=0x5632fb101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 shutdown_connections 2024-09-13T19:33:33.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.071+0000 7f84c9a2c980 1 -- 172.21.15.144:0/3853145353 wait complete. 2024-09-13T19:33:33.084 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:33:33.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:33:33.085 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T19:33:33.172 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:33.172 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:33.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f960c157980 1 Processor -- start 2024-09-13T19:33:33.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f960c157980 1 -- start start 2024-09-13T19:33:33.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f960c157980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55ce26c3f6d0 0x55ce26c3fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f960c157980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce26ac7ae0 con 0x55ce26c40020 2024-09-13T19:33:33.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f960c157980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55ce26aebe30 con 0x55ce26c3f6d0 2024-09-13T19:33:33.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f9609c67640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55ce26c3f6d0 0x55ce26c3fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f9609c67640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55ce26c3f6d0 0x55ce26c3fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57618/0 (socket says 172.21.15.144:57618) 2024-09-13T19:33:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f9609c67640 1 -- 172.21.15.144:0/1943174624 learned_addr learned my addr 172.21.15.144:0/1943174624 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f9609466640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55ce26c40020 0x55ce26c44a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44604/0 (socket says 172.21.15.144:44604) 2024-09-13T19:33:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f9609c67640 1 -- 172.21.15.144:0/1943174624 >> v1:172.21.15.18:6789/0 conn(0x55ce26c40020 legacy=0x55ce26c44a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.171+0000 7f9609c67640 1 -- 172.21.15.144:0/1943174624 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce26c472a0 con 0x55ce26c3f6d0 2024-09-13T19:33:33.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f9609c67640 1 --2- 172.21.15.144:0/1943174624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26c3fab0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f960400a4e0 tx=0x7f960401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f3a9812630156f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f9608c65640 1 -- 172.21.15.144:0/1943174624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96040aa540 con 0x55ce26c3f6d0 2024-09-13T19:33:33.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f9608c65640 1 -- 172.21.15.144:0/1943174624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96040aa6e0 con 0x55ce26c3f6d0 2024-09-13T19:33:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f9608c65640 1 -- 172.21.15.144:0/1943174624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96040aaa40 con 0x55ce26c3f6d0 2024-09-13T19:33:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f960c157980 1 -- 172.21.15.144:0/1943174624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 msgr2=0x55ce26c3fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f960c157980 1 --2- 172.21.15.144:0/1943174624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26c3fab0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f960400a4e0 tx=0x7f960401b090 comp rx=0 tx=0).stop 2024-09-13T19:33:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f960c157980 1 -- 172.21.15.144:0/1943174624 shutdown_connections 2024-09-13T19:33:33.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f960c157980 1 --2- 172.21.15.144:0/1943174624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26c3fab0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f960c157980 1 -- 172.21.15.144:0/1943174624 >> 172.21.15.144:0/1943174624 conn(0x55ce26c3b1f0 msgr2=0x55ce26c3d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f960c157980 1 -- 172.21.15.144:0/1943174624 shutdown_connections 2024-09-13T19:33:33.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.175+0000 7f960c157980 1 -- 172.21.15.144:0/1943174624 wait complete. 2024-09-13T19:33:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 Processor -- start 2024-09-13T19:33:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 -- start start 2024-09-13T19:33:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26bb63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ce26aed200 con 0x55ce26c3f6d0 2024-09-13T19:33:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f9609c67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26bb63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f9609c67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26bb63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57622/0 (socket says 172.21.15.144:57622) 2024-09-13T19:33:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f9609c67640 1 -- 172.21.15.144:0/2872306413 learned_addr learned my addr 172.21.15.144:0/2872306413 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f9609c67640 1 -- 172.21.15.144:0/2872306413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce26bb6980 con 0x55ce26c3f6d0 2024-09-13T19:33:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f9609c67640 1 --2- 172.21.15.144:0/2872306413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26bb63b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9604017ca0 tx=0x7f96040033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0660976b45a287a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f94f7e07640 1 -- 172.21.15.144:0/2872306413 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96040b9030 con 0x55ce26c3f6d0 2024-09-13T19:33:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f94f7e07640 1 -- 172.21.15.144:0/2872306413 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96040aaac0 con 0x55ce26c3f6d0 2024-09-13T19:33:33.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f94f7e07640 1 -- 172.21.15.144:0/2872306413 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96040aada0 con 0x55ce26c3f6d0 2024-09-13T19:33:33.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 -- 172.21.15.144:0/2872306413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 msgr2=0x55ce26bb63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 --2- 172.21.15.144:0/2872306413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26bb63b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9604017ca0 tx=0x7f96040033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 -- 172.21.15.144:0/2872306413 shutdown_connections 2024-09-13T19:33:33.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 --2- 172.21.15.144:0/2872306413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26bb63b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 -- 172.21.15.144:0/2872306413 >> 172.21.15.144:0/2872306413 conn(0x55ce26c3b1f0 msgr2=0x55ce26d26700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 -- 172.21.15.144:0/2872306413 shutdown_connections 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.191+0000 7f960c157980 1 -- 172.21.15.144:0/2872306413 wait complete. 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960c157980 1 Processor -- start 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960c157980 1 -- start start 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960c157980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26d33ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960c157980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ce26c46ce0 con 0x55ce26c3f6d0 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f9609c67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26d33ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f9609c67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26d33ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57638/0 (socket says 172.21.15.144:57638) 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f9609c67640 1 -- 172.21.15.144:0/1266441335 learned_addr learned my addr 172.21.15.144:0/1266441335 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f9609c67640 1 -- 172.21.15.144:0/1266441335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce26d34420 con 0x55ce26c3f6d0 2024-09-13T19:33:33.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f9609c67640 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26d33ee0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9604005cc0 tx=0x7f9604017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f94f6604640 1 -- 172.21.15.144:0/1266441335 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96040b9030 con 0x55ce26c3f6d0 2024-09-13T19:33:33.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce26d346b0 con 0x55ce26c3f6d0 2024-09-13T19:33:33.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f94f6604640 1 -- 172.21.15.144:0/1266441335 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96040c3070 con 0x55ce26c3f6d0 2024-09-13T19:33:33.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f94f6604640 1 -- 172.21.15.144:0/1266441335 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96040bf750 con 0x55ce26c3f6d0 2024-09-13T19:33:33.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce26d37390 con 0x55ce26c3f6d0 2024-09-13T19:33:33.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f94f6604640 1 -- 172.21.15.144:0/1266441335 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f96040c5030 con 0x55ce26c3f6d0 2024-09-13T19:33:33.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f94f6604640 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94f0034650 0x7f94f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f94f6604640 1 -- 172.21.15.144:0/1266441335 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f96040ba070 con 0x55ce26c3f6d0 2024-09-13T19:33:33.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f9609466640 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94f0034650 0x7f94f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26c40020 0x55ce26d3ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d3b4e0 con 0x55ce26c40020 2024-09-13T19:33:33.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f960a468640 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26c40020 0x55ce26d3ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.195+0000 7f9609466640 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94f0034650 0x7f94f0036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95f4001e50 tx=0x7f95f40013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960a468640 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26c40020 0x55ce26d3ae70 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960a468640 1 -- 172.21.15.144:0/1266441335 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95fc0083f0 con 0x55ce26c40020 2024-09-13T19:33:33.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d38590 con 0x55ce26c40020 2024-09-13T19:33:33.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960a468640 1 -- 172.21.15.144:0/1266441335 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95fc0083f0 con 0x55ce26c40020 2024-09-13T19:33:33.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d3d860 0x55ce26d3fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d40320 con 0x55ce26d3d860 2024-09-13T19:33:33.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f9609c67640 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d3d860 0x55ce26d3fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f9609c67640 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d3d860 0x55ce26d3fc50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f9609c67640 1 -- 172.21.15.144:0/1266441335 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d3d860 2024-09-13T19:33:33.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d3c700 con 0x55ce26c40020 2024-09-13T19:33:33.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960a468640 1 -- 172.21.15.144:0/1266441335 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95fc0083f0 con 0x55ce26c40020 2024-09-13T19:33:33.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d3cbe0 con 0x55ce26c40020 2024-09-13T19:33:33.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960a468640 1 -- 172.21.15.144:0/1266441335 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f95fc0083f0 con 0x55ce26c40020 2024-09-13T19:33:33.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 Processor -- start 2024-09-13T19:33:33.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 -- start start 2024-09-13T19:33:33.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d4ea60 0x55ce26d4ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.199+0000 7f960c157980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ce26b46800 con 0x55ce26d4ea60 2024-09-13T19:33:33.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960a468640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d4ea60 0x55ce26d4ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960a468640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d4ea60 0x55ce26d4ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57640/0 (socket says 172.21.15.144:57640) 2024-09-13T19:33:33.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960a468640 1 -- 172.21.15.144:0/3140850250 learned_addr learned my addr 172.21.15.144:0/3140850250 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960a468640 1 -- 172.21.15.144:0/3140850250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce26d4f3c0 con 0x55ce26d4ea60 2024-09-13T19:33:33.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960a468640 1 --2- 172.21.15.144:0/3140850250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d4ea60 0x55ce26d4ee80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55ce26d34de0 tx=0x7f95fc00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f94ef7fe640 1 -- 172.21.15.144:0/3140850250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95fc007d70 con 0x55ce26d4ea60 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f94ef7fe640 1 -- 172.21.15.144:0/3140850250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc01e020 con 0x55ce26d4ea60 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960c157980 1 -- 172.21.15.144:0/3140850250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce26d4f650 con 0x55ce26d4ea60 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f94ef7fe640 1 -- 172.21.15.144:0/3140850250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95fc019590 con 0x55ce26d4ea60 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960c157980 1 -- 172.21.15.144:0/3140850250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce26d522d0 con 0x55ce26d4ea60 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f94ef7fe640 1 -- 172.21.15.144:0/3140850250 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f95fc016040 con 0x55ce26d4ea60 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f94ef7fe640 1 --2- 172.21.15.144:0/3140850250 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94e4034650 0x7f94e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f94ef7fe640 1 -- 172.21.15.144:0/3140850250 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f95fc01f030 con 0x55ce26d4ea60 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f9609c67640 1 --2- 172.21.15.144:0/3140850250 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94e4034650 0x7f94e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960c157980 1 Processor -- start 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960c157980 1 -- start start 2024-09-13T19:33:33.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f9609c67640 1 --2- 172.21.15.144:0/3140850250 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94e4034650 0x7f94e4036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55ce26d3b9d0 tx=0x7f96040a3bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960c157980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d5b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960c157980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ce26bb4ae0 con 0x55ce26d5b5f0 2024-09-13T19:33:33.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960a468640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d5b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960a468640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d5b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57656/0 (socket says 172.21.15.144:57656) 2024-09-13T19:33:33.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.203+0000 7f960a468640 1 -- 172.21.15.144:0/3878231170 learned_addr learned my addr 172.21.15.144:0/3878231170 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960a468640 1 -- 172.21.15.144:0/3878231170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce26d5bfc0 con 0x55ce26d5b5f0 2024-09-13T19:33:33.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960a468640 1 --2- 172.21.15.144:0/3878231170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d5b9f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f95fc04a2a0 tx=0x7f95fc023610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c1cff85972feb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f94ed7fa640 1 -- 172.21.15.144:0/3878231170 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95fc01d030 con 0x55ce26d5b5f0 2024-09-13T19:33:33.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f94ed7fa640 1 -- 172.21.15.144:0/3878231170 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc043380 con 0x55ce26d5b5f0 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f94ed7fa640 1 -- 172.21.15.144:0/3878231170 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95fc043660 con 0x55ce26d5b5f0 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 -- 172.21.15.144:0/3878231170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 msgr2=0x55ce26d5b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 --2- 172.21.15.144:0/3878231170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d5b9f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f95fc04a2a0 tx=0x7f95fc023610 comp rx=0 tx=0).stop 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 -- 172.21.15.144:0/3878231170 shutdown_connections 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 --2- 172.21.15.144:0/3878231170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d5b9f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 -- 172.21.15.144:0/3878231170 >> 172.21.15.144:0/3878231170 conn(0x55ce26d57970 msgr2=0x55ce26d55a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 -- 172.21.15.144:0/3878231170 shutdown_connections 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 -- 172.21.15.144:0/3878231170 wait complete. 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 Processor -- start 2024-09-13T19:33:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 -- start start 2024-09-13T19:33:33.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d62920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960c157980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ce26d5c500 con 0x55ce26d5b5f0 2024-09-13T19:33:33.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960a468640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d62920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960a468640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d62920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57662/0 (socket says 172.21.15.144:57662) 2024-09-13T19:33:33.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 learned_addr learned my addr 172.21.15.144:0/2629651515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce26d62e60 con 0x55ce26d5b5f0 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.207+0000 7f960a468640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d62920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95fc023650 tx=0x7f95fc04a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f94db7fe640 1 -- 172.21.15.144:0/2629651515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95fc017770 con 0x55ce26d5b5f0 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f94db7fe640 1 -- 172.21.15.144:0/2629651515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc02b7d0 con 0x55ce26d5b5f0 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce26d630f0 con 0x55ce26d5b5f0 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f94db7fe640 1 -- 172.21.15.144:0/2629651515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95fc02baf0 con 0x55ce26d5b5f0 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce26d65dd0 con 0x55ce26d5b5f0 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f94db7fe640 1 -- 172.21.15.144:0/2629651515 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f95fc037070 con 0x55ce26d5b5f0 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f94db7fe640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94d40346a0 0x7f94d4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f94db7fe640 1 -- 172.21.15.144:0/2629651515 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f95fc056b10 con 0x55ce26d5b5f0 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f9609c67640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94d40346a0 0x7f94d4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26d6de10 0x55ce26d702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d70a00 con 0x55ce26d6de10 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f9609466640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26d6de10 0x55ce26d702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f9609c67640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94d40346a0 0x7f94d4036b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f960401aec0 tx=0x7f96040e1000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f9609466640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26d6de10 0x55ce26d702b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95f400f6a0 con 0x55ce26d6de10 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 realm 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d6d2e0 con 0x55ce26d6de10 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95f400f6a0 con 0x55ce26d6de10 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d714d0 con 0x55ce26d6de10 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95f400f6a0 con 0x55ce26d6de10 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d71da0 con 0x55ce26d6de10 2024-09-13T19:33:33.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95f400f6a0 con 0x55ce26d6de10 2024-09-13T19:33:33.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d72690 0x55ce26d74ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.211+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d75250 con 0x55ce26d72690 2024-09-13T19:33:33.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f960a468640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d72690 0x55ce26d74ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f960a468640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d72690 0x55ce26d74ac0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f960c157980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:33.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f960c157980 20 searching for the correct realm 2024-09-13T19:33:33.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ce26d771a0 0x55ce26d795d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609c67640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ce26d771a0 0x55ce26d795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609c67640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ce26d771a0 0x55ce26d795d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609c67640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96040bf9c0 0x7f96040dc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x7f96040bf9c0 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609466640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96040bf9c0 0x7f96040dc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609466640 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96040bf9c0 0x7f96040dc3f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f400f6a0 con 0x7f96040bf9c0 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.215+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d6de10 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f95f400f6a0 con 0x55ce26d6de10 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d6de10 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x7f96040bf9c0 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d6de10 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d6de10 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.219+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x7f96040bf9c0 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d6de10 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d6de10 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x7f96040bf9c0 2024-09-13T19:33:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.223+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d6de10 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x7f96040bf9c0 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d771a0 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d72690 2024-09-13T19:33:33.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x55ce26d6de10 2024-09-13T19:33:33.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d79ca0 con 0x7f96040bf9c0 2024-09-13T19:33:33.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960c157980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960c157980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960c157980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960c157980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960c157980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960c157980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.227+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d75c10 con 0x55ce26d6de10 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d75850 con 0x55ce26d6de10 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d765b0 con 0x55ce26d6de10 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 zone default found 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 4 Realm: () 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 zonegroup default 2024-09-13T19:33:33.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7a1d0 con 0x55ce26d72690 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7c4a0 con 0x55ce26d771a0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7c840 con 0x55ce26d771a0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 started sync module instance, tier type = 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7b8e0 con 0x7f96040bf9c0 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94343903296992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7b8e0 con 0x7f96040bf9c0 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.231+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7d260 con 0x55ce26d6de10 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.235+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94343903296992] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.235+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.235+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94343903300944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7b8e0 con 0x55ce26d6de10 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.235+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7dc70 con 0x55ce26d771a0 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.235+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94343903300944] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94343903294512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7b850 con 0x55ce26d771a0 2024-09-13T19:33:33.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7e9c0 con 0x7f96040bf9c0 2024-09-13T19:33:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94343903307296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7f0d0 con 0x7f96040bf9c0 2024-09-13T19:33:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7fbf0 con 0x55ce26d6de10 2024-09-13T19:33:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94343903294512] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94343903307296] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94343903311552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7fbb0 con 0x55ce26d6de10 2024-09-13T19:33:33.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.239+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7ffe0 con 0x55ce26d72690 2024-09-13T19:33:33.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.243+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94343903311552] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.243+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.243+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94343903305824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d80380 con 0x55ce26d72690 2024-09-13T19:33:33.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.243+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d80d40 con 0x55ce26d72690 2024-09-13T19:33:33.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.243+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94343903305824] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.243+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.243+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94343903308576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d80d40 con 0x55ce26d72690 2024-09-13T19:33:33.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.243+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d81740 con 0x55ce26d72690 2024-09-13T19:33:33.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94343903308576] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94343903318608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d81920 con 0x55ce26d72690 2024-09-13T19:33:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960c157980 20 add_watcher() i=0 2024-09-13T19:33:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960c157980 20 add_watcher() i=1 2024-09-13T19:33:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960c157980 20 add_watcher() i=2 2024-09-13T19:33:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960c157980 20 add_watcher() i=3 2024-09-13T19:33:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960c157980 20 add_watcher() i=4 2024-09-13T19:33:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960c157980 20 add_watcher() i=5 2024-09-13T19:33:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.247+0000 7f960c157980 20 add_watcher() i=6 2024-09-13T19:33:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94343903318608] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 20 add_watcher() i=7 2024-09-13T19:33:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d84cf0 con 0x55ce26d6de10 2024-09-13T19:33:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94343903320080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d820e0 con 0x55ce26d6de10 2024-09-13T19:33:33.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94343903320080] v30'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f94bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:33.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:33.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 5 note: GC not initialized 2024-09-13T19:33:33.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f94ba7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:33.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:33.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 20 Filter name: none 2024-09-13T19:33:33.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f942bfff640 20 reqs_thread_entry: start 2024-09-13T19:33:33.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:33:33.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da82a0 con 0x55ce26d72690 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.251+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da6a40 con 0x55ce26d72690 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:33:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:33:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:33:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da7330 con 0x55ce26d72690 2024-09-13T19:33:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:33:33.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:33.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:33:33.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94343903473280 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26dab890 con 0x55ce26d72690 2024-09-13T19:33:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== watch-notify(notify (1) cookie 94343903305824 notify 128849018882 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55ce26da7cf0 con 0x55ce26d72690 2024-09-13T19:33:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f94ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94343903305824 notifier 4482 bl.length()=556 2024-09-13T19:33:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f94ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:33:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f94ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.255+0000 7f94ed7fa640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f94cc003eb0 con 0x55ce26d72690 2024-09-13T19:33:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(65 notify.5 [notify cookie 94343903473280 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== watch-notify(notify_complete (2) cookie 94343903473280 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce26d62e60 con 0x55ce26d72690 2024-09-13T19:33:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da72b0 con 0x55ce26d72690 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960c157980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960c157980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960c157980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94343903473152 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da7260 con 0x55ce26d771a0 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== watch-notify(notify (1) cookie 94343903294512 notify 128849018882 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f96040f4040 con 0x55ce26d771a0 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f94ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94343903294512 notifier 4482 bl.length()=177 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f94ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f94ecff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f94ecff9640 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9434003410 con 0x55ce26d771a0 2024-09-13T19:33:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(68 notify.2 [notify cookie 94343903473152 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.259+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== watch-notify(notify_complete (2) cookie 94343903473152 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce26d37390 con 0x55ce26d771a0 2024-09-13T19:33:33.265 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:33:33.258353Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:33.258330Z","tags":[],"group_ids":[]} 2024-09-13T19:33:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.263+0000 7f94bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.263+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94343903320080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da6040 con 0x55ce26d6de10 2024-09-13T19:33:33.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.263+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94343903320080] v30'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.263+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94343903296992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da6040 con 0x7f96040bf9c0 2024-09-13T19:33:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.263+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94343903296992] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.263+0000 7f960c157980 20 remove_watcher() i=0 2024-09-13T19:33:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.263+0000 7f960c157980 2 removed watcher, disabling cache 2024-09-13T19:33:33.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.263+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94343903300944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7bde0 con 0x55ce26d6de10 2024-09-13T19:33:33.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.267+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94343903300944] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.267+0000 7f960c157980 20 remove_watcher() i=1 2024-09-13T19:33:33.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.267+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94343903294512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da6040 con 0x55ce26d771a0 2024-09-13T19:33:33.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.267+0000 7f9609c67640 1 -- 172.21.15.144:0/2629651515 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94343903294512] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96040ce070 con 0x55ce26d771a0 2024-09-13T19:33:33.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.267+0000 7f960c157980 20 remove_watcher() i=2 2024-09-13T19:33:33.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.267+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94343903307296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7bde0 con 0x7f96040bf9c0 2024-09-13T19:33:33.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.271+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94343903307296] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x7f96040bf9c0 2024-09-13T19:33:33.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.271+0000 7f960c157980 20 remove_watcher() i=3 2024-09-13T19:33:33.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.271+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94343903311552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7b430 con 0x55ce26d6de10 2024-09-13T19:33:33.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.271+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94343903311552] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95f402b040 con 0x55ce26d6de10 2024-09-13T19:33:33.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.271+0000 7f960c157980 20 remove_watcher() i=4 2024-09-13T19:33:33.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.271+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94343903305824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26da6040 con 0x55ce26d72690 2024-09-13T19:33:33.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.275+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94343903305824] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.275+0000 7f960c157980 20 remove_watcher() i=5 2024-09-13T19:33:33.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.275+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94343903308576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7bde0 con 0x55ce26d72690 2024-09-13T19:33:33.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.275+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94343903308576] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.275+0000 7f960c157980 20 remove_watcher() i=6 2024-09-13T19:33:33.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.275+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94343903318608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce26d7b430 con 0x55ce26d72690 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960a468640 1 -- 172.21.15.144:0/2629651515 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94343903318608] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95fc05e040 con 0x55ce26d72690 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 20 remove_watcher() i=7 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d72690 msgr2=0x55ce26d74ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d72690 0x55ce26d74ac0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26d6de10 msgr2=0x55ce26d702b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26d6de10 0x55ce26d702b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96040bf9c0 msgr2=0x7f96040dc3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96040bf9c0 0x7f96040dc3f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ce26d771a0 msgr2=0x55ce26d795d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ce26d771a0 0x55ce26d795d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94d40346a0 msgr2=0x7f94d4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94d40346a0 0x7f94d4036b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f960401aec0 tx=0x7f96040e1000 comp rx=0 tx=0).stop 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f9609466640 1 -- 172.21.15.144:0/2629651515 reap_dead start 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 msgr2=0x55ce26d62920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d62920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95fc023650 tx=0x7f95fc04a230 comp rx=0 tx=0).stop 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 shutdown_connections 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/2629651515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d5b5f0 0x55ce26d62920 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 >> 172.21.15.144:0/2629651515 conn(0x55ce26d57970 msgr2=0x55ce26d55a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 shutdown_connections 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/2629651515 wait complete. 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/3140850250 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94e4034650 msgr2=0x7f94e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/3140850250 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94e4034650 0x7f94e4036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55ce26d3b9d0 tx=0x7f96040a3bc0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/3140850250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d4ea60 msgr2=0x55ce26d4ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/3140850250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d4ea60 0x55ce26d4ee80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55ce26d34de0 tx=0x7f95fc00af40 comp rx=0 tx=0).stop 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/3140850250 shutdown_connections 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/3140850250 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94e4034650 0x7f94e4036b10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/3140850250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26d4ea60 0x55ce26d4ee80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/3140850250 >> 172.21.15.144:0/3140850250 conn(0x55ce26d43bb0 msgr2=0x55ce26d46630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/3140850250 shutdown_connections 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/3140850250 wait complete. 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d3d860 msgr2=0x55ce26d3fc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d3d860 0x55ce26d3fc50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26c40020 msgr2=0x55ce26d3ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26c40020 0x55ce26d3ae70 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94f0034650 msgr2=0x7f94f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94f0034650 0x7f94f0036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95f4001e50 tx=0x7f95f40013b0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 msgr2=0x55ce26d33ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26d33ee0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9604005cc0 tx=0x7f9604017e30 comp rx=0 tx=0).stop 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 shutdown_connections 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ce26c40020 0x55ce26d3ae70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ce26d3d860 0x55ce26d3fc50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f94f0034650 0x7f94f0036b10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 --2- 172.21.15.144:0/1266441335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce26c3f6d0 0x55ce26d33ee0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 >> 172.21.15.144:0/1266441335 conn(0x55ce26c3b1f0 msgr2=0x55ce26bb5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 shutdown_connections 2024-09-13T19:33:33.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.279+0000 7f960c157980 1 -- 172.21.15.144:0/1266441335 wait complete. 2024-09-13T19:33:33.295 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:33:33.258353Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:33.258330Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:33.303 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:33:33.310 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:33.310 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-13T19:33:33.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-13T19:33:33.310 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-13T19:33:33.341 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:33.341 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:33.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f59872ba980 1 Processor -- start 2024-09-13T19:33:33.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f59872ba980 1 -- start start 2024-09-13T19:33:33.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f59872ba980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55de42eaab00 0x55de42f39330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f59872ba980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de42dbeae0 con 0x55de42f39870 2024-09-13T19:33:33.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f59872ba980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55de42de2e30 con 0x55de42eaab00 2024-09-13T19:33:33.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f5984dca640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55de42eaab00 0x55de42f39330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f59845c9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55de42f39870 0x55de42f3bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44616/0 (socket says 172.21.15.144:44616) 2024-09-13T19:33:33.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f59845c9640 1 -- 172.21.15.144:0/629383881 learned_addr learned my addr 172.21.15.144:0/629383881 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:33.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f5984dca640 1 -- 172.21.15.144:0/629383881 >> v1:172.21.15.18:6789/0 conn(0x55de42f39870 legacy=0x55de42f3bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.339+0000 7f5984dca640 1 -- 172.21.15.144:0/629383881 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de42f3e390 con 0x55de42eaab00 2024-09-13T19:33:33.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f5984dca640 1 --2- 172.21.15.144:0/629383881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de42f39330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f597400a480 tx=0x7f597401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cf6c34125593b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f5983dc8640 1 -- 172.21.15.144:0/629383881 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59740b0070 con 0x55de42eaab00 2024-09-13T19:33:33.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f5983dc8640 1 -- 172.21.15.144:0/629383881 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59740ab540 con 0x55de42eaab00 2024-09-13T19:33:33.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f5983dc8640 1 -- 172.21.15.144:0/629383881 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59740ab840 con 0x55de42eaab00 2024-09-13T19:33:33.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f59872ba980 1 -- 172.21.15.144:0/629383881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 msgr2=0x55de42f39330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f59872ba980 1 --2- 172.21.15.144:0/629383881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de42f39330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f597400a480 tx=0x7f597401b280 comp rx=0 tx=0).stop 2024-09-13T19:33:33.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f59872ba980 1 -- 172.21.15.144:0/629383881 shutdown_connections 2024-09-13T19:33:33.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f59872ba980 1 --2- 172.21.15.144:0/629383881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de42f39330 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f59872ba980 1 -- 172.21.15.144:0/629383881 >> 172.21.15.144:0/629383881 conn(0x55de42f31060 msgr2=0x55de42f33480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f59872ba980 1 -- 172.21.15.144:0/629383881 shutdown_connections 2024-09-13T19:33:33.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.343+0000 7f59872ba980 1 -- 172.21.15.144:0/629383881 wait complete. 2024-09-13T19:33:33.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.359+0000 7f59872ba980 1 Processor -- start 2024-09-13T19:33:33.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.359+0000 7f59872ba980 1 -- start start 2024-09-13T19:33:33.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.359+0000 7f59872ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43021af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.359+0000 7f59872ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de42de4200 con 0x55de42eaab00 2024-09-13T19:33:33.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.359+0000 7f5984dca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43021af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.359+0000 7f5984dca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43021af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57690/0 (socket says 172.21.15.144:57690) 2024-09-13T19:33:33.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.359+0000 7f5984dca640 1 -- 172.21.15.144:0/3455066999 learned_addr learned my addr 172.21.15.144:0/3455066999 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5984dca640 1 -- 172.21.15.144:0/3455066999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de430220c0 con 0x55de42eaab00 2024-09-13T19:33:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5984dca640 1 --2- 172.21.15.144:0/3455066999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43021af0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f59740ae040 tx=0x7f5974003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c4c6f934b53fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5872e0d640 1 -- 172.21.15.144:0/3455066999 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59740b0040 con 0x55de42eaab00 2024-09-13T19:33:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5872e0d640 1 -- 172.21.15.144:0/3455066999 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59740ab9d0 con 0x55de42eaab00 2024-09-13T19:33:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5872e0d640 1 -- 172.21.15.144:0/3455066999 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59740abcf0 con 0x55de42eaab00 2024-09-13T19:33:33.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- 172.21.15.144:0/3455066999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 msgr2=0x55de43021af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 --2- 172.21.15.144:0/3455066999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43021af0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f59740ae040 tx=0x7f5974003030 comp rx=0 tx=0).stop 2024-09-13T19:33:33.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- 172.21.15.144:0/3455066999 shutdown_connections 2024-09-13T19:33:33.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 --2- 172.21.15.144:0/3455066999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43021af0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- 172.21.15.144:0/3455066999 >> 172.21.15.144:0/3455066999 conn(0x55de42f31060 msgr2=0x55de4301d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- 172.21.15.144:0/3455066999 shutdown_connections 2024-09-13T19:33:33.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- 172.21.15.144:0/3455066999 wait complete. 2024-09-13T19:33:33.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 Processor -- start 2024-09-13T19:33:33.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- start start 2024-09-13T19:33:33.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43028d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de42f3de30 con 0x55de42eaab00 2024-09-13T19:33:33.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5984dca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43028d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5984dca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43028d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57692/0 (socket says 172.21.15.144:57692) 2024-09-13T19:33:33.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5984dca640 1 -- 172.21.15.144:0/3020107260 learned_addr learned my addr 172.21.15.144:0/3020107260 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5984dca640 1 -- 172.21.15.144:0/3020107260 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de43029240 con 0x55de42eaab00 2024-09-13T19:33:33.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f5984dca640 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43028d00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5974019930 tx=0x7f5974018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f587160a640 1 -- 172.21.15.144:0/3020107260 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59740b0070 con 0x55de42eaab00 2024-09-13T19:33:33.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de430294d0 con 0x55de42eaab00 2024-09-13T19:33:33.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f587160a640 1 -- 172.21.15.144:0/3020107260 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59740b68b0 con 0x55de42eaab00 2024-09-13T19:33:33.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f587160a640 1 -- 172.21.15.144:0/3020107260 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59740b6b90 con 0x55de42eaab00 2024-09-13T19:33:33.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.363+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de4302c1b0 con 0x55de42eaab00 2024-09-13T19:33:33.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f587160a640 1 -- 172.21.15.144:0/3020107260 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f59740bf3f0 con 0x55de42eaab00 2024-09-13T19:33:33.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f587160a640 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f586c034650 0x7f586c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f587160a640 1 -- 172.21.15.144:0/3020107260 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f59740bc070 con 0x55de42eaab00 2024-09-13T19:33:33.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59845c9640 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f586c034650 0x7f586c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de42f39870 0x55de4302fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de430302e0 con 0x55de42f39870 2024-09-13T19:33:33.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59855cb640 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de42f39870 0x55de4302fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59845c9640 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f586c034650 0x7f586c036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5978001da0 tx=0x7f5978001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59855cb640 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de42f39870 0x55de4302fc90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59855cb640 1 -- 172.21.15.144:0/3020107260 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f597c00a4d0 con 0x55de42f39870 2024-09-13T19:33:33.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de4302d3b0 con 0x55de42f39870 2024-09-13T19:33:33.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59855cb640 1 -- 172.21.15.144:0/3020107260 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f597c00a4d0 con 0x55de42f39870 2024-09-13T19:33:33.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de43032610 0x55de43034a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de430350d0 con 0x55de43032610 2024-09-13T19:33:33.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.367+0000 7f5984dca640 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de43032610 0x55de43034a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f5984dca640 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de43032610 0x55de43034a00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f5984dca640 1 -- 172.21.15.144:0/3020107260 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f59740b3040 con 0x55de43032610 2024-09-13T19:33:33.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de43031480 con 0x55de42f39870 2024-09-13T19:33:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59855cb640 1 -- 172.21.15.144:0/3020107260 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f597c00a4d0 con 0x55de42f39870 2024-09-13T19:33:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de43031960 con 0x55de42f39870 2024-09-13T19:33:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59855cb640 1 -- 172.21.15.144:0/3020107260 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f597c00a4d0 con 0x55de42f39870 2024-09-13T19:33:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59872ba980 1 Processor -- start 2024-09-13T19:33:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59872ba980 1 -- start start 2024-09-13T19:33:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59872ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de430437d0 0x55de43043bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59872ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de42e3d800 con 0x55de430437d0 2024-09-13T19:33:33.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59855cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de430437d0 0x55de43043bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59855cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de430437d0 0x55de43043bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57694/0 (socket says 172.21.15.144:57694) 2024-09-13T19:33:33.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59855cb640 1 -- 172.21.15.144:0/3746603793 learned_addr learned my addr 172.21.15.144:0/3746603793 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59855cb640 1 -- 172.21.15.144:0/3746603793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de43044130 con 0x55de430437d0 2024-09-13T19:33:33.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f59855cb640 1 --2- 172.21.15.144:0/3746603793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de430437d0 0x55de43043bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55de43029c00 tx=0x7f597c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.371+0000 7f586a7fc640 1 -- 172.21.15.144:0/3746603793 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597c014450 con 0x55de430437d0 2024-09-13T19:33:33.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f586a7fc640 1 -- 172.21.15.144:0/3746603793 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c014610 con 0x55de430437d0 2024-09-13T19:33:33.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59872ba980 1 -- 172.21.15.144:0/3746603793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de430443c0 con 0x55de430437d0 2024-09-13T19:33:33.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f586a7fc640 1 -- 172.21.15.144:0/3746603793 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597c014930 con 0x55de430437d0 2024-09-13T19:33:33.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59872ba980 1 -- 172.21.15.144:0/3746603793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de43047040 con 0x55de430437d0 2024-09-13T19:33:33.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f586a7fc640 1 -- 172.21.15.144:0/3746603793 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f597c011040 con 0x55de430437d0 2024-09-13T19:33:33.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f586a7fc640 1 --2- 172.21.15.144:0/3746603793 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f585c0346a0 0x7f585c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f586a7fc640 1 -- 172.21.15.144:0/3746603793 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f597c01e070 con 0x55de430437d0 2024-09-13T19:33:33.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f5984dca640 1 --2- 172.21.15.144:0/3746603793 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f585c0346a0 0x7f585c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59872ba980 1 Processor -- start 2024-09-13T19:33:33.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59872ba980 1 -- start start 2024-09-13T19:33:33.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f5984dca640 1 --2- 172.21.15.144:0/3746603793 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f585c0346a0 0x7f585c036b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59740ab510 tx=0x7f59740d2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59872ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de42f356d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59872ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de43022380 con 0x55de42f352f0 2024-09-13T19:33:33.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59855cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de42f356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59855cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de42f356d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57702/0 (socket says 172.21.15.144:57702) 2024-09-13T19:33:33.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59855cb640 1 -- 172.21.15.144:0/3466307248 learned_addr learned my addr 172.21.15.144:0/3466307248 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59855cb640 1 -- 172.21.15.144:0/3466307248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de42f35ca0 con 0x55de42f352f0 2024-09-13T19:33:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f59855cb640 1 --2- 172.21.15.144:0/3466307248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de42f356d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f597c04a050 tx=0x7f597c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09e8bc96f5feb3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f585bfff640 1 -- 172.21.15.144:0/3466307248 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597c045e60 con 0x55de42f352f0 2024-09-13T19:33:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f585bfff640 1 -- 172.21.15.144:0/3466307248 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c00de50 con 0x55de42f352f0 2024-09-13T19:33:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.375+0000 7f585bfff640 1 -- 172.21.15.144:0/3466307248 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597c016570 con 0x55de42f352f0 2024-09-13T19:33:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- 172.21.15.144:0/3466307248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 msgr2=0x55de42f356d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 --2- 172.21.15.144:0/3466307248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de42f356d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f597c04a050 tx=0x7f597c011f60 comp rx=0 tx=0).stop 2024-09-13T19:33:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- 172.21.15.144:0/3466307248 shutdown_connections 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 --2- 172.21.15.144:0/3466307248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de42f356d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- 172.21.15.144:0/3466307248 >> 172.21.15.144:0/3466307248 conn(0x55de4304c690 msgr2=0x55de4304a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- 172.21.15.144:0/3466307248 shutdown_connections 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- 172.21.15.144:0/3466307248 wait complete. 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 Processor -- start 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- start start 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de43059820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de42f36470 con 0x55de42f352f0 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59855cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de43059820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59855cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de43059820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57716/0 (socket says 172.21.15.144:57716) 2024-09-13T19:33:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 learned_addr learned my addr 172.21.15.144:0/2019573559 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de43059d60 con 0x55de42f352f0 2024-09-13T19:33:33.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59855cb640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de43059820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f597c04a050 tx=0x7f597c049fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f585a7fc640 1 -- 172.21.15.144:0/2019573559 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597c0134e0 con 0x55de42f352f0 2024-09-13T19:33:33.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f585a7fc640 1 -- 172.21.15.144:0/2019573559 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c013680 con 0x55de42f352f0 2024-09-13T19:33:33.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de43059ff0 con 0x55de42f352f0 2024-09-13T19:33:33.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f585a7fc640 1 -- 172.21.15.144:0/2019573559 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597c04b230 con 0x55de42f352f0 2024-09-13T19:33:33.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de4305ccd0 con 0x55de42f352f0 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f585a7fc640 1 -- 172.21.15.144:0/2019573559 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f597c04b3d0 con 0x55de42f352f0 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f585a7fc640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5850034650 0x7f5850036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.379+0000 7f585a7fc640 1 -- 172.21.15.144:0/2019573559 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f597c033070 con 0x55de42f352f0 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f5984dca640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5850034650 0x7f5850036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de43064ec0 0x55de43067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de43067a80 con 0x55de43064ec0 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59845c9640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de43064ec0 0x55de43067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f5984dca640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5850034650 0x7f5850036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f59740e4010 tx=0x7f597401b280 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59845c9640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de43064ec0 0x55de43067330 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f597800e640 con 0x55de43064ec0 2024-09-13T19:33:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 realm 2024-09-13T19:33:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de43064420 con 0x55de43064ec0 2024-09-13T19:33:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f597800e640 con 0x55de43064ec0 2024-09-13T19:33:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de43068580 con 0x55de43064ec0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f597800e640 con 0x55de43064ec0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de43068ab0 con 0x55de43064ec0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f597800e640 con 0x55de43064ec0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de430698b0 0x55de4306bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de4306c220 con 0x55de430698b0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59855cb640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de430698b0 0x55de4306bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59855cb640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de430698b0 0x55de4306bca0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 20 searching for the correct realm 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de4306e200 0x55de430706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.383+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f5984dca640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de4306e200 0x55de430706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f5984dca640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de4306e200 0x55de430706c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f5984dca640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f59740de040 0x7f59740c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x7f59740de040 2024-09-13T19:33:33.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59845c9640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f59740de040 0x7f59740c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59845c9640 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f59740de040 0x7f59740c0070 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597800e640 con 0x7f59740de040 2024-09-13T19:33:33.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de43064ec0 2024-09-13T19:33:33.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f597800e640 con 0x55de43064ec0 2024-09-13T19:33:33.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de43064ec0 2024-09-13T19:33:33.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.387+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x7f59740de040 2024-09-13T19:33:33.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de43064ec0 2024-09-13T19:33:33.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de43064ec0 2024-09-13T19:33:33.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x7f59740de040 2024-09-13T19:33:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.391+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de43064ec0 2024-09-13T19:33:33.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de43064ec0 2024-09-13T19:33:33.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x7f59740de040 2024-09-13T19:33:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de43064ec0 2024-09-13T19:33:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.395+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x7f59740de040 2024-09-13T19:33:33.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de4306e200 2024-09-13T19:33:33.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de430698b0 2024-09-13T19:33:33.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x55de43064ec0 2024-09-13T19:33:33.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de43070d90 con 0x7f59740de040 2024-09-13T19:33:33.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:33.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:33.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de4306cbe0 con 0x55de43064ec0 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de4306d060 con 0x55de43064ec0 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de4306d070 con 0x55de43064ec0 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 zone default found 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 4 Realm: () 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 zonegroup default 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.399+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de4306d510 con 0x55de430698b0 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de430730a0 con 0x55de4306e200 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de43073440 con 0x55de4306e200 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 20 started sync module instance, tier type = 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:33.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de430724e0 con 0x7f59740de040 2024-09-13T19:33:33.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94413095643392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de430724e0 con 0x7f59740de040 2024-09-13T19:33:33.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43073e00 con 0x55de43064ec0 2024-09-13T19:33:33.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.403+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94413095643392] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.407+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.407+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94413095641408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43073e00 con 0x55de43064ec0 2024-09-13T19:33:33.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.407+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de430747c0 con 0x55de4306e200 2024-09-13T19:33:33.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.407+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94413095641408] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.407+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.407+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94413095647568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43073d70 con 0x55de4306e200 2024-09-13T19:33:33.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.407+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de430754c0 con 0x7f59740de040 2024-09-13T19:33:33.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.411+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.411+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94413095653696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43075d60 con 0x7f59740de040 2024-09-13T19:33:33.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.411+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43076720 con 0x55de43064ec0 2024-09-13T19:33:33.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.411+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94413095647568] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.411+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94413095653696] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.411+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.411+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94413095658096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43076690 con 0x55de43064ec0 2024-09-13T19:33:33.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.411+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43075cb0 con 0x55de430698b0 2024-09-13T19:33:33.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.415+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94413095658096] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.415+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.415+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94413095655424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43075c20 con 0x55de430698b0 2024-09-13T19:33:33.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.415+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43077470 con 0x55de430698b0 2024-09-13T19:33:33.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.415+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.415+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94413095661504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43077890 con 0x55de430698b0 2024-09-13T19:33:33.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.415+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de430783b0 con 0x55de430698b0 2024-09-13T19:33:33.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.415+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94413095655424] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94413095665280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43078370 con 0x55de430698b0 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 20 add_watcher() i=0 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 20 add_watcher() i=1 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 20 add_watcher() i=2 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 20 add_watcher() i=3 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 20 add_watcher() i=4 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 20 add_watcher() i=5 2024-09-13T19:33:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94413095661504] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 20 add_watcher() i=6 2024-09-13T19:33:33.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94413095665280] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.419+0000 7f59872ba980 20 add_watcher() i=7 2024-09-13T19:33:33.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:33.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de430773e0 con 0x55de43064ec0 2024-09-13T19:33:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94413095662560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43078870 con 0x55de43064ec0 2024-09-13T19:33:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94413095662560] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f583afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 5 note: GC not initialized 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f5839fe3640 20 reqs_thread_entry: start 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 20 Filter name: none 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f57ab7fe640 20 reqs_thread_entry: start 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de4309e400 con 0x7f59740de040 2024-09-13T19:33:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.423+0000 7f59872ba980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.427+0000 7f583afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.427+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94413095662560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de4309c320 con 0x55de43064ec0 2024-09-13T19:33:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.427+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94413095662560] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.427+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94413095643392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de4309c320 con 0x7f59740de040 2024-09-13T19:33:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.427+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94413095643392] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.427+0000 7f59872ba980 20 remove_watcher() i=0 2024-09-13T19:33:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.427+0000 7f59872ba980 2 removed watcher, disabling cache 2024-09-13T19:33:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.427+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94413095641408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de4309c320 con 0x55de43064ec0 2024-09-13T19:33:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.431+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94413095641408] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.431+0000 7f59872ba980 20 remove_watcher() i=1 2024-09-13T19:33:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.431+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94413095647568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de4309c320 con 0x55de4306e200 2024-09-13T19:33:33.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.431+0000 7f5984dca640 1 -- 172.21.15.144:0/2019573559 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94413095647568] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59740eb040 con 0x55de4306e200 2024-09-13T19:33:33.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.431+0000 7f59872ba980 20 remove_watcher() i=2 2024-09-13T19:33:33.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.431+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94413095653696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43073950 con 0x7f59740de040 2024-09-13T19:33:33.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.435+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94413095653696] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x7f59740de040 2024-09-13T19:33:33.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.435+0000 7f59872ba980 20 remove_watcher() i=3 2024-09-13T19:33:33.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.435+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94413095658096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43073950 con 0x55de43064ec0 2024-09-13T19:33:33.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.435+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94413095658096] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5978029040 con 0x55de43064ec0 2024-09-13T19:33:33.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.435+0000 7f59872ba980 20 remove_watcher() i=4 2024-09-13T19:33:33.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.435+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94413095655424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43076270 con 0x55de430698b0 2024-09-13T19:33:33.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.439+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94413095655424] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.439+0000 7f59872ba980 20 remove_watcher() i=5 2024-09-13T19:33:33.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.439+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94413095661504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43073950 con 0x55de430698b0 2024-09-13T19:33:33.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.439+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94413095661504] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.439+0000 7f59872ba980 20 remove_watcher() i=6 2024-09-13T19:33:33.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.439+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94413095665280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de43077450 con 0x55de430698b0 2024-09-13T19:33:33.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59855cb640 1 -- 172.21.15.144:0/2019573559 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94413095665280] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c02a070 con 0x55de430698b0 2024-09-13T19:33:33.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 20 remove_watcher() i=7 2024-09-13T19:33:33.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de430698b0 msgr2=0x55de4306bca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de430698b0 0x55de4306bca0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de43064ec0 msgr2=0x55de43067330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de43064ec0 0x55de43067330 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f59740de040 msgr2=0x7f59740c0070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f59740de040 0x7f59740c0070 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de4306e200 msgr2=0x55de430706c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de4306e200 0x55de430706c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5850034650 msgr2=0x7f5850036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5850034650 0x7f5850036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f59740e4010 tx=0x7f597401b280 comp rx=0 tx=0).stop 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59845c9640 1 -- 172.21.15.144:0/2019573559 reap_dead start 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 msgr2=0x55de43059820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de43059820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f597c04a050 tx=0x7f597c049fe0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 shutdown_connections 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/2019573559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42f352f0 0x55de43059820 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 >> 172.21.15.144:0/2019573559 conn(0x55de4304c690 msgr2=0x55de4304a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 shutdown_connections 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/2019573559 wait complete. 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3746603793 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f585c0346a0 msgr2=0x7f585c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3746603793 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f585c0346a0 0x7f585c036b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59740ab510 tx=0x7f59740d2040 comp rx=0 tx=0).stop 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3746603793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de430437d0 msgr2=0x55de43043bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3746603793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de430437d0 0x55de43043bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55de43029c00 tx=0x7f597c018830 comp rx=0 tx=0).stop 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3746603793 shutdown_connections 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3746603793 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f585c0346a0 0x7f585c036b60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3746603793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de430437d0 0x55de43043bf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3746603793 >> 172.21.15.144:0/3746603793 conn(0x55de43038920 msgr2=0x55de4303b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3746603793 shutdown_connections 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3746603793 wait complete. 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de43032610 msgr2=0x55de43034a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de43032610 0x55de43034a00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de42f39870 msgr2=0x55de4302fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de42f39870 0x55de4302fc90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f586c034650 msgr2=0x7f586c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f586c034650 0x7f586c036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5978001da0 tx=0x7f5978001300 comp rx=0 tx=0).stop 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 msgr2=0x55de43028d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43028d00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5974019930 tx=0x7f5974018020 comp rx=0 tx=0).stop 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 shutdown_connections 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de42f39870 0x55de4302fc90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de43032610 0x55de43034a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f586c034650 0x7f586c036b10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 --2- 172.21.15.144:0/3020107260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de42eaab00 0x55de43028d00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 >> 172.21.15.144:0/3020107260 conn(0x55de42f31060 msgr2=0x55de4301c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 shutdown_connections 2024-09-13T19:33:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.443+0000 7f59872ba980 1 -- 172.21.15.144:0/3020107260 wait complete. 2024-09-13T19:33:33.458 INFO:teuthology.orchestra.run.smithi144.stdout:{"key":"bucket:myfoo","ver":{"tag":"_aQ2GkDT_eqGInv0A_O1Rhw8","ver":2},"mtime":"2024-09-13T19:33:33.052094Z","data":{"bucket":{"name":"myfoo","marker":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","bucket_id":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-13T19:33:31.450072Z","linked":false,"has_bucket_info":false}} 2024-09-13T19:33:33.458 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_aQ2GkDT_eqGInv0A_O1Rhw8', 'ver': 2}, 'mtime': '2024-09-13T19:33:33.052094Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'bucket_id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-13T19:33:31.450072Z', 'linked': False, 'has_bucket_info': False}} 2024-09-13T19:33:33.458 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1'] 2024-09-13T19:33:33.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1'] 2024-09-13T19:33:33.458 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:33.539 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:33.539 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.535+0000 7f83a4d66980 1 Processor -- start 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.535+0000 7f83a4d66980 1 -- start start 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.535+0000 7f83a4d66980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e38dcae880 0x55e38dcaec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.535+0000 7f83a4d66980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e38db34ae0 con 0x55e38dcaf1d0 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.535+0000 7f83a4d66980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55e38db58e30 con 0x55e38dcae880 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.535+0000 7f83a2876640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e38dcae880 0x55e38dcaec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.535+0000 7f83a2075640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55e38dcaf1d0 0x55e38dcb3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44620/0 (socket says 172.21.15.144:44620) 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.535+0000 7f83a2075640 1 -- 172.21.15.144:0/2522969140 learned_addr learned my addr 172.21.15.144:0/2522969140 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a2876640 1 -- 172.21.15.144:0/2522969140 >> v1:172.21.15.18:6789/0 conn(0x55e38dcaf1d0 legacy=0x55e38dcb3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a2876640 1 -- 172.21.15.144:0/2522969140 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38dcb6450 con 0x55e38dcae880 2024-09-13T19:33:33.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a2876640 1 --2- 172.21.15.144:0/2522969140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dcaec60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f838c00a480 tx=0x7f838c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f214f3c4b457a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a1874640 1 -- 172.21.15.144:0/2522969140 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0b0070 con 0x55e38dcae880 2024-09-13T19:33:33.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a1874640 1 -- 172.21.15.144:0/2522969140 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c0ab540 con 0x55e38dcae880 2024-09-13T19:33:33.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a1874640 1 -- 172.21.15.144:0/2522969140 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0ab840 con 0x55e38dcae880 2024-09-13T19:33:33.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a4d66980 1 -- 172.21.15.144:0/2522969140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 msgr2=0x55e38dcaec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2522969140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dcaec60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f838c00a480 tx=0x7f838c01b280 comp rx=0 tx=0).stop 2024-09-13T19:33:33.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a4d66980 1 -- 172.21.15.144:0/2522969140 shutdown_connections 2024-09-13T19:33:33.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2522969140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dcaec60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a4d66980 1 -- 172.21.15.144:0/2522969140 >> 172.21.15.144:0/2522969140 conn(0x55e38dc221d0 msgr2=0x55e38dc225e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a4d66980 1 -- 172.21.15.144:0/2522969140 shutdown_connections 2024-09-13T19:33:33.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.539+0000 7f83a4d66980 1 -- 172.21.15.144:0/2522969140 wait complete. 2024-09-13T19:33:33.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.555+0000 7f83a4d66980 1 Processor -- start 2024-09-13T19:33:33.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.555+0000 7f83a4d66980 1 -- start start 2024-09-13T19:33:33.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.555+0000 7f83a4d66980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dd99c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.555+0000 7f83a4d66980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e38db5a200 con 0x55e38dcae880 2024-09-13T19:33:33.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dd99c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dd99c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57732/0 (socket says 172.21.15.144:57732) 2024-09-13T19:33:33.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 -- 172.21.15.144:0/3399423249 learned_addr learned my addr 172.21.15.144:0/3399423249 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 -- 172.21.15.144:0/3399423249 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38dd9a200 con 0x55e38dcae880 2024-09-13T19:33:33.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 --2- 172.21.15.144:0/3399423249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dd99c30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f838c0ae040 tx=0x7f838c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a02aedc046fb51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f8290e09640 1 -- 172.21.15.144:0/3399423249 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0b0040 con 0x55e38dcae880 2024-09-13T19:33:33.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f8290e09640 1 -- 172.21.15.144:0/3399423249 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c0ab9b0 con 0x55e38dcae880 2024-09-13T19:33:33.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f8290e09640 1 -- 172.21.15.144:0/3399423249 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0abc90 con 0x55e38dcae880 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 -- 172.21.15.144:0/3399423249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 msgr2=0x55e38dd99c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 --2- 172.21.15.144:0/3399423249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dd99c30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f838c0ae040 tx=0x7f838c003030 comp rx=0 tx=0).stop 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 -- 172.21.15.144:0/3399423249 shutdown_connections 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 --2- 172.21.15.144:0/3399423249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dd99c30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 -- 172.21.15.144:0/3399423249 >> 172.21.15.144:0/3399423249 conn(0x55e38dc221d0 msgr2=0x55e38dd95860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 -- 172.21.15.144:0/3399423249 shutdown_connections 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 -- 172.21.15.144:0/3399423249 wait complete. 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 Processor -- start 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 -- start start 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dda0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a4d66980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e38dcb5e90 con 0x55e38dcae880 2024-09-13T19:33:33.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dda0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dda0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57736/0 (socket says 172.21.15.144:57736) 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 -- 172.21.15.144:0/4085142569 learned_addr learned my addr 172.21.15.144:0/4085142569 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.559+0000 7f83a2876640 1 -- 172.21.15.144:0/4085142569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38dda1420 con 0x55e38dcae880 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a2876640 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dda0ee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f838c0030b0 tx=0x7f838c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f828f606640 1 -- 172.21.15.144:0/4085142569 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0c5070 con 0x55e38dcae880 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f828f606640 1 -- 172.21.15.144:0/4085142569 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c0b6970 con 0x55e38dcae880 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f828f606640 1 -- 172.21.15.144:0/4085142569 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0b0050 con 0x55e38dcae880 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e38dda16b0 con 0x55e38dcae880 2024-09-13T19:33:33.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e38dda4390 con 0x55e38dcae880 2024-09-13T19:33:33.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f828f606640 1 -- 172.21.15.144:0/4085142569 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f838c0c8070 con 0x55e38dcae880 2024-09-13T19:33:33.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f828f606640 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288034650 0x7f8288036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f828f606640 1 -- 172.21.15.144:0/4085142569 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f838c0bc070 con 0x55e38dcae880 2024-09-13T19:33:33.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a2075640 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288034650 0x7f8288036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dcaf1d0 0x55e38dda7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dda8500 con 0x55e38dcaf1d0 2024-09-13T19:33:33.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a3077640 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dcaf1d0 0x55e38dda7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a2075640 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288034650 0x7f8288036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83940012f0 tx=0x7f8394006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a3077640 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dcaf1d0 0x55e38dda7e90 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a3077640 1 -- 172.21.15.144:0/4085142569 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f839c0083f0 con 0x55e38dcaf1d0 2024-09-13T19:33:33.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dda55b0 con 0x55e38dcaf1d0 2024-09-13T19:33:33.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a3077640 1 -- 172.21.15.144:0/4085142569 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f839c0083f0 con 0x55e38dcaf1d0 2024-09-13T19:33:33.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38ddaa8a0 0x55e38ddacc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddad380 con 0x55e38ddaa8a0 2024-09-13T19:33:33.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.563+0000 7f83a2876640 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38ddaa8a0 0x55e38ddacc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a2876640 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38ddaa8a0 0x55e38ddacc90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a2876640 1 -- 172.21.15.144:0/4085142569 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f838c0c7030 con 0x55e38ddaa8a0 2024-09-13T19:33:33.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dda9740 con 0x55e38dcaf1d0 2024-09-13T19:33:33.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a3077640 1 -- 172.21.15.144:0/4085142569 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f839c0083f0 con 0x55e38dcaf1d0 2024-09-13T19:33:33.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dda9be0 con 0x55e38dcaf1d0 2024-09-13T19:33:33.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a3077640 1 -- 172.21.15.144:0/4085142569 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f839c0083f0 con 0x55e38dcaf1d0 2024-09-13T19:33:33.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a4d66980 1 Processor -- start 2024-09-13T19:33:33.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a4d66980 1 -- start start 2024-09-13T19:33:33.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a4d66980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddbba60 0x55e38ddbbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a4d66980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e38dbb3800 con 0x55e38ddbba60 2024-09-13T19:33:33.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a3077640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddbba60 0x55e38ddbbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a3077640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddbba60 0x55e38ddbbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57740/0 (socket says 172.21.15.144:57740) 2024-09-13T19:33:33.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a3077640 1 -- 172.21.15.144:0/36610696 learned_addr learned my addr 172.21.15.144:0/36610696 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a3077640 1 -- 172.21.15.144:0/36610696 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38ddbc3c0 con 0x55e38ddbba60 2024-09-13T19:33:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.567+0000 7f83a3077640 1 --2- 172.21.15.144:0/36610696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddbba60 0x55e38ddbbe80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55e38dda1de0 tx=0x7f839c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f828ce01640 1 -- 172.21.15.144:0/36610696 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839c007dd0 con 0x55e38ddbba60 2024-09-13T19:33:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a4d66980 1 -- 172.21.15.144:0/36610696 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e38ddbc650 con 0x55e38ddbba60 2024-09-13T19:33:33.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f828ce01640 1 -- 172.21.15.144:0/36610696 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c01e020 con 0x55e38ddbba60 2024-09-13T19:33:33.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f828ce01640 1 -- 172.21.15.144:0/36610696 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839c019590 con 0x55e38ddbba60 2024-09-13T19:33:33.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a4d66980 1 -- 172.21.15.144:0/36610696 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e38ddbf2d0 con 0x55e38ddbba60 2024-09-13T19:33:33.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f828ce01640 1 -- 172.21.15.144:0/36610696 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f839c016040 con 0x55e38ddbba60 2024-09-13T19:33:33.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f828ce01640 1 --2- 172.21.15.144:0/36610696 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f827c034650 0x7f827c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f828ce01640 1 -- 172.21.15.144:0/36610696 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f839c01f030 con 0x55e38ddbba60 2024-09-13T19:33:33.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a2876640 1 --2- 172.21.15.144:0/36610696 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f827c034650 0x7f827c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a4d66980 1 Processor -- start 2024-09-13T19:33:33.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a4d66980 1 -- start start 2024-09-13T19:33:33.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a2876640 1 --2- 172.21.15.144:0/36610696 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f827c034650 0x7f827c036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55e38dda89f0 tx=0x7f838c0c9f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a4d66980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddc89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a4d66980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e38dd9a4c0 con 0x55e38ddc85a0 2024-09-13T19:33:33.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a3077640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddc89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a3077640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddc89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57750/0 (socket says 172.21.15.144:57750) 2024-09-13T19:33:33.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a3077640 1 -- 172.21.15.144:0/3591063094 learned_addr learned my addr 172.21.15.144:0/3591063094 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a3077640 1 -- 172.21.15.144:0/3591063094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38ddc8f70 con 0x55e38ddc85a0 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f83a3077640 1 --2- 172.21.15.144:0/3591063094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddc89a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f839c04a1e0 tx=0x7f839c018470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef20979ccd299d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f82867fc640 1 -- 172.21.15.144:0/3591063094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839c01d070 con 0x55e38ddc85a0 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f82867fc640 1 -- 172.21.15.144:0/3591063094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c017c80 con 0x55e38ddc85a0 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.571+0000 7f82867fc640 1 -- 172.21.15.144:0/3591063094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839c017740 con 0x55e38ddc85a0 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- 172.21.15.144:0/3591063094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 msgr2=0x55e38ddc89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 --2- 172.21.15.144:0/3591063094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddc89a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f839c04a1e0 tx=0x7f839c018470 comp rx=0 tx=0).stop 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- 172.21.15.144:0/3591063094 shutdown_connections 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 --2- 172.21.15.144:0/3591063094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddc89a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- 172.21.15.144:0/3591063094 >> 172.21.15.144:0/3591063094 conn(0x55e38ddc4980 msgr2=0x55e38ddc2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- 172.21.15.144:0/3591063094 shutdown_connections 2024-09-13T19:33:33.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- 172.21.15.144:0/3591063094 wait complete. 2024-09-13T19:33:33.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 Processor -- start 2024-09-13T19:33:33.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- start start 2024-09-13T19:33:33.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddcf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e38ddc9570 con 0x55e38ddc85a0 2024-09-13T19:33:33.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a3077640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddcf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a3077640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddcf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57758/0 (socket says 172.21.15.144:57758) 2024-09-13T19:33:33.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 learned_addr learned my addr 172.21.15.144:0/2404581068 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38ddcfe40 con 0x55e38ddc85a0 2024-09-13T19:33:33.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a3077640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddcf900 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f839c04a1e0 tx=0x7f839c049ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f8284ff9640 1 -- 172.21.15.144:0/2404581068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839c015dc0 con 0x55e38ddc85a0 2024-09-13T19:33:33.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f8284ff9640 1 -- 172.21.15.144:0/2404581068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c04b410 con 0x55e38ddc85a0 2024-09-13T19:33:33.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e38ddd00d0 con 0x55e38ddc85a0 2024-09-13T19:33:33.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f8284ff9640 1 -- 172.21.15.144:0/2404581068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839c04b6f0 con 0x55e38ddc85a0 2024-09-13T19:33:33.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e38ddd2db0 con 0x55e38ddc85a0 2024-09-13T19:33:33.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.575+0000 7f8284ff9640 1 -- 172.21.15.144:0/2404581068 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f839c0153e0 con 0x55e38ddc85a0 2024-09-13T19:33:33.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f8284ff9640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f826c034650 0x7f826c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f8284ff9640 1 -- 172.21.15.144:0/2404581068 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f839c03aab0 con 0x55e38ddc85a0 2024-09-13T19:33:33.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a2876640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f826c034650 0x7f826c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dddae20 0x55e38dddd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dddda30 con 0x55e38dddae20 2024-09-13T19:33:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a2075640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dddae20 0x55e38dddd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a2876640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f826c034650 0x7f826c036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55e38ddad780 tx=0x7f838c0df000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a2075640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dddae20 0x55e38dddd2e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 realm 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddda2c0 con 0x55e38dddae20 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddde530 con 0x55e38dddae20 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dddee00 con 0x55e38dddae20 2024-09-13T19:33:33.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38dddf6f0 0x55e38dde1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde2290 con 0x55e38dddf6f0 2024-09-13T19:33:33.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a3077640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38dddf6f0 0x55e38dde1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.579+0000 7f83a3077640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38dddf6f0 0x55e38dde1b00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a4d66980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:33.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a4d66980 20 searching for the correct realm 2024-09-13T19:33:33.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e38dde41e0 0x55e38dde65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dde41e0 2024-09-13T19:33:33.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2876640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e38dde41e0 0x55e38dde65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2876640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e38dde41e0 0x55e38dde65f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2876640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f838c0ca060 0x7f838c0aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x7f838c0ca060 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2075640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f838c0ca060 0x7f838c0aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2075640 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f838c0ca060 0x7f838c0aa3b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dddf6f0 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dddae20 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dddae20 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dddf6f0 2024-09-13T19:33:33.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.583+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dddf6f0 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x7f838c0ca060 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dde41e0 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dddae20 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dddf6f0 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dddae20 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x7f838c0ca060 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde6cc0 con 0x55e38dde41e0 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dde41e0 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.587+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddf6f0 2024-09-13T19:33:33.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dde41e0 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dde41e0 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddae20 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddae20 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddf6f0 2024-09-13T19:33:33.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dde41e0 2024-09-13T19:33:33.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x7f838c0ca060 2024-09-13T19:33:33.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddae20 2024-09-13T19:33:33.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddf6f0 2024-09-13T19:33:33.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.591+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dde41e0 2024-09-13T19:33:33.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddf6f0 2024-09-13T19:33:33.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x7f838c0ca060 2024-09-13T19:33:33.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dde41e0 2024-09-13T19:33:33.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddf6f0 2024-09-13T19:33:33.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x55e38dddae20 2024-09-13T19:33:33.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f838c0fd040 con 0x7f838c0ca060 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde2c50 con 0x55e38dddae20 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde2890 con 0x55e38dddae20 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.595+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde35b0 con 0x55e38dddae20 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 zone default found 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 4 Realm: () 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 zonegroup default 2024-09-13T19:33:33.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde7140 con 0x55e38dddf6f0 2024-09-13T19:33:33.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde93f0 con 0x55e38dde41e0 2024-09-13T19:33:33.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde9790 con 0x55e38dde41e0 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 started sync module instance, tier type = 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde8880 con 0x7f838c0ca060 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94435826109856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde8880 con 0x7f838c0ca060 2024-09-13T19:33:33.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.599+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddea260 con 0x55e38dddae20 2024-09-13T19:33:33.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.603+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94435826109856] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.603+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.603+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94435826113856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde8880 con 0x55e38dddae20 2024-09-13T19:33:33.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.603+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddeac70 con 0x55e38dde41e0 2024-09-13T19:33:33.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.603+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94435826113856] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94435826107344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38dde87f0 con 0x55e38dde41e0 2024-09-13T19:33:33.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddeb970 con 0x7f838c0ca060 2024-09-13T19:33:33.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94435826120144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddec210 con 0x7f838c0ca060 2024-09-13T19:33:33.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddecbd0 con 0x55e38dddae20 2024-09-13T19:33:33.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94435826107344] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94435826120144] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94435826124576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddec180 con 0x55e38dddae20 2024-09-13T19:33:33.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.607+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddecb40 con 0x55e38dddf6f0 2024-09-13T19:33:33.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.611+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94435826124576] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.611+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.611+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94435826121936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddec0f0 con 0x55e38dddf6f0 2024-09-13T19:33:33.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.611+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38dded920 con 0x55e38dddf6f0 2024-09-13T19:33:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94435826127984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38dded890 con 0x55e38dddf6f0 2024-09-13T19:33:33.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddee8f0 con 0x55e38dddf6f0 2024-09-13T19:33:33.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94435826121936] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94435826127984] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94435826131936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddee8b0 con 0x55e38dddf6f0 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 20 add_watcher() i=0 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 20 add_watcher() i=1 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 20 add_watcher() i=2 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 20 add_watcher() i=3 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 20 add_watcher() i=4 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 20 add_watcher() i=5 2024-09-13T19:33:33.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.615+0000 7f83a4d66980 20 add_watcher() i=6 2024-09-13T19:33:33.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94435826131936] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a4d66980 20 add_watcher() i=7 2024-09-13T19:33:33.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a4d66980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:33.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddedcc0 con 0x55e38dddae20 2024-09-13T19:33:33.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94435826130112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddeed40 con 0x55e38dddae20 2024-09-13T19:33:33.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94435826130112] v30'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f8259fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a4d66980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:33.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a4d66980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:33.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f83a4d66980 5 note: GC not initialized 2024-09-13T19:33:33.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.619+0000 7f8258fe1640 20 reqs_thread_entry: start 2024-09-13T19:33:33.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:33.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 20 Filter name: none 2024-09-13T19:33:33.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f8251ffb640 20 reqs_thread_entry: start 2024-09-13T19:33:33.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:33:33.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38de14ef0 con 0x55e38dddf6f0 2024-09-13T19:33:33.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:33:33.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:33:33.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:33.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:33.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38de16fd0 con 0x7f838c0ca060 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38de18870 con 0x55e38dde41e0 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:33.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.623+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de1cd80 con 0x7f838c0ca060 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de22c60 con 0x55e38dde41e0 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a4d66980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a4d66980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a4d66980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a4d66980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1, ofs0, ns] 2024-09-13T19:33:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94435826303264 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38de1d1b0 con 0x7f838c0ca060 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== watch-notify(notify (1) cookie 94435826109856 notify 128849018899 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f839401b040 con 0x7f838c0ca060 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f82867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94435826109856 notifier 4496 bl.length()=752 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f82867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f82867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f82867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(67 notify.0 [notify cookie 94435826303264 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.627+0000 7f82867fc640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8268003eb0 con 0x7f838c0ca060 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== watch-notify(notify_complete (2) cookie 94435826303264 notify 128849018899 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e38db34ae0 con 0x7f838c0ca060 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a4d66980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_sources= new_sources= 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a4d66980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential sources added=[] removed=[] 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a4d66980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_dests= new_dests= 2024-09-13T19:33:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a4d66980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential dests added=[] removed=[] 2024-09-13T19:33:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de18120 con 0x55e38dddf6f0 2024-09-13T19:33:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.631+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de18120 con 0x7f838c0ca060 2024-09-13T19:33:33.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a4d66980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:33:33.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a4d66980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:33.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a4d66980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:33:33.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94435826303264 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e38de21950 con 0x55e38dddf6f0 2024-09-13T19:33:33.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== watch-notify(notify (1) cookie 94435826127984 notify 128849018883 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55e38ddcfe40 con 0x55e38dddf6f0 2024-09-13T19:33:33.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(71 notify.6 [notify cookie 94435826303264 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f8285ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94435826127984 notifier 4496 bl.length()=314 2024-09-13T19:33:33.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f8285ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:33:33.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f8285ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:33.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f8285ffb640 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f81cc003410 con 0x55e38dddf6f0 2024-09-13T19:33:33.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== watch-notify(notify_complete (2) cookie 94435826303264 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e38ddc8f70 con 0x55e38dddf6f0 2024-09-13T19:33:33.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.635+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.639+0000 7f8259fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.639+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94435826130112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de12d20 con 0x55e38dddae20 2024-09-13T19:33:33.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.639+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94435826130112] v30'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.639+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94435826109856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de12d20 con 0x7f838c0ca060 2024-09-13T19:33:33.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.639+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94435826109856] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.639+0000 7f83a4d66980 20 remove_watcher() i=0 2024-09-13T19:33:33.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.639+0000 7f83a4d66980 2 removed watcher, disabling cache 2024-09-13T19:33:33.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.639+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94435826113856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de12d20 con 0x55e38dddae20 2024-09-13T19:33:33.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.643+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94435826113856] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.643+0000 7f83a4d66980 20 remove_watcher() i=1 2024-09-13T19:33:33.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.643+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94435826107344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de12d20 con 0x55e38dde41e0 2024-09-13T19:33:33.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.643+0000 7f83a2876640 1 -- 172.21.15.144:0/2404581068 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94435826107344] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0ee070 con 0x55e38dde41e0 2024-09-13T19:33:33.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.643+0000 7f83a4d66980 20 remove_watcher() i=2 2024-09-13T19:33:33.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.643+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94435826120144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de12d20 con 0x7f838c0ca060 2024-09-13T19:33:33.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.647+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94435826120144] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x7f838c0ca060 2024-09-13T19:33:33.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.647+0000 7f83a4d66980 20 remove_watcher() i=3 2024-09-13T19:33:33.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.647+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94435826124576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddeb5d0 con 0x55e38dddae20 2024-09-13T19:33:33.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.647+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94435826124576] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839400f070 con 0x55e38dddae20 2024-09-13T19:33:33.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.647+0000 7f83a4d66980 20 remove_watcher() i=4 2024-09-13T19:33:33.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.647+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94435826121936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38de12d20 con 0x55e38dddf6f0 2024-09-13T19:33:33.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.651+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94435826121936] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.651+0000 7f83a4d66980 20 remove_watcher() i=5 2024-09-13T19:33:33.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.651+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94435826127984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddec720 con 0x55e38dddf6f0 2024-09-13T19:33:33.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.651+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94435826127984] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.651+0000 7f83a4d66980 20 remove_watcher() i=6 2024-09-13T19:33:33.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.651+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94435826131936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e38ddeb5d0 con 0x55e38dddf6f0 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a3077640 1 -- 172.21.15.144:0/2404581068 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94435826131936] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839c036020 con 0x55e38dddf6f0 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 20 remove_watcher() i=7 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38dddf6f0 msgr2=0x55e38dde1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38dddf6f0 0x55e38dde1b00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dddae20 msgr2=0x55e38dddd2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dddae20 0x55e38dddd2e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f838c0ca060 msgr2=0x7f838c0aa3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f838c0ca060 0x7f838c0aa3b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e38dde41e0 msgr2=0x55e38dde65f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e38dde41e0 0x55e38dde65f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f826c034650 msgr2=0x7f826c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f826c034650 0x7f826c036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55e38ddad780 tx=0x7f838c0df000 comp rx=0 tx=0).stop 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 msgr2=0x55e38ddcf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/2404581068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddc85a0 0x55e38ddcf900 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f839c04a1e0 tx=0x7f839c049ef0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a2075640 1 -- 172.21.15.144:0/2404581068 reap_dead start 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 shutdown_connections 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 >> 172.21.15.144:0/2404581068 conn(0x55e38ddc4980 msgr2=0x55e38ddc2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 shutdown_connections 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/2404581068 wait complete. 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/36610696 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f827c034650 msgr2=0x7f827c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/36610696 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f827c034650 0x7f827c036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55e38dda89f0 tx=0x7f838c0c9f70 comp rx=0 tx=0).stop 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/36610696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddbba60 msgr2=0x55e38ddbbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/36610696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddbba60 0x55e38ddbbe80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55e38dda1de0 tx=0x7f839c00af40 comp rx=0 tx=0).stop 2024-09-13T19:33:33.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/36610696 shutdown_connections 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/36610696 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f827c034650 0x7f827c036b10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/36610696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38ddbba60 0x55e38ddbbe80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/36610696 >> 172.21.15.144:0/36610696 conn(0x55e38ddb0bb0 msgr2=0x55e38ddb3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/36610696 shutdown_connections 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/36610696 wait complete. 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38ddaa8a0 msgr2=0x55e38ddacc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38ddaa8a0 0x55e38ddacc90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dcaf1d0 msgr2=0x55e38dda7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dcaf1d0 0x55e38dda7e90 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288034650 msgr2=0x7f8288036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288034650 0x7f8288036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83940012f0 tx=0x7f8394006700 comp rx=0 tx=0).stop 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 msgr2=0x55e38dda0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dda0ee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f838c0030b0 tx=0x7f838c018020 comp rx=0 tx=0).stop 2024-09-13T19:33:33.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 shutdown_connections 2024-09-13T19:33:33.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e38dcaf1d0 0x55e38dda7e90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e38ddaa8a0 0x55e38ddacc90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288034650 0x7f8288036b10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 --2- 172.21.15.144:0/4085142569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e38dcae880 0x55e38dda0ee0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 >> 172.21.15.144:0/4085142569 conn(0x55e38dc221d0 msgr2=0x55e38dd943e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 shutdown_connections 2024-09-13T19:33:33.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.655+0000 7f83a4d66980 1 -- 172.21.15.144:0/4085142569 wait complete. 2024-09-13T19:33:33.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:33:33.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:33:33.670 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:33:33.750 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:33.750 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:33.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.747+0000 7f6a093b4980 1 Processor -- start 2024-09-13T19:33:33.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.747+0000 7f6a093b4980 1 -- start start 2024-09-13T19:33:33.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.747+0000 7f6a093b4980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563d38d758f0 0x563d38d77ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.747+0000 7f6a093b4980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d38bfaae0 con 0x563d38d71570 2024-09-13T19:33:33.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.747+0000 7f6a093b4980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x563d38c1ee30 con 0x563d38d758f0 2024-09-13T19:33:33.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.747+0000 7f6a066c3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563d38d758f0 0x563d38d77ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.747+0000 7f6a06ec4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x563d38d71570 0x563d38d71950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44634/0 (socket says 172.21.15.144:44634) 2024-09-13T19:33:33.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.747+0000 7f6a06ec4640 1 -- 172.21.15.144:0/2826274318 learned_addr learned my addr 172.21.15.144:0/2826274318 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:33.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a066c3640 1 -- 172.21.15.144:0/2826274318 >> v1:172.21.15.18:6789/0 conn(0x563d38d71570 legacy=0x563d38d71950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a066c3640 1 -- 172.21.15.144:0/2826274318 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d38d79230 con 0x563d38d758f0 2024-09-13T19:33:33.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a066c3640 1 --2- 172.21.15.144:0/2826274318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d758f0 0x563d38d77ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00a480 tx=0x7f69fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9defedd16e432da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a05ec2640 1 -- 172.21.15.144:0/2826274318 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69fc0b0070 con 0x563d38d758f0 2024-09-13T19:33:33.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a05ec2640 1 -- 172.21.15.144:0/2826274318 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc0ab540 con 0x563d38d758f0 2024-09-13T19:33:33.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a05ec2640 1 -- 172.21.15.144:0/2826274318 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69fc0ab840 con 0x563d38d758f0 2024-09-13T19:33:33.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a093b4980 1 -- 172.21.15.144:0/2826274318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d758f0 msgr2=0x563d38d77ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a093b4980 1 --2- 172.21.15.144:0/2826274318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d758f0 0x563d38d77ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00a480 tx=0x7f69fc01b280 comp rx=0 tx=0).stop 2024-09-13T19:33:33.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a093b4980 1 -- 172.21.15.144:0/2826274318 shutdown_connections 2024-09-13T19:33:33.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a093b4980 1 --2- 172.21.15.144:0/2826274318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d758f0 0x563d38d77ce0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a093b4980 1 -- 172.21.15.144:0/2826274318 >> 172.21.15.144:0/2826274318 conn(0x563d38d6d090 msgr2=0x563d38d6f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a093b4980 1 -- 172.21.15.144:0/2826274318 shutdown_connections 2024-09-13T19:33:33.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.751+0000 7f6a093b4980 1 -- 172.21.15.144:0/2826274318 wait complete. 2024-09-13T19:33:33.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.767+0000 7f6a093b4980 1 Processor -- start 2024-09-13T19:33:33.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.767+0000 7f6a093b4980 1 -- start start 2024-09-13T19:33:33.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.767+0000 7f6a093b4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38ce6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.767+0000 7f6a093b4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563d38c20200 con 0x563d38d71570 2024-09-13T19:33:33.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38ce6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38ce6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57772/0 (socket says 172.21.15.144:57772) 2024-09-13T19:33:33.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 -- 172.21.15.144:0/327979069 learned_addr learned my addr 172.21.15.144:0/327979069 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 -- 172.21.15.144:0/327979069 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d38ce71d0 con 0x563d38d71570 2024-09-13T19:33:33.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/327979069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38ce6c00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f69f80017b0 tx=0x7f69f8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c715b5f1a875b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f68f4e09640 1 -- 172.21.15.144:0/327979069 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8016070 con 0x563d38d71570 2024-09-13T19:33:33.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f68f4e09640 1 -- 172.21.15.144:0/327979069 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8004530 con 0x563d38d71570 2024-09-13T19:33:33.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f68f4e09640 1 -- 172.21.15.144:0/327979069 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8004870 con 0x563d38d71570 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 -- 172.21.15.144:0/327979069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 msgr2=0x563d38ce6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 --2- 172.21.15.144:0/327979069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38ce6c00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f69f80017b0 tx=0x7f69f8001c70 comp rx=0 tx=0).stop 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 -- 172.21.15.144:0/327979069 shutdown_connections 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 --2- 172.21.15.144:0/327979069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38ce6c00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 -- 172.21.15.144:0/327979069 >> 172.21.15.144:0/327979069 conn(0x563d38d6d090 msgr2=0x563d38e585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 -- 172.21.15.144:0/327979069 shutdown_connections 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 -- 172.21.15.144:0/327979069 wait complete. 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 Processor -- start 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 -- start start 2024-09-13T19:33:33.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38e67000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a093b4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563d38d78d30 con 0x563d38d71570 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38e67000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38e67000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57780/0 (socket says 172.21.15.144:57780) 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 -- 172.21.15.144:0/3374427174 learned_addr learned my addr 172.21.15.144:0/3374427174 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.771+0000 7f6a06ec4640 1 -- 172.21.15.144:0/3374427174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d38e67540 con 0x563d38d71570 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38e67000 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f69f8014040 tx=0x7f69f8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f68f3606640 1 -- 172.21.15.144:0/3374427174 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8020070 con 0x563d38d71570 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d38e677d0 con 0x563d38d71570 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f68f3606640 1 -- 172.21.15.144:0/3374427174 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8011400 con 0x563d38d71570 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f68f3606640 1 -- 172.21.15.144:0/3374427174 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8016040 con 0x563d38d71570 2024-09-13T19:33:33.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d38e6a4b0 con 0x563d38d71570 2024-09-13T19:33:33.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f68f3606640 1 -- 172.21.15.144:0/3374427174 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69f8023070 con 0x563d38d71570 2024-09-13T19:33:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f68f3606640 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ec034650 0x7f68ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f68f3606640 1 -- 172.21.15.144:0/3374427174 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69f8048fe0 con 0x563d38d71570 2024-09-13T19:33:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a066c3640 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ec034650 0x7f68ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38d758f0 0x563d38e6e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38e6e640 con 0x563d38d758f0 2024-09-13T19:33:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a076c5640 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38d758f0 0x563d38e6e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a066c3640 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ec034650 0x7f68ec036b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0ad000 tx=0x7f69fc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a076c5640 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38d758f0 0x563d38e6e100 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a076c5640 1 -- 172.21.15.144:0/3374427174 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a000083f0 con 0x563d38d758f0 2024-09-13T19:33:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38e6b6b0 con 0x563d38d758f0 2024-09-13T19:33:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a076c5640 1 -- 172.21.15.144:0/3374427174 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a000083f0 con 0x563d38d758f0 2024-09-13T19:33:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38e70960 0x563d38e72d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38e73440 con 0x563d38e70960 2024-09-13T19:33:33.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.775+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38e70960 0x563d38e72d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38e70960 0x563d38e72d50 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a06ec4640 1 -- 172.21.15.144:0/3374427174 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69f802c070 con 0x563d38e70960 2024-09-13T19:33:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38e6f7d0 con 0x563d38d758f0 2024-09-13T19:33:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a076c5640 1 -- 172.21.15.144:0/3374427174 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a000083f0 con 0x563d38d758f0 2024-09-13T19:33:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38e6fcb0 con 0x563d38d758f0 2024-09-13T19:33:33.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a076c5640 1 -- 172.21.15.144:0/3374427174 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a000083f0 con 0x563d38d758f0 2024-09-13T19:33:33.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a093b4980 1 Processor -- start 2024-09-13T19:33:33.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a093b4980 1 -- start start 2024-09-13T19:33:33.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a093b4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e81b20 0x563d38e81f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a093b4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563d38c79800 con 0x563d38e81b20 2024-09-13T19:33:33.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a076c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e81b20 0x563d38e81f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a076c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e81b20 0x563d38e81f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57792/0 (socket says 172.21.15.144:57792) 2024-09-13T19:33:33.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a076c5640 1 -- 172.21.15.144:0/1593930117 learned_addr learned my addr 172.21.15.144:0/1593930117 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.779+0000 7f6a076c5640 1 -- 172.21.15.144:0/1593930117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d38e82480 con 0x563d38e81b20 2024-09-13T19:33:33.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a076c5640 1 --2- 172.21.15.144:0/1593930117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e81b20 0x563d38e81f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x563d38e67d40 tx=0x7f6a0000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f68f0e01640 1 -- 172.21.15.144:0/1593930117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a00007d70 con 0x563d38e81b20 2024-09-13T19:33:33.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f68f0e01640 1 -- 172.21.15.144:0/1593930117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0001e020 con 0x563d38e81b20 2024-09-13T19:33:33.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a093b4980 1 -- 172.21.15.144:0/1593930117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d38e82710 con 0x563d38e81b20 2024-09-13T19:33:33.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f68f0e01640 1 -- 172.21.15.144:0/1593930117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a00019590 con 0x563d38e81b20 2024-09-13T19:33:33.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a093b4980 1 -- 172.21.15.144:0/1593930117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d38e85390 con 0x563d38e81b20 2024-09-13T19:33:33.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f68f0e01640 1 -- 172.21.15.144:0/1593930117 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a00016040 con 0x563d38e81b20 2024-09-13T19:33:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f68f0e01640 1 --2- 172.21.15.144:0/1593930117 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68e00346a0 0x7f68e0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f68f0e01640 1 -- 172.21.15.144:0/1593930117 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6a0001f030 con 0x563d38e81b20 2024-09-13T19:33:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/1593930117 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68e00346a0 0x7f68e0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a093b4980 1 Processor -- start 2024-09-13T19:33:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a093b4980 1 -- start start 2024-09-13T19:33:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/1593930117 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68e00346a0 0x7f68e0036b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69f8001cb0 tx=0x7f69f80249a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a093b4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e8e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a093b4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563d38ce7550 con 0x563d38e8e570 2024-09-13T19:33:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a076c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e8e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a076c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e8e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57800/0 (socket says 172.21.15.144:57800) 2024-09-13T19:33:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a076c5640 1 -- 172.21.15.144:0/72321890 learned_addr learned my addr 172.21.15.144:0/72321890 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a076c5640 1 -- 172.21.15.144:0/72321890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d38e8ef40 con 0x563d38e8e570 2024-09-13T19:33:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.783+0000 7f6a076c5640 1 --2- 172.21.15.144:0/72321890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e8e970 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6a0004a290 tx=0x7f6a000234d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414620e5411bfabf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f68ea7fc640 1 -- 172.21.15.144:0/72321890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0001d040 con 0x563d38e8e570 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f68ea7fc640 1 -- 172.21.15.144:0/72321890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a00019dd0 con 0x563d38e8e570 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f68ea7fc640 1 -- 172.21.15.144:0/72321890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a00015550 con 0x563d38e8e570 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- 172.21.15.144:0/72321890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 msgr2=0x563d38e8e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 --2- 172.21.15.144:0/72321890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e8e970 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6a0004a290 tx=0x7f6a000234d0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- 172.21.15.144:0/72321890 shutdown_connections 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 --2- 172.21.15.144:0/72321890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e8e970 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- 172.21.15.144:0/72321890 >> 172.21.15.144:0/72321890 conn(0x563d38e8a990 msgr2=0x563d38e88a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- 172.21.15.144:0/72321890 shutdown_connections 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- 172.21.15.144:0/72321890 wait complete. 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 Processor -- start 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- start start 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e95920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563d38e8f520 con 0x563d38e8e570 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a076c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e95920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a076c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e95920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57804/0 (socket says 172.21.15.144:57804) 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 learned_addr learned my addr 172.21.15.144:0/894919233 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d38e95e60 con 0x563d38e8e570 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a076c5640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e95920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6a0004a320 tx=0x7f6a0004a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f68e8ff9640 1 -- 172.21.15.144:0/894919233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0001d030 con 0x563d38e8e570 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d38e960f0 con 0x563d38e8e570 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f68e8ff9640 1 -- 172.21.15.144:0/894919233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a00015740 con 0x563d38e8e570 2024-09-13T19:33:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d38e98dd0 con 0x563d38e8e570 2024-09-13T19:33:33.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.787+0000 7f68e8ff9640 1 -- 172.21.15.144:0/894919233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a000158f0 con 0x563d38e8e570 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f68e8ff9640 1 -- 172.21.15.144:0/894919233 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a00035070 con 0x563d38e8e570 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f68e8ff9640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68d0034650 0x7f68d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f68e8ff9640 1 -- 172.21.15.144:0/894919233 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6a00038b10 con 0x563d38e8e570 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68d0034650 0x7f68d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38ea0d60 0x563d38ea3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea3970 con 0x563d38ea0d60 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a066c3640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38ea0d60 0x563d38ea3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68d0034650 0x7f68d0036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69f80477e0 tx=0x7f69f803a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a066c3640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38ea0d60 0x563d38ea3220 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 realm 2024-09-13T19:33:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea3da0 con 0x563d38ea0d60 2024-09-13T19:33:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea4670 con 0x563d38ea0d60 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea4a10 con 0x563d38ea0d60 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38ea5770 0x563d38ea7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea8170 con 0x563d38ea5770 2024-09-13T19:33:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.791+0000 7f6a076c5640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38ea5770 0x563d38ea7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a076c5640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38ea5770 0x563d38ea7b60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a093b4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a093b4980 20 searching for the correct realm 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563d38eaa0c0 0x563d38eac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563d38eaa0c0 0x563d38eac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563d38eaa0c0 0x563d38eac4f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a06ec4640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69f8025070 0x7f69f8026970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x7f69f8025070 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a066c3640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69f8025070 0x7f69f8026970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a066c3640 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69f8025070 0x7f69f8026970 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea0d60 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea0d60 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.795+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x7f69f8025070 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea0d60 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea0d60 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x7f69f8025070 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.799+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea0d60 2024-09-13T19:33:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea0d60 2024-09-13T19:33:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x7f69f8025070 2024-09-13T19:33:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.803+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea0d60 2024-09-13T19:33:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x7f69f8025070 2024-09-13T19:33:33.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38eaa0c0 2024-09-13T19:33:33.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea5770 2024-09-13T19:33:33.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.807+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x563d38ea0d60 2024-09-13T19:33:33.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d38eacbc0 con 0x7f69f8025070 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea8b30 con 0x563d38ea0d60 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea8f20 con 0x563d38ea0d60 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea8680 con 0x563d38ea0d60 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 zone default found 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 4 Realm: () 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 zonegroup default 2024-09-13T19:33:33.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ea8680 con 0x563d38ea5770 2024-09-13T19:33:33.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38eaea20 con 0x563d38eaa0c0 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38eaee10 con 0x563d38eaa0c0 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 started sync module instance, tier type = 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.811+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eadec0 con 0x7f69f8025070 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.815+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.815+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94820947911616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eadec0 con 0x7f69f8025070 2024-09-13T19:33:33.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.815+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eaf8d0 con 0x563d38ea0d60 2024-09-13T19:33:33.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.815+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94820947911616] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.815+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.815+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94820947915744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eadec0 con 0x563d38ea0d60 2024-09-13T19:33:33.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.815+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb02e0 con 0x563d38eaa0c0 2024-09-13T19:33:33.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94820947915744] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94820947909136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eade30 con 0x563d38eaa0c0 2024-09-13T19:33:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb0fe0 con 0x7f69f8025070 2024-09-13T19:33:33.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94820947921984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb1690 con 0x7f69f8025070 2024-09-13T19:33:33.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb21b0 con 0x563d38ea0d60 2024-09-13T19:33:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94820947921984] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.819+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94820947909136] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.823+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.823+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94820947920512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb2170 con 0x563d38ea0d60 2024-09-13T19:33:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.823+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb25a0 con 0x563d38ea5770 2024-09-13T19:33:33.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.823+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94820947920512] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.823+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.823+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94820947923168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb2990 con 0x563d38ea5770 2024-09-13T19:33:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.823+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb3350 con 0x563d38ea5770 2024-09-13T19:33:33.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94820947923168] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94820947926144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb3350 con 0x563d38ea5770 2024-09-13T19:33:33.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb3d10 con 0x563d38ea5770 2024-09-13T19:33:33.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94820947926144] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94820947931264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb3d10 con 0x563d38ea5770 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 20 add_watcher() i=0 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 20 add_watcher() i=1 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 20 add_watcher() i=2 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 20 add_watcher() i=3 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 20 add_watcher() i=4 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 20 add_watcher() i=5 2024-09-13T19:33:33.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.827+0000 7f6a093b4980 20 add_watcher() i=6 2024-09-13T19:33:33.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94820947931264] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a093b4980 20 add_watcher() i=7 2024-09-13T19:33:33.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a093b4980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:33.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb7080 con 0x563d38ea0d60 2024-09-13T19:33:33.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94820947946096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb3e80 con 0x563d38ea0d60 2024-09-13T19:33:33.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94820947946096] v30'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f68bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a093b4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:33.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a093b4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:33.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.831+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb6300 con 0x563d38ea0d60 2024-09-13T19:33:33.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.835+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.835+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec0140 con 0x563d38ea5770 2024-09-13T19:33:33.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.835+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'14 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.835+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec0140 con 0x563d38eaa0c0 2024-09-13T19:33:33.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.839+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.839+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec0a10 con 0x563d38ea0d60 2024-09-13T19:33:33.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.839+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'113 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.839+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ebf8e0 con 0x7f69f8025070 2024-09-13T19:33:33.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.839+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.839+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ebf8e0 con 0x563d38eaa0c0 2024-09-13T19:33:33.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.843+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.843+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec19a0 con 0x563d38ea0d60 2024-09-13T19:33:33.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.843+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.843+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec19a0 con 0x563d38ea5770 2024-09-13T19:33:33.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.847+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.847+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec19a0 con 0x7f69f8025070 2024-09-13T19:33:33.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.847+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.847+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec19a0 con 0x563d38eaa0c0 2024-09-13T19:33:33.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.851+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.851+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec19a0 con 0x7f69f8025070 2024-09-13T19:33:33.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.851+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.851+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec19a0 con 0x563d38ea5770 2024-09-13T19:33:33.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.855+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.855+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1a50 con 0x7f69f8025070 2024-09-13T19:33:33.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.855+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.855+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1a50 con 0x563d38ea5770 2024-09-13T19:33:33.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.855+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.859+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1ae0 con 0x563d38ea0d60 2024-09-13T19:33:33.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.859+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'114 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.859+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1ae0 con 0x563d38eaa0c0 2024-09-13T19:33:33.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.859+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.859+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x7f69f8025070 2024-09-13T19:33:33.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.863+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.863+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38eaa0c0 2024-09-13T19:33:33.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.863+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.863+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38ea0d60 2024-09-13T19:33:33.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.867+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.867+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38ea0d60 2024-09-13T19:33:33.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.867+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'115 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.867+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38eaa0c0 2024-09-13T19:33:33.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.871+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.871+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x7f69f8025070 2024-09-13T19:33:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.871+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.871+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38eaa0c0 2024-09-13T19:33:33.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.871+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.871+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38eaa0c0 2024-09-13T19:33:33.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.875+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.875+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38eaa0c0 2024-09-13T19:33:33.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.875+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.875+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38eaa0c0 2024-09-13T19:33:33.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.879+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.879+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38ea5770 2024-09-13T19:33:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.879+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.879+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38eaa0c0 2024-09-13T19:33:33.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.883+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.883+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38ea5770 2024-09-13T19:33:33.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.883+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.883+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38eaa0c0 2024-09-13T19:33:33.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.887+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.887+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x563d38ea5770 2024-09-13T19:33:33.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.887+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.887+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38ec1f90 con 0x7f69f8025070 2024-09-13T19:33:33.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.891+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.891+0000 7f6837fff640 20 reqs_thread_entry: start 2024-09-13T19:33:33.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.891+0000 7f6a093b4980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:33.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.891+0000 7f6a093b4980 20 Filter name: none 2024-09-13T19:33:33.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.891+0000 7f6835ffb640 20 reqs_thread_entry: start 2024-09-13T19:33:33.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.891+0000 7f6a093b4980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:33:33.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.891+0000 7f6a093b4980 20 rados->read ofs=0 len=0 2024-09-13T19:33:33.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.891+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38ebecf0 con 0x563d38ea5770 2024-09-13T19:33:33.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a093b4980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:33:33.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a093b4980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:33:33.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a093b4980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:33.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a093b4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:33.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d38edfa00 con 0x563d38ea5770 2024-09-13T19:33:33.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.897 INFO:teuthology.orchestra.run.smithi144.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:33:33.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f68bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:33.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94820947946096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38e9b200 con 0x563d38ea0d60 2024-09-13T19:33:33.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94820947946096] v30'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.895+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94820947911616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb6a70 con 0x7f69f8025070 2024-09-13T19:33:33.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.899+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94820947911616] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.899+0000 7f6a093b4980 20 remove_watcher() i=0 2024-09-13T19:33:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.899+0000 7f6a093b4980 2 removed watcher, disabling cache 2024-09-13T19:33:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.899+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94820947915744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb6a70 con 0x563d38ea0d60 2024-09-13T19:33:33.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.899+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94820947915744] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.899+0000 7f6a093b4980 20 remove_watcher() i=1 2024-09-13T19:33:33.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.899+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94820947909136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eaf3e0 con 0x563d38eaa0c0 2024-09-13T19:33:33.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.903+0000 7f6a06ec4640 1 -- 172.21.15.144:0/894919233 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94820947909136] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f8038030 con 0x563d38eaa0c0 2024-09-13T19:33:33.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.903+0000 7f6a093b4980 20 remove_watcher() i=2 2024-09-13T19:33:33.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.903+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94820947921984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb6a70 con 0x7f69f8025070 2024-09-13T19:33:33.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.903+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94820947921984] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x7f69f8025070 2024-09-13T19:33:33.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.903+0000 7f6a093b4980 20 remove_watcher() i=3 2024-09-13T19:33:33.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.903+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94820947920512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eada10 con 0x563d38ea0d60 2024-09-13T19:33:33.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.907+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94820947920512] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc0b3040 con 0x563d38ea0d60 2024-09-13T19:33:33.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.907+0000 7f6a093b4980 20 remove_watcher() i=4 2024-09-13T19:33:33.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.907+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94820947923168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eaf3e0 con 0x563d38ea5770 2024-09-13T19:33:33.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.907+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94820947923168] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.907+0000 7f6a093b4980 20 remove_watcher() i=5 2024-09-13T19:33:33.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.907+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94820947926144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb0c40 con 0x563d38ea5770 2024-09-13T19:33:33.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.911+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94820947926144] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.911+0000 7f6a093b4980 20 remove_watcher() i=6 2024-09-13T19:33:33.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.911+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94820947931264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d38eb6a70 con 0x563d38ea5770 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a076c5640 1 -- 172.21.15.144:0/894919233 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94820947931264] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a00042020 con 0x563d38ea5770 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 20 remove_watcher() i=7 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38ea5770 msgr2=0x563d38ea7b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38ea5770 0x563d38ea7b60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38ea0d60 msgr2=0x563d38ea3220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38ea0d60 0x563d38ea3220 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69f8025070 msgr2=0x7f69f8026970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69f8025070 0x7f69f8026970 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563d38eaa0c0 msgr2=0x563d38eac4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563d38eaa0c0 0x563d38eac4f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68d0034650 msgr2=0x7f68d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68d0034650 0x7f68d0036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69f80477e0 tx=0x7f69f803a000 comp rx=0 tx=0).stop 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 msgr2=0x563d38e95920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/894919233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e8e570 0x563d38e95920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6a0004a320 tx=0x7f6a0004a1f0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a066c3640 1 -- 172.21.15.144:0/894919233 reap_dead start 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 shutdown_connections 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 >> 172.21.15.144:0/894919233 conn(0x563d38e8a990 msgr2=0x563d38e88a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 shutdown_connections 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/894919233 wait complete. 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/1593930117 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68e00346a0 msgr2=0x7f68e0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/1593930117 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68e00346a0 0x7f68e0036b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69f8001cb0 tx=0x7f69f80249a0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/1593930117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e81b20 msgr2=0x563d38e81f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/1593930117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e81b20 0x563d38e81f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x563d38e67d40 tx=0x7f6a0000af40 comp rx=0 tx=0).stop 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/1593930117 shutdown_connections 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/1593930117 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68e00346a0 0x7f68e0036b60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/1593930117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38e81b20 0x563d38e81f40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/1593930117 >> 172.21.15.144:0/1593930117 conn(0x563d38e76c70 msgr2=0x563d38e796f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/1593930117 shutdown_connections 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/1593930117 wait complete. 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38e70960 msgr2=0x563d38e72d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38e70960 0x563d38e72d50 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38d758f0 msgr2=0x563d38e6e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38d758f0 0x563d38e6e100 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ec034650 msgr2=0x7f68ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ec034650 0x7f68ec036b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0ad000 tx=0x7f69fc0a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 msgr2=0x563d38e67000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38e67000 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f69f8014040 tx=0x7f69f8001260 comp rx=0 tx=0).stop 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 shutdown_connections 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563d38d758f0 0x563d38e6e100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563d38e70960 0x563d38e72d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ec034650 0x7f68ec036b10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 --2- 172.21.15.144:0/3374427174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d38d71570 0x563d38e67000 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 >> 172.21.15.144:0/3374427174 conn(0x563d38d6d090 msgr2=0x563d38e57120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 shutdown_connections 2024-09-13T19:33:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:33.915+0000 7f6a093b4980 1 -- 172.21.15.144:0/3374427174 wait complete. 2024-09-13T19:33:33.932 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:33:33.933 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T19:33:33.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T19:33:33.933 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-13T19:33:34.015 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:34.015 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:34.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.011+0000 7f69e476e980 1 Processor -- start 2024-09-13T19:33:34.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.011+0000 7f69e476e980 1 -- start start 2024-09-13T19:33:34.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e476e980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f6cadf7c70 0x55f6cadfa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e476e980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f6cac79ae0 con 0x55f6cadf38f0 2024-09-13T19:33:34.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e476e980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55f6cac9de30 con 0x55f6cadf7c70 2024-09-13T19:33:34.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e1a7d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f6cadf7c70 0x55f6cadfa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e227e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55f6cadf38f0 0x55f6cadf3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44636/0 (socket says 172.21.15.144:44636) 2024-09-13T19:33:34.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e227e640 1 -- 172.21.15.144:0/2468474463 learned_addr learned my addr 172.21.15.144:0/2468474463 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:34.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e1a7d640 1 -- 172.21.15.144:0/2468474463 >> v1:172.21.15.18:6789/0 conn(0x55f6cadf38f0 legacy=0x55f6cadf3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e1a7d640 1 -- 172.21.15.144:0/2468474463 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6cadfb5b0 con 0x55f6cadf7c70 2024-09-13T19:33:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e1a7d640 1 --2- 172.21.15.144:0/2468474463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf7c70 0x55f6cadfa060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f69d800a480 tx=0x7f69d801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c239442ff2755bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.015+0000 7f69e127c640 1 -- 172.21.15.144:0/2468474463 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d80b0070 con 0x55f6cadf7c70 2024-09-13T19:33:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e127c640 1 -- 172.21.15.144:0/2468474463 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d80ab540 con 0x55f6cadf7c70 2024-09-13T19:33:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e127c640 1 -- 172.21.15.144:0/2468474463 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d80ab840 con 0x55f6cadf7c70 2024-09-13T19:33:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e476e980 1 -- 172.21.15.144:0/2468474463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf7c70 msgr2=0x55f6cadfa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e476e980 1 --2- 172.21.15.144:0/2468474463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf7c70 0x55f6cadfa060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f69d800a480 tx=0x7f69d801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e476e980 1 -- 172.21.15.144:0/2468474463 shutdown_connections 2024-09-13T19:33:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e476e980 1 --2- 172.21.15.144:0/2468474463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf7c70 0x55f6cadfa060 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e476e980 1 -- 172.21.15.144:0/2468474463 >> 172.21.15.144:0/2468474463 conn(0x55f6cad67240 msgr2=0x55f6cad67650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e476e980 1 -- 172.21.15.144:0/2468474463 shutdown_connections 2024-09-13T19:33:34.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.019+0000 7f69e476e980 1 -- 172.21.15.144:0/2468474463 wait complete. 2024-09-13T19:33:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.031+0000 7f69e476e980 1 Processor -- start 2024-09-13T19:33:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.031+0000 7f69e476e980 1 -- start start 2024-09-13T19:33:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caedec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6cac9f200 con 0x55f6cadf38f0 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e227e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caedec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e227e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caedec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57822/0 (socket says 172.21.15.144:57822) 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e227e640 1 -- 172.21.15.144:0/2315834568 learned_addr learned my addr 172.21.15.144:0/2315834568 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e227e640 1 -- 172.21.15.144:0/2315834568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6caedf210 con 0x55f6cadf38f0 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e227e640 1 --2- 172.21.15.144:0/2315834568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caedec40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0015f0 tx=0x7f69dc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cf83e5667d5ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f68d0608640 1 -- 172.21.15.144:0/2315834568 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69dc004530 con 0x55f6cadf38f0 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f68d0608640 1 -- 172.21.15.144:0/2315834568 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc0046f0 con 0x55f6cadf38f0 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f68d0608640 1 -- 172.21.15.144:0/2315834568 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69dc004a90 con 0x55f6cadf38f0 2024-09-13T19:33:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 -- 172.21.15.144:0/2315834568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 msgr2=0x55f6caedec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 --2- 172.21.15.144:0/2315834568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caedec40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0015f0 tx=0x7f69dc001ab0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 -- 172.21.15.144:0/2315834568 shutdown_connections 2024-09-13T19:33:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 --2- 172.21.15.144:0/2315834568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caedec40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 -- 172.21.15.144:0/2315834568 >> 172.21.15.144:0/2315834568 conn(0x55f6cad67240 msgr2=0x55f6caeda870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 -- 172.21.15.144:0/2315834568 shutdown_connections 2024-09-13T19:33:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 -- 172.21.15.144:0/2315834568 wait complete. 2024-09-13T19:33:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 Processor -- start 2024-09-13T19:33:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 -- start start 2024-09-13T19:33:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caee5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e476e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6cadfb0b0 con 0x55f6cadf38f0 2024-09-13T19:33:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e227e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caee5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e227e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caee5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57826/0 (socket says 172.21.15.144:57826) 2024-09-13T19:33:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.035+0000 7f69e227e640 1 -- 172.21.15.144:0/2894770098 learned_addr learned my addr 172.21.15.144:0/2894770098 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e227e640 1 -- 172.21.15.144:0/2894770098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6caee64f0 con 0x55f6cadf38f0 2024-09-13T19:33:34.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e227e640 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caee5fb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55f6caedfe20 tx=0x7f69dc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f68cee05640 1 -- 172.21.15.144:0/2894770098 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69dc013760 con 0x55f6cadf38f0 2024-09-13T19:33:34.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6caee6780 con 0x55f6cadf38f0 2024-09-13T19:33:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f68cee05640 1 -- 172.21.15.144:0/2894770098 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc013900 con 0x55f6cadf38f0 2024-09-13T19:33:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f68cee05640 1 -- 172.21.15.144:0/2894770098 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69dc013be0 con 0x55f6cadf38f0 2024-09-13T19:33:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6caee9460 con 0x55f6cadf38f0 2024-09-13T19:33:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f68cee05640 1 -- 172.21.15.144:0/2894770098 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69dc010070 con 0x55f6cadf38f0 2024-09-13T19:33:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f68cee05640 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68c8034650 0x7f68c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f68cee05640 1 -- 172.21.15.144:0/2894770098 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69dc018070 con 0x55f6cadf38f0 2024-09-13T19:33:34.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e1a7d640 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68c8034650 0x7f68c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6cadf7c70 0x55f6caeecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caeed5f0 con 0x55f6cadf7c70 2024-09-13T19:33:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e2a7f640 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6cadf7c70 0x55f6caeecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e1a7d640 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68c8034650 0x7f68c8036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69d80ad000 tx=0x7f69d80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e2a7f640 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6cadf7c70 0x55f6caeecf80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e2a7f640 1 -- 172.21.15.144:0/2894770098 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d40083f0 con 0x55f6cadf7c70 2024-09-13T19:33:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caeea680 con 0x55f6cadf7c70 2024-09-13T19:33:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.039+0000 7f69e2a7f640 1 -- 172.21.15.144:0/2894770098 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69d40083f0 con 0x55f6cadf7c70 2024-09-13T19:33:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caeef940 0x55f6caef1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caef2400 con 0x55f6caeef940 2024-09-13T19:33:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e227e640 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caeef940 0x55f6caef1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e227e640 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caeef940 0x55f6caef1d30 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e227e640 1 -- 172.21.15.144:0/2894770098 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caeef940 2024-09-13T19:33:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caeee7e0 con 0x55f6cadf7c70 2024-09-13T19:33:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e2a7f640 1 -- 172.21.15.144:0/2894770098 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69d40083f0 con 0x55f6cadf7c70 2024-09-13T19:33:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caeeecc0 con 0x55f6cadf7c70 2024-09-13T19:33:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e2a7f640 1 -- 172.21.15.144:0/2894770098 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69d40083f0 con 0x55f6cadf7c70 2024-09-13T19:33:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e476e980 1 Processor -- start 2024-09-13T19:33:34.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e476e980 1 -- start start 2024-09-13T19:33:34.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e476e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf00ae0 0x55f6caf00f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e476e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6cacf8800 con 0x55f6caf00ae0 2024-09-13T19:33:34.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e2a7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf00ae0 0x55f6caf00f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e2a7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf00ae0 0x55f6caf00f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57838/0 (socket says 172.21.15.144:57838) 2024-09-13T19:33:34.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.043+0000 7f69e2a7f640 1 -- 172.21.15.144:0/3200078685 learned_addr learned my addr 172.21.15.144:0/3200078685 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e2a7f640 1 -- 172.21.15.144:0/3200078685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6caf01440 con 0x55f6caf00ae0 2024-09-13T19:33:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e2a7f640 1 --2- 172.21.15.144:0/3200078685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf00ae0 0x55f6caf00f00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55f6caeed9f0 tx=0x7f69d400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f68c7fff640 1 -- 172.21.15.144:0/3200078685 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4007e00 con 0x55f6caf00ae0 2024-09-13T19:33:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e476e980 1 -- 172.21.15.144:0/3200078685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6caf016d0 con 0x55f6caf00ae0 2024-09-13T19:33:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f68c7fff640 1 -- 172.21.15.144:0/3200078685 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d401e020 con 0x55f6caf00ae0 2024-09-13T19:33:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f68c7fff640 1 -- 172.21.15.144:0/3200078685 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4019590 con 0x55f6caf00ae0 2024-09-13T19:33:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e476e980 1 -- 172.21.15.144:0/3200078685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6caf04350 con 0x55f6caf00ae0 2024-09-13T19:33:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f68c7fff640 1 -- 172.21.15.144:0/3200078685 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69d4016040 con 0x55f6caf00ae0 2024-09-13T19:33:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f68c7fff640 1 --2- 172.21.15.144:0/3200078685 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68bc034650 0x7f68bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f68c7fff640 1 -- 172.21.15.144:0/3200078685 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69d401f030 con 0x55f6caf00ae0 2024-09-13T19:33:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e227e640 1 --2- 172.21.15.144:0/3200078685 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68bc034650 0x7f68bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e476e980 1 Processor -- start 2024-09-13T19:33:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e476e980 1 -- start start 2024-09-13T19:33:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e227e640 1 --2- 172.21.15.144:0/3200078685 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68bc034650 0x7f68bc036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55f6caeeda90 tx=0x7f69dc0124a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e476e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf0d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e476e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6caedf590 con 0x55f6caf0d5e0 2024-09-13T19:33:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e2a7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf0d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e2a7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf0d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57854/0 (socket says 172.21.15.144:57854) 2024-09-13T19:33:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e2a7f640 1 -- 172.21.15.144:0/3783048820 learned_addr learned my addr 172.21.15.144:0/3783048820 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e2a7f640 1 -- 172.21.15.144:0/3783048820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6caf0df90 con 0x55f6caf0d5e0 2024-09-13T19:33:34.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.047+0000 7f69e2a7f640 1 --2- 172.21.15.144:0/3783048820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf0d9c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f69d404a360 tx=0x7f69d4017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ddc8400795eca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f68c5ffb640 1 -- 172.21.15.144:0/3783048820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d401d070 con 0x55f6caf0d5e0 2024-09-13T19:33:34.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f68c5ffb640 1 -- 172.21.15.144:0/3783048820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40153e0 con 0x55f6caf0d5e0 2024-09-13T19:33:34.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f68c5ffb640 1 -- 172.21.15.144:0/3783048820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d402b350 con 0x55f6caf0d5e0 2024-09-13T19:33:34.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- 172.21.15.144:0/3783048820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 msgr2=0x55f6caf0d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 --2- 172.21.15.144:0/3783048820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf0d9c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f69d404a360 tx=0x7f69d4017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- 172.21.15.144:0/3783048820 shutdown_connections 2024-09-13T19:33:34.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 --2- 172.21.15.144:0/3783048820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf0d9c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- 172.21.15.144:0/3783048820 >> 172.21.15.144:0/3783048820 conn(0x55f6caf099c0 msgr2=0x55f6caf07ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- 172.21.15.144:0/3783048820 shutdown_connections 2024-09-13T19:33:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- 172.21.15.144:0/3783048820 wait complete. 2024-09-13T19:33:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 Processor -- start 2024-09-13T19:33:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- start start 2024-09-13T19:33:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf14930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6caf0e5b0 con 0x55f6caf0d5e0 2024-09-13T19:33:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e2a7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf14930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e2a7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf14930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57856/0 (socket says 172.21.15.144:57856) 2024-09-13T19:33:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 learned_addr learned my addr 172.21.15.144:0/914731624 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6caf14e70 con 0x55f6caf0d5e0 2024-09-13T19:33:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e2a7f640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf14930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f69d4017fe0 tx=0x7f69d404a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f68b3fff640 1 -- 172.21.15.144:0/914731624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4015590 con 0x55f6caf0d5e0 2024-09-13T19:33:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6caf15100 con 0x55f6caf0d5e0 2024-09-13T19:33:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f68b3fff640 1 -- 172.21.15.144:0/914731624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d4022a60 con 0x55f6caf0d5e0 2024-09-13T19:33:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f68b3fff640 1 -- 172.21.15.144:0/914731624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4022d40 con 0x55f6caf0d5e0 2024-09-13T19:33:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.051+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6caf15510 con 0x55f6caf0d5e0 2024-09-13T19:33:34.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f68b3fff640 1 -- 172.21.15.144:0/914731624 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69d4052020 con 0x55f6caf0d5e0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f68b3fff640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ac034650 0x7f68ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f68b3fff640 1 -- 172.21.15.144:0/914731624 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69d4047070 con 0x55f6caf0d5e0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6caf1fdf0 0x55f6caf22290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e227e640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ac034650 0x7f68ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf229e0 con 0x55f6caf1fdf0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e1a7d640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6caf1fdf0 0x55f6caf22290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e227e640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ac034650 0x7f68ac036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f69dc04afd0 tx=0x7f69dc036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e1a7d640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6caf1fdf0 0x55f6caf22290 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 realm 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf22e10 con 0x55f6caf1fdf0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf236e0 con 0x55f6caf1fdf0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf23a80 con 0x55f6caf1fdf0 2024-09-13T19:33:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caf247e0 0x55f6caf26bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf271e0 con 0x55f6caf247e0 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.055+0000 7f69e2a7f640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caf247e0 0x55f6caf26bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e2a7f640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caf247e0 0x55f6caf26bd0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e476e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e476e980 20 searching for the correct realm 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6caf290c0 0x55f6caf2b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e227e640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6caf290c0 0x55f6caf2b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e227e640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6caf290c0 0x55f6caf2b530 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e227e640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69dc0287f0 0x7f69dc048790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x7f69dc0287f0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e1a7d640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69dc0287f0 0x7f69dc048790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e1a7d640 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69dc0287f0 0x7f69dc048790 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.059+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x7f69dc0287f0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x7f69dc0287f0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.063+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x7f69dc0287f0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.067+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x7f69dc0287f0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf290c0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf247e0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2bc00 con 0x7f69dc0287f0 2024-09-13T19:33:34.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf27b30 con 0x55f6caf1fdf0 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf27f20 con 0x55f6caf1fdf0 2024-09-13T19:33:34.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.071+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf27f20 con 0x55f6caf1fdf0 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 zone default found 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 4 Realm: () 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 zonegroup default 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf28340 con 0x55f6caf247e0 2024-09-13T19:33:34.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2da60 con 0x55f6caf290c0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2dea0 con 0x55f6caf290c0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 started sync module instance, tier type = 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2cf00 con 0x7f69dc0287f0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94518455227424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2cf00 con 0x7f69dc0287f0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.075+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2e9d0 con 0x55f6caf1fdf0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.079+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94518455227424] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.079+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.079+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94518455231680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2cf00 con 0x55f6caf1fdf0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.079+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2f3e0 con 0x55f6caf290c0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.079+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.079+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94518455231680] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.079+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94518455224912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2f780 con 0x55f6caf290c0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.079+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf30140 con 0x7f69dc0287f0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.083+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.083+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94518455237776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf30560 con 0x7f69dc0287f0 2024-09-13T19:33:34.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.083+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf30f80 con 0x55f6caf1fdf0 2024-09-13T19:33:34.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.083+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94518455224912] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.083+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94518455237776] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.083+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.083+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94518455241328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf300b0 con 0x55f6caf1fdf0 2024-09-13T19:33:34.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.083+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf31820 con 0x55f6caf247e0 2024-09-13T19:33:34.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.087+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94518455241328] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.087+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.087+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94518455234352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf300b0 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.087+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf31cd0 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.087+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.087+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94518455244832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf32130 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.087+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf32c30 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.087+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94518455234352] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94518455244832] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94518455248672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf31c40 con 0x55f6caf247e0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e476e980 20 add_watcher() i=0 2024-09-13T19:33:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e476e980 20 add_watcher() i=1 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e476e980 20 add_watcher() i=2 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e476e980 20 add_watcher() i=3 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e476e980 20 add_watcher() i=4 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e476e980 20 add_watcher() i=5 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.091+0000 7f69e476e980 20 add_watcher() i=6 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94518455248672] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 20 add_watcher() i=7 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf35c20 con 0x55f6caf1fdf0 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94518455243552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf330a0 con 0x55f6caf1fdf0 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94518455243552] v30'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f6898fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 5 note: GC not initialized 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f68137fe640 20 reqs_thread_entry: start 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 20 Filter name: none 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f68117fa640 20 reqs_thread_entry: start 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf590e0 con 0x55f6caf247e0 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:33:34.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.095+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf58c30 con 0x7f69dc0287f0 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf5cd70 con 0x55f6caf290c0 2024-09-13T19:33:34.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf5e1b0 con 0x55f6caf247e0 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf5e5b0 con 0x7f69dc0287f0 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.099+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf641a0 con 0x7f69dc0287f0 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94518455434416 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf61650 con 0x55f6caf247e0 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== watch-notify(notify (1) cookie 94518455244832 notify 128849018884 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55f6caf15100 con 0x55f6caf247e0 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f68c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94518455244832 notifier 4510 bl.length()=338 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f68c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:33:34.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f68c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:34.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(68 notify.6 [notify cookie 94518455434416 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f68c5ffb640 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f68a8003eb0 con 0x55f6caf247e0 2024-09-13T19:33:34.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.103+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== watch-notify(notify_complete (2) cookie 94518455434416 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f6caf14e70 con 0x55f6caf247e0 2024-09-13T19:33:34.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f6898fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94518455243552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf56f10 con 0x55f6caf1fdf0 2024-09-13T19:33:34.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94518455243552] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94518455227424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf56f10 con 0x7f69dc0287f0 2024-09-13T19:33:34.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94518455227424] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f69e476e980 20 remove_watcher() i=0 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f69e476e980 2 removed watcher, disabling cache 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.107+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94518455231680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf56f10 con 0x55f6caf1fdf0 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.111+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94518455231680] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.111+0000 7f69e476e980 20 remove_watcher() i=1 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.111+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94518455224912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2e4c0 con 0x55f6caf290c0 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.111+0000 7f69e227e640 1 -- 172.21.15.144:0/914731624 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94518455224912] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69dc01b030 con 0x55f6caf290c0 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.111+0000 7f69e476e980 20 remove_watcher() i=2 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.111+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94518455237776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf56f10 con 0x7f69dc0287f0 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.115+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94518455237776] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x7f69dc0287f0 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.115+0000 7f69e476e980 20 remove_watcher() i=3 2024-09-13T19:33:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.115+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94518455241328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2ca50 con 0x55f6caf1fdf0 2024-09-13T19:33:34.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.115+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94518455241328] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d80b3040 con 0x55f6caf1fdf0 2024-09-13T19:33:34.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.115+0000 7f69e476e980 20 remove_watcher() i=4 2024-09-13T19:33:34.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.115+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94518455234352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2e4c0 con 0x55f6caf247e0 2024-09-13T19:33:34.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.119+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94518455234352] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.119+0000 7f69e476e980 20 remove_watcher() i=5 2024-09-13T19:33:34.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.119+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94518455244832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf2fc90 con 0x55f6caf247e0 2024-09-13T19:33:34.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.119+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94518455244832] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.119+0000 7f69e476e980 20 remove_watcher() i=6 2024-09-13T19:33:34.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.119+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94518455248672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f6caf56f10 con 0x55f6caf247e0 2024-09-13T19:33:34.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e2a7f640 1 -- 172.21.15.144:0/914731624 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94518455248672] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d4036030 con 0x55f6caf247e0 2024-09-13T19:33:34.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 20 remove_watcher() i=7 2024-09-13T19:33:34.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caf247e0 msgr2=0x55f6caf26bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caf247e0 0x55f6caf26bd0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6caf1fdf0 msgr2=0x55f6caf22290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6caf1fdf0 0x55f6caf22290 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69dc0287f0 msgr2=0x7f69dc048790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f69dc0287f0 0x7f69dc048790 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6caf290c0 msgr2=0x55f6caf2b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f6caf290c0 0x55f6caf2b530 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ac034650 msgr2=0x7f68ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68ac034650 0x7f68ac036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f69dc04afd0 tx=0x7f69dc036000 comp rx=0 tx=0).stop 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e1a7d640 1 -- 172.21.15.144:0/914731624 reap_dead start 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 msgr2=0x55f6caf14930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf14930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f69d4017fe0 tx=0x7f69d404a2f0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 shutdown_connections 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/914731624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf0d5e0 0x55f6caf14930 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 >> 172.21.15.144:0/914731624 conn(0x55f6caf099c0 msgr2=0x55f6caf07a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 shutdown_connections 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/914731624 wait complete. 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/3200078685 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68bc034650 msgr2=0x7f68bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/3200078685 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68bc034650 0x7f68bc036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55f6caeeda90 tx=0x7f69dc0124a0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/3200078685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf00ae0 msgr2=0x55f6caf00f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/3200078685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf00ae0 0x55f6caf00f00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55f6caeed9f0 tx=0x7f69d400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/3200078685 shutdown_connections 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/3200078685 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68bc034650 0x7f68bc036b10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/3200078685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6caf00ae0 0x55f6caf00f00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/3200078685 >> 172.21.15.144:0/3200078685 conn(0x55f6caef5c30 msgr2=0x55f6caef86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/3200078685 shutdown_connections 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/3200078685 wait complete. 2024-09-13T19:33:34.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caeef940 msgr2=0x55f6caef1d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caeef940 0x55f6caef1d30 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6cadf7c70 msgr2=0x55f6caeecf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6cadf7c70 0x55f6caeecf80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68c8034650 msgr2=0x7f68c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68c8034650 0x7f68c8036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69d80ad000 tx=0x7f69d80a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 msgr2=0x55f6caee5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caee5fb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55f6caedfe20 tx=0x7f69dc000f50 comp rx=0 tx=0).stop 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 shutdown_connections 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f6cadf7c70 0x55f6caeecf80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f6caeef940 0x55f6caef1d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f68c8034650 0x7f68c8036b10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 --2- 172.21.15.144:0/2894770098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6cadf38f0 0x55f6caee5fb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 >> 172.21.15.144:0/2894770098 conn(0x55f6cad67240 msgr2=0x55f6caed93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 shutdown_connections 2024-09-13T19:33:34.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.123+0000 7f69e476e980 1 -- 172.21.15.144:0/2894770098 wait complete. 2024-09-13T19:33:34.139 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1'] 2024-09-13T19:33:34.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1'] 2024-09-13T19:33:34.139 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:34.216 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:34.216 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d2943980 1 Processor -- start 2024-09-13T19:33:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d2943980 1 -- start start 2024-09-13T19:33:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d2943980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55897419e230 0x55897422c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d2943980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589740b1ae0 con 0x55897422c880 2024-09-13T19:33:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d2943980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5589740d5e30 con 0x55897419e230 2024-09-13T19:33:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d0453640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55897419e230 0x55897422c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2cfc52640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55897422c880 0x55897422ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44650/0 (socket says 172.21.15.144:44650) 2024-09-13T19:33:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d0453640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55897419e230 0x55897422c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57872/0 (socket says 172.21.15.144:57872) 2024-09-13T19:33:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2cfc52640 1 -- 172.21.15.144:0/3482365990 learned_addr learned my addr 172.21.15.144:0/3482365990 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d0453640 1 -- 172.21.15.144:0/3482365990 >> v1:172.21.15.18:6789/0 conn(0x55897422c880 legacy=0x55897422ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.215+0000 7fe2d0453640 1 -- 172.21.15.144:0/3482365990 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897419e7c0 con 0x55897419e230 2024-09-13T19:33:34.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2d0453640 1 --2- 172.21.15.144:0/3482365990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897422c340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000a420 tx=0x7fe2c001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93f72ad8408b9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2cf451640 1 -- 172.21.15.144:0/3482365990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c00af070 con 0x55897419e230 2024-09-13T19:33:34.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2cf451640 1 -- 172.21.15.144:0/3482365990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c00aa530 con 0x55897419e230 2024-09-13T19:33:34.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2cf451640 1 -- 172.21.15.144:0/3482365990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c00aa850 con 0x55897419e230 2024-09-13T19:33:34.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2d2943980 1 -- 172.21.15.144:0/3482365990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 msgr2=0x55897422c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2d2943980 1 --2- 172.21.15.144:0/3482365990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897422c340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000a420 tx=0x7fe2c001afd0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2d2943980 1 -- 172.21.15.144:0/3482365990 shutdown_connections 2024-09-13T19:33:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2d2943980 1 --2- 172.21.15.144:0/3482365990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897422c340 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2d2943980 1 -- 172.21.15.144:0/3482365990 >> 172.21.15.144:0/3482365990 conn(0x558974224030 msgr2=0x558974226450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2d2943980 1 -- 172.21.15.144:0/3482365990 shutdown_connections 2024-09-13T19:33:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.219+0000 7fe2d2943980 1 -- 172.21.15.144:0/3482365990 wait complete. 2024-09-13T19:33:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 Processor -- start 2024-09-13T19:33:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 -- start start 2024-09-13T19:33:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x558974229aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589740d7200 con 0x55897419e230 2024-09-13T19:33:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d0453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x558974229aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d0453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x558974229aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57876/0 (socket says 172.21.15.144:57876) 2024-09-13T19:33:34.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d0453640 1 -- 172.21.15.144:0/2188983259 learned_addr learned my addr 172.21.15.144:0/2188983259 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d0453640 1 -- 172.21.15.144:0/2188983259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897422a070 con 0x55897419e230 2024-09-13T19:33:34.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d0453640 1 --2- 172.21.15.144:0/2188983259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x558974229aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00ad040 tx=0x7fe2c00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f58e57ccd54549 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe1be60c640 1 -- 172.21.15.144:0/2188983259 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c00af050 con 0x55897419e230 2024-09-13T19:33:34.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe1be60c640 1 -- 172.21.15.144:0/2188983259 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c00b0040 con 0x55897419e230 2024-09-13T19:33:34.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe1be60c640 1 -- 172.21.15.144:0/2188983259 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c00aaca0 con 0x55897419e230 2024-09-13T19:33:34.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 -- 172.21.15.144:0/2188983259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 msgr2=0x558974229aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 --2- 172.21.15.144:0/2188983259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x558974229aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00ad040 tx=0x7fe2c00033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 -- 172.21.15.144:0/2188983259 shutdown_connections 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 --2- 172.21.15.144:0/2188983259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x558974229aa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 -- 172.21.15.144:0/2188983259 >> 172.21.15.144:0/2188983259 conn(0x558974224030 msgr2=0x558974310720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.235+0000 7fe2d2943980 1 -- 172.21.15.144:0/2188983259 shutdown_connections 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 -- 172.21.15.144:0/2188983259 wait complete. 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 Processor -- start 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 -- start start 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897431df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558974230ea0 con 0x55897419e230 2024-09-13T19:33:34.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d0453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897431df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d0453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897431df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57886/0 (socket says 172.21.15.144:57886) 2024-09-13T19:33:34.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d0453640 1 -- 172.21.15.144:0/252875569 learned_addr learned my addr 172.21.15.144:0/252875569 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d0453640 1 -- 172.21.15.144:0/252875569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897431e490 con 0x55897419e230 2024-09-13T19:33:34.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d0453640 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897431df50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0019680 tx=0x7fe2c0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe1bce09640 1 -- 172.21.15.144:0/252875569 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c00c5070 con 0x55897419e230 2024-09-13T19:33:34.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55897431e720 con 0x55897419e230 2024-09-13T19:33:34.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe1bce09640 1 -- 172.21.15.144:0/252875569 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c00b6d60 con 0x55897419e230 2024-09-13T19:33:34.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe1bce09640 1 -- 172.21.15.144:0/252875569 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c00c15f0 con 0x55897419e230 2024-09-13T19:33:34.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558974321400 con 0x55897419e230 2024-09-13T19:33:34.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe1bce09640 1 -- 172.21.15.144:0/252875569 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2c00c8070 con 0x55897419e230 2024-09-13T19:33:34.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe1bce09640 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1b8034650 0x7fe1b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe1bce09640 1 -- 172.21.15.144:0/252875569 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe2c00bb070 con 0x55897419e230 2024-09-13T19:33:34.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2cfc52640 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1b8034650 0x7fe1b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897422c880 0x558974324ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.239+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974325550 con 0x55897422c880 2024-09-13T19:33:34.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0c54640 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897422c880 0x558974324ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2cfc52640 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1b8034650 0x7fe1b8036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8000f70 tx=0x7fe2b80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0c54640 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897422c880 0x558974324ee0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0c54640 1 -- 172.21.15.144:0/252875569 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c80083f0 con 0x55897422c880 2024-09-13T19:33:34.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974322620 con 0x55897422c880 2024-09-13T19:33:34.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0c54640 1 -- 172.21.15.144:0/252875569 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2c80083f0 con 0x55897422c880 2024-09-13T19:33:34.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589743278d0 0x558974329cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897432a390 con 0x5589743278d0 2024-09-13T19:33:34.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0453640 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589743278d0 0x558974329cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0453640 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589743278d0 0x558974329cc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0453640 1 -- 172.21.15.144:0/252875569 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2c00d1070 con 0x5589743278d0 2024-09-13T19:33:34.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974326770 con 0x55897422c880 2024-09-13T19:33:34.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0c54640 1 -- 172.21.15.144:0/252875569 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2c80083f0 con 0x55897422c880 2024-09-13T19:33:34.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974326c50 con 0x55897422c880 2024-09-13T19:33:34.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d0c54640 1 -- 172.21.15.144:0/252875569 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2c80083f0 con 0x55897422c880 2024-09-13T19:33:34.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.243+0000 7fe2d2943980 1 Processor -- start 2024-09-13T19:33:34.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d2943980 1 -- start start 2024-09-13T19:33:34.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d2943980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974338ad0 0x558974338ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d2943980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558974130800 con 0x558974338ad0 2024-09-13T19:33:34.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d0c54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974338ad0 0x558974338ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d0c54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974338ad0 0x558974338ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57900/0 (socket says 172.21.15.144:57900) 2024-09-13T19:33:34.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d0c54640 1 -- 172.21.15.144:0/453168119 learned_addr learned my addr 172.21.15.144:0/453168119 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d0c54640 1 -- 172.21.15.144:0/453168119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558974339430 con 0x558974338ad0 2024-09-13T19:33:34.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d0c54640 1 --2- 172.21.15.144:0/453168119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974338ad0 0x558974338ef0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55897431ee50 tx=0x7fe2c800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe1b5ffb640 1 -- 172.21.15.144:0/453168119 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8007d70 con 0x558974338ad0 2024-09-13T19:33:34.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe1b5ffb640 1 -- 172.21.15.144:0/453168119 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c801e020 con 0x558974338ad0 2024-09-13T19:33:34.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d2943980 1 -- 172.21.15.144:0/453168119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589743396c0 con 0x558974338ad0 2024-09-13T19:33:34.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe1b5ffb640 1 -- 172.21.15.144:0/453168119 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8019590 con 0x558974338ad0 2024-09-13T19:33:34.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d2943980 1 -- 172.21.15.144:0/453168119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897433c340 con 0x558974338ad0 2024-09-13T19:33:34.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe1b5ffb640 1 -- 172.21.15.144:0/453168119 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2c8016040 con 0x558974338ad0 2024-09-13T19:33:34.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe1b5ffb640 1 --2- 172.21.15.144:0/453168119 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a8034650 0x7fe1a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe1b5ffb640 1 -- 172.21.15.144:0/453168119 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe2c801f030 con 0x558974338ad0 2024-09-13T19:33:34.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d0453640 1 --2- 172.21.15.144:0/453168119 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a8034650 0x7fe1a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d2943980 1 Processor -- start 2024-09-13T19:33:34.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d2943980 1 -- start start 2024-09-13T19:33:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.247+0000 7fe2d0453640 1 --2- 172.21.15.144:0/453168119 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a8034650 0x7fe1a8036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x558974325a20 tx=0x7fe2c00e5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x5589743459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589742281d0 con 0x558974345610 2024-09-13T19:33:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d0c54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x5589743459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d0c54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x5589743459f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57912/0 (socket says 172.21.15.144:57912) 2024-09-13T19:33:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d0c54640 1 -- 172.21.15.144:0/1642962996 learned_addr learned my addr 172.21.15.144:0/1642962996 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d0c54640 1 -- 172.21.15.144:0/1642962996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558974345fc0 con 0x558974345610 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d0c54640 1 --2- 172.21.15.144:0/1642962996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x5589743459f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe2c804a2a0 tx=0x7fe2c803bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e0dbde51837151 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe1af7fe640 1 -- 172.21.15.144:0/1642962996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c801d070 con 0x558974345610 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe1af7fe640 1 -- 172.21.15.144:0/1642962996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c803f030 con 0x558974345610 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe1af7fe640 1 -- 172.21.15.144:0/1642962996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8043650 con 0x558974345610 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 -- 172.21.15.144:0/1642962996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 msgr2=0x5589743459f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 --2- 172.21.15.144:0/1642962996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x5589743459f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe2c804a2a0 tx=0x7fe2c803bcc0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 -- 172.21.15.144:0/1642962996 shutdown_connections 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 --2- 172.21.15.144:0/1642962996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x5589743459f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 -- 172.21.15.144:0/1642962996 >> 172.21.15.144:0/1642962996 conn(0x5589743419f0 msgr2=0x55897433faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 -- 172.21.15.144:0/1642962996 shutdown_connections 2024-09-13T19:33:34.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 -- 172.21.15.144:0/1642962996 wait complete. 2024-09-13T19:33:34.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 Processor -- start 2024-09-13T19:33:34.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 -- start start 2024-09-13T19:33:34.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x55897434c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d2943980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589743465e0 con 0x558974345610 2024-09-13T19:33:34.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d0c54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x55897434c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d0c54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x55897434c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57928/0 (socket says 172.21.15.144:57928) 2024-09-13T19:33:34.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.251+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 learned_addr learned my addr 172.21.15.144:0/180241585 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897434cee0 con 0x558974345610 2024-09-13T19:33:34.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d0c54640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x55897434c9a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8016010 tx=0x7fe2c804a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe1adffb640 1 -- 172.21.15.144:0/180241585 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c802b7d0 con 0x558974345610 2024-09-13T19:33:34.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55897434d170 con 0x558974345610 2024-09-13T19:33:34.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe1adffb640 1 -- 172.21.15.144:0/180241585 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c802b970 con 0x558974345610 2024-09-13T19:33:34.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe1adffb640 1 -- 172.21.15.144:0/180241585 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c802bd10 con 0x558974345610 2024-09-13T19:33:34.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897434d580 con 0x558974345610 2024-09-13T19:33:34.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe1adffb640 1 -- 172.21.15.144:0/180241585 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2c8052020 con 0x558974345610 2024-09-13T19:33:34.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe1adffb640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a0034650 0x7fe1a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe1adffb640 1 -- 172.21.15.144:0/180241585 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe2c8055aa0 con 0x558974345610 2024-09-13T19:33:34.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d0453640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a0034650 0x7fe1a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558974357e40 0x55897435a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897435aa50 con 0x558974357e40 2024-09-13T19:33:34.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2cfc52640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558974357e40 0x55897435a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d0453640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a0034650 0x7fe1a0036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00c8fd0 tx=0x7fe2c00e0000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2cfc52640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558974357e40 0x55897435a300 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b800e5a0 con 0x558974357e40 2024-09-13T19:33:34.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 20 realm 2024-09-13T19:33:34.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974357290 con 0x558974357e40 2024-09-13T19:33:34.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b800e5a0 con 0x558974357e40 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.255+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897435b550 con 0x558974357e40 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b800e5a0 con 0x558974357e40 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897435be20 con 0x558974357e40 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2b800e5a0 con 0x558974357e40 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897435c840 0x55897435ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897435f320 con 0x55897435c840 2024-09-13T19:33:34.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d0c54640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897435c840 0x55897435ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d0c54640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897435c840 0x55897435ec30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:34.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 20 searching for the correct realm 2024-09-13T19:33:34.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x558974361270 0x5589743636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d0453640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x558974361270 0x5589743636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d0453640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x558974361270 0x5589743636a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d0453640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2c00f7040 0x7fe2c00c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x7fe2c00f7040 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2cfc52640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2c00f7040 0x7fe2c00c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2cfc52640 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2c00f7040 0x7fe2c00c17e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b800e5a0 con 0x7fe2c00f7040 2024-09-13T19:33:34.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.259+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974357e40 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe2b800e5a0 con 0x558974357e40 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974357e40 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x7fe2c00f7040 2024-09-13T19:33:34.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974357e40 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.263+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974357e40 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x7fe2c00f7040 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974357e40 2024-09-13T19:33:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974357e40 2024-09-13T19:33:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.267+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x7fe2c00f7040 2024-09-13T19:33:34.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974357e40 2024-09-13T19:33:34.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x7fe2c00f7040 2024-09-13T19:33:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974361270 2024-09-13T19:33:34.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x55897435c840 2024-09-13T19:33:34.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.271+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x558974357e40 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558974363d70 con 0x7fe2c00f7040 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897435fce0 con 0x558974357e40 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897435f920 con 0x558974357e40 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897435f930 con 0x558974357e40 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 zone default found 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 4 Realm: () 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:34.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:34.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 zonegroup default 2024-09-13T19:33:34.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589743641f0 con 0x55897435c840 2024-09-13T19:33:34.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5589743664a0 con 0x558974361270 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974366840 con 0x558974361270 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 started sync module instance, tier type = 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.275+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589743658e0 con 0x7fe2c00f7040 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.279+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.279+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94048848600544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589743658e0 con 0x7fe2c00f7040 2024-09-13T19:33:34.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.279+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974367260 con 0x558974357e40 2024-09-13T19:33:34.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.279+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94048848600544] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.279+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.279+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94048848604496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5589743658e0 con 0x558974357e40 2024-09-13T19:33:34.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.279+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974367c70 con 0x558974361270 2024-09-13T19:33:34.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.283+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94048848604496] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.283+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.283+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94048848598064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974365850 con 0x558974361270 2024-09-13T19:33:34.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.283+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974368970 con 0x7fe2c00f7040 2024-09-13T19:33:34.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.283+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.283+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94048848610768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974369040 con 0x7fe2c00f7040 2024-09-13T19:33:34.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.283+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974369b60 con 0x558974357e40 2024-09-13T19:33:34.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.283+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94048848598064] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.287+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94048848610768] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.287+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.287+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94048848614960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974369b20 con 0x558974357e40 2024-09-13T19:33:34.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.287+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974369f50 con 0x55897435c840 2024-09-13T19:33:34.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.287+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94048848614960] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.287+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.287+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94048848609296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974369f50 con 0x55897435c840 2024-09-13T19:33:34.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.287+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897436a870 con 0x55897435c840 2024-09-13T19:33:34.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94048848618304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897436ad20 con 0x55897435c840 2024-09-13T19:33:34.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897436b820 con 0x55897435c840 2024-09-13T19:33:34.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94048848609296] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94048848618304] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94048848622352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897436a830 con 0x55897435c840 2024-09-13T19:33:34.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 20 add_watcher() i=0 2024-09-13T19:33:34.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 20 add_watcher() i=1 2024-09-13T19:33:34.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 20 add_watcher() i=2 2024-09-13T19:33:34.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 20 add_watcher() i=3 2024-09-13T19:33:34.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 20 add_watcher() i=4 2024-09-13T19:33:34.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 20 add_watcher() i=5 2024-09-13T19:33:34.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.291+0000 7fe2d2943980 20 add_watcher() i=6 2024-09-13T19:33:34.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94048848622352] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 20 add_watcher() i=7 2024-09-13T19:33:34.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:34.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897436e810 con 0x558974357e40 2024-09-13T19:33:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94048848611984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897436bc90 con 0x558974357e40 2024-09-13T19:33:34.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94048848611984] v30'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe1867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 5 note: GC not initialized 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe1857e2640 20 reqs_thread_entry: start 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 20 Filter name: none 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe0f6ffd640 20 reqs_thread_entry: start 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.295+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974391d80 con 0x558974357e40 2024-09-13T19:33:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974393e60 con 0x7fe2c00f7040 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558974395670 con 0x558974361270 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:34.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:33:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974399f50 con 0x55897435c840 2024-09-13T19:33:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.299+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897439fe70 con 0x558974361270 2024-09-13T19:33:34.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:34.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:34.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1, ofs0, ns] 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94048848796976 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897439a380 con 0x7fe2c00f7040 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== watch-notify(notify (1) cookie 94048848600544 notify 128849018900 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5589740b1ae0 con 0x7fe2c00f7040 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe1af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018900 cookie 94048848600544 notifier 4517 bl.length()=752 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe1af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe1af7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe1af7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(67 notify.0 [notify cookie 94048848796976 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe1af7fe640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fe194003eb0 con 0x7fe2c00f7040 2024-09-13T19:33:34.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== watch-notify(notify_complete (2) cookie 94048848796976 notify 128849018900 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe2b802dab0 con 0x7fe2c00f7040 2024-09-13T19:33:34.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_sources= new_sources= 2024-09-13T19:33:34.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential sources added=[] removed=[] 2024-09-13T19:33:34.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_dests= new_dests= 2024-09-13T19:33:34.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential dests added=[] removed=[] 2024-09-13T19:33:34.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.303+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897439e670 con 0x7fe2c00f7040 2024-09-13T19:33:34.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.307+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.307+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897439f680 con 0x7fe2c00f7040 2024-09-13T19:33:34.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.307+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.307+0000 7fe2d2943980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:33:34.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.307+0000 7fe2d2943980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:34.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.307+0000 7fe2d2943980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:33:34.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.307+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94048848796944 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55897439eb20 con 0x55897435c840 2024-09-13T19:33:34.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== watch-notify(notify (1) cookie 94048848618304 notify 128849018885 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55897434cee0 con 0x55897435c840 2024-09-13T19:33:34.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe1af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94048848618304 notifier 4517 bl.length()=314 2024-09-13T19:33:34.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe1af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:33:34.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe1af7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:34.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.6 [notify cookie 94048848796944 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe1af7fe640 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fe194003eb0 con 0x55897435c840 2024-09-13T19:33:34.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== watch-notify(notify_complete (2) cookie 94048848796944 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558974345fc0 con 0x55897435c840 2024-09-13T19:33:34.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe1867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94048848611984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897438fbb0 con 0x558974357e40 2024-09-13T19:33:34.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94048848611984] v30'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.311+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94048848600544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897438fbb0 con 0x7fe2c00f7040 2024-09-13T19:33:34.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.315+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94048848600544] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.315+0000 7fe2d2943980 20 remove_watcher() i=0 2024-09-13T19:33:34.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.315+0000 7fe2d2943980 2 removed watcher, disabling cache 2024-09-13T19:33:34.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.315+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94048848604496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974365de0 con 0x558974357e40 2024-09-13T19:33:34.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.315+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94048848604496] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.315+0000 7fe2d2943980 20 remove_watcher() i=1 2024-09-13T19:33:34.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.315+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94048848598064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897438fbb0 con 0x558974361270 2024-09-13T19:33:34.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.319+0000 7fe2d0453640 1 -- 172.21.15.144:0/180241585 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94048848598064] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c00d1070 con 0x558974361270 2024-09-13T19:33:34.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.319+0000 7fe2d2943980 20 remove_watcher() i=2 2024-09-13T19:33:34.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.319+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94048848610768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974366d50 con 0x7fe2c00f7040 2024-09-13T19:33:34.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.319+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94048848610768] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x7fe2c00f7040 2024-09-13T19:33:34.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.319+0000 7fe2d2943980 20 remove_watcher() i=3 2024-09-13T19:33:34.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.319+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94048848614960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974365de0 con 0x558974357e40 2024-09-13T19:33:34.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.323+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94048848614960] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b8029040 con 0x558974357e40 2024-09-13T19:33:34.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.323+0000 7fe2d2943980 20 remove_watcher() i=4 2024-09-13T19:33:34.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.323+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94048848609296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974365430 con 0x55897435c840 2024-09-13T19:33:34.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.323+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94048848609296] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.323+0000 7fe2d2943980 20 remove_watcher() i=5 2024-09-13T19:33:34.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.323+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94048848618304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55897438fbb0 con 0x55897435c840 2024-09-13T19:33:34.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94048848618304] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 20 remove_watcher() i=6 2024-09-13T19:33:34.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94048848622352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558974365de0 con 0x55897435c840 2024-09-13T19:33:34.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d0c54640 1 -- 172.21.15.144:0/180241585 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94048848622352] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c8036030 con 0x55897435c840 2024-09-13T19:33:34.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 20 remove_watcher() i=7 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897435c840 msgr2=0x55897435ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55897435c840 0x55897435ec30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558974357e40 msgr2=0x55897435a300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x558974357e40 0x55897435a300 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2c00f7040 msgr2=0x7fe2c00c17e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe2c00f7040 0x7fe2c00c17e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x558974361270 msgr2=0x5589743636a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x558974361270 0x5589743636a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a0034650 msgr2=0x7fe1a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a0034650 0x7fe1a0036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00c8fd0 tx=0x7fe2c00e0000 comp rx=0 tx=0).stop 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 msgr2=0x55897434c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/180241585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974345610 0x55897434c9a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8016010 tx=0x7fe2c804a230 comp rx=0 tx=0).stop 2024-09-13T19:33:34.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 reap_dead start 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2cfc52640 1 -- 172.21.15.144:0/180241585 reap_dead start 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 shutdown_connections 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 >> 172.21.15.144:0/180241585 conn(0x5589743419f0 msgr2=0x55897433fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 shutdown_connections 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/180241585 wait complete. 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/453168119 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a8034650 msgr2=0x7fe1a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/453168119 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a8034650 0x7fe1a8036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x558974325a20 tx=0x7fe2c00e5040 comp rx=0 tx=0).stop 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/453168119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974338ad0 msgr2=0x558974338ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/453168119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974338ad0 0x558974338ef0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55897431ee50 tx=0x7fe2c800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/453168119 shutdown_connections 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/453168119 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1a8034650 0x7fe1a8036b10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/453168119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558974338ad0 0x558974338ef0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/453168119 >> 172.21.15.144:0/453168119 conn(0x55897432dc20 msgr2=0x5589743306a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/453168119 shutdown_connections 2024-09-13T19:33:34.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/453168119 wait complete. 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589743278d0 msgr2=0x558974329cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589743278d0 0x558974329cc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897422c880 msgr2=0x558974324ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897422c880 0x558974324ee0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1b8034650 msgr2=0x7fe1b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1b8034650 0x7fe1b8036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8000f70 tx=0x7fe2b80012c0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 msgr2=0x55897431df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.327+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897431df50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0019680 tx=0x7fe2c0019810 comp rx=0 tx=0).stop 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.331+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 shutdown_connections 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.331+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55897422c880 0x558974324ee0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.331+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589743278d0 0x558974329cc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.331+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe1b8034650 0x7fe1b8036b10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.331+0000 7fe2d2943980 1 --2- 172.21.15.144:0/252875569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55897419e230 0x55897431df50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.331+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 >> 172.21.15.144:0/252875569 conn(0x558974224030 msgr2=0x558974310360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.331+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 shutdown_connections 2024-09-13T19:33:34.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.331+0000 7fe2d2943980 1 -- 172.21.15.144:0/252875569 wait complete. 2024-09-13T19:33:34.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:33:34.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:33:34.344 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:33:34.420 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:34.421 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:34.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fe31b980 1 Processor -- start 2024-09-13T19:33:34.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fe31b980 1 -- start start 2024-09-13T19:33:34.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fe31b980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563958e718e0 0x563958e71cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fe31b980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563958cf7ae0 con 0x563958e72230 2024-09-13T19:33:34.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fe31b980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x563958d1be30 con 0x563958e718e0 2024-09-13T19:33:34.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fbe2b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563958e718e0 0x563958e71cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fb62a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x563958e72230 0x563958e76c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44664/0 (socket says 172.21.15.144:44664) 2024-09-13T19:33:34.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fb62a640 1 -- 172.21.15.144:0/1499556680 learned_addr learned my addr 172.21.15.144:0/1499556680 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:34.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fbe2b640 1 -- 172.21.15.144:0/1499556680 >> v1:172.21.15.18:6789/0 conn(0x563958e72230 legacy=0x563958e76c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.419+0000 7f86fbe2b640 1 -- 172.21.15.144:0/1499556680 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563958e794b0 con 0x563958e718e0 2024-09-13T19:33:34.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/1499556680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958e71cc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00a420 tx=0x7f86ec01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1862f885b1f082f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fae29640 1 -- 172.21.15.144:0/1499556680 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec0af070 con 0x563958e718e0 2024-09-13T19:33:34.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fae29640 1 -- 172.21.15.144:0/1499556680 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec0aa530 con 0x563958e718e0 2024-09-13T19:33:34.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fae29640 1 -- 172.21.15.144:0/1499556680 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec0aa850 con 0x563958e718e0 2024-09-13T19:33:34.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fe31b980 1 -- 172.21.15.144:0/1499556680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 msgr2=0x563958e71cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1499556680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958e71cc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00a420 tx=0x7f86ec01afd0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fe31b980 1 -- 172.21.15.144:0/1499556680 shutdown_connections 2024-09-13T19:33:34.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1499556680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958e71cc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fe31b980 1 -- 172.21.15.144:0/1499556680 >> 172.21.15.144:0/1499556680 conn(0x563958de5230 msgr2=0x563958de5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fe31b980 1 -- 172.21.15.144:0/1499556680 shutdown_connections 2024-09-13T19:33:34.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.423+0000 7f86fe31b980 1 -- 172.21.15.144:0/1499556680 wait complete. 2024-09-13T19:33:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fe31b980 1 Processor -- start 2024-09-13T19:33:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fe31b980 1 -- start start 2024-09-13T19:33:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fe31b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f5cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fe31b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563958d1d200 con 0x563958e718e0 2024-09-13T19:33:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fbe2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f5cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fbe2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f5cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57938/0 (socket says 172.21.15.144:57938) 2024-09-13T19:33:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fbe2b640 1 -- 172.21.15.144:0/2307038192 learned_addr learned my addr 172.21.15.144:0/2307038192 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fbe2b640 1 -- 172.21.15.144:0/2307038192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563958f5d220 con 0x563958e718e0 2024-09-13T19:33:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/2307038192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f5cc50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0ad040 tx=0x7f86ec0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f85e23d1f8af21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f85e9e0b640 1 -- 172.21.15.144:0/2307038192 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec0af050 con 0x563958e718e0 2024-09-13T19:33:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.439+0000 7f85e9e0b640 1 -- 172.21.15.144:0/2307038192 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec0b0040 con 0x563958e718e0 2024-09-13T19:33:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f85e9e0b640 1 -- 172.21.15.144:0/2307038192 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec0aaca0 con 0x563958e718e0 2024-09-13T19:33:34.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- 172.21.15.144:0/2307038192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 msgr2=0x563958f5cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 --2- 172.21.15.144:0/2307038192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f5cc50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0ad040 tx=0x7f86ec0033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- 172.21.15.144:0/2307038192 shutdown_connections 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 --2- 172.21.15.144:0/2307038192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f5cc50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- 172.21.15.144:0/2307038192 >> 172.21.15.144:0/2307038192 conn(0x563958de5230 msgr2=0x563958f58880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- 172.21.15.144:0/2307038192 shutdown_connections 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- 172.21.15.144:0/2307038192 wait complete. 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 Processor -- start 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- start start 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f63ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563958e78ef0 con 0x563958e718e0 2024-09-13T19:33:34.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fbe2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f63ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fbe2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f63ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57950/0 (socket says 172.21.15.144:57950) 2024-09-13T19:33:34.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fbe2b640 1 -- 172.21.15.144:0/1822730436 learned_addr learned my addr 172.21.15.144:0/1822730436 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fbe2b640 1 -- 172.21.15.144:0/1822730436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563958f64400 con 0x563958e718e0 2024-09-13T19:33:34.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f63ec0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f86ec019680 tx=0x7f86ec019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f85e3fff640 1 -- 172.21.15.144:0/1822730436 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec0c5070 con 0x563958e718e0 2024-09-13T19:33:34.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f85e3fff640 1 -- 172.21.15.144:0/1822730436 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec0b6d60 con 0x563958e718e0 2024-09-13T19:33:34.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f85e3fff640 1 -- 172.21.15.144:0/1822730436 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec0c15f0 con 0x563958e718e0 2024-09-13T19:33:34.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563958f64690 con 0x563958e718e0 2024-09-13T19:33:34.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.443+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563958f67370 con 0x563958e718e0 2024-09-13T19:33:34.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f85e3fff640 1 -- 172.21.15.144:0/1822730436 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86ec0c8070 con 0x563958e718e0 2024-09-13T19:33:34.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f85e3fff640 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85e40346f0 0x7f85e4036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f85e3fff640 1 -- 172.21.15.144:0/1822730436 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86ec0bb070 con 0x563958e718e0 2024-09-13T19:33:34.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fb62a640 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85e40346f0 0x7f85e4036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958e72230 0x563958f6ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958f6b4c0 con 0x563958e72230 2024-09-13T19:33:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fc62c640 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958e72230 0x563958f6ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fb62a640 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85e40346f0 0x7f85e4036bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000f70 tx=0x7f86f00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fc62c640 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958e72230 0x563958f6ae50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fc62c640 1 -- 172.21.15.144:0/1822730436 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86f40083f0 con 0x563958e72230 2024-09-13T19:33:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958f68570 con 0x563958e72230 2024-09-13T19:33:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fc62c640 1 -- 172.21.15.144:0/1822730436 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f86f40083f0 con 0x563958e72230 2024-09-13T19:33:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958f6d840 0x563958f6fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958f70300 con 0x563958f6d840 2024-09-13T19:33:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958f6d840 0x563958f6fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.447+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958f6d840 0x563958f6fc30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fbe2b640 1 -- 172.21.15.144:0/1822730436 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958f6d840 2024-09-13T19:33:34.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958f6c6e0 con 0x563958e72230 2024-09-13T19:33:34.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fc62c640 1 -- 172.21.15.144:0/1822730436 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f86f40083f0 con 0x563958e72230 2024-09-13T19:33:34.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958f6cbc0 con 0x563958e72230 2024-09-13T19:33:34.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fc62c640 1 -- 172.21.15.144:0/1822730436 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f86f40083f0 con 0x563958e72230 2024-09-13T19:33:34.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fe31b980 1 Processor -- start 2024-09-13T19:33:34.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fe31b980 1 -- start start 2024-09-13T19:33:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fe31b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f7ea40 0x563958f7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fe31b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563958d76800 con 0x563958f7ea40 2024-09-13T19:33:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fc62c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f7ea40 0x563958f7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fc62c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f7ea40 0x563958f7ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57966/0 (socket says 172.21.15.144:57966) 2024-09-13T19:33:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fc62c640 1 -- 172.21.15.144:0/4173183842 learned_addr learned my addr 172.21.15.144:0/4173183842 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fc62c640 1 -- 172.21.15.144:0/4173183842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563958f7f3a0 con 0x563958f7ea40 2024-09-13T19:33:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.451+0000 7f86fc62c640 1 --2- 172.21.15.144:0/4173183842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f7ea40 0x563958f7ee60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x563958f64dc0 tx=0x7f86f400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f85e17fa640 1 -- 172.21.15.144:0/4173183842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f4007d70 con 0x563958f7ea40 2024-09-13T19:33:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f85e17fa640 1 -- 172.21.15.144:0/4173183842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f401e020 con 0x563958f7ea40 2024-09-13T19:33:34.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f85e17fa640 1 -- 172.21.15.144:0/4173183842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f4019550 con 0x563958f7ea40 2024-09-13T19:33:34.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fe31b980 1 -- 172.21.15.144:0/4173183842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563958f7f630 con 0x563958f7ea40 2024-09-13T19:33:34.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fe31b980 1 -- 172.21.15.144:0/4173183842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563958f822b0 con 0x563958f7ea40 2024-09-13T19:33:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f85e17fa640 1 -- 172.21.15.144:0/4173183842 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86f4016040 con 0x563958f7ea40 2024-09-13T19:33:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f85e17fa640 1 --2- 172.21.15.144:0/4173183842 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85d4034650 0x7f85d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f85e17fa640 1 -- 172.21.15.144:0/4173183842 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86f401f030 con 0x563958f7ea40 2024-09-13T19:33:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/4173183842 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85d4034650 0x7f85d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fe31b980 1 Processor -- start 2024-09-13T19:33:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fe31b980 1 -- start start 2024-09-13T19:33:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fe31b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f8b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fe31b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563958f5d4e0 con 0x563958f8b530 2024-09-13T19:33:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/4173183842 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85d4034650 0x7f85d4036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x563958f6b9b0 tx=0x7f86ec0e5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fc62c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f8b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fc62c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f8b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57982/0 (socket says 172.21.15.144:57982) 2024-09-13T19:33:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fc62c640 1 -- 172.21.15.144:0/2532821255 learned_addr learned my addr 172.21.15.144:0/2532821255 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fc62c640 1 -- 172.21.15.144:0/2532821255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563958f8bf00 con 0x563958f8b530 2024-09-13T19:33:34.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.455+0000 7f86fc62c640 1 --2- 172.21.15.144:0/2532821255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f8b930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f86f404a550 tx=0x7f86f4017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4efa26f4d667775 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f85daffd640 1 -- 172.21.15.144:0/2532821255 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f401d040 con 0x563958f8b530 2024-09-13T19:33:34.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f85daffd640 1 -- 172.21.15.144:0/2532821255 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f4015e30 con 0x563958f8b530 2024-09-13T19:33:34.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f85daffd640 1 -- 172.21.15.144:0/2532821255 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f4023580 con 0x563958f8b530 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- 172.21.15.144:0/2532821255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 msgr2=0x563958f8b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 --2- 172.21.15.144:0/2532821255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f8b930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f86f404a550 tx=0x7f86f4017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- 172.21.15.144:0/2532821255 shutdown_connections 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 --2- 172.21.15.144:0/2532821255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f8b930 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- 172.21.15.144:0/2532821255 >> 172.21.15.144:0/2532821255 conn(0x563958f87870 msgr2=0x563958f859c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- 172.21.15.144:0/2532821255 shutdown_connections 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- 172.21.15.144:0/2532821255 wait complete. 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 Processor -- start 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- start start 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f92850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563958f8c480 con 0x563958f8b530 2024-09-13T19:33:34.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fc62c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f92850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fc62c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f92850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:57998/0 (socket says 172.21.15.144:57998) 2024-09-13T19:33:34.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 learned_addr learned my addr 172.21.15.144:0/338156004 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563958f92d90 con 0x563958f8b530 2024-09-13T19:33:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fc62c640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f92850 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f86f4022a30 tx=0x7f86f404a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f85d97fa640 1 -- 172.21.15.144:0/338156004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f401d040 con 0x563958f8b530 2024-09-13T19:33:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563958f93020 con 0x563958f8b530 2024-09-13T19:33:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563958f95d00 con 0x563958f8b530 2024-09-13T19:33:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f85d97fa640 1 -- 172.21.15.144:0/338156004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f402b350 con 0x563958f8b530 2024-09-13T19:33:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.459+0000 7f85d97fa640 1 -- 172.21.15.144:0/338156004 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f4015770 con 0x563958f8b530 2024-09-13T19:33:34.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f85d97fa640 1 -- 172.21.15.144:0/338156004 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f86f4015910 con 0x563958f8b530 2024-09-13T19:33:34.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f85d97fa640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85c4034600 0x7f85c4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f85d97fa640 1 -- 172.21.15.144:0/338156004 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f86f4035070 con 0x563958f8b530 2024-09-13T19:33:34.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85c4034600 0x7f85c4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958f9dd20 0x563958fa01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fa0930 con 0x563958f9dd20 2024-09-13T19:33:34.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fb62a640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958f9dd20 0x563958fa01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85c4034600 0x7f85c4036ac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0c8b10 tx=0x7f86ec0df000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fb62a640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958f9dd20 0x563958fa01e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86f000e5a0 con 0x563958f9dd20 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 realm 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958f9d170 con 0x563958f9dd20 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86f000e5a0 con 0x563958f9dd20 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fa1430 con 0x563958f9dd20 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86f000e5a0 con 0x563958f9dd20 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fa1d00 con 0x563958f9dd20 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f86f000e5a0 con 0x563958f9dd20 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958fa2720 0x563958fa4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fa5250 con 0x563958fa2720 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fc62c640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958fa2720 0x563958fa4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.463+0000 7f86fc62c640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958fa2720 0x563958fa4b10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fe31b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fe31b980 20 searching for the correct realm 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563958fa71a0 0x563958fa95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563958fa71a0 0x563958fa95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563958fa71a0 0x563958fa95b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fbe2b640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f86ec0ca070 0x7f86ec0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x7f86ec0ca070 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fb62a640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f86ec0ca070 0x7f86ec0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fb62a640 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f86ec0ca070 0x7f86ec0c0720 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f000e5a0 con 0x7f86ec0ca070 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958f9dd20 2024-09-13T19:33:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f86f000e5a0 con 0x563958f9dd20 2024-09-13T19:33:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958f9dd20 2024-09-13T19:33:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.467+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x7f86ec0ca070 2024-09-13T19:33:34.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958f9dd20 2024-09-13T19:33:34.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958f9dd20 2024-09-13T19:33:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x7f86ec0ca070 2024-09-13T19:33:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.471+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958f9dd20 2024-09-13T19:33:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958f9dd20 2024-09-13T19:33:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x7f86ec0ca070 2024-09-13T19:33:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958f9dd20 2024-09-13T19:33:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.475+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x7f86ec0ca070 2024-09-13T19:33:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa71a0 2024-09-13T19:33:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958fa2720 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x563958f9dd20 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563958fa9c80 con 0x7f86ec0ca070 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fa5c10 con 0x563958f9dd20 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fa64b0 con 0x563958f9dd20 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.479+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fa5850 con 0x563958f9dd20 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:34.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 zone default found 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 4 Realm: () 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 zonegroup default 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958faa100 con 0x563958fa2720 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fabe80 con 0x563958fa71a0 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fac310 con 0x563958fa71a0 2024-09-13T19:33:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 started sync module instance, tier type = 2024-09-13T19:33:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fab320 con 0x7f86ec0ca070 2024-09-13T19:33:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804305950784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fab320 con 0x7f86ec0ca070 2024-09-13T19:33:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.483+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958face10 con 0x563958f9dd20 2024-09-13T19:33:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.487+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804305950784] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.487+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.487+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804305955040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fab320 con 0x563958f9dd20 2024-09-13T19:33:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.487+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fad820 con 0x563958fa71a0 2024-09-13T19:33:34.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.487+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804305955040] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.487+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.487+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804305948272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fab290 con 0x563958fa71a0 2024-09-13T19:33:34.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.487+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fae520 con 0x7f86ec0ca070 2024-09-13T19:33:34.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.491+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.491+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804305961344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958faec30 con 0x7f86ec0ca070 2024-09-13T19:33:34.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.491+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958faf750 con 0x563958f9dd20 2024-09-13T19:33:34.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.491+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804305948272] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.491+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804305961344] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.491+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.491+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804305965600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958faf710 con 0x563958f9dd20 2024-09-13T19:33:34.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.491+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fafb40 con 0x563958fa2720 2024-09-13T19:33:34.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.495+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804305965600] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.495+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.495+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804305959872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fafb40 con 0x563958fa2720 2024-09-13T19:33:34.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.495+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fb0550 con 0x563958fa2720 2024-09-13T19:33:34.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.495+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.495+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804305969312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fb0970 con 0x563958fa2720 2024-09-13T19:33:34.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.495+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fb1460 con 0x563958fa2720 2024-09-13T19:33:34.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.495+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804305959872] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804305969312] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804305973040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fb04c0 con 0x563958fa2720 2024-09-13T19:33:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 20 add_watcher() i=0 2024-09-13T19:33:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 20 add_watcher() i=1 2024-09-13T19:33:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 20 add_watcher() i=2 2024-09-13T19:33:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 20 add_watcher() i=3 2024-09-13T19:33:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 20 add_watcher() i=4 2024-09-13T19:33:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 20 add_watcher() i=5 2024-09-13T19:33:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 20 add_watcher() i=6 2024-09-13T19:33:34.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804305973040] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 20 add_watcher() i=7 2024-09-13T19:33:34.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:34.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fb4560 con 0x563958f9dd20 2024-09-13T19:33:34.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.499+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804305962624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fb19e0 con 0x563958f9dd20 2024-09-13T19:33:34.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.503+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804305962624] v30'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.503+0000 7f85b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.503+0000 7f86fe31b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:34.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.503+0000 7f86fe31b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:34.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.503+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbcc80 con 0x563958f9dd20 2024-09-13T19:33:34.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.503+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.503+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbd350 con 0x563958fa2720 2024-09-13T19:33:34.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.507+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.507+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbd350 con 0x563958fa71a0 2024-09-13T19:33:34.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.507+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.507+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbd940 con 0x563958f9dd20 2024-09-13T19:33:34.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.511+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'122 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.511+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbddf0 con 0x7f86ec0ca070 2024-09-13T19:33:34.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.511+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.511+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbe360 con 0x563958fa71a0 2024-09-13T19:33:34.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.511+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.511+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbe360 con 0x563958f9dd20 2024-09-13T19:33:34.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.515+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.515+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbe5c0 con 0x563958fa2720 2024-09-13T19:33:34.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.515+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.515+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbe5c0 con 0x7f86ec0ca070 2024-09-13T19:33:34.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.519+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.519+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.519+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.519+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x7f86ec0ca070 2024-09-13T19:33:34.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.519+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.519+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa2720 2024-09-13T19:33:34.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.523+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.523+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x7f86ec0ca070 2024-09-13T19:33:34.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.523+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.523+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa2720 2024-09-13T19:33:34.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.527+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.527+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958f9dd20 2024-09-13T19:33:34.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.527+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'123 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.527+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.531+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.531+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x7f86ec0ca070 2024-09-13T19:33:34.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.531+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.531+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.531+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.531+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958f9dd20 2024-09-13T19:33:34.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.535+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.535+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958f9dd20 2024-09-13T19:33:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.535+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'124 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.535+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.535+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.535+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x7f86ec0ca070 2024-09-13T19:33:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.539+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.539+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.539+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.539+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.539+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.539+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.539+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.539+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.543+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.543+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa2720 2024-09-13T19:33:34.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.543+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.543+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.547+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.547+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa2720 2024-09-13T19:33:34.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.547+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.547+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa71a0 2024-09-13T19:33:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.551+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.551+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x563958fa2720 2024-09-13T19:33:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fbaab0 con 0x7f86ec0ca070 2024-09-13T19:33:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f85b0fe1640 20 reqs_thread_entry: start 2024-09-13T19:33:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f86fe31b980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f86fe31b980 20 Filter name: none 2024-09-13T19:33:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f852a7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f86fe31b980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:33:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f86fe31b980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.555+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fb8e30 con 0x563958fa2720 2024-09-13T19:33:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fe31b980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:33:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fe31b980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:33:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fe31b980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:33:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fe31b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fb88a0 con 0x563958fa2720 2024-09-13T19:33:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fe31b980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:33:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.559+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fb88c0 con 0x563958fa2720 2024-09-13T19:33:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fe31b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:33:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94804306141376 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fdcae0 con 0x563958fa71a0 2024-09-13T19:33:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== watch-notify(notify (1) cookie 94804305948272 notify 128849018883 ret 0) ==== 212+0+0 (crc 0 0 0) 0x563958fb9420 con 0x563958fa71a0 2024-09-13T19:33:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f85daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94804305948272 notifier 4524 bl.length()=170 2024-09-13T19:33:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(97 notify.2 [notify cookie 94804306141376 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f85daffd640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f85c0003d70 con 0x563958fa71a0 2024-09-13T19:33:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== watch-notify(notify_complete (2) cookie 94804306141376 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563958f93020 con 0x563958fa71a0 2024-09-13T19:33:34.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fe31b980 10 removing email index: 2024-09-13T19:33:34.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fe31b980 10 removing user buckets index 2024-09-13T19:33:34.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.563+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fda0c0 con 0x563958fa2720 2024-09-13T19:33:34.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(99 fud.buckets [delete] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fe31b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T19:33:34.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94804306141376 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fdcae0 con 0x563958fa2720 2024-09-13T19:33:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== watch-notify(notify (1) cookie 94804305969312 notify 128849018886 ret 0) ==== 202+0+0 (crc 0 0 0) 0x563958fbc920 con 0x563958fa2720 2024-09-13T19:33:34.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f85daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94804305969312 notifier 4524 bl.length()=160 2024-09-13T19:33:34.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f85daffd640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f85c0003d70 con 0x563958fa2720 2024-09-13T19:33:34.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(100 notify.6 [notify cookie 94804306141376 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== watch-notify(notify_complete (2) cookie 94804306141376 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563958f92d90 con 0x563958fa2720 2024-09-13T19:33:34.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fe31b980 10 removing user index: fud 2024-09-13T19:33:34.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.567+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fdeab0 con 0x563958fa2720 2024-09-13T19:33:34.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(102 fud [call,call,delete] v30'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f86fe31b980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T19:33:34.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f86fe31b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:33:34.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94804306142656 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563958fdbea0 con 0x563958fa2720 2024-09-13T19:33:34.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== watch-notify(notify (1) cookie 94804305959872 notify 128849018887 ret 0) ==== 194+0+0 (crc 0 0 0) 0x563958f92d90 con 0x563958fa2720 2024-09-13T19:33:34.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(103 notify.5 [notify cookie 94804306142656 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f85da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94804305959872 notifier 4524 bl.length()=152 2024-09-13T19:33:34.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f85da7fc640 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f85300032d0 con 0x563958fa2720 2024-09-13T19:33:34.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== watch-notify(notify_complete (2) cookie 94804306142656 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563958f8bf00 con 0x563958fa2720 2024-09-13T19:33:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.571+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.575+0000 7f85b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.575+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804305962624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fb7520 con 0x563958f9dd20 2024-09-13T19:33:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.575+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94804305962624] v30'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.575+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804305950784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fae680 con 0x7f86ec0ca070 2024-09-13T19:33:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.575+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94804305950784] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.575+0000 7f86fe31b980 20 remove_watcher() i=0 2024-09-13T19:33:34.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.575+0000 7f86fe31b980 2 removed watcher, disabling cache 2024-09-13T19:33:34.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.575+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804305955040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fae680 con 0x563958f9dd20 2024-09-13T19:33:34.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94804305955040] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fe31b980 20 remove_watcher() i=1 2024-09-13T19:33:34.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804305948272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fae680 con 0x563958fa71a0 2024-09-13T19:33:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fbe2b640 1 -- 172.21.15.144:0/338156004 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94804305948272] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86ec0d1070 con 0x563958fa71a0 2024-09-13T19:33:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fe31b980 20 remove_watcher() i=2 2024-09-13T19:33:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804305961344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958faae70 con 0x7f86ec0ca070 2024-09-13T19:33:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94804305961344] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x7f86ec0ca070 2024-09-13T19:33:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fe31b980 20 remove_watcher() i=3 2024-09-13T19:33:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.579+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804305965600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fae680 con 0x563958f9dd20 2024-09-13T19:33:34.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.583+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94804305965600] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f0029040 con 0x563958f9dd20 2024-09-13T19:33:34.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.583+0000 7f86fe31b980 20 remove_watcher() i=4 2024-09-13T19:33:34.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.583+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804305959872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958faae70 con 0x563958fa2720 2024-09-13T19:33:34.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.587+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94804305959872] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.587+0000 7f86fe31b980 20 remove_watcher() i=5 2024-09-13T19:33:34.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.587+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804305969312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958faf220 con 0x563958fa2720 2024-09-13T19:33:34.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.587+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94804305969312] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.587+0000 7f86fe31b980 20 remove_watcher() i=6 2024-09-13T19:33:34.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.587+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804305973040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563958fadbc0 con 0x563958fa2720 2024-09-13T19:33:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fc62c640 1 -- 172.21.15.144:0/338156004 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94804305973040] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86f402a070 con 0x563958fa2720 2024-09-13T19:33:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 20 remove_watcher() i=7 2024-09-13T19:33:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958fa2720 msgr2=0x563958fa4b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958fa2720 0x563958fa4b10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958f9dd20 msgr2=0x563958fa01e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958f9dd20 0x563958fa01e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f86ec0ca070 msgr2=0x7f86ec0c0720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f86ec0ca070 0x7f86ec0c0720 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563958fa71a0 msgr2=0x563958fa95b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563958fa71a0 0x563958fa95b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85c4034600 msgr2=0x7f85c4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85c4034600 0x7f85c4036ac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0c8b10 tx=0x7f86ec0df000 comp rx=0 tx=0).stop 2024-09-13T19:33:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 msgr2=0x563958f92850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/338156004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f8b530 0x563958f92850 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f86f4022a30 tx=0x7f86f404a260 comp rx=0 tx=0).stop 2024-09-13T19:33:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fb62a640 1 -- 172.21.15.144:0/338156004 reap_dead start 2024-09-13T19:33:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 shutdown_connections 2024-09-13T19:33:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 >> 172.21.15.144:0/338156004 conn(0x563958f87870 msgr2=0x563958f8cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 shutdown_connections 2024-09-13T19:33:34.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/338156004 wait complete. 2024-09-13T19:33:34.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/4173183842 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85d4034650 msgr2=0x7f85d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/4173183842 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85d4034650 0x7f85d4036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x563958f6b9b0 tx=0x7f86ec0e5040 comp rx=0 tx=0).stop 2024-09-13T19:33:34.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/4173183842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f7ea40 msgr2=0x563958f7ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/4173183842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f7ea40 0x563958f7ee60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x563958f64dc0 tx=0x7f86f400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/4173183842 shutdown_connections 2024-09-13T19:33:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/4173183842 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85d4034650 0x7f85d4036b10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/4173183842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958f7ea40 0x563958f7ee60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/4173183842 >> 172.21.15.144:0/4173183842 conn(0x563958f73b90 msgr2=0x563958f76610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/4173183842 shutdown_connections 2024-09-13T19:33:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/4173183842 wait complete. 2024-09-13T19:33:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958f6d840 msgr2=0x563958f6fc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958f6d840 0x563958f6fc30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958e72230 msgr2=0x563958f6ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958e72230 0x563958f6ae50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85e40346f0 msgr2=0x7f85e4036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85e40346f0 0x7f85e4036bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000f70 tx=0x7f86f00012c0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 msgr2=0x563958f63ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f63ec0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f86ec019680 tx=0x7f86ec019810 comp rx=0 tx=0).stop 2024-09-13T19:33:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 shutdown_connections 2024-09-13T19:33:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563958e72230 0x563958f6ae50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563958f6d840 0x563958f6fc30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f85e40346f0 0x7f85e4036bb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 --2- 172.21.15.144:0/1822730436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563958e718e0 0x563958f63ec0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 >> 172.21.15.144:0/1822730436 conn(0x563958de5230 msgr2=0x563958f57400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 shutdown_connections 2024-09-13T19:33:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.591+0000 7f86fe31b980 1 -- 172.21.15.144:0/1822730436 wait complete. 2024-09-13T19:33:34.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:33:34.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:33:34.608 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T19:33:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.691+0000 7f4b05257980 1 Processor -- start 2024-09-13T19:33:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b05257980 1 -- start start 2024-09-13T19:33:34.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b05257980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f51d2ed9f0 0x55f51d2efde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b05257980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f51d171ae0 con 0x55f51d25daa0 2024-09-13T19:33:34.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b05257980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55f51d195e30 con 0x55f51d2ed9f0 2024-09-13T19:33:34.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b02566640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f51d2ed9f0 0x55f51d2efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b02d67640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55f51d25daa0 0x55f51d2ec2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44668/0 (socket says 172.21.15.144:44668) 2024-09-13T19:33:34.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b02566640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f51d2ed9f0 0x55f51d2efde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58000/0 (socket says 172.21.15.144:58000) 2024-09-13T19:33:34.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b02d67640 1 -- 172.21.15.144:0/1362891742 learned_addr learned my addr 172.21.15.144:0/1362891742 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:34.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b02566640 1 -- 172.21.15.144:0/1362891742 >> v1:172.21.15.18:6789/0 conn(0x55f51d25daa0 legacy=0x55f51d2ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b02566640 1 -- 172.21.15.144:0/1362891742 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f51d2f1330 con 0x55f51d2ed9f0 2024-09-13T19:33:34.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b02566640 1 --2- 172.21.15.144:0/1362891742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d2ed9f0 0x55f51d2efde0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4af800a480 tx=0x7f4af801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938c621bfccb12fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.695+0000 7f4b01d65640 1 -- 172.21.15.144:0/1362891742 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af80b0070 con 0x55f51d2ed9f0 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b01d65640 1 -- 172.21.15.144:0/1362891742 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af80ab540 con 0x55f51d2ed9f0 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b01d65640 1 -- 172.21.15.144:0/1362891742 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af80ab840 con 0x55f51d2ed9f0 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b05257980 1 -- 172.21.15.144:0/1362891742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d2ed9f0 msgr2=0x55f51d2efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b05257980 1 --2- 172.21.15.144:0/1362891742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d2ed9f0 0x55f51d2efde0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4af800a480 tx=0x7f4af801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b05257980 1 -- 172.21.15.144:0/1362891742 shutdown_connections 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b05257980 1 --2- 172.21.15.144:0/1362891742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d2ed9f0 0x55f51d2efde0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b05257980 1 -- 172.21.15.144:0/1362891742 >> 172.21.15.144:0/1362891742 conn(0x55f51d2e4000 msgr2=0x55f51d2e6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b05257980 1 -- 172.21.15.144:0/1362891742 shutdown_connections 2024-09-13T19:33:34.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.699+0000 7f4b05257980 1 -- 172.21.15.144:0/1362891742 wait complete. 2024-09-13T19:33:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b05257980 1 Processor -- start 2024-09-13T19:33:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b05257980 1 -- start start 2024-09-13T19:33:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b05257980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d3d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b05257980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f51d197200 con 0x55f51d25daa0 2024-09-13T19:33:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b02d67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d3d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b02d67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d3d4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58016/0 (socket says 172.21.15.144:58016) 2024-09-13T19:33:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b02d67640 1 -- 172.21.15.144:0/3358759199 learned_addr learned my addr 172.21.15.144:0/3358759199 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b02d67640 1 -- 172.21.15.144:0/3358759199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f51d3d5080 con 0x55f51d25daa0 2024-09-13T19:33:34.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.711+0000 7f4b02d67640 1 --2- 172.21.15.144:0/3358759199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d3d4ab0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4af4001d90 tx=0x7f4af4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ad88d3d3318249 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f49f0e09640 1 -- 172.21.15.144:0/3358759199 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af4013030 con 0x55f51d25daa0 2024-09-13T19:33:34.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f49f0e09640 1 -- 172.21.15.144:0/3358759199 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af400e690 con 0x55f51d25daa0 2024-09-13T19:33:34.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f49f0e09640 1 -- 172.21.15.144:0/3358759199 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af400ea10 con 0x55f51d25daa0 2024-09-13T19:33:34.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- 172.21.15.144:0/3358759199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 msgr2=0x55f51d3d4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 --2- 172.21.15.144:0/3358759199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d3d4ab0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4af4001d90 tx=0x7f4af4001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:34.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- 172.21.15.144:0/3358759199 shutdown_connections 2024-09-13T19:33:34.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 --2- 172.21.15.144:0/3358759199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d3d4ab0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- 172.21.15.144:0/3358759199 >> 172.21.15.144:0/3358759199 conn(0x55f51d2e4000 msgr2=0x55f51d3d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- 172.21.15.144:0/3358759199 shutdown_connections 2024-09-13T19:33:34.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- 172.21.15.144:0/3358759199 wait complete. 2024-09-13T19:33:34.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 Processor -- start 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- start start 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d2e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f51d2f0dd0 con 0x55f51d25daa0 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b02d67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d2e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b02d67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d2e9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58032/0 (socket says 172.21.15.144:58032) 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b02d67640 1 -- 172.21.15.144:0/2630057767 learned_addr learned my addr 172.21.15.144:0/2630057767 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b02d67640 1 -- 172.21.15.144:0/2630057767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f51d2e82f0 con 0x55f51d25daa0 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b02d67640 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d2e9bd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x55f51d3d5c90 tx=0x7f4af4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f49ef606640 1 -- 172.21.15.144:0/2630057767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af4027070 con 0x55f51d25daa0 2024-09-13T19:33:34.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f51d2e8580 con 0x55f51d25daa0 2024-09-13T19:33:34.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f49ef606640 1 -- 172.21.15.144:0/2630057767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af4019900 con 0x55f51d25daa0 2024-09-13T19:33:34.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f49ef606640 1 -- 172.21.15.144:0/2630057767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af4019c20 con 0x55f51d25daa0 2024-09-13T19:33:34.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.715+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f51d2e8a70 con 0x55f51d25daa0 2024-09-13T19:33:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f49ef606640 1 -- 172.21.15.144:0/2630057767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4af402a070 con 0x55f51d25daa0 2024-09-13T19:33:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f49ef606640 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49e8034650 0x7f49e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f49ef606640 1 -- 172.21.15.144:0/2630057767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4af401f070 con 0x55f51d25daa0 2024-09-13T19:33:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b02566640 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49e8034650 0x7f49e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d2ed9f0 0x55f51d3e5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d3e57c0 con 0x55f51d2ed9f0 2024-09-13T19:33:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b03568640 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d2ed9f0 0x55f51d3e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b02566640 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49e8034650 0x7f49e8036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4af80ad000 tx=0x7f4af80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b03568640 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d2ed9f0 0x55f51d3e5280 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b03568640 1 -- 172.21.15.144:0/2630057767 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4afc00a4d0 con 0x55f51d2ed9f0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d3e5be0 con 0x55f51d2ed9f0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b03568640 1 -- 172.21.15.144:0/2630057767 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4afc00a4d0 con 0x55f51d2ed9f0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d3e79f0 0x55f51d3e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d3ea480 con 0x55f51d3e79f0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b02d67640 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d3e79f0 0x55f51d3e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b02d67640 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d3e79f0 0x55f51d3e9de0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b02d67640 1 -- 172.21.15.144:0/2630057767 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d3e79f0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.719+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d3e6890 con 0x55f51d2ed9f0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b03568640 1 -- 172.21.15.144:0/2630057767 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4afc00a4d0 con 0x55f51d2ed9f0 2024-09-13T19:33:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d3e6d30 con 0x55f51d2ed9f0 2024-09-13T19:33:34.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b03568640 1 -- 172.21.15.144:0/2630057767 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4afc00a4d0 con 0x55f51d2ed9f0 2024-09-13T19:33:34.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b05257980 1 Processor -- start 2024-09-13T19:33:34.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b05257980 1 -- start start 2024-09-13T19:33:34.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b05257980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d3f8ba0 0x55f51d3f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b05257980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f51d1f0800 con 0x55f51d3f8ba0 2024-09-13T19:33:34.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b03568640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d3f8ba0 0x55f51d3f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b03568640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d3f8ba0 0x55f51d3f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58038/0 (socket says 172.21.15.144:58038) 2024-09-13T19:33:34.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b03568640 1 -- 172.21.15.144:0/3966638775 learned_addr learned my addr 172.21.15.144:0/3966638775 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b03568640 1 -- 172.21.15.144:0/3966638775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f51d3f9500 con 0x55f51d3f8ba0 2024-09-13T19:33:34.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b03568640 1 --2- 172.21.15.144:0/3966638775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d3f8ba0 0x55f51d3f8fc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x55f51d2e9940 tx=0x7f4afc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f49ece01640 1 -- 172.21.15.144:0/3966638775 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4afc014450 con 0x55f51d3f8ba0 2024-09-13T19:33:34.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b05257980 1 -- 172.21.15.144:0/3966638775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f51d3f9790 con 0x55f51d3f8ba0 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f49ece01640 1 -- 172.21.15.144:0/3966638775 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc0145f0 con 0x55f51d3f8ba0 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f49ece01640 1 -- 172.21.15.144:0/3966638775 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4afc014910 con 0x55f51d3f8ba0 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f4b05257980 1 -- 172.21.15.144:0/3966638775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f51d3fc410 con 0x55f51d3f8ba0 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f49ece01640 1 -- 172.21.15.144:0/3966638775 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4afc011040 con 0x55f51d3f8ba0 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f49ece01640 1 --2- 172.21.15.144:0/3966638775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49dc034650 0x7f49dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.723+0000 7f49ece01640 1 -- 172.21.15.144:0/3966638775 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4afc01e070 con 0x55f51d3f8ba0 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b02d67640 1 --2- 172.21.15.144:0/3966638775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49dc034650 0x7f49dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 Processor -- start 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- start start 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b02d67640 1 --2- 172.21.15.144:0/3966638775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49dc034650 0x7f49dc036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55f51d2e8d20 tx=0x7f4af4019e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d405ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f51d3d5400 con 0x55f51d4056e0 2024-09-13T19:33:34.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d405ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d405ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58050/0 (socket says 172.21.15.144:58050) 2024-09-13T19:33:34.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 -- 172.21.15.144:0/1272954488 learned_addr learned my addr 172.21.15.144:0/1272954488 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 -- 172.21.15.144:0/1272954488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f51d4060b0 con 0x55f51d4056e0 2024-09-13T19:33:34.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 --2- 172.21.15.144:0/1272954488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d405ae0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4afc04a0e0 tx=0x7f4afc016a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1385f65631c78c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f49e67fc640 1 -- 172.21.15.144:0/1272954488 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4afc03bb90 con 0x55f51d4056e0 2024-09-13T19:33:34.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f49e67fc640 1 -- 172.21.15.144:0/1272954488 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc022a80 con 0x55f51d4056e0 2024-09-13T19:33:34.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f49e67fc640 1 -- 172.21.15.144:0/1272954488 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4afc022d60 con 0x55f51d4056e0 2024-09-13T19:33:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- 172.21.15.144:0/1272954488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 msgr2=0x55f51d405ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 --2- 172.21.15.144:0/1272954488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d405ae0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4afc04a0e0 tx=0x7f4afc016a90 comp rx=0 tx=0).stop 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- 172.21.15.144:0/1272954488 shutdown_connections 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 --2- 172.21.15.144:0/1272954488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d405ae0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- 172.21.15.144:0/1272954488 >> 172.21.15.144:0/1272954488 conn(0x55f51d401ac0 msgr2=0x55f51d3ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- 172.21.15.144:0/1272954488 shutdown_connections 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- 172.21.15.144:0/1272954488 wait complete. 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 Processor -- start 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- start start 2024-09-13T19:33:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d40ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b05257980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f51d4066b0 con 0x55f51d4056e0 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d40ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d40ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58058/0 (socket says 172.21.15.144:58058) 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 learned_addr learned my addr 172.21.15.144:0/3770157315 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.727+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f51d40cfa0 con 0x55f51d4056e0 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b03568640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d40ca60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4afc011dc0 tx=0x7f4afc011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f49e4ff9640 1 -- 172.21.15.144:0/3770157315 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4afc0133b0 con 0x55f51d4056e0 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f51d40d230 con 0x55f51d4056e0 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f51d40ff10 con 0x55f51d4056e0 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f49e4ff9640 1 -- 172.21.15.144:0/3770157315 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc013550 con 0x55f51d4056e0 2024-09-13T19:33:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f49e4ff9640 1 -- 172.21.15.144:0/3770157315 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4afc013830 con 0x55f51d4056e0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f49e4ff9640 1 -- 172.21.15.144:0/3770157315 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4afc037070 con 0x55f51d4056e0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f49e4ff9640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49cc034650 0x7f49cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f49e4ff9640 1 -- 172.21.15.144:0/3770157315 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4afc00e040 con 0x55f51d4056e0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b02d67640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49cc034650 0x7f49cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d4181c0 0x55f51d41a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d41adb0 con 0x55f51d4181c0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b02566640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d4181c0 0x55f51d41a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b02d67640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49cc034650 0x7f49cc036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55f51d3ea880 tx=0x7f4af4033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b02566640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d4181c0 0x55f51d41a660 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 realm 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d41b1e0 con 0x55f51d4181c0 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d41ba80 con 0x55f51d4181c0 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d41be20 con 0x55f51d4181c0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d41cbd0 0x55f51d41efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.731+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d41f610 con 0x55f51d41cbd0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b03568640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d41cbd0 0x55f51d41efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b03568640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d41cbd0 0x55f51d41efc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b05257980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b05257980 20 searching for the correct realm 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f51d421560 0x55f51d423990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02d67640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f51d421560 0x55f51d423990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02d67640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f51d421560 0x55f51d423990 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02d67640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4af402c060 0x7f4af4048540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x7f4af402c060 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02566640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4af402c060 0x7f4af4048540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02566640 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4af402c060 0x7f4af4048540 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.735+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d4181c0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d4181c0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x7f4af402c060 2024-09-13T19:33:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d4181c0 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d4181c0 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x7f4af402c060 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.739+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d4181c0 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d4181c0 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x7f4af402c060 2024-09-13T19:33:34.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d4181c0 2024-09-13T19:33:34.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.743+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x7f4af402c060 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d421560 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d41cbd0 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x55f51d4181c0 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424010 con 0x7f4af402c060 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d41ffd0 con 0x55f51d4181c0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4203c0 con 0x55f51d4181c0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4203c0 con 0x55f51d4181c0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 zone default found 2024-09-13T19:33:34.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 4 Realm: () 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 zonegroup default 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.747+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4207e0 con 0x55f51d41cbd0 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d425e70 con 0x55f51d421560 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d426280 con 0x55f51d421560 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 20 started sync module instance, tier type = 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d425310 con 0x7f4af402c060 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94511246235664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d425310 con 0x7f4af402c060 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d426dc0 con 0x55f51d4181c0 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.751+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94511246235664] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.755+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.755+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94511246239920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d425310 con 0x55f51d4181c0 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.755+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4277d0 con 0x55f51d421560 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.755+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94511246239920] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.755+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.755+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94511246233184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d425280 con 0x55f51d421560 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.755+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d428510 con 0x7f4af402c060 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.759+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.759+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94511246245920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d428db0 con 0x7f4af402c060 2024-09-13T19:33:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.759+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4297b0 con 0x55f51d4181c0 2024-09-13T19:33:34.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.759+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94511246233184] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.759+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94511246245920] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.759+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.759+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94511246244720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4288b0 con 0x55f51d4181c0 2024-09-13T19:33:34.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.759+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d42a050 con 0x55f51d41cbd0 2024-09-13T19:33:34.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.763+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94511246244720] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.763+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.763+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94511246250688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4288b0 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.763+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d42a500 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.763+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94511246250688] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.763+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.763+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94511246252960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d42a470 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.763+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d42aec0 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94511246252960] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94511246254016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d42a3e0 con 0x55f51d41cbd0 2024-09-13T19:33:34.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 20 add_watcher() i=0 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 20 add_watcher() i=1 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 20 add_watcher() i=2 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 20 add_watcher() i=3 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 20 add_watcher() i=4 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 20 add_watcher() i=5 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 20 add_watcher() i=6 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94511246254016] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 20 add_watcher() i=7 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:34.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.767+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d42e360 con 0x55f51d4181c0 2024-09-13T19:33:34.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94511246257792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d42b7c0 con 0x55f51d4181c0 2024-09-13T19:33:34.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94511246257792] v30'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f49b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:34.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:34.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 5 note: GC not initialized 2024-09-13T19:33:34.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4933fff640 20 reqs_thread_entry: start 2024-09-13T19:33:34.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:34.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 20 Filter name: none 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4931ffb640 20 reqs_thread_entry: start 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d451ab0 con 0x55f51d41cbd0 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:33:34.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4501a0 con 0x55f51d41cbd0 2024-09-13T19:33:34.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:33:34.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:34.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:33:34.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:33:34.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.771+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d454830 con 0x55f51d41cbd0 2024-09-13T19:33:34.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b05257980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b05257980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b05257980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94511246426544 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d455300 con 0x7f4af402c060 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== watch-notify(notify (1) cookie 94511246245920 notify 128849018901 ret 0) ==== 652+0+0 (crc 0 0 0) 0x55f51d2f1330 con 0x7f4af402c060 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f49e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018901 cookie 94511246245920 notifier 4531 bl.length()=610 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f49e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f49e67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(65 notify.3 [notify cookie 94511246426544 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f49e67fc640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f49c8003eb0 con 0x7f4af402c060 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== watch-notify(notify_complete (2) cookie 94511246426544 notify 128849018901 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4af80cfe00 con 0x7f4af402c060 2024-09-13T19:33:34.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.775+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d454180 con 0x55f51d41cbd0 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b05257980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b05257980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b05257980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94511246426448 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f51d455300 con 0x55f51d421560 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== watch-notify(notify (1) cookie 94511246233184 notify 128849018884 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f4af405b040 con 0x55f51d421560 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f49e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94511246233184 notifier 4531 bl.length()=192 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f49e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:33:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f49e67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:33:34.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f49e67fc640 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f49c8003eb0 con 0x55f51d421560 2024-09-13T19:33:34.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(68 notify.2 [notify cookie 94511246426448 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== watch-notify(notify_complete (2) cookie 94511246426448 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f51d2e8a70 con 0x55f51d421560 2024-09-13T19:33:34.784 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:33:34.777079Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:34.777065Z","tags":[],"group_ids":[]} 2024-09-13T19:33:34.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f49b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.779+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94511246257792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d44f6d0 con 0x55f51d4181c0 2024-09-13T19:33:34.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94511246257792] v30'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94511246235664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d44f6d0 con 0x7f4af402c060 2024-09-13T19:33:34.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94511246235664] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b05257980 20 remove_watcher() i=0 2024-09-13T19:33:34.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b05257980 2 removed watcher, disabling cache 2024-09-13T19:33:34.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94511246239920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d44f6d0 con 0x55f51d4181c0 2024-09-13T19:33:34.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94511246239920] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b05257980 20 remove_watcher() i=1 2024-09-13T19:33:34.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.783+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94511246233184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4268b0 con 0x55f51d421560 2024-09-13T19:33:34.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b02d67640 1 -- 172.21.15.144:0/3770157315 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94511246233184] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af4029030 con 0x55f51d421560 2024-09-13T19:33:34.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b05257980 20 remove_watcher() i=2 2024-09-13T19:33:34.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94511246245920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d44f6d0 con 0x7f4af402c060 2024-09-13T19:33:34.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94511246245920] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x7f4af402c060 2024-09-13T19:33:34.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b05257980 20 remove_watcher() i=3 2024-09-13T19:33:34.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94511246244720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424e60 con 0x55f51d4181c0 2024-09-13T19:33:34.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94511246244720] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af80b3040 con 0x55f51d4181c0 2024-09-13T19:33:34.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b05257980 20 remove_watcher() i=4 2024-09-13T19:33:34.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.787+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94511246250688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d4268b0 con 0x55f51d41cbd0 2024-09-13T19:33:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.791+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94511246250688] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.791+0000 7f4b05257980 20 remove_watcher() i=5 2024-09-13T19:33:34.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.791+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94511246252960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d44f6d0 con 0x55f51d41cbd0 2024-09-13T19:33:34.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94511246252960] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 20 remove_watcher() i=6 2024-09-13T19:33:34.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94511246254016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f51d424e60 con 0x55f51d41cbd0 2024-09-13T19:33:34.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b03568640 1 -- 172.21.15.144:0/3770157315 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94511246254016] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4afc036030 con 0x55f51d41cbd0 2024-09-13T19:33:34.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 20 remove_watcher() i=7 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d41cbd0 msgr2=0x55f51d41efc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d41cbd0 0x55f51d41efc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d4181c0 msgr2=0x55f51d41a660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d4181c0 0x55f51d41a660 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4af402c060 msgr2=0x7f4af4048540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4af402c060 0x7f4af4048540 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f51d421560 msgr2=0x55f51d423990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f51d421560 0x55f51d423990 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49cc034650 msgr2=0x7f49cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49cc034650 0x7f49cc036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55f51d3ea880 tx=0x7f4af4033000 comp rx=0 tx=0).stop 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 msgr2=0x55f51d40ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b02566640 1 -- 172.21.15.144:0/3770157315 reap_dead start 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d40ca60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4afc011dc0 tx=0x7f4afc011f90 comp rx=0 tx=0).stop 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 shutdown_connections 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3770157315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d4056e0 0x55f51d40ca60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 >> 172.21.15.144:0/3770157315 conn(0x55f51d401ac0 msgr2=0x55f51d3ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 shutdown_connections 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3770157315 wait complete. 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3966638775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49dc034650 msgr2=0x7f49dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3966638775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49dc034650 0x7f49dc036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55f51d2e8d20 tx=0x7f4af4019e60 comp rx=0 tx=0).stop 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3966638775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d3f8ba0 msgr2=0x55f51d3f8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3966638775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d3f8ba0 0x55f51d3f8fc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x55f51d2e9940 tx=0x7f4afc018830 comp rx=0 tx=0).stop 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3966638775 shutdown_connections 2024-09-13T19:33:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3966638775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49dc034650 0x7f49dc036b10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 --2- 172.21.15.144:0/3966638775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d3f8ba0 0x55f51d3f8fc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3966638775 >> 172.21.15.144:0/3966638775 conn(0x55f51d3edcf0 msgr2=0x55f51d3f0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3966638775 shutdown_connections 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.795+0000 7f4b05257980 1 -- 172.21.15.144:0/3966638775 wait complete. 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d3e79f0 msgr2=0x55f51d3e9de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d3e79f0 0x55f51d3e9de0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d2ed9f0 msgr2=0x55f51d3e5280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d2ed9f0 0x55f51d3e5280 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49e8034650 msgr2=0x7f49e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49e8034650 0x7f49e8036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4af80ad000 tx=0x7f4af80a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 msgr2=0x55f51d2e9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d2e9bd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x55f51d3d5c90 tx=0x7f4af4000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 shutdown_connections 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f51d2ed9f0 0x55f51d3e5280 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f51d3e79f0 0x55f51d3e9de0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f49e8034650 0x7f49e8036b10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 --2- 172.21.15.144:0/2630057767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d25daa0 0x55f51d2e9bd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 >> 172.21.15.144:0/2630057767 conn(0x55f51d2e4000 msgr2=0x55f51d3cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 shutdown_connections 2024-09-13T19:33:34.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.799+0000 7f4b05257980 1 -- 172.21.15.144:0/2630057767 wait complete. 2024-09-13T19:33:34.810 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:33:34.777079Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:34.777065Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:34.810 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:33:34.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:33:34.810 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-13T19:33:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f419819f980 1 Processor -- start 2024-09-13T19:33:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f419819f980 1 -- start start 2024-09-13T19:33:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f419819f980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559938454760 0x559938453220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f419819f980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559938365ae0 con 0x559938454350 2024-09-13T19:33:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f419819f980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x559938389e30 con 0x559938454760 2024-09-13T19:33:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f41954ae640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559938454760 0x559938453220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f4195caf640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x559938454350 0x559938452b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44672/0 (socket says 172.21.15.144:44672) 2024-09-13T19:33:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f4195caf640 1 -- 172.21.15.144:0/1181628627 learned_addr learned my addr 172.21.15.144:0/1181628627 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f41954ae640 1 -- 172.21.15.144:0/1181628627 >> v1:172.21.15.18:6789/0 conn(0x559938454350 legacy=0x559938452b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.891+0000 7f41954ae640 1 -- 172.21.15.144:0/1181628627 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559938453880 con 0x559938454760 2024-09-13T19:33:34.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f41954ae640 1 --2- 172.21.15.144:0/1181628627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454760 0x559938453220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f418000a480 tx=0x7f418001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9502e1058c331ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f4194cad640 1 -- 172.21.15.144:0/1181628627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41800b0070 con 0x559938454760 2024-09-13T19:33:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f4194cad640 1 -- 172.21.15.144:0/1181628627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41800ab540 con 0x559938454760 2024-09-13T19:33:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f4194cad640 1 -- 172.21.15.144:0/1181628627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41800ab840 con 0x559938454760 2024-09-13T19:33:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f419819f980 1 -- 172.21.15.144:0/1181628627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454760 msgr2=0x559938453220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f419819f980 1 --2- 172.21.15.144:0/1181628627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454760 0x559938453220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f418000a480 tx=0x7f418001b280 comp rx=0 tx=0).stop 2024-09-13T19:33:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f419819f980 1 -- 172.21.15.144:0/1181628627 shutdown_connections 2024-09-13T19:33:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f419819f980 1 --2- 172.21.15.144:0/1181628627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454760 0x559938453220 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f419819f980 1 -- 172.21.15.144:0/1181628627 >> 172.21.15.144:0/1181628627 conn(0x5599384d9150 msgr2=0x5599384db570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f419819f980 1 -- 172.21.15.144:0/1181628627 shutdown_connections 2024-09-13T19:33:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.895+0000 7f419819f980 1 -- 172.21.15.144:0/1181628627 wait complete. 2024-09-13T19:33:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.907+0000 7f419819f980 1 Processor -- start 2024-09-13T19:33:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.907+0000 7f419819f980 1 -- start start 2024-09-13T19:33:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.907+0000 7f419819f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.907+0000 7f419819f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55993838b200 con 0x559938454350 2024-09-13T19:33:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.907+0000 7f4195caf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.907+0000 7f4195caf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58074/0 (socket says 172.21.15.144:58074) 2024-09-13T19:33:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.907+0000 7f4195caf640 1 -- 172.21.15.144:0/4097396860 learned_addr learned my addr 172.21.15.144:0/4097396860 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4195caf640 1 -- 172.21.15.144:0/4097396860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599385cb110 con 0x559938454350 2024-09-13T19:33:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4195caf640 1 --2- 172.21.15.144:0/4097396860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385cab40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4188001d90 tx=0x7f4188001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9a9856e0a4ed24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4083e07640 1 -- 172.21.15.144:0/4097396860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188013030 con 0x559938454350 2024-09-13T19:33:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4083e07640 1 -- 172.21.15.144:0/4097396860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418800e690 con 0x559938454350 2024-09-13T19:33:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4083e07640 1 -- 172.21.15.144:0/4097396860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418800ea10 con 0x559938454350 2024-09-13T19:33:34.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- 172.21.15.144:0/4097396860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 msgr2=0x5599385cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 --2- 172.21.15.144:0/4097396860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385cab40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4188001d90 tx=0x7f4188001e80 comp rx=0 tx=0).stop 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- 172.21.15.144:0/4097396860 shutdown_connections 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 --2- 172.21.15.144:0/4097396860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385cab40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- 172.21.15.144:0/4097396860 >> 172.21.15.144:0/4097396860 conn(0x5599384d9150 msgr2=0x5599385c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- 172.21.15.144:0/4097396860 shutdown_connections 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- 172.21.15.144:0/4097396860 wait complete. 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 Processor -- start 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- start start 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5599384e91a0 con 0x559938454350 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4195caf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4195caf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58088/0 (socket says 172.21.15.144:58088) 2024-09-13T19:33:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4195caf640 1 -- 172.21.15.144:0/2731556675 learned_addr learned my addr 172.21.15.144:0/2731556675 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4195caf640 1 -- 172.21.15.144:0/2731556675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599385d2470 con 0x559938454350 2024-09-13T19:33:34.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4195caf640 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385d1f30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x5599385cbd20 tx=0x7f4188000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4082604640 1 -- 172.21.15.144:0/2731556675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188027070 con 0x559938454350 2024-09-13T19:33:34.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599385d2700 con 0x559938454350 2024-09-13T19:33:34.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4082604640 1 -- 172.21.15.144:0/2731556675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41880198e0 con 0x559938454350 2024-09-13T19:33:34.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f4082604640 1 -- 172.21.15.144:0/2731556675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188019c00 con 0x559938454350 2024-09-13T19:33:34.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.911+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599385d53e0 con 0x559938454350 2024-09-13T19:33:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f4082604640 1 -- 172.21.15.144:0/2731556675 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f418802a070 con 0x559938454350 2024-09-13T19:33:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f4082604640 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f407c0346a0 0x7f407c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f4082604640 1 -- 172.21.15.144:0/2731556675 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f418801f070 con 0x559938454350 2024-09-13T19:33:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f41954ae640 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f407c0346a0 0x7f407c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559938454760 0x5599385d9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599385d95b0 con 0x559938454760 2024-09-13T19:33:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f41964b0640 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559938454760 0x5599385d9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f41954ae640 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f407c0346a0 0x7f407c036b60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f41800ad000 tx=0x7f41800a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f41964b0640 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559938454760 0x5599385d9030 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f41964b0640 1 -- 172.21.15.144:0/2731556675 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f419000a4d0 con 0x559938454760 2024-09-13T19:33:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599385d6600 con 0x559938454760 2024-09-13T19:33:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f41964b0640 1 -- 172.21.15.144:0/2731556675 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f419000a4d0 con 0x559938454760 2024-09-13T19:33:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599385db8c0 0x5599385ddcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599385de380 con 0x5599385db8c0 2024-09-13T19:33:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f4195caf640 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599385db8c0 0x5599385ddcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.915+0000 7f4195caf640 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599385db8c0 0x5599385ddcb0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f4195caf640 1 -- 172.21.15.144:0/2731556675 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4188029030 con 0x5599385db8c0 2024-09-13T19:33:34.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599385da730 con 0x559938454760 2024-09-13T19:33:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f41964b0640 1 -- 172.21.15.144:0/2731556675 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f419000a4d0 con 0x559938454760 2024-09-13T19:33:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599385dac10 con 0x559938454760 2024-09-13T19:33:34.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f41964b0640 1 -- 172.21.15.144:0/2731556675 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f419000a4d0 con 0x559938454760 2024-09-13T19:33:34.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f419819f980 1 Processor -- start 2024-09-13T19:33:34.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f419819f980 1 -- start start 2024-09-13T19:33:34.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f419819f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385eca80 0x5599385ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f419819f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5599383e4800 con 0x5599385eca80 2024-09-13T19:33:34.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f41964b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385eca80 0x5599385ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f41964b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385eca80 0x5599385ecea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58094/0 (socket says 172.21.15.144:58094) 2024-09-13T19:33:34.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f41964b0640 1 -- 172.21.15.144:0/4286716718 learned_addr learned my addr 172.21.15.144:0/4286716718 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f41964b0640 1 -- 172.21.15.144:0/4286716718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599385ed3e0 con 0x5599385eca80 2024-09-13T19:33:34.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f41964b0640 1 --2- 172.21.15.144:0/4286716718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385eca80 0x5599385ecea0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5599385d2e30 tx=0x7f4190018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f407b7fe640 1 -- 172.21.15.144:0/4286716718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190014450 con 0x5599385eca80 2024-09-13T19:33:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f407b7fe640 1 -- 172.21.15.144:0/4286716718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190014610 con 0x5599385eca80 2024-09-13T19:33:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f419819f980 1 -- 172.21.15.144:0/4286716718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599385ed670 con 0x5599385eca80 2024-09-13T19:33:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f407b7fe640 1 -- 172.21.15.144:0/4286716718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190014930 con 0x5599385eca80 2024-09-13T19:33:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.919+0000 7f419819f980 1 -- 172.21.15.144:0/4286716718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599385f02f0 con 0x5599385eca80 2024-09-13T19:33:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f407b7fe640 1 -- 172.21.15.144:0/4286716718 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4190011040 con 0x5599385eca80 2024-09-13T19:33:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f407b7fe640 1 --2- 172.21.15.144:0/4286716718 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4070034650 0x7f4070036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f407b7fe640 1 -- 172.21.15.144:0/4286716718 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f419001e070 con 0x5599385eca80 2024-09-13T19:33:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f4195caf640 1 --2- 172.21.15.144:0/4286716718 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4070034650 0x7f4070036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 Processor -- start 2024-09-13T19:33:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- start start 2024-09-13T19:33:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f4195caf640 1 --2- 172.21.15.144:0/4286716718 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4070034650 0x7f4070036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f41880015c0 tx=0x7f418802aec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x5599385f9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5599385cb490 con 0x5599385f9610 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f41964b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x5599385f9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f41964b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x5599385f9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58096/0 (socket says 172.21.15.144:58096) 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f41964b0640 1 -- 172.21.15.144:0/1136331439 learned_addr learned my addr 172.21.15.144:0/1136331439 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f41964b0640 1 -- 172.21.15.144:0/1136331439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599385f9fe0 con 0x5599385f9610 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f41964b0640 1 --2- 172.21.15.144:0/1136331439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x5599385f9a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f419004a050 tx=0x7f4190011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4d453084bf2455 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f40797fa640 1 -- 172.21.15.144:0/1136331439 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190045e60 con 0x5599385f9610 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f40797fa640 1 -- 172.21.15.144:0/1136331439 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f419000de50 con 0x5599385f9610 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f40797fa640 1 -- 172.21.15.144:0/1136331439 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4190016570 con 0x5599385f9610 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- 172.21.15.144:0/1136331439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 msgr2=0x5599385f9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 --2- 172.21.15.144:0/1136331439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x5599385f9a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f419004a050 tx=0x7f4190011f60 comp rx=0 tx=0).stop 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- 172.21.15.144:0/1136331439 shutdown_connections 2024-09-13T19:33:34.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 --2- 172.21.15.144:0/1136331439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x5599385f9a10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:34.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- 172.21.15.144:0/1136331439 >> 172.21.15.144:0/1136331439 conn(0x5599385f5940 msgr2=0x5599385f3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:34.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- 172.21.15.144:0/1136331439 shutdown_connections 2024-09-13T19:33:34.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- 172.21.15.144:0/1136331439 wait complete. 2024-09-13T19:33:34.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 Processor -- start 2024-09-13T19:33:34.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- start start 2024-09-13T19:33:34.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x559938600940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.923+0000 7f419819f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5599385fa590 con 0x5599385f9610 2024-09-13T19:33:34.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41964b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x559938600940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41964b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x559938600940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58108/0 (socket says 172.21.15.144:58108) 2024-09-13T19:33:34.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 learned_addr learned my addr 172.21.15.144:0/2808724219 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:34.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559938600e80 con 0x5599385f9610 2024-09-13T19:33:34.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41964b0640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x559938600940 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4190047040 tx=0x7f4190049fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f40677fe640 1 -- 172.21.15.144:0/2808724219 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900135c0 con 0x5599385f9610 2024-09-13T19:33:34.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559938601110 con 0x5599385f9610 2024-09-13T19:33:34.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559938603df0 con 0x5599385f9610 2024-09-13T19:33:34.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f40677fe640 1 -- 172.21.15.144:0/2808724219 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190013760 con 0x5599385f9610 2024-09-13T19:33:34.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f40677fe640 1 -- 172.21.15.144:0/2808724219 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f419004b360 con 0x5599385f9610 2024-09-13T19:33:34.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f40677fe640 1 -- 172.21.15.144:0/2808724219 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f419004b500 con 0x5599385f9610 2024-09-13T19:33:34.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f40677fe640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4060034650 0x7f4060036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f40677fe640 1 -- 172.21.15.144:0/2808724219 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4190034070 con 0x5599385f9610 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f4195caf640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4060034650 0x7f4060036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55993860c000 0x55993860e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55993860ec10 con 0x55993860c000 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41954ae640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55993860c000 0x55993860e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f4195caf640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4060034650 0x7f4060036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f418802aff0 tx=0x7f4188034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41954ae640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55993860c000 0x55993860e4c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 20 realm 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55993860efe0 con 0x55993860c000 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.927+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55993860f880 con 0x55993860c000 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55993860fc20 con 0x55993860c000 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559938610980 0x559938612d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599386133c0 con 0x559938610980 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41964b0640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559938610980 0x559938612d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41964b0640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559938610980 0x559938612d70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:34.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 20 searching for the correct realm 2024-09-13T19:33:34.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5599386152a0 0x5599386176b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x5599386152a0 2024-09-13T19:33:34.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f4195caf640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5599386152a0 0x5599386176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f4195caf640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5599386152a0 0x5599386176b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f4195caf640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f418802c060 0x7f418802c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x7f418802c060 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41954ae640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f418802c060 0x7f418802c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41954ae640 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f418802c060 0x7f418802c440 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.931+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x559938610980 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x55993860c000 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x55993860c000 2024-09-13T19:33:34.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x559938610980 2024-09-13T19:33:34.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x559938610980 2024-09-13T19:33:34.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x7f418802c060 2024-09-13T19:33:34.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x5599386152a0 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x55993860c000 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x559938610980 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x55993860c000 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x7f418802c060 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.935+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x5599386152a0 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559938617d80 con 0x5599386152a0 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x559938610980 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x5599386152a0 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x5599386152a0 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x55993860c000 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x55993860c000 2024-09-13T19:33:34.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x559938610980 2024-09-13T19:33:34.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x5599386152a0 2024-09-13T19:33:34.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x7f418802c060 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x55993860c000 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.939+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x559938610980 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x5599386152a0 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x559938610980 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x7f418802c060 2024-09-13T19:33:34.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x5599386152a0 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x559938610980 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x55993860c000 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f4188060040 con 0x7f418802c060 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:34.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559938613d10 con 0x55993860c000 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559938613950 con 0x55993860c000 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599386146b0 con 0x55993860c000 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:34.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 zone default found 2024-09-13T19:33:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 4 Realm: () 2024-09-13T19:33:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 zonegroup default 2024-09-13T19:33:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.943+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559938618220 con 0x559938610980 2024-09-13T19:33:34.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55993861a4f0 con 0x5599386152a0 2024-09-13T19:33:34.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55993861a890 con 0x5599386152a0 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 20 started sync module instance, tier type = 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938619980 con 0x7f418802c060 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94116564278912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938619980 con 0x7f418802c060 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861b3a0 con 0x55993860c000 2024-09-13T19:33:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.947+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94116564278912] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94116564282992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938619980 con 0x55993860c000 2024-09-13T19:33:34.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861bdb0 con 0x5599386152a0 2024-09-13T19:33:34.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94116564285696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861c600 con 0x5599386152a0 2024-09-13T19:33:34.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861d000 con 0x7f418802c060 2024-09-13T19:33:34.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94116564282992] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94116564276432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861cfc0 con 0x7f418802c060 2024-09-13T19:33:34.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.951+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861da10 con 0x55993860c000 2024-09-13T19:33:34.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94116564285696] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94116564276432] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94116564290320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861d560 con 0x55993860c000 2024-09-13T19:33:34.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861ddb0 con 0x559938610980 2024-09-13T19:33:34.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94116564290320] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94116564292960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861de30 con 0x559938610980 2024-09-13T19:33:34.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.955+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861e680 con 0x559938610980 2024-09-13T19:33:34.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94116564295696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861eac0 con 0x559938610980 2024-09-13T19:33:34.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861f5c0 con 0x559938610980 2024-09-13T19:33:34.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94116564292960] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94116564295696] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94116564299952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861e510 con 0x559938610980 2024-09-13T19:33:34.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 20 add_watcher() i=0 2024-09-13T19:33:34.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 20 add_watcher() i=1 2024-09-13T19:33:34.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 20 add_watcher() i=2 2024-09-13T19:33:34.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 20 add_watcher() i=3 2024-09-13T19:33:34.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 20 add_watcher() i=4 2024-09-13T19:33:34.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 20 add_watcher() i=5 2024-09-13T19:33:34.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.959+0000 7f419819f980 20 add_watcher() i=6 2024-09-13T19:33:34.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94116564299952] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 20 add_watcher() i=7 2024-09-13T19:33:34.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:34.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599386225b0 con 0x55993860c000 2024-09-13T19:33:34.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94116564294016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861faa0 con 0x55993860c000 2024-09-13T19:33:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94116564294016] v30'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f40477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 5 note: GC not initialized 2024-09-13T19:33:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f40467fc640 20 reqs_thread_entry: start 2024-09-13T19:33:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 20 Filter name: none 2024-09-13T19:33:34.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f3fb7fff640 20 reqs_thread_entry: start 2024-09-13T19:33:34.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:33:34.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.963+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559938645c90 con 0x559938610980 2024-09-13T19:33:34.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599386456e0 con 0x7f418802c060 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 20 rados->read ofs=0 len=0 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559938649430 con 0x5599386152a0 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-13T19:33:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.967+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993864da80 con 0x7f418802c060 2024-09-13T19:33:34.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 8.10 8:09bb0a1d:root::.bucket.meta.testx%3amyfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938651390 con 0x5599386152a0 2024-09-13T19:33:34.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [create,call,writefull 0~412,setxattr (203)] v30'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x7 2024-09-13T19:33:34.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:34.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:33:34.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1, ofs0, ns] 2024-09-13T19:33:34.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94116564496400 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559938650cd0 con 0x559938610980 2024-09-13T19:33:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== watch-notify(notify (1) cookie 94116564299952 notify 128849018888 ret 0) ==== 889+0+0 (crc 0 0 0) 0x559938603df0 con 0x559938610980 2024-09-13T19:33:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f40797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94116564299952 notifier 4538 bl.length()=847 2024-09-13T19:33:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f40797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x7 2024-09-13T19:33:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f40797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f40797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f40797fa640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4058003eb0 con 0x559938610980 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(67 notify.7 [notify cookie 94116564496400 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== watch-notify(notify_complete (2) cookie 94116564496400 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559938601110 con 0x559938610980 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 20 handle_bi_update(): bucket=testx:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_sources= new_sources= 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 20 handle_bi_update(): bucket=testx:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential sources added=[] removed=[] 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 20 handle_bi_update(): bucket=testx:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_dests= new_dests= 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 20 handle_bi_update(): bucket=testx:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential dests added=[] removed=[] 2024-09-13T19:33:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.971+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993864ccb0 con 0x55993860c000 2024-09-13T19:33:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938650020 con 0x55993860c000 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f419819f980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f419819f980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f419819f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94116564487856 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559938650020 con 0x55993860c000 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94116564290320 notify 128849018891 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55993864ccb0 con 0x55993860c000 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f4078ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94116564290320 notifier 4538 bl.length()=348 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f4078ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f4078ff9640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:33:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(71 notify.4 [notify cookie 94116564487856 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f4078ff9640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3fc0003410 con 0x55993860c000 2024-09-13T19:33:34.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94116564487856 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559938651710 con 0x55993860c000 2024-09-13T19:33:34.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.975+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993864f010 con 0x7f418802c060 2024-09-13T19:33:34.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(73 myfoo [call,delete] v30'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f419819f980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:33:34.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f419819f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:33:34.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94116564487856 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55993864e4b0 con 0x559938610980 2024-09-13T19:33:34.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== watch-notify(notify (1) cookie 94116564295696 notify 128849018889 ret 0) ==== 191+0+0 (crc 0 0 0) 0x559938601110 con 0x559938610980 2024-09-13T19:33:34.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f40797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94116564295696 notifier 4538 bl.length()=149 2024-09-13T19:33:34.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f40797fa640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4058003eb0 con 0x559938610980 2024-09-13T19:33:34.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(74 notify.6 [notify cookie 94116564487856 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== watch-notify(notify_complete (2) cookie 94116564487856 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559938600e80 con 0x559938610980 2024-09-13T19:33:34.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.979+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:76 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993864e000 con 0x5599386152a0 2024-09-13T19:33:34.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(76 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call,delete] v30'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f419819f980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 from cache 2024-09-13T19:33:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f419819f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1, ofs0, ns] 2024-09-13T19:33:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94116564471040 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599386478c0 con 0x7f418802c060 2024-09-13T19:33:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== watch-notify(notify (1) cookie 94116564278912 notify 128849018902 ret 0) ==== 248+0+0 (crc 0 0 0) 0x559938651710 con 0x7f418802c060 2024-09-13T19:33:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f4078ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018902 cookie 94116564278912 notifier 4538 bl.length()=206 2024-09-13T19:33:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(77 notify.0 [notify cookie 94116564471040 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f4078ff9640 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3fc0003410 con 0x7f418802c060 2024-09-13T19:33:34.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== watch-notify(notify_complete (2) cookie 94116564471040 notify 128849018902 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559938453880 con 0x7f418802c060 2024-09-13T19:33:34.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f40477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:34.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94116564294016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938643920 con 0x55993860c000 2024-09-13T19:33:34.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94116564294016] v30'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94116564278912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938643920 con 0x7f418802c060 2024-09-13T19:33:34.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94116564278912] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.983+0000 7f419819f980 20 remove_watcher() i=0 2024-09-13T19:33:34.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.987+0000 7f419819f980 2 removed watcher, disabling cache 2024-09-13T19:33:34.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.987+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94116564282992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938643920 con 0x55993860c000 2024-09-13T19:33:34.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.987+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94116564282992] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.987+0000 7f419819f980 20 remove_watcher() i=1 2024-09-13T19:33:34.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.987+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94116564285696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861ae70 con 0x5599386152a0 2024-09-13T19:33:34.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.987+0000 7f4195caf640 1 -- 172.21.15.144:0/2808724219 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94116564285696] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188029030 con 0x5599386152a0 2024-09-13T19:33:34.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.987+0000 7f419819f980 20 remove_watcher() i=2 2024-09-13T19:33:34.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.987+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94116564276432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938643920 con 0x7f418802c060 2024-09-13T19:33:34.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.991+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94116564276432] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x7f418802c060 2024-09-13T19:33:34.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.991+0000 7f419819f980 20 remove_watcher() i=3 2024-09-13T19:33:34.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.991+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94116564290320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861b900 con 0x55993860c000 2024-09-13T19:33:34.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.991+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94116564290320] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41800b3040 con 0x55993860c000 2024-09-13T19:33:34.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.991+0000 7f419819f980 20 remove_watcher() i=4 2024-09-13T19:33:34.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.991+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94116564292960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55993861ae70 con 0x559938610980 2024-09-13T19:33:34.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.995+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94116564292960] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.995+0000 7f419819f980 20 remove_watcher() i=5 2024-09-13T19:33:34.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.995+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94116564295696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599386194d0 con 0x559938610980 2024-09-13T19:33:34.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.995+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94116564295696] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:34.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.995+0000 7f419819f980 20 remove_watcher() i=6 2024-09-13T19:33:34.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.995+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94116564299952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559938643920 con 0x559938610980 2024-09-13T19:33:35.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f41964b0640 1 -- 172.21.15.144:0/2808724219 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94116564299952] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419002a070 con 0x559938610980 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 20 remove_watcher() i=7 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559938610980 msgr2=0x559938612d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559938610980 0x559938612d70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55993860c000 msgr2=0x55993860e4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55993860c000 0x55993860e4c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f418802c060 msgr2=0x7f418802c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f418802c060 0x7f418802c440 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5599386152a0 msgr2=0x5599386176b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5599386152a0 0x5599386176b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4060034650 msgr2=0x7f4060036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4060034650 0x7f4060036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f418802aff0 tx=0x7f4188034000 comp rx=0 tx=0).stop 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f41954ae640 1 -- 172.21.15.144:0/2808724219 reap_dead start 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 msgr2=0x559938600940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x559938600940 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4190047040 tx=0x7f4190049fe0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 shutdown_connections 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2808724219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385f9610 0x559938600940 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 >> 172.21.15.144:0/2808724219 conn(0x5599385f5940 msgr2=0x5599385fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 shutdown_connections 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2808724219 wait complete. 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/4286716718 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4070034650 msgr2=0x7f4070036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/4286716718 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4070034650 0x7f4070036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f41880015c0 tx=0x7f418802aec0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/4286716718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385eca80 msgr2=0x5599385ecea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/4286716718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385eca80 0x5599385ecea0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5599385d2e30 tx=0x7f4190018830 comp rx=0 tx=0).stop 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/4286716718 shutdown_connections 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/4286716718 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4070034650 0x7f4070036b10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/4286716718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599385eca80 0x5599385ecea0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/4286716718 >> 172.21.15.144:0/4286716718 conn(0x5599385e1bd0 msgr2=0x5599385e4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/4286716718 shutdown_connections 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/4286716718 wait complete. 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599385db8c0 msgr2=0x5599385ddcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599385db8c0 0x5599385ddcb0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559938454760 msgr2=0x5599385d9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559938454760 0x5599385d9030 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f407c0346a0 msgr2=0x7f407c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f407c0346a0 0x7f407c036b60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f41800ad000 tx=0x7f41800a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 msgr2=0x5599385d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385d1f30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x5599385cbd20 tx=0x7f4188000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 shutdown_connections 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559938454760 0x5599385d9030 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599385db8c0 0x5599385ddcb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f407c0346a0 0x7f407c036b60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 --2- 172.21.15.144:0/2731556675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559938454350 0x5599385d1f30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 >> 172.21.15.144:0/2731556675 conn(0x5599384d9150 msgr2=0x5599385c52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 shutdown_connections 2024-09-13T19:33:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:34.999+0000 7f419819f980 1 -- 172.21.15.144:0/2731556675 wait complete. 2024-09-13T19:33:35.011 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T19:33:35.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T19:33:35.012 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-13T19:33:35.077 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:35.077 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:35.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7227136980 1 Processor -- start 2024-09-13T19:33:35.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7227136980 1 -- start start 2024-09-13T19:33:35.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7227136980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56379aa749d0 0x56379aa76dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7227136980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56379a8f8ae0 con 0x56379aa70650 2024-09-13T19:33:35.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7227136980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56379a91ce30 con 0x56379aa749d0 2024-09-13T19:33:35.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7224445640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56379aa749d0 0x56379aa76dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7224c46640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x56379aa70650 0x56379aa70a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44674/0 (socket says 172.21.15.144:44674) 2024-09-13T19:33:35.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7224c46640 1 -- 172.21.15.144:0/3611260733 learned_addr learned my addr 172.21.15.144:0/3611260733 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:35.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7223c44640 1 -- 172.21.15.144:0/3611260733 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090138324 0 0) 0x56379a8f8ae0 con 0x56379aa70650 2024-09-13T19:33:35.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7223c44640 1 -- 172.21.15.144:0/3611260733 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f720c001e20 con 0x56379aa70650 2024-09-13T19:33:35.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7224445640 1 -- 172.21.15.144:0/3611260733 >> v1:172.21.15.18:6789/0 conn(0x56379aa70650 legacy=0x56379aa70a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.075+0000 7f7224445640 1 -- 172.21.15.144:0/3611260733 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379aa78310 con 0x56379aa749d0 2024-09-13T19:33:35.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7224445640 1 --2- 172.21.15.144:0/3611260733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa749d0 0x56379aa76dc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f721800a480 tx=0x7f721801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6d27b010dd3cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7223c44640 1 -- 172.21.15.144:0/3611260733 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72180b0070 con 0x56379aa749d0 2024-09-13T19:33:35.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7223c44640 1 -- 172.21.15.144:0/3611260733 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72180ab540 con 0x56379aa749d0 2024-09-13T19:33:35.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7223c44640 1 -- 172.21.15.144:0/3611260733 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72180ab820 con 0x56379aa749d0 2024-09-13T19:33:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7227136980 1 -- 172.21.15.144:0/3611260733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa749d0 msgr2=0x56379aa76dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7227136980 1 --2- 172.21.15.144:0/3611260733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa749d0 0x56379aa76dc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f721800a480 tx=0x7f721801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7227136980 1 -- 172.21.15.144:0/3611260733 shutdown_connections 2024-09-13T19:33:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7227136980 1 --2- 172.21.15.144:0/3611260733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa749d0 0x56379aa76dc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7227136980 1 -- 172.21.15.144:0/3611260733 >> 172.21.15.144:0/3611260733 conn(0x56379aa6c170 msgr2=0x56379aa6e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7227136980 1 -- 172.21.15.144:0/3611260733 shutdown_connections 2024-09-13T19:33:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.079+0000 7f7227136980 1 -- 172.21.15.144:0/3611260733 wait complete. 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.091+0000 7f7227136980 1 Processor -- start 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.091+0000 7f7227136980 1 -- start start 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.091+0000 7f7227136980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab5b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.091+0000 7f7227136980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56379a91e200 con 0x56379aa70650 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.091+0000 7f7224c46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab5b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7224c46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab5b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58118/0 (socket says 172.21.15.144:58118) 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7224c46640 1 -- 172.21.15.144:0/934188959 learned_addr learned my addr 172.21.15.144:0/934188959 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7224c46640 1 -- 172.21.15.144:0/934188959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379ab5be60 con 0x56379aa70650 2024-09-13T19:33:35.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7224c46640 1 --2- 172.21.15.144:0/934188959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab5b890 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7214001dc0 tx=0x7f721400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918daaa5917505 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7112e0d640 1 -- 172.21.15.144:0/934188959 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7214012020 con 0x56379aa70650 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7112e0d640 1 -- 172.21.15.144:0/934188959 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721400e7c0 con 0x56379aa70650 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7112e0d640 1 -- 172.21.15.144:0/934188959 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721400eb40 con 0x56379aa70650 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 -- 172.21.15.144:0/934188959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 msgr2=0x56379ab5b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 --2- 172.21.15.144:0/934188959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab5b890 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7214001dc0 tx=0x7f721400b6d0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 -- 172.21.15.144:0/934188959 shutdown_connections 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 --2- 172.21.15.144:0/934188959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab5b890 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 -- 172.21.15.144:0/934188959 >> 172.21.15.144:0/934188959 conn(0x56379aa6c170 msgr2=0x56379ab574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 -- 172.21.15.144:0/934188959 shutdown_connections 2024-09-13T19:33:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 -- 172.21.15.144:0/934188959 wait complete. 2024-09-13T19:33:35.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 Processor -- start 2024-09-13T19:33:35.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 -- start start 2024-09-13T19:33:35.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab62c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7227136980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56379aa77e10 con 0x56379aa70650 2024-09-13T19:33:35.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7224c46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab62c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7224c46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab62c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58124/0 (socket says 172.21.15.144:58124) 2024-09-13T19:33:35.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7224c46640 1 -- 172.21.15.144:0/3389182481 learned_addr learned my addr 172.21.15.144:0/3389182481 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.095+0000 7f7224c46640 1 -- 172.21.15.144:0/3389182481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379ab631a0 con 0x56379aa70650 2024-09-13T19:33:35.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7224c46640 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab62c60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x56379ab5ca70 tx=0x7f7214000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f711160a640 1 -- 172.21.15.144:0/3389182481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7214012030 con 0x56379aa70650 2024-09-13T19:33:35.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56379ab63430 con 0x56379aa70650 2024-09-13T19:33:35.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f711160a640 1 -- 172.21.15.144:0/3389182481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7214001440 con 0x56379aa70650 2024-09-13T19:33:35.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f711160a640 1 -- 172.21.15.144:0/3389182481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721401aaf0 con 0x56379aa70650 2024-09-13T19:33:35.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379ab66110 con 0x56379aa70650 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f711160a640 1 -- 172.21.15.144:0/3389182481 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7214015020 con 0x56379aa70650 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f711160a640 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f710c0346f0 0x7f710c036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f711160a640 1 -- 172.21.15.144:0/3389182481 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7214020030 con 0x56379aa70650 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7224445640 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f710c0346f0 0x7f710c036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379aa749d0 0x56379ab69bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379ab6a210 con 0x56379aa749d0 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7225447640 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379aa749d0 0x56379ab69bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7224445640 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f710c0346f0 0x7f710c036bb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f72180ad000 tx=0x7f72180a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7225447640 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379aa749d0 0x56379ab69bf0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7225447640 1 -- 172.21.15.144:0/3389182481 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f721c00a4d0 con 0x56379aa749d0 2024-09-13T19:33:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379ab67330 con 0x56379aa749d0 2024-09-13T19:33:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7225447640 1 -- 172.21.15.144:0/3389182481 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f721c00a4d0 con 0x56379aa749d0 2024-09-13T19:33:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379ab6c560 0x56379ab6e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379ab6f020 con 0x56379ab6c560 2024-09-13T19:33:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.099+0000 7f7224c46640 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379ab6c560 0x56379ab6e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7224c46640 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379ab6c560 0x56379ab6e950 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7224c46640 1 -- 172.21.15.144:0/3389182481 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7214008030 con 0x56379ab6c560 2024-09-13T19:33:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379ab6b400 con 0x56379aa749d0 2024-09-13T19:33:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7225447640 1 -- 172.21.15.144:0/3389182481 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f721c00a4d0 con 0x56379aa749d0 2024-09-13T19:33:35.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379ab6b8e0 con 0x56379aa749d0 2024-09-13T19:33:35.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7225447640 1 -- 172.21.15.144:0/3389182481 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f721c00a4d0 con 0x56379aa749d0 2024-09-13T19:33:35.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7227136980 1 Processor -- start 2024-09-13T19:33:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7227136980 1 -- start start 2024-09-13T19:33:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7227136980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab7d700 0x56379ab7db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7227136980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56379a977800 con 0x56379ab7d700 2024-09-13T19:33:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7225447640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab7d700 0x56379ab7db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7225447640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab7d700 0x56379ab7db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58128/0 (socket says 172.21.15.144:58128) 2024-09-13T19:33:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7225447640 1 -- 172.21.15.144:0/525123802 learned_addr learned my addr 172.21.15.144:0/525123802 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7225447640 1 -- 172.21.15.144:0/525123802 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379ab7e060 con 0x56379ab7d700 2024-09-13T19:33:35.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7225447640 1 --2- 172.21.15.144:0/525123802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab7d700 0x56379ab7db20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x56379ab6a610 tx=0x7f721c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f710a7fc640 1 -- 172.21.15.144:0/525123802 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721c014450 con 0x56379ab7d700 2024-09-13T19:33:35.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f710a7fc640 1 -- 172.21.15.144:0/525123802 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c0145f0 con 0x56379ab7d700 2024-09-13T19:33:35.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f7227136980 1 -- 172.21.15.144:0/525123802 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56379ab7e2f0 con 0x56379ab7d700 2024-09-13T19:33:35.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.103+0000 7f710a7fc640 1 -- 172.21.15.144:0/525123802 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721c014910 con 0x56379ab7d700 2024-09-13T19:33:35.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 -- 172.21.15.144:0/525123802 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379ab80f70 con 0x56379ab7d700 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f710a7fc640 1 -- 172.21.15.144:0/525123802 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f721c011040 con 0x56379ab7d700 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f710a7fc640 1 --2- 172.21.15.144:0/525123802 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70fc034650 0x7f70fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f710a7fc640 1 -- 172.21.15.144:0/525123802 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f721c01e070 con 0x56379ab7d700 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7224c46640 1 --2- 172.21.15.144:0/525123802 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70fc034650 0x7f70fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 Processor -- start 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 -- start start 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7224c46640 1 --2- 172.21.15.144:0/525123802 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70fc034650 0x7f70fc036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x56379ab6a6b0 tx=0x7f7214001010 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab8a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56379ab5c1e0 con 0x56379ab8a1b0 2024-09-13T19:33:35.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7225447640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab8a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7225447640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab8a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58132/0 (socket says 172.21.15.144:58132) 2024-09-13T19:33:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7225447640 1 -- 172.21.15.144:0/3918007095 learned_addr learned my addr 172.21.15.144:0/3918007095 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7225447640 1 -- 172.21.15.144:0/3918007095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379ab8ab80 con 0x56379ab8a1b0 2024-09-13T19:33:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7225447640 1 --2- 172.21.15.144:0/3918007095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab8a5b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f721c04a140 tx=0x7f721c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705b8554cfb0c511 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f70fbfff640 1 -- 172.21.15.144:0/3918007095 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721c028070 con 0x56379ab8a1b0 2024-09-13T19:33:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f70fbfff640 1 -- 172.21.15.144:0/3918007095 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c03aa60 con 0x56379ab8a1b0 2024-09-13T19:33:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f70fbfff640 1 -- 172.21.15.144:0/3918007095 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721c03ad40 con 0x56379ab8a1b0 2024-09-13T19:33:35.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 -- 172.21.15.144:0/3918007095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 msgr2=0x56379ab8a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 --2- 172.21.15.144:0/3918007095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab8a5b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f721c04a140 tx=0x7f721c011700 comp rx=0 tx=0).stop 2024-09-13T19:33:35.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 -- 172.21.15.144:0/3918007095 shutdown_connections 2024-09-13T19:33:35.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 --2- 172.21.15.144:0/3918007095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab8a5b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.107+0000 7f7227136980 1 -- 172.21.15.144:0/3918007095 >> 172.21.15.144:0/3918007095 conn(0x56379ab865e0 msgr2=0x56379ab846e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 -- 172.21.15.144:0/3918007095 shutdown_connections 2024-09-13T19:33:35.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 -- 172.21.15.144:0/3918007095 wait complete. 2024-09-13T19:33:35.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 Processor -- start 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 -- start start 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab91590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56379ab8b1d0 con 0x56379ab8a1b0 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7225447640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab91590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7225447640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab91590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58138/0 (socket says 172.21.15.144:58138) 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 learned_addr learned my addr 172.21.15.144:0/3803669426 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379ab91ad0 con 0x56379ab8a1b0 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7225447640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab91590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f721c0117d0 tx=0x7f721c04a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f70fa7fc640 1 -- 172.21.15.144:0/3803669426 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721c022d90 con 0x56379ab8a1b0 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56379ab91d60 con 0x56379ab8a1b0 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379ab92170 con 0x56379ab8a1b0 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f70fa7fc640 1 -- 172.21.15.144:0/3803669426 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c0133b0 con 0x56379ab8a1b0 2024-09-13T19:33:35.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f70fa7fc640 1 -- 172.21.15.144:0/3803669426 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f721c050060 con 0x56379ab8a1b0 2024-09-13T19:33:35.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f70fa7fc640 1 -- 172.21.15.144:0/3803669426 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f721c04bd10 con 0x56379ab8a1b0 2024-09-13T19:33:35.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f70fa7fc640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70f00346a0 0x7f70f0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f70fa7fc640 1 -- 172.21.15.144:0/3803669426 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f721c034030 con 0x56379ab8a1b0 2024-09-13T19:33:35.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7224c46640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70f00346a0 0x7f70f0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379ab9cba0 0x56379ab9f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379ab9f790 con 0x56379ab9cba0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7224445640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379ab9cba0 0x56379ab9f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.111+0000 7f7224c46640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70f00346a0 0x7f70f0036b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x56379ab6f400 tx=0x7f7214032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224445640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379ab9cba0 0x56379ab9f040 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 realm 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379ab9fbc0 con 0x56379ab9cba0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379aba0460 con 0x56379ab9cba0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379aba0800 con 0x56379ab9cba0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379aba1560 0x56379aba3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379aba3e90 con 0x56379aba1560 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7225447640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379aba1560 0x56379aba3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7225447640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379aba1560 0x56379aba3950 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 20 searching for the correct realm 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56379aba5de0 0x56379aba82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224c46640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56379aba5de0 0x56379aba82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224c46640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56379aba5de0 0x56379aba82a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224c46640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7214017050 0x7f721400d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x7f7214017050 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224445640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7214017050 0x7f721400d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.115+0000 7f7224445640 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7214017050 0x7f721400d860 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379ab9cba0 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379ab9cba0 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x7f7214017050 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379ab9cba0 2024-09-13T19:33:35.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.119+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379ab9cba0 2024-09-13T19:33:35.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x7f7214017050 2024-09-13T19:33:35.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379ab9cba0 2024-09-13T19:33:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379ab9cba0 2024-09-13T19:33:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x7f7214017050 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379ab9cba0 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.123+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x7f7214017050 2024-09-13T19:33:35.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba5de0 2024-09-13T19:33:35.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379aba1560 2024-09-13T19:33:35.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x56379ab9cba0 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379aba8970 con 0x7f7214017050 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379aba4850 con 0x56379ab9cba0 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379aba4850 con 0x56379ab9cba0 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379aba4cc0 con 0x56379ab9cba0 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 zone default found 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 4 Realm: () 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 zonegroup default 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.127+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379aba4d00 con 0x56379aba1560 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379abaa7d0 con 0x56379aba5de0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379abaab70 con 0x56379aba5de0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 20 started sync module instance, tier type = 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379aba9c70 con 0x7f7214017050 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94796819112336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379aba9c70 con 0x7f7214017050 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abab530 con 0x56379ab9cba0 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94796819112336] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.131+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796819116432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379aba9c70 con 0x56379ab9cba0 2024-09-13T19:33:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379ababe60 con 0x56379aba5de0 2024-09-13T19:33:35.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94796819118416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abac700 con 0x56379aba5de0 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94796819116432] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379aba97c0 con 0x7f7214017050 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94796819123216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abad4e0 con 0x7f7214017050 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.135+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abadea0 con 0x56379ab9cba0 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94796819118416] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94796819123216] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94796819124272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abac360 con 0x56379ab9cba0 2024-09-13T19:33:35.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abae350 con 0x56379aba1560 2024-09-13T19:33:35.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94796819124272] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94796819126768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abae6f0 con 0x56379aba1560 2024-09-13T19:33:35.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.139+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abaef40 con 0x56379aba1560 2024-09-13T19:33:35.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.143+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94796819126768] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.143+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.143+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94796819130096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abaefc0 con 0x56379aba1560 2024-09-13T19:33:35.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.143+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abaf980 con 0x56379aba1560 2024-09-13T19:33:35.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.143+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94796819130096] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94796819131424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abaf980 con 0x56379aba1560 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 20 add_watcher() i=0 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 20 add_watcher() i=1 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 20 add_watcher() i=2 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 20 add_watcher() i=3 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 20 add_watcher() i=4 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 20 add_watcher() i=5 2024-09-13T19:33:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 20 add_watcher() i=6 2024-09-13T19:33:35.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94796819131424] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 20 add_watcher() i=7 2024-09-13T19:33:35.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:35.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379abb2ca0 con 0x56379ab9cba0 2024-09-13T19:33:35.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94796819146464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abafaf0 con 0x56379ab9cba0 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.147+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94796819146464] v30'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f70dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 5 note: GC not initialized 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f70d9fe3640 20 reqs_thread_entry: start 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 20 Filter name: none 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f704b7fe640 20 reqs_thread_entry: start 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379abd5e00 con 0x56379ab9cba0 2024-09-13T19:33:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T19:33:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f70dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94796819146464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abd3d70 con 0x56379ab9cba0 2024-09-13T19:33:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94796819146464] v30'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94796819112336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abd3d70 con 0x7f7214017050 2024-09-13T19:33:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94796819112336] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 20 remove_watcher() i=0 2024-09-13T19:33:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 2 removed watcher, disabling cache 2024-09-13T19:33:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.151+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94796819116432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abd3d70 con 0x56379ab9cba0 2024-09-13T19:33:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.155+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94796819116432] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.155+0000 7f7227136980 20 remove_watcher() i=1 2024-09-13T19:33:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.155+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94796819118416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abd3d70 con 0x56379aba5de0 2024-09-13T19:33:35.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.155+0000 7f7224c46640 1 -- 172.21.15.144:0/3803669426 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94796819118416] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7214008030 con 0x56379aba5de0 2024-09-13T19:33:35.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.155+0000 7f7227136980 20 remove_watcher() i=2 2024-09-13T19:33:35.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.155+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94796819123216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abab190 con 0x7f7214017050 2024-09-13T19:33:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.159+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94796819123216] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x7f7214017050 2024-09-13T19:33:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.159+0000 7f7227136980 20 remove_watcher() i=3 2024-09-13T19:33:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.159+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94796819124272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abacc10 con 0x56379ab9cba0 2024-09-13T19:33:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.159+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94796819124272] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72180b3040 con 0x56379ab9cba0 2024-09-13T19:33:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.159+0000 7f7227136980 20 remove_watcher() i=4 2024-09-13T19:33:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.159+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94796819126768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abab950 con 0x56379aba1560 2024-09-13T19:33:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.163+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94796819126768] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.163+0000 7f7227136980 20 remove_watcher() i=5 2024-09-13T19:33:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.163+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94796819130096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abad9f0 con 0x56379aba1560 2024-09-13T19:33:35.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.163+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94796819130096] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.163+0000 7f7227136980 20 remove_watcher() i=6 2024-09-13T19:33:35.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.163+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94796819131424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379abad9f0 con 0x56379aba1560 2024-09-13T19:33:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7225447640 1 -- 172.21.15.144:0/3803669426 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94796819131424] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721c052070 con 0x56379aba1560 2024-09-13T19:33:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 20 remove_watcher() i=7 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379aba1560 msgr2=0x56379aba3950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379aba1560 0x56379aba3950 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379ab9cba0 msgr2=0x56379ab9f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379ab9cba0 0x56379ab9f040 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7214017050 msgr2=0x7f721400d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7214017050 0x7f721400d860 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56379aba5de0 msgr2=0x56379aba82a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56379aba5de0 0x56379aba82a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70f00346a0 msgr2=0x7f70f0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70f00346a0 0x7f70f0036b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x56379ab6f400 tx=0x7f7214032000 comp rx=0 tx=0).stop 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 msgr2=0x56379ab91590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7224445640 1 -- 172.21.15.144:0/3803669426 reap_dead start 2024-09-13T19:33:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab91590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f721c0117d0 tx=0x7f721c04a0a0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 shutdown_connections 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3803669426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab8a1b0 0x56379ab91590 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 >> 172.21.15.144:0/3803669426 conn(0x56379ab865e0 msgr2=0x56379ab846b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 shutdown_connections 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3803669426 wait complete. 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/525123802 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70fc034650 msgr2=0x7f70fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/525123802 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70fc034650 0x7f70fc036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x56379ab6a6b0 tx=0x7f7214001010 comp rx=0 tx=0).stop 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/525123802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab7d700 msgr2=0x56379ab7db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/525123802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab7d700 0x56379ab7db20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x56379ab6a610 tx=0x7f721c018830 comp rx=0 tx=0).stop 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/525123802 shutdown_connections 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/525123802 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f70fc034650 0x7f70fc036b10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/525123802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379ab7d700 0x56379ab7db20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/525123802 >> 172.21.15.144:0/525123802 conn(0x56379ab72850 msgr2=0x56379ab752d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/525123802 shutdown_connections 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/525123802 wait complete. 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379ab6c560 msgr2=0x56379ab6e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379ab6c560 0x56379ab6e950 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379aa749d0 msgr2=0x56379ab69bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379aa749d0 0x56379ab69bf0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f710c0346f0 msgr2=0x7f710c036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f710c0346f0 0x7f710c036bb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f72180ad000 tx=0x7f72180a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 msgr2=0x56379ab62c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab62c60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x56379ab5ca70 tx=0x7f7214000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 shutdown_connections 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56379aa749d0 0x56379ab69bf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56379ab6c560 0x56379ab6e950 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f710c0346f0 0x7f710c036bb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 --2- 172.21.15.144:0/3389182481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56379aa70650 0x56379ab62c60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 >> 172.21.15.144:0/3389182481 conn(0x56379aa6c170 msgr2=0x56379ab56040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 shutdown_connections 2024-09-13T19:33:35.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.167+0000 7f7227136980 1 -- 172.21.15.144:0/3389182481 wait complete. 2024-09-13T19:33:35.179 INFO:teuthology.orchestra.run.smithi144.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"IwDwx9x2MT3LWEwjrwxBVnAm","ver":2},"mtime":"2024-09-13T19:33:34.978255Z","data":{"bucket":{"name":"myfoo","marker":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","bucket_id":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-13T19:33:31.450072Z","linked":true,"has_bucket_info":false}} 2024-09-13T19:33:35.179 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'IwDwx9x2MT3LWEwjrwxBVnAm', 'ver': 2}, 'mtime': '2024-09-13T19:33:34.978255Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'bucket_id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-13T19:33:31.450072Z', 'linked': True, 'has_bucket_info': False}} 2024-09-13T19:33:35.179 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T19:33:35.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T19:33:35.179 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-13T19:33:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.247+0000 7f3dfe73a980 1 Processor -- start 2024-09-13T19:33:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.247+0000 7f3dfe73a980 1 -- start start 2024-09-13T19:33:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.247+0000 7f3dfe73a980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559d3134a9e0 0x559d3134cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.247+0000 7f3dfe73a980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d311ceae0 con 0x559d31346660 2024-09-13T19:33:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.247+0000 7f3dfe73a980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x559d311f2e30 con 0x559d3134a9e0 2024-09-13T19:33:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.247+0000 7f3dfba49640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559d3134a9e0 0x559d3134cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.247+0000 7f3dfc24a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x559d31346660 0x559d31346a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44688/0 (socket says 172.21.15.144:44688) 2024-09-13T19:33:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.247+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1348278476 learned_addr learned my addr 172.21.15.144:0/1348278476 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfb248640 1 -- 172.21.15.144:0/1348278476 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605163687 0 0) 0x559d311ceae0 con 0x559d31346660 2024-09-13T19:33:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfb248640 1 -- 172.21.15.144:0/1348278476 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de4001e20 con 0x559d31346660 2024-09-13T19:33:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfba49640 1 -- 172.21.15.144:0/1348278476 >> v1:172.21.15.18:6789/0 conn(0x559d31346660 legacy=0x559d31346a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfba49640 1 -- 172.21.15.144:0/1348278476 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d3134e320 con 0x559d3134a9e0 2024-09-13T19:33:35.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfba49640 1 --2- 172.21.15.144:0/1348278476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3134a9e0 0x559d3134cdd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3df000a480 tx=0x7f3df001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1370a92745207183 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfb248640 1 -- 172.21.15.144:0/1348278476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df00b0070 con 0x559d3134a9e0 2024-09-13T19:33:35.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfb248640 1 -- 172.21.15.144:0/1348278476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df00ab540 con 0x559d3134a9e0 2024-09-13T19:33:35.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfb248640 1 -- 172.21.15.144:0/1348278476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df00ab840 con 0x559d3134a9e0 2024-09-13T19:33:35.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1348278476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3134a9e0 msgr2=0x559d3134cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1348278476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3134a9e0 0x559d3134cdd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3df000a480 tx=0x7f3df001b280 comp rx=0 tx=0).stop 2024-09-13T19:33:35.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1348278476 shutdown_connections 2024-09-13T19:33:35.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1348278476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3134a9e0 0x559d3134cdd0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1348278476 >> 172.21.15.144:0/1348278476 conn(0x559d31342180 msgr2=0x559d313445a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1348278476 shutdown_connections 2024-09-13T19:33:35.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.251+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1348278476 wait complete. 2024-09-13T19:33:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 Processor -- start 2024-09-13T19:33:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- start start 2024-09-13T19:33:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31431890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d311f4200 con 0x559d31346660 2024-09-13T19:33:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfc24a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31431890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfc24a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31431890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58158/0 (socket says 172.21.15.144:58158) 2024-09-13T19:33:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfc24a640 1 -- 172.21.15.144:0/2147037853 learned_addr learned my addr 172.21.15.144:0/2147037853 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfc24a640 1 -- 172.21.15.144:0/2147037853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d31431e60 con 0x559d31346660 2024-09-13T19:33:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/2147037853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31431890 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3dec001dc0 tx=0x7f3dec00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0576dc3b69ac35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3cea60c640 1 -- 172.21.15.144:0/2147037853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dec012020 con 0x559d31346660 2024-09-13T19:33:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3cea60c640 1 -- 172.21.15.144:0/2147037853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec00e7c0 con 0x559d31346660 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3cea60c640 1 -- 172.21.15.144:0/2147037853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dec00eb40 con 0x559d31346660 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2147037853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 msgr2=0x559d31431890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/2147037853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31431890 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3dec001dc0 tx=0x7f3dec00b6d0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2147037853 shutdown_connections 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/2147037853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31431890 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2147037853 >> 172.21.15.144:0/2147037853 conn(0x559d31342180 msgr2=0x559d3142d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2147037853 shutdown_connections 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2147037853 wait complete. 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 Processor -- start 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- start start 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31438c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfe73a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d3134de20 con 0x559d31346660 2024-09-13T19:33:35.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.267+0000 7f3dfc24a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31438c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfc24a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31438c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58166/0 (socket says 172.21.15.144:58166) 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfc24a640 1 -- 172.21.15.144:0/841298484 learned_addr learned my addr 172.21.15.144:0/841298484 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfc24a640 1 -- 172.21.15.144:0/841298484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d314391a0 con 0x559d31346660 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31438c60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x559d31432a70 tx=0x7f3dec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3ce8e09640 1 -- 172.21.15.144:0/841298484 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dec012030 con 0x559d31346660 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3ce8e09640 1 -- 172.21.15.144:0/841298484 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec001440 con 0x559d31346660 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d31439430 con 0x559d31346660 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3ce8e09640 1 -- 172.21.15.144:0/841298484 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dec01aaf0 con 0x559d31346660 2024-09-13T19:33:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d3143c110 con 0x559d31346660 2024-09-13T19:33:35.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3ce8e09640 1 -- 172.21.15.144:0/841298484 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3dec015020 con 0x559d31346660 2024-09-13T19:33:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3ce8e09640 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ce4034650 0x7f3ce4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3ce8e09640 1 -- 172.21.15.144:0/841298484 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3dec020030 con 0x559d31346660 2024-09-13T19:33:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfba49640 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ce4034650 0x7f3ce4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d3134a9e0 0x559d3143fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314402a0 con 0x559d3134a9e0 2024-09-13T19:33:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfca4b640 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d3134a9e0 0x559d3143fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfba49640 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ce4034650 0x7f3ce4036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3df00ad000 tx=0x7f3df00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfca4b640 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d3134a9e0 0x559d3143fc30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfca4b640 1 -- 172.21.15.144:0/841298484 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df400a4d0 con 0x559d3134a9e0 2024-09-13T19:33:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.271+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d3143d330 con 0x559d3134a9e0 2024-09-13T19:33:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfca4b640 1 -- 172.21.15.144:0/841298484 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3df400a4d0 con 0x559d3134a9e0 2024-09-13T19:33:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d314425d0 0x559d314449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d31445090 con 0x559d314425d0 2024-09-13T19:33:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d314425d0 0x559d314449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d314425d0 0x559d314449c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfc24a640 1 -- 172.21.15.144:0/841298484 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3dec008030 con 0x559d314425d0 2024-09-13T19:33:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d31441470 con 0x559d3134a9e0 2024-09-13T19:33:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfca4b640 1 -- 172.21.15.144:0/841298484 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3df400a4d0 con 0x559d3134a9e0 2024-09-13T19:33:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d31441950 con 0x559d3134a9e0 2024-09-13T19:33:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfca4b640 1 -- 172.21.15.144:0/841298484 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3df400a4d0 con 0x559d3134a9e0 2024-09-13T19:33:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfe73a980 1 Processor -- start 2024-09-13T19:33:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfe73a980 1 -- start start 2024-09-13T19:33:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfe73a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d312bcd80 0x559d312bb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfe73a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d3124d800 con 0x559d312bcd80 2024-09-13T19:33:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfca4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d312bcd80 0x559d312bb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfca4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d312bcd80 0x559d312bb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58178/0 (socket says 172.21.15.144:58178) 2024-09-13T19:33:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfca4b640 1 -- 172.21.15.144:0/3813449398 learned_addr learned my addr 172.21.15.144:0/3813449398 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.275+0000 7f3dfca4b640 1 -- 172.21.15.144:0/3813449398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d312bd1a0 con 0x559d312bcd80 2024-09-13T19:33:35.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfca4b640 1 --2- 172.21.15.144:0/3813449398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d312bcd80 0x559d312bb400 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x559d31439b60 tx=0x7f3df4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3ce1ffb640 1 -- 172.21.15.144:0/3813449398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df4014450 con 0x559d312bcd80 2024-09-13T19:33:35.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3ce1ffb640 1 -- 172.21.15.144:0/3813449398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4014610 con 0x559d312bcd80 2024-09-13T19:33:35.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfe73a980 1 -- 172.21.15.144:0/3813449398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d312bb9a0 con 0x559d312bcd80 2024-09-13T19:33:35.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3ce1ffb640 1 -- 172.21.15.144:0/3813449398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df4014930 con 0x559d312bcd80 2024-09-13T19:33:35.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfe73a980 1 -- 172.21.15.144:0/3813449398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d312bbe70 con 0x559d312bcd80 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3ce1ffb640 1 -- 172.21.15.144:0/3813449398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3df4011040 con 0x559d312bcd80 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3ce1ffb640 1 --2- 172.21.15.144:0/3813449398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3cd40346a0 0x7f3cd4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3ce1ffb640 1 -- 172.21.15.144:0/3813449398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3df401e070 con 0x559d312bcd80 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/3813449398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3cd40346a0 0x7f3cd4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfe73a980 1 Processor -- start 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfe73a980 1 -- start start 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/3813449398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3cd40346a0 0x7f3cd4036b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x559d31440720 tx=0x7f3dec01af30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfe73a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31462800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfe73a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d314321e0 con 0x559d31462400 2024-09-13T19:33:35.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfca4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31462800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfca4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31462800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58188/0 (socket says 172.21.15.144:58188) 2024-09-13T19:33:35.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfca4b640 1 -- 172.21.15.144:0/2110936987 learned_addr learned my addr 172.21.15.144:0/2110936987 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfca4b640 1 -- 172.21.15.144:0/2110936987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d31462dd0 con 0x559d31462400 2024-09-13T19:33:35.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.279+0000 7f3dfca4b640 1 --2- 172.21.15.144:0/2110936987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31462800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3df404a040 tx=0x7f3df404a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f135680c0db13c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3cdb7fe640 1 -- 172.21.15.144:0/2110936987 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df4028070 con 0x559d31462400 2024-09-13T19:33:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3cdb7fe640 1 -- 172.21.15.144:0/2110936987 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4013e00 con 0x559d31462400 2024-09-13T19:33:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3cdb7fe640 1 -- 172.21.15.144:0/2110936987 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df4016910 con 0x559d31462400 2024-09-13T19:33:35.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2110936987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 msgr2=0x559d31462800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/2110936987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31462800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3df404a040 tx=0x7f3df404a2f0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2110936987 shutdown_connections 2024-09-13T19:33:35.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/2110936987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31462800 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2110936987 >> 172.21.15.144:0/2110936987 conn(0x559d3145e830 msgr2=0x559d3145c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2110936987 shutdown_connections 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- 172.21.15.144:0/2110936987 wait complete. 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 Processor -- start 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- start start 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31469860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d31463420 con 0x559d31462400 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfca4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31469860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfca4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31469860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58202/0 (socket says 172.21.15.144:58202) 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 learned_addr learned my addr 172.21.15.144:0/1421453219 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d31469da0 con 0x559d31462400 2024-09-13T19:33:35.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfca4b640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31469860 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3df4013fd0 tx=0x7f3df4049fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3cd9ffb640 1 -- 172.21.15.144:0/1421453219 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df4022e70 con 0x559d31462400 2024-09-13T19:33:35.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d3146a030 con 0x559d31462400 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d3146cd10 con 0x559d31462400 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3cd9ffb640 1 -- 172.21.15.144:0/1421453219 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df402b560 con 0x559d31462400 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.283+0000 7f3cd9ffb640 1 -- 172.21.15.144:0/1421453219 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df4050060 con 0x559d31462400 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3cd9ffb640 1 -- 172.21.15.144:0/1421453219 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3df404b070 con 0x559d31462400 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3cd9ffb640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ccc0347f0 0x7f3ccc036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3cd9ffb640 1 -- 172.21.15.144:0/1421453219 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3df4034030 con 0x559d31462400 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ccc0347f0 0x7f3ccc036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d31474ec0 0x559d31477360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d31477ab0 con 0x559d31474ec0 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfba49640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d31474ec0 0x559d31477360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ccc0347f0 0x7f3ccc036cb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3dec01a9f0 tx=0x7f3dec03a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfba49640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d31474ec0 0x559d31477360 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 realm 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d31477e80 con 0x559d31474ec0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d31478720 con 0x559d31474ec0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d31478ac0 con 0x559d31474ec0 2024-09-13T19:33:35.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d31479820 0x559d3147bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d3147c260 con 0x559d31479820 2024-09-13T19:33:35.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfca4b640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d31479820 0x559d3147bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfca4b640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d31479820 0x559d3147bc10 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:35.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 20 searching for the correct realm 2024-09-13T19:33:35.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559d3147e1b0 0x559d314805e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.287+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559d3147e1b0 0x559d314805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559d3147e1b0 0x559d314805e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfc24a640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3dec046040 0x7f3dec02d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x7f3dec046040 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3dec046040 0x7f3dec02d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3dec046040 0x7f3dec02d3f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31474ec0 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31474ec0 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x7f3dec046040 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.291+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31474ec0 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31474ec0 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x7f3dec046040 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31474ec0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31474ec0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.295+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x7f3dec046040 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31474ec0 2024-09-13T19:33:35.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x7f3dec046040 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d3147e1b0 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31479820 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x559d31474ec0 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.299+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559d31480cb0 con 0x7f3dec046040 2024-09-13T19:33:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d3147cc20 con 0x559d31474ec0 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d3147d4c0 con 0x559d31474ec0 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d3147c860 con 0x559d31474ec0 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 zone default found 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 4 Realm: () 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 zonegroup default 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314811e0 con 0x559d31479820 2024-09-13T19:33:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314834b0 con 0x559d3147e1b0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d31483850 con 0x559d3147e1b0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 started sync module instance, tier type = 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31482940 con 0x7f3dec046040 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94133625040448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31482940 con 0x7f3dec046040 2024-09-13T19:33:35.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.303+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31484260 con 0x559d31474ec0 2024-09-13T19:33:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.307+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94133625040448] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.307+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.307+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94133625044672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31482940 con 0x559d31474ec0 2024-09-13T19:33:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.307+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31484c70 con 0x559d3147e1b0 2024-09-13T19:33:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.307+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.307+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94133625046976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314854c0 con 0x559d3147e1b0 2024-09-13T19:33:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.307+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31485e80 con 0x7f3dec046040 2024-09-13T19:33:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.307+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94133625044672] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.311+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.311+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94133625051600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31485df0 con 0x7f3dec046040 2024-09-13T19:33:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.311+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31486c10 con 0x559d31474ec0 2024-09-13T19:33:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.311+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94133625046976] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.311+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94133625051600] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.311+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.311+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94133625049104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314866d0 con 0x559d31474ec0 2024-09-13T19:33:35.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.311+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314874b0 con 0x559d31479820 2024-09-13T19:33:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.315+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94133625049104] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.315+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.315+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94133625057280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314866d0 con 0x559d31479820 2024-09-13T19:33:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.315+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31487d00 con 0x559d31479820 2024-09-13T19:33:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.315+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94133625057280] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.315+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.315+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94133625054000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31487d00 con 0x559d31479820 2024-09-13T19:33:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.315+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314886c0 con 0x559d31479820 2024-09-13T19:33:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94133625054000] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94133625059408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314888a0 con 0x559d31479820 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 20 add_watcher() i=0 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 20 add_watcher() i=1 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 20 add_watcher() i=2 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 20 add_watcher() i=3 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 20 add_watcher() i=4 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 20 add_watcher() i=5 2024-09-13T19:33:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 20 add_watcher() i=6 2024-09-13T19:33:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94133625059408] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 20 add_watcher() i=7 2024-09-13T19:33:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d3148ba50 con 0x559d31474ec0 2024-09-13T19:33:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94133625074688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d3148ba50 con 0x559d31474ec0 2024-09-13T19:33:35.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.319+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94133625074688] v30'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3cb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:35.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:35.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:35.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 5 note: GC not initialized 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3cb17e2640 20 reqs_thread_entry: start 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 Filter name: none 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3c22ffd640 20 reqs_thread_entry: start 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314af0a0 con 0x559d31474ec0 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314aebc0 con 0x559d31474ec0 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 8.10 8:09bb0a1d:root::.bucket.meta.testx%3amyfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314b29a0 con 0x559d3147e1b0 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 20 rados_obj.operate() r=0 bl.length=412 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:35.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:35.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:33:35.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:35.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:33:35.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314b6ed0 con 0x559d31474ec0 2024-09-13T19:33:35.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.323+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314ba7e0 con 0x559d3147e1b0 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [create,call,writefull 0~379,setxattr (123)] v30'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x7 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1, ofs0, ns] 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94133625258976 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314ba0e0 con 0x7f3dec046040 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== watch-notify(notify (1) cookie 94133625040448 notify 128849018903 ret 0) ==== 770+0+0 (crc 0 0 0) 0x559d3134e320 con 0x7f3dec046040 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3cdb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018903 cookie 94133625040448 notifier 4552 bl.length()=728 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3cdb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x7 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3cdb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3cdb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3cdb7fe640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3cc0003eb0 con 0x7f3dec046040 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.0 [notify cookie 94133625258976 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== watch-notify(notify_complete (2) cookie 94133625258976 notify 128849018903 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3df00dd810 con 0x7f3dec046040 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_sources= new_sources= 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential sources added=[] removed=[] 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_dests= new_dests= 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential dests added=[] removed=[] 2024-09-13T19:33:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.327+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314b5fb0 con 0x7f3dec046040 2024-09-13T19:33:35.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314b93f0 con 0x7f3dec046040 2024-09-13T19:33:35.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfe73a980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:33:35.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfe73a980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:35.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfe73a980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:33:35.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94133625248832 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314b6510 con 0x559d31479820 2024-09-13T19:33:35.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== watch-notify(notify (1) cookie 94133625054000 notify 128849018890 ret 0) ==== 356+0+0 (crc 0 0 0) 0x559d3146a030 con 0x559d31479820 2024-09-13T19:33:35.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3cdaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94133625054000 notifier 4552 bl.length()=314 2024-09-13T19:33:35.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3cdaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:33:35.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3cdaffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:35.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3cdaffd640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3c30003410 con 0x559d31479820 2024-09-13T19:33:35.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.6 [notify cookie 94133625248832 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.331+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== watch-notify(notify_complete (2) cookie 94133625248832 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d31469da0 con 0x559d31479820 2024-09-13T19:33:35.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314b9430 con 0x559d31474ec0 2024-09-13T19:33:35.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfe73a980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-13T19:33:35.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfe73a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T19:33:35.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94133625263152 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314b60f0 con 0x559d31474ec0 2024-09-13T19:33:35.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify (1) cookie 94133625049104 notify 128849018892 ret 0) ==== 197+0+0 (crc 0 0 0) 0x559d314bab30 con 0x559d31474ec0 2024-09-13T19:33:35.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3cdb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94133625049104 notifier 4552 bl.length()=155 2024-09-13T19:33:35.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3cdb7fe640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3cc0003eb0 con 0x559d31474ec0 2024-09-13T19:33:35.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(74 notify.4 [notify cookie 94133625263152 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== watch-notify(notify_complete (2) cookie 94133625263152 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d314ba960 con 0x559d31474ec0 2024-09-13T19:33:35.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:76 8.10 8:09bb0a1d:root::.bucket.meta.testx%3amyfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314b9430 con 0x559d3147e1b0 2024-09-13T19:33:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call,delete] v30'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfe73a980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 from cache 2024-09-13T19:33:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfe73a980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1, ofs0, ns] 2024-09-13T19:33:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94133625263152 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559d314b5c40 con 0x559d31479820 2024-09-13T19:33:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== watch-notify(notify (1) cookie 94133625059408 notify 128849018891 ret 0) ==== 254+0+0 (crc 0 0 0) 0x559d31469da0 con 0x559d31479820 2024-09-13T19:33:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3cdaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94133625059408 notifier 4552 bl.length()=212 2024-09-13T19:33:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3cdaffd640 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3c30003480 con 0x559d31479820 2024-09-13T19:33:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.335+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(77 notify.7 [notify cookie 94133625263152 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== watch-notify(notify_complete (2) cookie 94133625263152 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d31462dd0 con 0x559d31479820 2024-09-13T19:33:35.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3cb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:35.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94133625074688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314aced0 con 0x559d31474ec0 2024-09-13T19:33:35.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94133625074688] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94133625040448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314aced0 con 0x7f3dec046040 2024-09-13T19:33:35.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94133625040448] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfe73a980 20 remove_watcher() i=0 2024-09-13T19:33:35.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfe73a980 2 removed watcher, disabling cache 2024-09-13T19:33:35.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.339+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94133625044672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314b2280 con 0x559d31474ec0 2024-09-13T19:33:35.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.343+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94133625044672] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.343+0000 7f3dfe73a980 20 remove_watcher() i=1 2024-09-13T19:33:35.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.343+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94133625046976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d31483ec0 con 0x559d3147e1b0 2024-09-13T19:33:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.343+0000 7f3dfc24a640 1 -- 172.21.15.144:0/1421453219 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94133625046976] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dec008030 con 0x559d3147e1b0 2024-09-13T19:33:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.343+0000 7f3dfe73a980 20 remove_watcher() i=2 2024-09-13T19:33:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.343+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94133625051600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314847c0 con 0x7f3dec046040 2024-09-13T19:33:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.347+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94133625051600] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x7f3dec046040 2024-09-13T19:33:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.347+0000 7f3dfe73a980 20 remove_watcher() i=3 2024-09-13T19:33:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.347+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94133625049104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314859d0 con 0x559d31474ec0 2024-09-13T19:33:35.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.347+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94133625049104] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df00abc70 con 0x559d31474ec0 2024-09-13T19:33:35.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.347+0000 7f3dfe73a980 20 remove_watcher() i=4 2024-09-13T19:33:35.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.347+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94133625057280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314847c0 con 0x559d31479820 2024-09-13T19:33:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.351+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94133625057280] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.351+0000 7f3dfe73a980 20 remove_watcher() i=5 2024-09-13T19:33:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.351+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94133625054000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314859d0 con 0x559d31479820 2024-09-13T19:33:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.351+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94133625054000] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.351+0000 7f3dfe73a980 20 remove_watcher() i=6 2024-09-13T19:33:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.351+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94133625059408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559d314847c0 con 0x559d31479820 2024-09-13T19:33:35.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfca4b640 1 -- 172.21.15.144:0/1421453219 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94133625059408] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df4052070 con 0x559d31479820 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 20 remove_watcher() i=7 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d31479820 msgr2=0x559d3147bc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d31479820 0x559d3147bc10 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d31474ec0 msgr2=0x559d31477360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d31474ec0 0x559d31477360 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3dec046040 msgr2=0x7f3dec02d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3dec046040 0x7f3dec02d3f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559d3147e1b0 msgr2=0x559d314805e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559d3147e1b0 0x559d314805e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ccc0347f0 msgr2=0x7f3ccc036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ccc0347f0 0x7f3ccc036cb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3dec01a9f0 tx=0x7f3dec03a000 comp rx=0 tx=0).stop 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 msgr2=0x559d31469860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/1421453219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31462400 0x559d31469860 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3df4013fd0 tx=0x7f3df4049fd0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfba49640 1 -- 172.21.15.144:0/1421453219 reap_dead start 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 shutdown_connections 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 >> 172.21.15.144:0/1421453219 conn(0x559d3145e830 msgr2=0x559d3145c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 shutdown_connections 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/1421453219 wait complete. 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/3813449398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3cd40346a0 msgr2=0x7f3cd4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/3813449398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3cd40346a0 0x7f3cd4036b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x559d31440720 tx=0x7f3dec01af30 comp rx=0 tx=0).stop 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/3813449398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d312bcd80 msgr2=0x559d312bb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/3813449398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d312bcd80 0x559d312bb400 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x559d31439b60 tx=0x7f3df4018830 comp rx=0 tx=0).stop 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/3813449398 shutdown_connections 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/3813449398 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3cd40346a0 0x7f3cd4036b60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/3813449398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d312bcd80 0x559d312bb400 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/3813449398 >> 172.21.15.144:0/3813449398 conn(0x559d31448920 msgr2=0x559d3144b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/3813449398 shutdown_connections 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/3813449398 wait complete. 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d314425d0 msgr2=0x559d314449c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d314425d0 0x559d314449c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d3134a9e0 msgr2=0x559d3143fc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d3134a9e0 0x559d3143fc30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ce4034650 msgr2=0x7f3ce4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ce4034650 0x7f3ce4036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3df00ad000 tx=0x7f3df00a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:35.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 msgr2=0x559d31438c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31438c60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x559d31432a70 tx=0x7f3dec000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 shutdown_connections 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559d3134a9e0 0x559d3143fc30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559d314425d0 0x559d314449c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3ce4034650 0x7f3ce4036b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 --2- 172.21.15.144:0/841298484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d31346660 0x559d31438c60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 >> 172.21.15.144:0/841298484 conn(0x559d31342180 msgr2=0x559d3142c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 shutdown_connections 2024-09-13T19:33:35.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.355+0000 7f3dfe73a980 1 -- 172.21.15.144:0/841298484 wait complete. 2024-09-13T19:33:35.367 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:33:35.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:33:35.368 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-13T19:33:35.436 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:35.436 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:35.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf4279e980 1 Processor -- start 2024-09-13T19:33:35.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf4279e980 1 -- start start 2024-09-13T19:33:35.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf4279e980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55c5d672aed0 0x55c5d672d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf4279e980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5d65acae0 con 0x55c5d66992a0 2024-09-13T19:33:35.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf4279e980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55c5d65d0e30 con 0x55c5d672aed0 2024-09-13T19:33:35.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf402ae640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55c5d66992a0 0x55c5d67297b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44696/0 (socket says 172.21.15.144:44696) 2024-09-13T19:33:35.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf402ae640 1 -- 172.21.15.144:0/1653401359 learned_addr learned my addr 172.21.15.144:0/1653401359 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:35.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf3faad640 1 --2- 172.21.15.144:0/1653401359 >> v2:172.21.15.18:3300/0 conn(0x55c5d672aed0 0x55c5d672d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf3f2ac640 1 -- 172.21.15.144:0/1653401359 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802334481 0 0) 0x55c5d65acae0 con 0x55c5d66992a0 2024-09-13T19:33:35.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf3f2ac640 1 -- 172.21.15.144:0/1653401359 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf2c001e20 con 0x55c5d66992a0 2024-09-13T19:33:35.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf3faad640 1 -- 172.21.15.144:0/1653401359 >> v1:172.21.15.18:6789/0 conn(0x55c5d66992a0 legacy=0x55c5d67297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.435+0000 7fcf3faad640 1 -- 172.21.15.144:0/1653401359 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d6699680 con 0x55c5d672aed0 2024-09-13T19:33:35.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf3faad640 1 --2- 172.21.15.144:0/1653401359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d672aed0 0x55c5d672d2c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800a480 tx=0x7fcf2801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0eb7948e324d0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf3f2ac640 1 -- 172.21.15.144:0/1653401359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf280b0070 con 0x55c5d672aed0 2024-09-13T19:33:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf3f2ac640 1 -- 172.21.15.144:0/1653401359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf280ab540 con 0x55c5d672aed0 2024-09-13T19:33:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf3f2ac640 1 -- 172.21.15.144:0/1653401359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf280ab840 con 0x55c5d672aed0 2024-09-13T19:33:35.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf4279e980 1 -- 172.21.15.144:0/1653401359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d672aed0 msgr2=0x55c5d672d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1653401359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d672aed0 0x55c5d672d2c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800a480 tx=0x7fcf2801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:35.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf4279e980 1 -- 172.21.15.144:0/1653401359 shutdown_connections 2024-09-13T19:33:35.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1653401359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d672aed0 0x55c5d672d2c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf4279e980 1 -- 172.21.15.144:0/1653401359 >> 172.21.15.144:0/1653401359 conn(0x55c5d671f0a0 msgr2=0x55c5d67214c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf4279e980 1 -- 172.21.15.144:0/1653401359 shutdown_connections 2024-09-13T19:33:35.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.439+0000 7fcf4279e980 1 -- 172.21.15.144:0/1653401359 wait complete. 2024-09-13T19:33:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf4279e980 1 Processor -- start 2024-09-13T19:33:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf4279e980 1 -- start start 2024-09-13T19:33:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf4279e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6811c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf4279e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5d65d2200 con 0x55c5d66992a0 2024-09-13T19:33:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf402ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6811c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf402ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6811c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58228/0 (socket says 172.21.15.144:58228) 2024-09-13T19:33:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf402ae640 1 -- 172.21.15.144:0/1089883649 learned_addr learned my addr 172.21.15.144:0/1089883649 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf402ae640 1 -- 172.21.15.144:0/1089883649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d6812200 con 0x55c5d66992a0 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.451+0000 7fcf402ae640 1 --2- 172.21.15.144:0/1089883649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6811c30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcf30001740 tx=0x7fcf30001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafa227c8bf78110 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fce2e60c640 1 -- 172.21.15.144:0/1089883649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf30016070 con 0x55c5d66992a0 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fce2e60c640 1 -- 172.21.15.144:0/1089883649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30004530 con 0x55c5d66992a0 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fce2e60c640 1 -- 172.21.15.144:0/1089883649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf30004850 con 0x55c5d66992a0 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- 172.21.15.144:0/1089883649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 msgr2=0x55c5d6811c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1089883649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6811c30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcf30001740 tx=0x7fcf30001c00 comp rx=0 tx=0).stop 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- 172.21.15.144:0/1089883649 shutdown_connections 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1089883649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6811c30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- 172.21.15.144:0/1089883649 >> 172.21.15.144:0/1089883649 conn(0x55c5d671f0a0 msgr2=0x55c5d680d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- 172.21.15.144:0/1089883649 shutdown_connections 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- 172.21.15.144:0/1089883649 wait complete. 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 Processor -- start 2024-09-13T19:33:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- start start 2024-09-13T19:33:35.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6818fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5d6730230 con 0x55c5d66992a0 2024-09-13T19:33:35.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf402ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6818fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf402ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6818fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58242/0 (socket says 172.21.15.144:58242) 2024-09-13T19:33:35.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf402ae640 1 -- 172.21.15.144:0/4251409664 learned_addr learned my addr 172.21.15.144:0/4251409664 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf402ae640 1 -- 172.21.15.144:0/4251409664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d68194e0 con 0x55c5d66992a0 2024-09-13T19:33:35.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf402ae640 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6818fa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcf30014040 tx=0x7fcf30001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fce2ce09640 1 -- 172.21.15.144:0/4251409664 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf30016040 con 0x55c5d66992a0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fce2ce09640 1 -- 172.21.15.144:0/4251409664 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30011400 con 0x55c5d66992a0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5d6819770 con 0x55c5d66992a0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fce2ce09640 1 -- 172.21.15.144:0/4251409664 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf30011720 con 0x55c5d66992a0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.455+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d681c450 con 0x55c5d66992a0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fce2ce09640 1 -- 172.21.15.144:0/4251409664 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf300118c0 con 0x55c5d66992a0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fce2ce09640 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce280346a0 0x7fce28036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fce2ce09640 1 -- 172.21.15.144:0/4251409664 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fcf30049420 con 0x55c5d66992a0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf3faad640 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce280346a0 0x7fce28036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d681e090 0x55c5d6820480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68209c0 con 0x55c5d681e090 2024-09-13T19:33:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf40aaf640 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d681e090 0x55c5d6820480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf3faad640 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce280346a0 0x7fce28036b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf280ad000 tx=0x7fcf280a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf40aaf640 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d681e090 0x55c5d6820480 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf40aaf640 1 -- 172.21.15.144:0/4251409664 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf380083f0 con 0x55c5d681e090 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d681d650 con 0x55c5d681e090 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf40aaf640 1 -- 172.21.15.144:0/4251409664 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf380083f0 con 0x55c5d681e090 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6822c60 0x55c5d6825050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6825740 con 0x55c5d6822c60 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf402ae640 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6822c60 0x55c5d6825050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.459+0000 7fcf402ae640 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6822c60 0x55c5d6825050 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf402ae640 1 -- 172.21.15.144:0/4251409664 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d6822c60 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6821b00 con 0x55c5d681e090 2024-09-13T19:33:35.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf40aaf640 1 -- 172.21.15.144:0/4251409664 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf380083f0 con 0x55c5d681e090 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6821fe0 con 0x55c5d681e090 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf40aaf640 1 -- 172.21.15.144:0/4251409664 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf380083f0 con 0x55c5d681e090 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf4279e980 1 Processor -- start 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf4279e980 1 -- start start 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf4279e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d6833e60 0x55c5d6834280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf4279e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5d662b800 con 0x55c5d6833e60 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf40aaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d6833e60 0x55c5d6834280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf40aaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d6833e60 0x55c5d6834280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58250/0 (socket says 172.21.15.144:58250) 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf40aaf640 1 -- 172.21.15.144:0/3013932597 learned_addr learned my addr 172.21.15.144:0/3013932597 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf40aaf640 1 -- 172.21.15.144:0/3013932597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d68347c0 con 0x55c5d6833e60 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf40aaf640 1 --2- 172.21.15.144:0/3013932597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d6833e60 0x55c5d6834280 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55c5d681a3d0 tx=0x7fcf3800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fce25ffb640 1 -- 172.21.15.144:0/3013932597 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38007dd0 con 0x55c5d6833e60 2024-09-13T19:33:35.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf4279e980 1 -- 172.21.15.144:0/3013932597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5d6834a50 con 0x55c5d6833e60 2024-09-13T19:33:35.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fce25ffb640 1 -- 172.21.15.144:0/3013932597 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3801e020 con 0x55c5d6833e60 2024-09-13T19:33:35.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fce25ffb640 1 -- 172.21.15.144:0/3013932597 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38019550 con 0x55c5d6833e60 2024-09-13T19:33:35.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.463+0000 7fcf4279e980 1 -- 172.21.15.144:0/3013932597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d68376d0 con 0x55c5d6833e60 2024-09-13T19:33:35.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fce25ffb640 1 -- 172.21.15.144:0/3013932597 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf38016040 con 0x55c5d6833e60 2024-09-13T19:33:35.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fce25ffb640 1 --2- 172.21.15.144:0/3013932597 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce18034650 0x7fce18036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fce25ffb640 1 -- 172.21.15.144:0/3013932597 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fcf3801f030 con 0x55c5d6833e60 2024-09-13T19:33:35.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf402ae640 1 --2- 172.21.15.144:0/3013932597 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce18034650 0x7fce18036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 Processor -- start 2024-09-13T19:33:35.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- start start 2024-09-13T19:33:35.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf402ae640 1 --2- 172.21.15.144:0/3013932597 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce18034650 0x7fce18036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55c5d6820dd0 tx=0x7fcf30047890 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6840d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5d6812580 con 0x55c5d68409a0 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf40aaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6840d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf40aaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6840d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58256/0 (socket says 172.21.15.144:58256) 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf40aaf640 1 -- 172.21.15.144:0/3642601286 learned_addr learned my addr 172.21.15.144:0/3642601286 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf40aaf640 1 -- 172.21.15.144:0/3642601286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d6841350 con 0x55c5d68409a0 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf40aaf640 1 --2- 172.21.15.144:0/3642601286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6840d80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcf3804a010 tx=0x7fcf38015800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c909dc14287fd63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fce1f7fe640 1 -- 172.21.15.144:0/3642601286 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3801d070 con 0x55c5d68409a0 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fce1f7fe640 1 -- 172.21.15.144:0/3642601286 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf380224f0 con 0x55c5d68409a0 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fce1f7fe640 1 -- 172.21.15.144:0/3642601286 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38014470 con 0x55c5d68409a0 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- 172.21.15.144:0/3642601286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 msgr2=0x55c5d6840d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 --2- 172.21.15.144:0/3642601286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6840d80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcf3804a010 tx=0x7fcf38015800 comp rx=0 tx=0).stop 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- 172.21.15.144:0/3642601286 shutdown_connections 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 --2- 172.21.15.144:0/3642601286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6840d80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- 172.21.15.144:0/3642601286 >> 172.21.15.144:0/3642601286 conn(0x55c5d683cd80 msgr2=0x55c5d683ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- 172.21.15.144:0/3642601286 shutdown_connections 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- 172.21.15.144:0/3642601286 wait complete. 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 Processor -- start 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- start start 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6847ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf4279e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5d6841910 con 0x55c5d68409a0 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf40aaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6847ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf40aaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6847ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58262/0 (socket says 172.21.15.144:58262) 2024-09-13T19:33:35.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.467+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 learned_addr learned my addr 172.21.15.144:0/1723227732 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.471+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d6848220 con 0x55c5d68409a0 2024-09-13T19:33:35.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.471+0000 7fcf40aaf640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6847ce0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55c5d683ba30 tx=0x7fcf38049f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fce1dffb640 1 -- 172.21.15.144:0/1723227732 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38019900 con 0x55c5d68409a0 2024-09-13T19:33:35.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5d68484b0 con 0x55c5d68409a0 2024-09-13T19:33:35.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fce1dffb640 1 -- 172.21.15.144:0/1723227732 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf38019aa0 con 0x55c5d68409a0 2024-09-13T19:33:35.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fce1dffb640 1 -- 172.21.15.144:0/1723227732 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3804b190 con 0x55c5d68409a0 2024-09-13T19:33:35.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d684b190 con 0x55c5d68409a0 2024-09-13T19:33:35.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fce1dffb640 1 -- 172.21.15.144:0/1723227732 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf38043050 con 0x55c5d68409a0 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fce1dffb640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce10034650 0x7fce10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fce1dffb640 1 -- 172.21.15.144:0/1723227732 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fcf38041020 con 0x55c5d68409a0 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf402ae640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce10034650 0x7fce10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d6853110 0x55c5d68555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6855cf0 con 0x55c5d6853110 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf3faad640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d6853110 0x55c5d68555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf402ae640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce10034650 0x7fce10036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcf30049010 tx=0x7fcf30032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf3faad640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d6853110 0x55c5d68555a0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 realm 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68560c0 con 0x55c5d6853110 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6856990 con 0x55c5d6853110 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6856d30 con 0x55c5d6853110 2024-09-13T19:33:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6857a90 0x55c5d6859e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.475+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685a4d0 con 0x55c5d6857a90 2024-09-13T19:33:35.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf40aaf640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6857a90 0x55c5d6859e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf40aaf640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6857a90 0x55c5d6859e80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf4279e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:35.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf4279e980 20 searching for the correct realm 2024-09-13T19:33:35.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c5d685c3b0 0x55c5d685e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d685c3b0 2024-09-13T19:33:35.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf402ae640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c5d685c3b0 0x55c5d685e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf402ae640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c5d685c3b0 0x55c5d685e820 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf402ae640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf3002d4c0 0x7fcf3002c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf3faad640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf3002d4c0 0x7fcf3002c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf3faad640 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf3002d4c0 0x7fcf3002c300 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d6857a90 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.479+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d6853110 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d6853110 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d6857a90 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d6857a90 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d685c3b0 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d6853110 2024-09-13T19:33:35.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d6857a90 2024-09-13T19:33:35.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d6853110 2024-09-13T19:33:35.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685eef0 con 0x55c5d685c3b0 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d685c3b0 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.483+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6857a90 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d685c3b0 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d685c3b0 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6853110 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6853110 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6857a90 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d685c3b0 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x7fcf3002d4c0 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6853110 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6857a90 2024-09-13T19:33:35.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d685c3b0 2024-09-13T19:33:35.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.487+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6857a90 2024-09-13T19:33:35.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x7fcf3002d4c0 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d685c3b0 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6857a90 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x55c5d6853110 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fcf30056040 con 0x7fcf3002d4c0 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:35.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685ae20 con 0x55c5d6853110 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685aa60 con 0x55c5d6853110 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685b780 con 0x55c5d6853110 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 zone default found 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 4 Realm: () 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 zonegroup default 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d685f370 con 0x55c5d6857a90 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6861620 con 0x55c5d685c3b0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68619c0 con 0x55c5d685c3b0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 started sync module instance, tier type = 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.491+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6860ab0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.495+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.495+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94308196028336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6860ab0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.495+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6862420 con 0x55c5d6853110 2024-09-13T19:33:35.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.495+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94308196028336] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.495+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.495+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94308196032304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6860ab0 con 0x55c5d6853110 2024-09-13T19:33:35.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.495+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6862e30 con 0x55c5d685c3b0 2024-09-13T19:33:35.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94308196032304] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94308196025856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6860a20 con 0x55c5d685c3b0 2024-09-13T19:33:35.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6863b30 con 0x7fcf3002d4c0 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94308196038576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68643d0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6864dd0 con 0x55c5d6853110 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94308196025856] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.499+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94308196038576] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.503+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.503+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94308196037072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6863eb0 con 0x55c5d6853110 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.503+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6865670 con 0x55c5d6857a90 2024-09-13T19:33:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.503+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94308196037072] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.503+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.503+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94308196045248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6863eb0 con 0x55c5d6857a90 2024-09-13T19:33:35.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.503+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6865ec0 con 0x55c5d6857a90 2024-09-13T19:33:35.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94308196045248] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94308196042976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6865ec0 con 0x55c5d6857a90 2024-09-13T19:33:35.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6866880 con 0x55c5d6857a90 2024-09-13T19:33:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94308196049872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6866ce0 con 0x55c5d6857a90 2024-09-13T19:33:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 20 add_watcher() i=0 2024-09-13T19:33:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 20 add_watcher() i=1 2024-09-13T19:33:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 20 add_watcher() i=2 2024-09-13T19:33:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 20 add_watcher() i=3 2024-09-13T19:33:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 20 add_watcher() i=4 2024-09-13T19:33:35.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.507+0000 7fcf4279e980 20 add_watcher() i=5 2024-09-13T19:33:35.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94308196042976] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf4279e980 20 add_watcher() i=6 2024-09-13T19:33:35.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94308196049872] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf4279e980 20 add_watcher() i=7 2024-09-13T19:33:35.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf4279e980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:35.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6865a10 con 0x55c5d6853110 2024-09-13T19:33:35.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94308196047376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6867220 con 0x55c5d6853110 2024-09-13T19:33:35.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94308196047376] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcdf67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:35.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf4279e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:35.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf4279e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:35.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.511+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68725d0 con 0x55c5d6853110 2024-09-13T19:33:35.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.515+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.515+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6872c20 con 0x55c5d6857a90 2024-09-13T19:33:35.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.515+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.515+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6872c20 con 0x55c5d685c3b0 2024-09-13T19:33:35.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.519+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.519+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6873510 con 0x55c5d6853110 2024-09-13T19:33:35.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.519+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.519+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6870510 con 0x7fcf3002d4c0 2024-09-13T19:33:35.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.519+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.519+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6870510 con 0x55c5d685c3b0 2024-09-13T19:33:35.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.519+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.519+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6873fd0 con 0x55c5d6853110 2024-09-13T19:33:35.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.523+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.523+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6873fd0 con 0x55c5d6857a90 2024-09-13T19:33:35.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.523+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.523+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6873fd0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.527+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.527+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68741a0 con 0x55c5d685c3b0 2024-09-13T19:33:35.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.527+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.527+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68741a0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.527+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.527+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68741a0 con 0x55c5d6857a90 2024-09-13T19:33:35.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.531+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.531+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68741a0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.531+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.531+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68741a0 con 0x55c5d6857a90 2024-09-13T19:33:35.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.531+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.535+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68741a0 con 0x55c5d6853110 2024-09-13T19:33:35.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.535+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.535+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68741a0 con 0x55c5d685c3b0 2024-09-13T19:33:35.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.535+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.535+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6873fd0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.535+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.535+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6873fd0 con 0x55c5d685c3b0 2024-09-13T19:33:35.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.539+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.539+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6874080 con 0x55c5d6853110 2024-09-13T19:33:35.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.539+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.539+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6874080 con 0x55c5d6853110 2024-09-13T19:33:35.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.539+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.539+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d685c3b0 2024-09-13T19:33:35.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.543+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.543+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.543+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.543+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d685c3b0 2024-09-13T19:33:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.543+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.543+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d685c3b0 2024-09-13T19:33:35.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.547+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.547+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d685c3b0 2024-09-13T19:33:35.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.547+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.547+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d685c3b0 2024-09-13T19:33:35.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.547+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.547+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d6857a90 2024-09-13T19:33:35.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.551+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.551+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d685c3b0 2024-09-13T19:33:35.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.551+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.551+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d6857a90 2024-09-13T19:33:35.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.551+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.551+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d685c3b0 2024-09-13T19:33:35.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.555+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.555+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x55c5d6857a90 2024-09-13T19:33:35.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.555+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.555+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68700f0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcdf57e2640 20 reqs_thread_entry: start 2024-09-13T19:33:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 20 Filter name: none 2024-09-13T19:33:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcd66ffd640 20 reqs_thread_entry: start 2024-09-13T19:33:35.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:33:35.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d688fa30 con 0x55c5d6857a90 2024-09-13T19:33:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T19:33:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T19:33:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:33:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6891f00 con 0x55c5d6853110 2024-09-13T19:33:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:33:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.559+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d688fee0 con 0x55c5d6857a90 2024-09-13T19:33:35.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf4279e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94308196219536 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68927a0 con 0x55c5d685c3b0 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== watch-notify(notify (1) cookie 94308196025856 notify 128849018885 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c5d68745c0 con 0x55c5d685c3b0 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fce1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94308196025856 notifier 4559 bl.length()=170 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(97 notify.2 [notify cookie 94308196219536 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fce1f7fe640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fce04003d70 con 0x55c5d685c3b0 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== watch-notify(notify_complete (2) cookie 94308196219536 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcf30050040 con 0x55c5d685c3b0 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf4279e980 10 removing email index: 2024-09-13T19:33:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf4279e980 10 removing user buckets index 2024-09-13T19:33:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d688fa60 con 0x55c5d6853110 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf4279e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94308196219488 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d68927a0 con 0x55c5d6853110 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== watch-notify(notify (1) cookie 94308196037072 notify 128849018893 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55c5d6870830 con 0x55c5d6853110 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fce1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94308196037072 notifier 4559 bl.length()=175 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fce1f7fe640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fce04003d70 con 0x55c5d6853110 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(100 notify.4 [notify cookie 94308196219488 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== watch-notify(notify_complete (2) cookie 94308196219488 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5d686fe00 con 0x55c5d6853110 2024-09-13T19:33:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.563+0000 7fcf4279e980 10 removing user index: testx$tenanteduser 2024-09-13T19:33:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d688fb00 con 0x55c5d6857a90 2024-09-13T19:33:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf4279e980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-13T19:33:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf4279e980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T19:33:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94308196221648 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5d688fb00 con 0x7fcf3002d4c0 2024-09-13T19:33:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== watch-notify(notify (1) cookie 94308196038576 notify 128849018904 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55c5d686fe00 con 0x7fcf3002d4c0 2024-09-13T19:33:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fce1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018904 cookie 94308196038576 notifier 4559 bl.length()=167 2024-09-13T19:33:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fce1effd640 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fcd740032d0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(103 notify.3 [notify cookie 94308196221648 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== watch-notify(notify_complete (2) cookie 94308196221648 notify 128849018904 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5d68721c0 con 0x7fcf3002d4c0 2024-09-13T19:33:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcdf67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.567+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94308196047376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d688fb00 con 0x55c5d6853110 2024-09-13T19:33:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94308196047376] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94308196028336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d686d820 con 0x7fcf3002d4c0 2024-09-13T19:33:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94308196028336] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf4279e980 20 remove_watcher() i=0 2024-09-13T19:33:35.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf4279e980 2 removed watcher, disabling cache 2024-09-13T19:33:35.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94308196032304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6871370 con 0x55c5d6853110 2024-09-13T19:33:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94308196032304] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf4279e980 20 remove_watcher() i=1 2024-09-13T19:33:35.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.571+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94308196025856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d688fb00 con 0x55c5d685c3b0 2024-09-13T19:33:35.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.575+0000 7fcf402ae640 1 -- 172.21.15.144:0/1723227732 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94308196025856] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3002c070 con 0x55c5d685c3b0 2024-09-13T19:33:35.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.575+0000 7fcf4279e980 20 remove_watcher() i=2 2024-09-13T19:33:35.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.575+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94308196038576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d686d820 con 0x7fcf3002d4c0 2024-09-13T19:33:35.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.575+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94308196038576] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x7fcf3002d4c0 2024-09-13T19:33:35.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.575+0000 7fcf4279e980 20 remove_watcher() i=3 2024-09-13T19:33:35.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.575+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94308196037072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6871370 con 0x55c5d6853110 2024-09-13T19:33:35.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.579+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94308196037072] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf280ab770 con 0x55c5d6853110 2024-09-13T19:33:35.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.579+0000 7fcf4279e980 20 remove_watcher() i=4 2024-09-13T19:33:35.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.579+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94308196045248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d688fb00 con 0x55c5d6857a90 2024-09-13T19:33:35.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.579+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94308196045248] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.579+0000 7fcf4279e980 20 remove_watcher() i=5 2024-09-13T19:33:35.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.579+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94308196042976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d686d820 con 0x55c5d6857a90 2024-09-13T19:33:35.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94308196042976] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 20 remove_watcher() i=6 2024-09-13T19:33:35.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94308196049872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c5d6871370 con 0x55c5d6857a90 2024-09-13T19:33:35.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf40aaf640 1 -- 172.21.15.144:0/1723227732 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94308196049872] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf38052070 con 0x55c5d6857a90 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 20 remove_watcher() i=7 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6857a90 msgr2=0x55c5d6859e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6857a90 0x55c5d6859e80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d6853110 msgr2=0x55c5d68555a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d6853110 0x55c5d68555a0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf3002d4c0 msgr2=0x7fcf3002c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf3002d4c0 0x7fcf3002c300 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c5d685c3b0 msgr2=0x55c5d685e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55c5d685c3b0 0x55c5d685e820 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce10034650 msgr2=0x7fce10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce10034650 0x7fce10036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcf30049010 tx=0x7fcf30032000 comp rx=0 tx=0).stop 2024-09-13T19:33:35.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 msgr2=0x55c5d6847ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6847ce0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55c5d683ba30 tx=0x7fcf38049f70 comp rx=0 tx=0).stop 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf3faad640 1 -- 172.21.15.144:0/1723227732 reap_dead start 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 shutdown_connections 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/1723227732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d68409a0 0x55c5d6847ce0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 >> 172.21.15.144:0/1723227732 conn(0x55c5d683cd80 msgr2=0x55c5d6842070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 shutdown_connections 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/1723227732 wait complete. 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/3013932597 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce18034650 msgr2=0x7fce18036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/3013932597 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce18034650 0x7fce18036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55c5d6820dd0 tx=0x7fcf30047890 comp rx=0 tx=0).stop 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/3013932597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d6833e60 msgr2=0x55c5d6834280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/3013932597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d6833e60 0x55c5d6834280 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55c5d681a3d0 tx=0x7fcf3800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/3013932597 shutdown_connections 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/3013932597 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce18034650 0x7fce18036b10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/3013932597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d6833e60 0x55c5d6834280 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/3013932597 >> 172.21.15.144:0/3013932597 conn(0x55c5d6828fb0 msgr2=0x55c5d682ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/3013932597 shutdown_connections 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/3013932597 wait complete. 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6822c60 msgr2=0x55c5d6825050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6822c60 0x55c5d6825050 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d681e090 msgr2=0x55c5d6820480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.583+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d681e090 0x55c5d6820480 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce280346a0 msgr2=0x7fce28036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce280346a0 0x7fce28036b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf280ad000 tx=0x7fcf280a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 msgr2=0x55c5d6818fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6818fa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcf30014040 tx=0x7fcf30001260 comp rx=0 tx=0).stop 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 shutdown_connections 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55c5d681e090 0x55c5d6820480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55c5d6822c60 0x55c5d6825050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce280346a0 0x7fce28036b60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 --2- 172.21.15.144:0/4251409664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5d66992a0 0x55c5d6818fa0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 >> 172.21.15.144:0/4251409664 conn(0x55c5d671f0a0 msgr2=0x55c5d680c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 shutdown_connections 2024-09-13T19:33:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.587+0000 7fcf4279e980 1 -- 172.21.15.144:0/4251409664 wait complete. 2024-09-13T19:33:35.606 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T19:33:35.608 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-13T19:33:35.611 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:35.611 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T19:33:35.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T19:33:35.612 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-13T19:33:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2e0db2980 1 Processor -- start 2024-09-13T19:33:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2e0db2980 1 -- start start 2024-09-13T19:33:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2e0db2980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56167aaaa3c0 0x56167aaa8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2e0db2980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56167a9bbae0 con 0x56167aaaa7d0 2024-09-13T19:33:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2e0db2980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56167a9dfe30 con 0x56167aaaa3c0 2024-09-13T19:33:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2de8c2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56167aaaa3c0 0x56167aaa8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2de0c1640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x56167aaaa7d0 0x56167aaa90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44704/0 (socket says 172.21.15.144:44704) 2024-09-13T19:33:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2de0c1640 1 -- 172.21.15.144:0/655536774 learned_addr learned my addr 172.21.15.144:0/655536774 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2de8c2640 1 -- 172.21.15.144:0/655536774 >> v1:172.21.15.18:6789/0 conn(0x56167aaaa7d0 legacy=0x56167aaa90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.679+0000 7fc2de8c2640 1 -- 172.21.15.144:0/655536774 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167aaa98f0 con 0x56167aaaa3c0 2024-09-13T19:33:35.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/655536774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167aaa8b80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800a480 tx=0x7fc2d801b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99122ce28c3b4987 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2dd8c0640 1 -- 172.21.15.144:0/655536774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d80af070 con 0x56167aaaa3c0 2024-09-13T19:33:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2dd8c0640 1 -- 172.21.15.144:0/655536774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d80aa530 con 0x56167aaaa3c0 2024-09-13T19:33:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2dd8c0640 1 -- 172.21.15.144:0/655536774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d80a3e60 con 0x56167aaaa3c0 2024-09-13T19:33:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2e0db2980 1 -- 172.21.15.144:0/655536774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 msgr2=0x56167aaa8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/655536774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167aaa8b80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800a480 tx=0x7fc2d801b0a0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2e0db2980 1 -- 172.21.15.144:0/655536774 shutdown_connections 2024-09-13T19:33:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/655536774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167aaa8b80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2e0db2980 1 -- 172.21.15.144:0/655536774 >> 172.21.15.144:0/655536774 conn(0x56167ab2f1c0 msgr2=0x56167ab315e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2e0db2980 1 -- 172.21.15.144:0/655536774 shutdown_connections 2024-09-13T19:33:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.683+0000 7fc2e0db2980 1 -- 172.21.15.144:0/655536774 wait complete. 2024-09-13T19:33:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.695+0000 7fc2e0db2980 1 Processor -- start 2024-09-13T19:33:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.695+0000 7fc2e0db2980 1 -- start start 2024-09-13T19:33:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.695+0000 7fc2e0db2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac253d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.695+0000 7fc2e0db2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56167a9e1200 con 0x56167aaaa3c0 2024-09-13T19:33:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.695+0000 7fc2de8c2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.695+0000 7fc2de8c2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac253d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58282/0 (socket says 172.21.15.144:58282) 2024-09-13T19:33:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.695+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3855443425 learned_addr learned my addr 172.21.15.144:0/3855443425 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3855443425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167ac259a0 con 0x56167aaaa3c0 2024-09-13T19:33:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/3855443425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac253d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80aa500 tx=0x7fc2d8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1944bed5fb87076e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc1cce09640 1 -- 172.21.15.144:0/3855443425 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d80af070 con 0x56167aaaa3c0 2024-09-13T19:33:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc1cce09640 1 -- 172.21.15.144:0/3855443425 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d80bb070 con 0x56167aaaa3c0 2024-09-13T19:33:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc1cce09640 1 -- 172.21.15.144:0/3855443425 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d80aaad0 con 0x56167aaaa3c0 2024-09-13T19:33:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3855443425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 msgr2=0x56167ac253d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3855443425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac253d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80aa500 tx=0x7fc2d8003030 comp rx=0 tx=0).stop 2024-09-13T19:33:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3855443425 shutdown_connections 2024-09-13T19:33:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3855443425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac253d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3855443425 >> 172.21.15.144:0/3855443425 conn(0x56167ab2f1c0 msgr2=0x56167ac21000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3855443425 shutdown_connections 2024-09-13T19:33:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3855443425 wait complete. 2024-09-13T19:33:35.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 Processor -- start 2024-09-13T19:33:35.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 -- start start 2024-09-13T19:33:35.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac2c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2e0db2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56167ab43a00 con 0x56167aaaa3c0 2024-09-13T19:33:35.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2de8c2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac2c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2de8c2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac2c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58296/0 (socket says 172.21.15.144:58296) 2024-09-13T19:33:35.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2de8c2640 1 -- 172.21.15.144:0/2854920891 learned_addr learned my addr 172.21.15.144:0/2854920891 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2de8c2640 1 -- 172.21.15.144:0/2854920891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167ac2cc30 con 0x56167aaaa3c0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.699+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac2c6f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80b8040 tx=0x7fc2d8017e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc1cb606640 1 -- 172.21.15.144:0/2854920891 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d80cb480 con 0x56167aaaa3c0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56167ac2cec0 con 0x56167aaaa3c0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc1cb606640 1 -- 172.21.15.144:0/2854920891 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d80b0040 con 0x56167aaaa3c0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc1cb606640 1 -- 172.21.15.144:0/2854920891 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d80cb750 con 0x56167aaaa3c0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56167ac2fba0 con 0x56167aaaa3c0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc1cb606640 1 -- 172.21.15.144:0/2854920891 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2d80b6480 con 0x56167aaaa3c0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc1cb606640 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1c4034650 0x7fc1c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc1cb606640 1 -- 172.21.15.144:0/2854920891 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc2d80e4d50 con 0x56167aaaa3c0 2024-09-13T19:33:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2de0c1640 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1c4034650 0x7fc1c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167aaaa7d0 0x56167ac337f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac33d30 con 0x56167aaaa7d0 2024-09-13T19:33:35.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2df0c3640 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167aaaa7d0 0x56167ac337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2de0c1640 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1c4034650 0x7fc1c4036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4001da0 tx=0x7fc2d4001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2df0c3640 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167aaaa7d0 0x56167ac337f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2df0c3640 1 -- 172.21.15.144:0/2854920891 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d000a4d0 con 0x56167aaaa7d0 2024-09-13T19:33:35.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac30da0 con 0x56167aaaa7d0 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2df0c3640 1 -- 172.21.15.144:0/2854920891 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2d000a4d0 con 0x56167aaaa7d0 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac36050 0x56167ac38440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac38b30 con 0x56167ac36050 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.703+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac36050 0x56167ac38440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac36050 0x56167ac38440 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2de8c2640 1 -- 172.21.15.144:0/2854920891 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac36050 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac34ef0 con 0x56167aaaa7d0 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2df0c3640 1 -- 172.21.15.144:0/2854920891 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2d000a4d0 con 0x56167aaaa7d0 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac35390 con 0x56167aaaa7d0 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2df0c3640 1 -- 172.21.15.144:0/2854920891 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2d000a4d0 con 0x56167aaaa7d0 2024-09-13T19:33:35.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2e0db2980 1 Processor -- start 2024-09-13T19:33:35.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2e0db2980 1 -- start start 2024-09-13T19:33:35.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2e0db2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac47210 0x56167ac47630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2e0db2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56167aa3a800 con 0x56167ac47210 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2df0c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac47210 0x56167ac47630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2df0c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac47210 0x56167ac47630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58308/0 (socket says 172.21.15.144:58308) 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2df0c3640 1 -- 172.21.15.144:0/856820265 learned_addr learned my addr 172.21.15.144:0/856820265 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2df0c3640 1 -- 172.21.15.144:0/856820265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167ac47b70 con 0x56167ac47210 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2df0c3640 1 --2- 172.21.15.144:0/856820265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac47210 0x56167ac47630 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x56167ac2db20 tx=0x7fc2d0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc1c8e01640 1 -- 172.21.15.144:0/856820265 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d0014450 con 0x56167ac47210 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2e0db2980 1 -- 172.21.15.144:0/856820265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56167ac47e00 con 0x56167ac47210 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc1c8e01640 1 -- 172.21.15.144:0/856820265 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d00145f0 con 0x56167ac47210 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc1c8e01640 1 -- 172.21.15.144:0/856820265 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d00148d0 con 0x56167ac47210 2024-09-13T19:33:35.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.707+0000 7fc2e0db2980 1 -- 172.21.15.144:0/856820265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56167ac4aa80 con 0x56167ac47210 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc1c8e01640 1 -- 172.21.15.144:0/856820265 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2d0011040 con 0x56167ac47210 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc1c8e01640 1 --2- 172.21.15.144:0/856820265 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1b8034650 0x7fc1b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc1c8e01640 1 -- 172.21.15.144:0/856820265 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc2d001e070 con 0x56167ac47210 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/856820265 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1b8034650 0x7fc1b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 Processor -- start 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 -- start start 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/856820265 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1b8034650 0x7fc1b8036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x56167ac341c0 tx=0x7fc2d80b6810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac54150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56167ac25cc0 con 0x56167ac53d50 2024-09-13T19:33:35.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2df0c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac54150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2df0c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac54150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58314/0 (socket says 172.21.15.144:58314) 2024-09-13T19:33:35.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3753603023 learned_addr learned my addr 172.21.15.144:0/3753603023 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3753603023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167ac54720 con 0x56167ac53d50 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2df0c3640 1 --2- 172.21.15.144:0/3753603023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac54150 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc2d004a1c0 tx=0x7fc2d004a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26d1049c2e00c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc1c27fc640 1 -- 172.21.15.144:0/3753603023 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d0043480 con 0x56167ac53d50 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc1c27fc640 1 -- 172.21.15.144:0/3753603023 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0016960 con 0x56167ac53d50 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc1c27fc640 1 -- 172.21.15.144:0/3753603023 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d0016440 con 0x56167ac53d50 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3753603023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 msgr2=0x56167ac54150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3753603023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac54150 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc2d004a1c0 tx=0x7fc2d004a2b0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3753603023 shutdown_connections 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3753603023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac54150 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3753603023 >> 172.21.15.144:0/3753603023 conn(0x56167ac50130 msgr2=0x56167ac4e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3753603023 shutdown_connections 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3753603023 wait complete. 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 Processor -- start 2024-09-13T19:33:35.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.711+0000 7fc2e0db2980 1 -- start start 2024-09-13T19:33:35.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2e0db2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac5b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2e0db2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56167ac54d20 con 0x56167ac53d50 2024-09-13T19:33:35.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2df0c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac5b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2df0c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac5b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58320/0 (socket says 172.21.15.144:58320) 2024-09-13T19:33:35.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 learned_addr learned my addr 172.21.15.144:0/3213667546 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167ac5b5f0 con 0x56167ac53d50 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2df0c3640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac5b0b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x56167ac50810 tx=0x7fc2d0049f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc1c0ff9640 1 -- 172.21.15.144:0/3213667546 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d004b670 con 0x56167ac53d50 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56167ac5b880 con 0x56167ac53d50 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56167ac5e560 con 0x56167ac53d50 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc1c0ff9640 1 -- 172.21.15.144:0/3213667546 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d004b810 con 0x56167ac53d50 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc1c0ff9640 1 -- 172.21.15.144:0/3213667546 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d00133b0 con 0x56167ac53d50 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc1c0ff9640 1 -- 172.21.15.144:0/3213667546 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2d0013550 con 0x56167ac53d50 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc1c0ff9640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1a8034650 0x7fc1a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc1c0ff9640 1 -- 172.21.15.144:0/3213667546 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc2d000e040 con 0x56167ac53d50 2024-09-13T19:33:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1a8034650 0x7fc1a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167ac667c0 0x56167ac68c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac693b0 con 0x56167ac667c0 2024-09-13T19:33:35.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2de0c1640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167ac667c0 0x56167ac68c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1a8034650 0x7fc1a8036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80c0fd0 tx=0x7fc2d80e6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.715+0000 7fc2de0c1640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167ac667c0 0x56167ac68c60 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d400e640 con 0x56167ac667c0 2024-09-13T19:33:35.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 realm 2024-09-13T19:33:35.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac65cd0 con 0x56167ac667c0 2024-09-13T19:33:35.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d400e640 con 0x56167ac667c0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac69e80 con 0x56167ac667c0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d400e640 con 0x56167ac667c0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac6a750 con 0x56167ac667c0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2d400e640 con 0x56167ac667c0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac6b170 0x56167ac6d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac6dc60 con 0x56167ac6b170 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2df0c3640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac6b170 0x56167ac6d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2df0c3640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac6b170 0x56167ac6d560 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 20 searching for the correct realm 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56167ac6fbb0 0x56167ac71fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56167ac6fbb0 0x56167ac71fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56167ac6fbb0 0x56167ac71fe0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de8c2640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc2d80e0030 0x7fc2d80ec470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x7fc2d80e0030 2024-09-13T19:33:35.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de0c1640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc2d80e0030 0x7fc2d80ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de0c1640 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc2d80e0030 0x7fc2d80ec470 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d400e640 con 0x7fc2d80e0030 2024-09-13T19:33:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.719+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac667c0 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc2d400e640 con 0x56167ac667c0 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac667c0 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x7fc2d80e0030 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac667c0 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.723+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac667c0 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x7fc2d80e0030 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac667c0 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac667c0 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x7fc2d80e0030 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.727+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac667c0 2024-09-13T19:33:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x7fc2d80e0030 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6fbb0 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac6b170 2024-09-13T19:33:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x56167ac667c0 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56167ac726b0 con 0x7fc2d80e0030 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac6e620 con 0x56167ac667c0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.731+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac6e260 con 0x56167ac667c0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac6e270 con 0x56167ac667c0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 zone default found 2024-09-13T19:33:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 4 Realm: () 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 zonegroup default 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac72b70 con 0x56167ac6b170 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac74e40 con 0x56167ac6fbb0 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac751e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 started sync module instance, tier type = 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac742d0 con 0x7fc2d80e0030 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94654549149728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac742d0 con 0x7fc2d80e0030 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac75c20 con 0x56167ac667c0 2024-09-13T19:33:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.735+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94654549149728] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94654549153520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac742d0 con 0x56167ac667c0 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac76630 con 0x56167ac6fbb0 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94654549156224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac76ed0 con 0x56167ac6fbb0 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac77890 con 0x7fc2d80e0030 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94654549153520] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94654549160928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac77800 con 0x7fc2d80e0030 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.739+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac78620 con 0x56167ac667c0 2024-09-13T19:33:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.743+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94654549156224] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.743+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94654549160928] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.743+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.743+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94654549158432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac780e0 con 0x56167ac667c0 2024-09-13T19:33:35.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.743+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac78ec0 con 0x56167ac6b170 2024-09-13T19:33:35.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.747+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94654549158432] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.747+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.747+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94654549166608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac780e0 con 0x56167ac6b170 2024-09-13T19:33:35.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.747+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac79710 con 0x56167ac6b170 2024-09-13T19:33:35.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.747+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.747+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94654549168736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac79b30 con 0x56167ac6b170 2024-09-13T19:33:35.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.747+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac7a610 con 0x56167ac6b170 2024-09-13T19:33:35.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.747+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94654549166608] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94654549168736] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94654549163056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac79680 con 0x56167ac6b170 2024-09-13T19:33:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 20 add_watcher() i=0 2024-09-13T19:33:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 20 add_watcher() i=1 2024-09-13T19:33:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 20 add_watcher() i=2 2024-09-13T19:33:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 20 add_watcher() i=3 2024-09-13T19:33:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 20 add_watcher() i=4 2024-09-13T19:33:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 20 add_watcher() i=5 2024-09-13T19:33:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 20 add_watcher() i=6 2024-09-13T19:33:35.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94654549163056] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 20 add_watcher() i=7 2024-09-13T19:33:35.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:35.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac79680 con 0x56167ac667c0 2024-09-13T19:33:35.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.751+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94654549172512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac79680 con 0x56167ac667c0 2024-09-13T19:33:35.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.755+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94654549172512] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.755+0000 7fc1957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:35.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.755+0000 7fc2e0db2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:35.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.755+0000 7fc2e0db2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:35.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.755+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac85dd0 con 0x56167ac667c0 2024-09-13T19:33:35.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.755+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.755+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac864a0 con 0x56167ac6b170 2024-09-13T19:33:35.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.759+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.759+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac86920 con 0x56167ac6fbb0 2024-09-13T19:33:35.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.759+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.759+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac86cc0 con 0x56167ac667c0 2024-09-13T19:33:35.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.759+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.759+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87230 con 0x7fc2d80e0030 2024-09-13T19:33:35.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.763+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.763+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac876e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.763+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.763+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87a80 con 0x56167ac667c0 2024-09-13T19:33:35.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.767+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.767+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87a80 con 0x56167ac6b170 2024-09-13T19:33:35.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.767+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.767+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87b10 con 0x7fc2d80e0030 2024-09-13T19:33:35.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.771+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.771+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87b10 con 0x56167ac6fbb0 2024-09-13T19:33:35.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.771+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.771+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87b10 con 0x7fc2d80e0030 2024-09-13T19:33:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.771+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.771+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87b10 con 0x56167ac6b170 2024-09-13T19:33:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.775+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.775+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87c40 con 0x7fc2d80e0030 2024-09-13T19:33:35.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.775+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.775+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87c40 con 0x56167ac6b170 2024-09-13T19:33:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.779+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.779+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87c40 con 0x56167ac667c0 2024-09-13T19:33:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.779+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.779+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac87c40 con 0x56167ac6fbb0 2024-09-13T19:33:35.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.779+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.779+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x7fc2d80e0030 2024-09-13T19:33:35.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.783+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.783+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.783+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.783+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac667c0 2024-09-13T19:33:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.783+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.783+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac667c0 2024-09-13T19:33:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.787+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.787+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.787+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.787+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x7fc2d80e0030 2024-09-13T19:33:35.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.791+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.791+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.791+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.791+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.795+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.795+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.795+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.795+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.795+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.795+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6b170 2024-09-13T19:33:35.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.799+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.799+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.799+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.799+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6b170 2024-09-13T19:33:35.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.803+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.803+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.807+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.807+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x56167ac6b170 2024-09-13T19:33:35.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.807+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.807+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac880e0 con 0x7fc2d80e0030 2024-09-13T19:33:35.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc10ffff640 20 reqs_thread_entry: start 2024-09-13T19:33:35.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:35.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 Filter name: none 2024-09-13T19:33:35.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc10dffb640 20 reqs_thread_entry: start 2024-09-13T19:33:35.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:35.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167ac84210 con 0x7fc2d80e0030 2024-09-13T19:33:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:95 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167aca4c10 con 0x56167ac6fbb0 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(95 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 get_obj_state: octx=0x7fc2d400e5c0 obj=myfoo:four state=0x56167aca59c8 s->prefetch_data=0 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:96 3.13 3:c9759ffa:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56167aca6a60 con 0x56167ac6fbb0 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(96 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 10 manifest: total_size = 4 2024-09-13T19:33:35.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 get_obj_state: setting s->obj_tag to c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9590131203070126555 2024-09-13T19:33:35.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 get_obj_state: octx=0x7fc2d400e5c0 obj=myfoo:four state=0x56167aca59c8 s->prefetch_data=0 2024-09-13T19:33:35.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 prepare_atomic_modification: state is not atomic. state=0x56167aca59c8 2024-09-13T19:33:35.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6 2024-09-13T19:33:35.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.811+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:97 4.1b 4:d823e2ff:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167acab4e0 con 0x7fc2d80e0030 2024-09-13T19:33:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.815+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(97 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6 [stat,call,call] v30'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.815+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:98 3.13 3:c9759ffa:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167acab4e0 con 0x56167ac6fbb0 2024-09-13T19:33:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.815+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(98 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.815+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:99 4.1b 4:d823e2ff:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167acabf70 con 0x7fc2d80e0030 2024-09-13T19:33:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc1957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94654549172512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167acabf70 con 0x56167ac667c0 2024-09-13T19:33:35.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(99 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6 [stat,call,call] v30'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc1c27fc640 20 handle_completion(): completion ok for obj=four 2024-09-13T19:33:35.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94654549172512] v30'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94654549149728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167acabf70 con 0x7fc2d80e0030 2024-09-13T19:33:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94654549149728] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc2e0db2980 20 remove_watcher() i=0 2024-09-13T19:33:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc2e0db2980 2 removed watcher, disabling cache 2024-09-13T19:33:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.819+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94654549153520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac74820 con 0x56167ac667c0 2024-09-13T19:33:35.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94654549153520] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2e0db2980 20 remove_watcher() i=1 2024-09-13T19:33:35.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94654549156224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac756f0 con 0x56167ac6fbb0 2024-09-13T19:33:35.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2de8c2640 1 -- 172.21.15.144:0/3213667546 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94654549156224] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d80a8070 con 0x56167ac6fbb0 2024-09-13T19:33:35.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2e0db2980 20 remove_watcher() i=2 2024-09-13T19:33:35.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94654549160928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac76180 con 0x7fc2d80e0030 2024-09-13T19:33:35.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94654549160928] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x7fc2d80e0030 2024-09-13T19:33:35.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2e0db2980 20 remove_watcher() i=3 2024-09-13T19:33:35.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.823+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94654549158432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac756f0 con 0x56167ac667c0 2024-09-13T19:33:35.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.827+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94654549158432] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d4029040 con 0x56167ac667c0 2024-09-13T19:33:35.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.827+0000 7fc2e0db2980 20 remove_watcher() i=4 2024-09-13T19:33:35.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.827+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94654549166608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac773e0 con 0x56167ac6b170 2024-09-13T19:33:35.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.827+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94654549166608] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.827+0000 7fc2e0db2980 20 remove_watcher() i=5 2024-09-13T19:33:35.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.827+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94654549168736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac76180 con 0x56167ac6b170 2024-09-13T19:33:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.831+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94654549168736] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.831+0000 7fc2e0db2980 20 remove_watcher() i=6 2024-09-13T19:33:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.831+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94654549163056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56167ac76a20 con 0x56167ac6b170 2024-09-13T19:33:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.831+0000 7fc2df0c3640 1 -- 172.21.15.144:0/3213667546 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94654549163056] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0036070 con 0x56167ac6b170 2024-09-13T19:33:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.831+0000 7fc2e0db2980 20 remove_watcher() i=7 2024-09-13T19:33:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac6b170 msgr2=0x56167ac6d560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac6b170 0x56167ac6d560 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167ac667c0 msgr2=0x56167ac68c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167ac667c0 0x56167ac68c60 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc2d80e0030 msgr2=0x7fc2d80ec470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc2d80e0030 0x7fc2d80ec470 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56167ac6fbb0 msgr2=0x56167ac71fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56167ac6fbb0 0x56167ac71fe0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1a8034650 msgr2=0x7fc1a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1a8034650 0x7fc1a8036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80c0fd0 tx=0x7fc2d80e6000 comp rx=0 tx=0).stop 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 msgr2=0x56167ac5b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2de0c1640 1 -- 172.21.15.144:0/3213667546 reap_dead start 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac5b0b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x56167ac50810 tx=0x7fc2d0049f60 comp rx=0 tx=0).stop 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 shutdown_connections 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/3213667546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac53d50 0x56167ac5b0b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 >> 172.21.15.144:0/3213667546 conn(0x56167ac50130 msgr2=0x56167ac4e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 shutdown_connections 2024-09-13T19:33:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/3213667546 wait complete. 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/856820265 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1b8034650 msgr2=0x7fc1b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/856820265 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1b8034650 0x7fc1b8036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x56167ac341c0 tx=0x7fc2d80b6810 comp rx=0 tx=0).stop 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/856820265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac47210 msgr2=0x56167ac47630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/856820265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac47210 0x56167ac47630 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x56167ac2db20 tx=0x7fc2d0018830 comp rx=0 tx=0).stop 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/856820265 shutdown_connections 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/856820265 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1b8034650 0x7fc1b8036b10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/856820265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167ac47210 0x56167ac47630 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/856820265 >> 172.21.15.144:0/856820265 conn(0x56167ac3c360 msgr2=0x56167ac3ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/856820265 shutdown_connections 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/856820265 wait complete. 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac36050 msgr2=0x56167ac38440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac36050 0x56167ac38440 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167aaaa7d0 msgr2=0x56167ac337f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167aaaa7d0 0x56167ac337f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1c4034650 msgr2=0x7fc1c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1c4034650 0x7fc1c4036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4001da0 tx=0x7fc2d4001300 comp rx=0 tx=0).stop 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 msgr2=0x56167ac2c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac2c6f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80b8040 tx=0x7fc2d8017e40 comp rx=0 tx=0).stop 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 shutdown_connections 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56167aaaa7d0 0x56167ac337f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56167ac36050 0x56167ac38440 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1c4034650 0x7fc1c4036b10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 --2- 172.21.15.144:0/2854920891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167aaaa3c0 0x56167ac2c6f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 >> 172.21.15.144:0/2854920891 conn(0x56167ab2f1c0 msgr2=0x56167ac1fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 shutdown_connections 2024-09-13T19:33:35.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.835+0000 7fc2e0db2980 1 -- 172.21.15.144:0/2854920891 wait complete. 2024-09-13T19:33:35.848 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:33:35.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:33:35.848 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:33:35.925 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:35.925 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:35.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdf3ff980 1 Processor -- start 2024-09-13T19:33:35.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdf3ff980 1 -- start start 2024-09-13T19:33:35.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdf3ff980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f4060d1290 0x55f40615f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdf3ff980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f405fe4ae0 con 0x55f40615f8e0 2024-09-13T19:33:35.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdf3ff980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55f406008e30 con 0x55f4060d1290 2024-09-13T19:33:35.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdcf0f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f4060d1290 0x55f40615f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdc70e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55f40615f8e0 0x55f406161cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44716/0 (socket says 172.21.15.144:44716) 2024-09-13T19:33:35.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdc70e640 1 -- 172.21.15.144:0/3424651592 learned_addr learned my addr 172.21.15.144:0/3424651592 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:35.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/3424651592 >> v1:172.21.15.18:6789/0 conn(0x55f40615f8e0 legacy=0x55f406161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.923+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/3424651592 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4060d1820 con 0x55f4060d1290 2024-09-13T19:33:35.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/3424651592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615f3a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00a480 tx=0x7fbfcc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65213e713e918fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdbf0d640 1 -- 172.21.15.144:0/3424651592 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc0b0070 con 0x55f4060d1290 2024-09-13T19:33:35.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdbf0d640 1 -- 172.21.15.144:0/3424651592 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0ab540 con 0x55f4060d1290 2024-09-13T19:33:35.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdbf0d640 1 -- 172.21.15.144:0/3424651592 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc0ab840 con 0x55f4060d1290 2024-09-13T19:33:35.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3424651592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 msgr2=0x55f40615f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/3424651592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615f3a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00a480 tx=0x7fbfcc01b280 comp rx=0 tx=0).stop 2024-09-13T19:33:35.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3424651592 shutdown_connections 2024-09-13T19:33:35.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/3424651592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615f3a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3424651592 >> 172.21.15.144:0/3424651592 conn(0x55f406157090 msgr2=0x55f4061594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3424651592 shutdown_connections 2024-09-13T19:33:35.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.927+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3424651592 wait complete. 2024-09-13T19:33:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.939+0000 7fbfdf3ff980 1 Processor -- start 2024-09-13T19:33:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.939+0000 7fbfdf3ff980 1 -- start start 2024-09-13T19:33:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.939+0000 7fbfdf3ff980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.939+0000 7fbfdf3ff980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f40600a200 con 0x55f4060d1290 2024-09-13T19:33:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.939+0000 7fbfdcf0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.939+0000 7fbfdcf0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58350/0 (socket says 172.21.15.144:58350) 2024-09-13T19:33:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.939+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/622032003 learned_addr learned my addr 172.21.15.144:0/622032003 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/622032003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f40615d0d0 con 0x55f4060d1290 2024-09-13T19:33:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/622032003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615cb00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ae040 tx=0x7fbfcc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fe14c54e162665 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbecae0d640 1 -- 172.21.15.144:0/622032003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc0b0040 con 0x55f4060d1290 2024-09-13T19:33:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbecae0d640 1 -- 172.21.15.144:0/622032003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0ab9b0 con 0x55f4060d1290 2024-09-13T19:33:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbecae0d640 1 -- 172.21.15.144:0/622032003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc0abc90 con 0x55f4060d1290 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/622032003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 msgr2=0x55f40615cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/622032003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615cb00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ae040 tx=0x7fbfcc003030 comp rx=0 tx=0).stop 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/622032003 shutdown_connections 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/622032003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f40615cb00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/622032003 >> 172.21.15.144:0/622032003 conn(0x55f406157090 msgr2=0x55f4062435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/622032003 shutdown_connections 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/622032003 wait complete. 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 Processor -- start 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 -- start start 2024-09-13T19:33:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f406250e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdf3ff980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f406163f00 con 0x55f4060d1290 2024-09-13T19:33:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdcf0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f406250e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdcf0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f406250e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58362/0 (socket says 172.21.15.144:58362) 2024-09-13T19:33:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/1092650301 learned_addr learned my addr 172.21.15.144:0/1092650301 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/1092650301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f406251380 con 0x55f4060d1290 2024-09-13T19:33:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.943+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f406250e40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ab510 tx=0x7fbfcc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbec960a640 1 -- 172.21.15.144:0/1092650301 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc0b0070 con 0x55f4060d1290 2024-09-13T19:33:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f406251610 con 0x55f4060d1290 2024-09-13T19:33:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbec960a640 1 -- 172.21.15.144:0/1092650301 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0b6970 con 0x55f4060d1290 2024-09-13T19:33:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbec960a640 1 -- 172.21.15.144:0/1092650301 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc0b6c50 con 0x55f4060d1290 2024-09-13T19:33:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4062542f0 con 0x55f4060d1290 2024-09-13T19:33:35.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbec960a640 1 -- 172.21.15.144:0/1092650301 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbfcc0b7420 con 0x55f4060d1290 2024-09-13T19:33:35.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbec960a640 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbec4034650 0x7fbec4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbec960a640 1 -- 172.21.15.144:0/1092650301 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbfcc0bc070 con 0x55f4060d1290 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdc70e640 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbec4034650 0x7fbec4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40615f8e0 0x55f406257f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406258480 con 0x55f40615f8e0 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdd710640 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40615f8e0 0x55f406257f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdc70e640 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbec4034650 0x7fbec4036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0001da0 tx=0x7fbfd0001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdd710640 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40615f8e0 0x55f406257f40 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdd710640 1 -- 172.21.15.144:0/1092650301 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd400a4d0 con 0x55f40615f8e0 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406255500 con 0x55f40615f8e0 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdd710640 1 -- 172.21.15.144:0/1092650301 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfd400a4d0 con 0x55f40615f8e0 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40625a740 0x55f40625cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f40625d200 con 0x55f40625a740 2024-09-13T19:33:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40625a740 0x55f40625cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.947+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40625a740 0x55f40625cb30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/1092650301 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f40625a740 2024-09-13T19:33:35.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406259610 con 0x55f40615f8e0 2024-09-13T19:33:35.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdd710640 1 -- 172.21.15.144:0/1092650301 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfd400a4d0 con 0x55f40615f8e0 2024-09-13T19:33:35.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406259a70 con 0x55f40615f8e0 2024-09-13T19:33:35.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdd710640 1 -- 172.21.15.144:0/1092650301 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbfd400a4d0 con 0x55f40615f8e0 2024-09-13T19:33:35.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdf3ff980 1 Processor -- start 2024-09-13T19:33:35.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdf3ff980 1 -- start start 2024-09-13T19:33:35.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdf3ff980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f40626b8a0 0x55f40626bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdf3ff980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f406063800 con 0x55f40626b8a0 2024-09-13T19:33:35.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdd710640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f40626b8a0 0x55f40626bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdd710640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f40626b8a0 0x55f40626bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58370/0 (socket says 172.21.15.144:58370) 2024-09-13T19:33:35.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdd710640 1 -- 172.21.15.144:0/412155365 learned_addr learned my addr 172.21.15.144:0/412155365 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdd710640 1 -- 172.21.15.144:0/412155365 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f40626c200 con 0x55f40626b8a0 2024-09-13T19:33:35.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdd710640 1 --2- 172.21.15.144:0/412155365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f40626b8a0 0x55f40626bcc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55f406251c20 tx=0x7fbfd4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbec27fc640 1 -- 172.21.15.144:0/412155365 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd40180d0 con 0x55f40626b8a0 2024-09-13T19:33:35.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/412155365 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f40626c490 con 0x55f40626b8a0 2024-09-13T19:33:35.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbec27fc640 1 -- 172.21.15.144:0/412155365 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd4018270 con 0x55f40626b8a0 2024-09-13T19:33:35.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbec27fc640 1 -- 172.21.15.144:0/412155365 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd40145c0 con 0x55f40626b8a0 2024-09-13T19:33:35.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.951+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/412155365 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f40626f110 con 0x55f40626b8a0 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbec27fc640 1 -- 172.21.15.144:0/412155365 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbfd4011040 con 0x55f40626b8a0 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbec27fc640 1 --2- 172.21.15.144:0/412155365 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbeb4034650 0x7fbeb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbec27fc640 1 -- 172.21.15.144:0/412155365 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbfd401e070 con 0x55f40626b8a0 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/412155365 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbeb4034650 0x7fbeb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 Processor -- start 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- start start 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/412155365 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbeb4034650 0x7fbeb4036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55f406258890 tx=0x7fbfcc0e4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f406278750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f40615b230 con 0x55f406278350 2024-09-13T19:33:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdd710640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f406278750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdd710640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f406278750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58380/0 (socket says 172.21.15.144:58380) 2024-09-13T19:33:35.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdd710640 1 -- 172.21.15.144:0/3456656687 learned_addr learned my addr 172.21.15.144:0/3456656687 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdd710640 1 -- 172.21.15.144:0/3456656687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f406278d20 con 0x55f406278350 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdd710640 1 --2- 172.21.15.144:0/3456656687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f406278750 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4049e20 tx=0x7fbfd404a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd80c369ab3a8a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbeb3fff640 1 -- 172.21.15.144:0/3456656687 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4014b30 con 0x55f406278350 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbeb3fff640 1 -- 172.21.15.144:0/3456656687 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd402b350 con 0x55f406278350 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbeb3fff640 1 -- 172.21.15.144:0/3456656687 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4014cd0 con 0x55f406278350 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3456656687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 msgr2=0x55f406278750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/3456656687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f406278750 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4049e20 tx=0x7fbfd404a0a0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3456656687 shutdown_connections 2024-09-13T19:33:35.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/3456656687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f406278750 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3456656687 >> 172.21.15.144:0/3456656687 conn(0x55f406274780 msgr2=0x55f406272880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3456656687 shutdown_connections 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/3456656687 wait complete. 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 Processor -- start 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- start start 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f40627f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.955+0000 7fbfdf3ff980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f406279370 con 0x55f406278350 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdd710640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f40627f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdd710640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f40627f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58392/0 (socket says 172.21.15.144:58392) 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 learned_addr learned my addr 172.21.15.144:0/2452851325 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f40627fc70 con 0x55f406278350 2024-09-13T19:33:35.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdd710640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f40627f730 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4011ae0 tx=0x7fbfd4049d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbeb27fc640 1 -- 172.21.15.144:0/2452851325 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd402b500 con 0x55f406278350 2024-09-13T19:33:35.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f40627ff00 con 0x55f406278350 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbeb27fc640 1 -- 172.21.15.144:0/2452851325 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd4013c80 con 0x55f406278350 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f406282be0 con 0x55f406278350 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbeb27fc640 1 -- 172.21.15.144:0/2452851325 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4013e30 con 0x55f406278350 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbeb27fc640 1 -- 172.21.15.144:0/2452851325 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbfd404ba30 con 0x55f406278350 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbeb27fc640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbea8034650 0x7fbea8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbeb27fc640 1 -- 172.21.15.144:0/2452851325 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbfd4033070 con 0x55f406278350 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbea8034650 0x7fbea8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40628adc0 0x55f40628d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f40628d9b0 con 0x55f40628adc0 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdc70e640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40628adc0 0x55f40628d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbea8034650 0x7fbea8036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ab980 tx=0x7fbfcc0d5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdc70e640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40628adc0 0x55f40628d260 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd000e640 con 0x55f40628adc0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 20 realm 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f40628a290 con 0x55f40628adc0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd000e640 con 0x55f40628adc0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.959+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f40628e4b0 con 0x55f40628adc0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd000e640 con 0x55f40628adc0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f40628e9e0 con 0x55f40628adc0 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfd000e640 con 0x55f40628adc0 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40628f7e0 0x55f406291bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406292150 con 0x55f40628f7e0 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdd710640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40628f7e0 0x55f406291bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdd710640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40628f7e0 0x55f406291bd0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 20 searching for the correct realm 2024-09-13T19:33:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f406294130 0x55f4062965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f406294130 0x55f4062965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f406294130 0x55f4062965f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdcf0f640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fbfcc0f2040 0x7fbfcc0de9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x7fbfcc0f2040 2024-09-13T19:33:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdc70e640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fbfcc0f2040 0x7fbfcc0de9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdc70e640 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fbfcc0f2040 0x7fbfcc0de9a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd000e640 con 0x7fbfcc0f2040 2024-09-13T19:33:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.963+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628adc0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbfd000e640 con 0x55f40628adc0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628adc0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x7fbfcc0f2040 2024-09-13T19:33:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628adc0 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628adc0 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x7fbfcc0f2040 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.967+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628adc0 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628adc0 2024-09-13T19:33:35.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x7fbfcc0f2040 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628adc0 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.971+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x7fbfcc0f2040 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f406294130 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628f7e0 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x55f40628adc0 2024-09-13T19:33:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f406296cc0 con 0x7fbfcc0f2040 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406292b10 con 0x55f40628adc0 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406292f90 con 0x55f40628adc0 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406292fa0 con 0x55f40628adc0 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 zone default found 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 4 Realm: () 2024-09-13T19:33:35.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 zonegroup default 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.975+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406293440 con 0x55f40628f7e0 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406298fd0 con 0x55f406294130 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f406299370 con 0x55f406294130 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 20 started sync module instance, tier type = 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f406298410 con 0x7fbfcc0f2040 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94506563766624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f406298410 con 0x7fbfcc0f2040 2024-09-13T19:33:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f406299d30 con 0x55f40628adc0 2024-09-13T19:33:35.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.979+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94506563766624] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.983+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.983+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94506563764336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f406299d30 con 0x55f40628adc0 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.983+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629a6f0 con 0x55f406294130 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.983+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94506563764336] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.983+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.983+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94506563770496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f406299ca0 con 0x55f406294130 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.983+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629b3f0 con 0x7fbfcc0f2040 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.983+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.987+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94506563776656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629bc90 con 0x7fbfcc0f2040 2024-09-13T19:33:35.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.987+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629c690 con 0x55f40628adc0 2024-09-13T19:33:35.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.987+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94506563770496] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:35.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.987+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94506563776656] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:35.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.987+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.987+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94506563775120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629b790 con 0x55f40628adc0 2024-09-13T19:33:35.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.987+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629cf30 con 0x55f40628f7e0 2024-09-13T19:33:35.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.991+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94506563775120] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:35.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.991+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.991+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94506563783296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629b790 con 0x55f40628f7e0 2024-09-13T19:33:35.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.991+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629d780 con 0x55f40628f7e0 2024-09-13T19:33:35.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.991+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94506563783296] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.991+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.991+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94506563781024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629d780 con 0x55f40628f7e0 2024-09-13T19:33:35.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.991+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629e180 con 0x55f40628f7e0 2024-09-13T19:33:35.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94506563781024] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:35.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94506563787920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629d780 con 0x55f40628f7e0 2024-09-13T19:33:35.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 20 add_watcher() i=0 2024-09-13T19:33:35.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 20 add_watcher() i=1 2024-09-13T19:33:35.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 20 add_watcher() i=2 2024-09-13T19:33:35.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 20 add_watcher() i=3 2024-09-13T19:33:35.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 20 add_watcher() i=4 2024-09-13T19:33:35.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 20 add_watcher() i=5 2024-09-13T19:33:35.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 20 add_watcher() i=6 2024-09-13T19:33:36.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94506563787920] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:36.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 20 add_watcher() i=7 2024-09-13T19:33:36.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:36.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062a15d0 con 0x55f40628adc0 2024-09-13T19:33:36.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.995+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94506563785888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f40629ea90 con 0x55f40628adc0 2024-09-13T19:33:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94506563785888] v30'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbe92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:36.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 5 note: GC not initialized 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbe91fe3640 20 reqs_thread_entry: start 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 Filter name: none 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbe037fe640 20 reqs_thread_entry: start 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062c4ca0 con 0x7fbfcc0f2040 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:63 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062c5530 con 0x55f406294130 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(63 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:36.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062c6b40 con 0x7fbfcc0f2040 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062c6b40 con 0x55f406294130 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(65 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 4.2e 4:75513853:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062c8650 con 0x55f406294130 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 4.2a 4:55887a35:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062cb0a0 con 0x55f40628adc0 2024-09-13T19:33:36.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 4.3 4:c2144c8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062cda00 con 0x55f40628adc0 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 4.14 4:29ca2d96:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062d05c0 con 0x55f406294130 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 4.8 4:113a96eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062cda00 con 0x55f406294130 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 4.9 4:91094f8f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062d5980 con 0x55f40628adc0 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 4.1b 4:d823e2ff:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062d8270 con 0x7fbfcc0f2040 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 4.38 4:1f552a94:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062daae0 con 0x55f40628adc0 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 4.a 4:53bc6a1b:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062dd390 con 0x7fbfcc0f2040 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 4.6 4:622ed0b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062dfd80 con 0x55f406294130 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:76 4.18 4:18667e6d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x7fbfcc0f2040 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(67 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(68 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:35.999+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(71 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(73 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(66 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(69 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(70 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(76 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(75 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbe92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:36.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94506563785888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x55f40628adc0 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94506563785888] v30'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94506563766624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x7fbfcc0f2040 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94506563766624] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdf3ff980 20 remove_watcher() i=0 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdf3ff980 2 removed watcher, disabling cache 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.003+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94506563764336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x55f40628adc0 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.007+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94506563764336] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.007+0000 7fbfdf3ff980 20 remove_watcher() i=1 2024-09-13T19:33:36.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.007+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94506563770496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x55f406294130 2024-09-13T19:33:36.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.007+0000 7fbfdcf0f640 1 -- 172.21.15.144:0/2452851325 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94506563770496] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfcc0b3040 con 0x55f406294130 2024-09-13T19:33:36.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.007+0000 7fbfdf3ff980 20 remove_watcher() i=2 2024-09-13T19:33:36.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.007+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94506563776656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x7fbfcc0f2040 2024-09-13T19:33:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.011+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94506563776656] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x7fbfcc0f2040 2024-09-13T19:33:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.011+0000 7fbfdf3ff980 20 remove_watcher() i=3 2024-09-13T19:33:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.011+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94506563775120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x55f40628adc0 2024-09-13T19:33:36.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.011+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94506563775120] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0029040 con 0x55f40628adc0 2024-09-13T19:33:36.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.011+0000 7fbfdf3ff980 20 remove_watcher() i=4 2024-09-13T19:33:36.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.011+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94506563783296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x55f40628f7e0 2024-09-13T19:33:36.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.015+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94506563783296] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:36.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.015+0000 7fbfdf3ff980 20 remove_watcher() i=5 2024-09-13T19:33:36.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.015+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94506563781024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x55f40628f7e0 2024-09-13T19:33:36.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.015+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94506563781024] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:36.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.015+0000 7fbfdf3ff980 20 remove_watcher() i=6 2024-09-13T19:33:36.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.015+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94506563787920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4062e2790 con 0x55f40628f7e0 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdd710640 1 -- 172.21.15.144:0/2452851325 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94506563787920] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd402a070 con 0x55f40628f7e0 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 20 remove_watcher() i=7 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40628f7e0 msgr2=0x55f406291bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40628f7e0 0x55f406291bd0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40628adc0 msgr2=0x55f40628d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40628adc0 0x55f40628d260 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fbfcc0f2040 msgr2=0x7fbfcc0de9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fbfcc0f2040 0x7fbfcc0de9a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f406294130 msgr2=0x55f4062965f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f406294130 0x55f4062965f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbea8034650 msgr2=0x7fbea8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbea8034650 0x7fbea8036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ab980 tx=0x7fbfcc0d5000 comp rx=0 tx=0).stop 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 msgr2=0x55f40627f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdc70e640 1 -- 172.21.15.144:0/2452851325 reap_dead start 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f40627f730 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4011ae0 tx=0x7fbfd4049d80 comp rx=0 tx=0).stop 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 shutdown_connections 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/2452851325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f406278350 0x55f40627f730 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 >> 172.21.15.144:0/2452851325 conn(0x55f406274780 msgr2=0x55f406272850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 shutdown_connections 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/2452851325 wait complete. 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/412155365 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbeb4034650 msgr2=0x7fbeb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/412155365 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbeb4034650 0x7fbeb4036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55f406258890 tx=0x7fbfcc0e4040 comp rx=0 tx=0).stop 2024-09-13T19:33:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/412155365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f40626b8a0 msgr2=0x55f40626bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/412155365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f40626b8a0 0x55f40626bcc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55f406251c20 tx=0x7fbfd4018830 comp rx=0 tx=0).stop 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/412155365 shutdown_connections 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/412155365 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbeb4034650 0x7fbeb4036b10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/412155365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f40626b8a0 0x55f40626bcc0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/412155365 >> 172.21.15.144:0/412155365 conn(0x55f4062609f0 msgr2=0x55f406263470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/412155365 shutdown_connections 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/412155365 wait complete. 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40625a740 msgr2=0x55f40625cb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40625a740 0x55f40625cb30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40615f8e0 msgr2=0x55f406257f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40615f8e0 0x55f406257f40 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbec4034650 msgr2=0x7fbec4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbec4034650 0x7fbec4036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0001da0 tx=0x7fbfd0001300 comp rx=0 tx=0).stop 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 msgr2=0x55f406250e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f406250e40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ab510 tx=0x7fbfcc018020 comp rx=0 tx=0).stop 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 shutdown_connections 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f40615f8e0 0x55f406257f40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f40625a740 0x55f40625cb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbec4034650 0x7fbec4036b10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 --2- 172.21.15.144:0/1092650301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f4060d1290 0x55f406250e40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 >> 172.21.15.144:0/1092650301 conn(0x55f406157090 msgr2=0x55f40615b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 shutdown_connections 2024-09-13T19:33:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.019+0000 7fbfdf3ff980 1 -- 172.21.15.144:0/1092650301 wait complete. 2024-09-13T19:33:36.031 INFO:teuthology.orchestra.run.smithi144.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b5bcd2ca-839b-4a0e-a5d6-f37391d778b0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","marker":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:33:35.328997Z","creation_time":"2024-09-13T19:33:31.450072Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:33:36.032 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:33:35.328997Z', 'creation_time': '2024-09-13T19:33:31.450072Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:33:36.032 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-13T19:33:36.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-13T19:33:36.032 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-13T19:33:36.103 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:36.103 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:36.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.099+0000 7f4d6018d980 1 Processor -- start 2024-09-13T19:33:36.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.099+0000 7f4d6018d980 1 -- start start 2024-09-13T19:33:36.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.099+0000 7f4d6018d980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56537bf05ab0 0x56537bf07ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.099+0000 7f4d6018d980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56537bd89ae0 con 0x56537be76280 2024-09-13T19:33:36.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d6018d980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56537bdade30 con 0x56537bf05ab0 2024-09-13T19:33:36.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5dc9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x56537be76280 0x56537bf04390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44730/0 (socket says 172.21.15.144:44730) 2024-09-13T19:33:36.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/3416890880 learned_addr learned my addr 172.21.15.144:0/3416890880 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:36.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5d49c640 1 --2- 172.21.15.144:0/3416890880 >> v2:172.21.15.18:3300/0 conn(0x56537bf05ab0 0x56537bf07ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5cc9b640 1 -- 172.21.15.144:0/3416890880 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675420362 0 0) 0x56537bd89ae0 con 0x56537be76280 2024-09-13T19:33:36.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5cc9b640 1 -- 172.21.15.144:0/3416890880 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d4c001e20 con 0x56537be76280 2024-09-13T19:33:36.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5d49c640 1 -- 172.21.15.144:0/3416890880 >> v1:172.21.15.18:6789/0 conn(0x56537be76280 legacy=0x56537bf04390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5d49c640 1 -- 172.21.15.144:0/3416890880 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56537be76810 con 0x56537bf05ab0 2024-09-13T19:33:36.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5d49c640 1 --2- 172.21.15.144:0/3416890880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537bf05ab0 0x56537bf07ea0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800a480 tx=0x7f4d4801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bb52521b497b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5cc9b640 1 -- 172.21.15.144:0/3416890880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d480b0070 con 0x56537bf05ab0 2024-09-13T19:33:36.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5cc9b640 1 -- 172.21.15.144:0/3416890880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d480ab540 con 0x56537bf05ab0 2024-09-13T19:33:36.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.103+0000 7f4d5cc9b640 1 -- 172.21.15.144:0/3416890880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d480ab820 con 0x56537bf05ab0 2024-09-13T19:33:36.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.107+0000 7f4d6018d980 1 -- 172.21.15.144:0/3416890880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537bf05ab0 msgr2=0x56537bf07ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.107+0000 7f4d6018d980 1 --2- 172.21.15.144:0/3416890880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537bf05ab0 0x56537bf07ea0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800a480 tx=0x7f4d4801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.107+0000 7f4d6018d980 1 -- 172.21.15.144:0/3416890880 shutdown_connections 2024-09-13T19:33:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.107+0000 7f4d6018d980 1 --2- 172.21.15.144:0/3416890880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537bf05ab0 0x56537bf07ea0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.107+0000 7f4d6018d980 1 -- 172.21.15.144:0/3416890880 >> 172.21.15.144:0/3416890880 conn(0x56537befc080 msgr2=0x56537befe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.107+0000 7f4d6018d980 1 -- 172.21.15.144:0/3416890880 shutdown_connections 2024-09-13T19:33:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.107+0000 7f4d6018d980 1 -- 172.21.15.144:0/3416890880 wait complete. 2024-09-13T19:33:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 Processor -- start 2024-09-13T19:33:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 -- start start 2024-09-13T19:33:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bfec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56537bdaf200 con 0x56537be76280 2024-09-13T19:33:36.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d5dc9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bfec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d5dc9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bfec7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58402/0 (socket says 172.21.15.144:58402) 2024-09-13T19:33:36.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/2620803543 learned_addr learned my addr 172.21.15.144:0/2620803543 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/2620803543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56537bfecdc0 con 0x56537be76280 2024-09-13T19:33:36.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/2620803543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bfec7f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4d58001dc0 tx=0x7f4d5800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd72acb5f18ae4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4c4be07640 1 -- 172.21.15.144:0/2620803543 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d58012020 con 0x56537be76280 2024-09-13T19:33:36.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4c4be07640 1 -- 172.21.15.144:0/2620803543 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5800e7c0 con 0x56537be76280 2024-09-13T19:33:36.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4c4be07640 1 -- 172.21.15.144:0/2620803543 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5800eb40 con 0x56537be76280 2024-09-13T19:33:36.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 -- 172.21.15.144:0/2620803543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 msgr2=0x56537bfec7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 --2- 172.21.15.144:0/2620803543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bfec7f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4d58001dc0 tx=0x7f4d5800b6d0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 -- 172.21.15.144:0/2620803543 shutdown_connections 2024-09-13T19:33:36.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 --2- 172.21.15.144:0/2620803543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bfec7f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 -- 172.21.15.144:0/2620803543 >> 172.21.15.144:0/2620803543 conn(0x56537befc080 msgr2=0x56537bfe8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 -- 172.21.15.144:0/2620803543 shutdown_connections 2024-09-13T19:33:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 -- 172.21.15.144:0/2620803543 wait complete. 2024-09-13T19:33:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.119+0000 7f4d6018d980 1 Processor -- start 2024-09-13T19:33:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d6018d980 1 -- start start 2024-09-13T19:33:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d6018d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bff3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d6018d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56537bf08ef0 con 0x56537be76280 2024-09-13T19:33:36.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5dc9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bff3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5dc9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bff3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58404/0 (socket says 172.21.15.144:58404) 2024-09-13T19:33:36.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/492122437 learned_addr learned my addr 172.21.15.144:0/492122437 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/492122437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56537bff40a0 con 0x56537be76280 2024-09-13T19:33:36.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bff3b60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x56537bfed9d0 tx=0x7f4d58000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4c4a604640 1 -- 172.21.15.144:0/492122437 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d58012030 con 0x56537be76280 2024-09-13T19:33:36.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56537bff4330 con 0x56537be76280 2024-09-13T19:33:36.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4c4a604640 1 -- 172.21.15.144:0/492122437 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d58001440 con 0x56537be76280 2024-09-13T19:33:36.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4c4a604640 1 -- 172.21.15.144:0/492122437 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5801aaf0 con 0x56537be76280 2024-09-13T19:33:36.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56537bff7010 con 0x56537be76280 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4c4a604640 1 -- 172.21.15.144:0/492122437 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d58015020 con 0x56537be76280 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4c4a604640 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c44034650 0x7f4c44036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4c4a604640 1 -- 172.21.15.144:0/492122437 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4d58020030 con 0x56537be76280 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5d49c640 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c44034650 0x7f4c44036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537bf05ab0 0x56537bffab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537bffb190 con 0x56537bf05ab0 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5e49e640 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537bf05ab0 0x56537bffab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5d49c640 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c44034650 0x7f4c44036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d480ad000 tx=0x7f4d480a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.123+0000 7f4d5e49e640 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537bf05ab0 0x56537bffab50 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5e49e640 1 -- 172.21.15.144:0/492122437 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d5000a4d0 con 0x56537bf05ab0 2024-09-13T19:33:36.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537bff8210 con 0x56537bf05ab0 2024-09-13T19:33:36.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5e49e640 1 -- 172.21.15.144:0/492122437 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d5000a4d0 con 0x56537bf05ab0 2024-09-13T19:33:36.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537bffd4c0 0x56537bfff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537bffff80 con 0x56537bffd4c0 2024-09-13T19:33:36.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537bffd4c0 0x56537bfff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537bffd4c0 0x56537bfff8b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/492122437 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d58008030 con 0x56537bffd4c0 2024-09-13T19:33:36.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537bffc360 con 0x56537bf05ab0 2024-09-13T19:33:36.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5e49e640 1 -- 172.21.15.144:0/492122437 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d5000a4d0 con 0x56537bf05ab0 2024-09-13T19:33:36.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537bffc840 con 0x56537bf05ab0 2024-09-13T19:33:36.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5e49e640 1 -- 172.21.15.144:0/492122437 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d5000a4d0 con 0x56537bf05ab0 2024-09-13T19:33:36.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 Processor -- start 2024-09-13T19:33:36.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 -- start start 2024-09-13T19:33:36.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c00e660 0x56537c00ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d6018d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56537be08800 con 0x56537c00e660 2024-09-13T19:33:36.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5e49e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c00e660 0x56537c00ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5e49e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c00e660 0x56537c00ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58414/0 (socket says 172.21.15.144:58414) 2024-09-13T19:33:36.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.127+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1650001979 learned_addr learned my addr 172.21.15.144:0/1650001979 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1650001979 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56537c00efc0 con 0x56537c00e660 2024-09-13T19:33:36.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d5e49e640 1 --2- 172.21.15.144:0/1650001979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c00e660 0x56537c00ea80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x56537bffb590 tx=0x7f4d50018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4c437fe640 1 -- 172.21.15.144:0/1650001979 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50014450 con 0x56537c00e660 2024-09-13T19:33:36.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4c437fe640 1 -- 172.21.15.144:0/1650001979 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d500145f0 con 0x56537c00e660 2024-09-13T19:33:36.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4c437fe640 1 -- 172.21.15.144:0/1650001979 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50014910 con 0x56537c00e660 2024-09-13T19:33:36.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d6018d980 1 -- 172.21.15.144:0/1650001979 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56537c00f250 con 0x56537c00e660 2024-09-13T19:33:36.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d6018d980 1 -- 172.21.15.144:0/1650001979 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56537c011ed0 con 0x56537c00e660 2024-09-13T19:33:36.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4c437fe640 1 -- 172.21.15.144:0/1650001979 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d50011040 con 0x56537c00e660 2024-09-13T19:33:36.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4c437fe640 1 --2- 172.21.15.144:0/1650001979 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c380346a0 0x7f4c38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4c437fe640 1 -- 172.21.15.144:0/1650001979 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4d5001e070 con 0x56537c00e660 2024-09-13T19:33:36.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/1650001979 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c380346a0 0x7f4c38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d6018d980 1 Processor -- start 2024-09-13T19:33:36.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d6018d980 1 -- start start 2024-09-13T19:33:36.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/1650001979 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c380346a0 0x7f4c38036b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x56537bffb630 tx=0x7f4d5801af30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d6018d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c01b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d6018d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56537bfed140 con 0x56537c01b100 2024-09-13T19:33:36.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d5e49e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c01b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d5e49e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c01b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58418/0 (socket says 172.21.15.144:58418) 2024-09-13T19:33:36.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.131+0000 7f4d5e49e640 1 -- 172.21.15.144:0/877642699 learned_addr learned my addr 172.21.15.144:0/877642699 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d5e49e640 1 -- 172.21.15.144:0/877642699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56537c01bad0 con 0x56537c01b100 2024-09-13T19:33:36.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d5e49e640 1 --2- 172.21.15.144:0/877642699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c01b500 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d5004a130 tx=0x7f4d50013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af247877ca32fb88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4c417fa640 1 -- 172.21.15.144:0/877642699 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50028070 con 0x56537c01b100 2024-09-13T19:33:36.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4c417fa640 1 -- 172.21.15.144:0/877642699 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d50022a80 con 0x56537c01b100 2024-09-13T19:33:36.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4c417fa640 1 -- 172.21.15.144:0/877642699 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50022d60 con 0x56537c01b100 2024-09-13T19:33:36.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- 172.21.15.144:0/877642699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 msgr2=0x56537c01b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 --2- 172.21.15.144:0/877642699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c01b500 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d5004a130 tx=0x7f4d50013dd0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- 172.21.15.144:0/877642699 shutdown_connections 2024-09-13T19:33:36.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 --2- 172.21.15.144:0/877642699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c01b500 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- 172.21.15.144:0/877642699 >> 172.21.15.144:0/877642699 conn(0x56537c017490 msgr2=0x56537c015590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- 172.21.15.144:0/877642699 shutdown_connections 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- 172.21.15.144:0/877642699 wait complete. 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 Processor -- start 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- start start 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c022460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56537c01c0b0 con 0x56537c01b100 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d5e49e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c022460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d5e49e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c022460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58426/0 (socket says 172.21.15.144:58426) 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 learned_addr learned my addr 172.21.15.144:0/1228332633 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56537c0229a0 con 0x56537c01b100 2024-09-13T19:33:36.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d5e49e640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c022460 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d50011b30 tx=0x7f4d5004a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4c2f7fe640 1 -- 172.21.15.144:0/1228332633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5004b770 con 0x56537c01b100 2024-09-13T19:33:36.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56537c022c30 con 0x56537c01b100 2024-09-13T19:33:36.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56537c025910 con 0x56537c01b100 2024-09-13T19:33:36.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4c2f7fe640 1 -- 172.21.15.144:0/1228332633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5004b910 con 0x56537c01b100 2024-09-13T19:33:36.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.135+0000 7f4c2f7fe640 1 -- 172.21.15.144:0/1228332633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d500134e0 con 0x56537c01b100 2024-09-13T19:33:36.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4c2f7fe640 1 -- 172.21.15.144:0/1228332633 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d50043050 con 0x56537c01b100 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4c2f7fe640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c28034650 0x7f4c28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4c2f7fe640 1 -- 172.21.15.144:0/1228332633 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4d50034030 con 0x56537c01b100 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c28034650 0x7f4c28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537c02db60 0x56537c030020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c030770 con 0x56537c02db60 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5d49c640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537c02db60 0x56537c030020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c28034650 0x7f4c28036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4d5801a9f0 tx=0x7f4d5803a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5d49c640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537c02db60 0x56537c030020 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 realm 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c030b40 con 0x56537c02db60 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c0313e0 con 0x56537c02db60 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c031780 con 0x56537c02db60 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:36.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537c0324e0 0x56537c0348d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c034e10 con 0x56537c0324e0 2024-09-13T19:33:36.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5e49e640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537c0324e0 0x56537c0348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.139+0000 7f4d5e49e640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537c0324e0 0x56537c0348d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d6018d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d6018d980 20 searching for the correct realm 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56537c036df0 0x56537c0392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56537c036df0 0x56537c0392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56537c036df0 0x56537c0392b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5dc9d640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d58046040 0x7f4d5802d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x7f4d58046040 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5d49c640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d58046040 0x7f4d5802d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5d49c640 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d58046040 0x7f4d5802d3f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c02db60 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c02db60 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.143+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x7f4d58046040 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c02db60 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c02db60 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x7f4d58046040 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c02db60 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c02db60 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.147+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x7f4d58046040 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c02db60 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x7f4d58046040 2024-09-13T19:33:36.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c036df0 2024-09-13T19:33:36.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.151+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c0324e0 2024-09-13T19:33:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x56537c02db60 2024-09-13T19:33:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c039980 con 0x7f4d58046040 2024-09-13T19:33:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c02db60 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c035b90 con 0x56537c02db60 2024-09-13T19:33:36.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c035ba0 con 0x56537c02db60 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 zone default found 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 4 Realm: () 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 zonegroup default 2024-09-13T19:33:36.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c036040 con 0x56537c0324e0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c0353a0 con 0x56537c036df0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c03bd10 con 0x56537c036df0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 started sync module instance, tier type = 2024-09-13T19:33:36.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:36.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03b120 con 0x7f4d58046040 2024-09-13T19:33:36.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94916562892352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03b120 con 0x7f4d58046040 2024-09-13T19:33:36.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.155+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03c8c0 con 0x56537c02db60 2024-09-13T19:33:36.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.159+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94916562892352] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.159+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.159+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94916562895760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03b120 con 0x56537c02db60 2024-09-13T19:33:36.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.159+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03d2d0 con 0x56537c036df0 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94916562898464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03db20 con 0x56537c036df0 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03e4e0 con 0x7f4d58046040 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94916562895760] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94916562903088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03e450 con 0x7f4d58046040 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03f230 con 0x56537c02db60 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94916562898464] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94916562903088] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94916562900592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03ed30 con 0x56537c02db60 2024-09-13T19:33:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.163+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03fad0 con 0x56537c0324e0 2024-09-13T19:33:36.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.167+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94916562900592] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.167+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.167+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94916562908704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03ed30 con 0x56537c0324e0 2024-09-13T19:33:36.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.167+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c040320 con 0x56537c0324e0 2024-09-13T19:33:36.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.167+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.167+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94916562910832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c040780 con 0x56537c0324e0 2024-09-13T19:33:36.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.167+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c041280 con 0x56537c0324e0 2024-09-13T19:33:36.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94916562908704] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94916562910832] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94916562914672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c040290 con 0x56537c0324e0 2024-09-13T19:33:36.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 20 add_watcher() i=0 2024-09-13T19:33:36.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 20 add_watcher() i=1 2024-09-13T19:33:36.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 20 add_watcher() i=2 2024-09-13T19:33:36.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 20 add_watcher() i=3 2024-09-13T19:33:36.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 20 add_watcher() i=4 2024-09-13T19:33:36.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 20 add_watcher() i=5 2024-09-13T19:33:36.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 20 add_watcher() i=6 2024-09-13T19:33:36.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94916562914672] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 20 add_watcher() i=7 2024-09-13T19:33:36.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:36.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.171+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56537c044270 con 0x56537c02db60 2024-09-13T19:33:36.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94916562905216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c0416f0 con 0x56537c02db60 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94916562905216] v30'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4c0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d6018d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d6018d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d6018d980 5 note: GC not initialized 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4c0e7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d6018d980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d6018d980 20 Filter name: none 2024-09-13T19:33:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4b7ffff640 20 reqs_thread_entry: start 2024-09-13T19:33:36.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c066db0 con 0x56537c0324e0 2024-09-13T19:33:36.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c03fad0 con 0x56537c0324e0 2024-09-13T19:33:36.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c03fad0 con 0x56537c036df0 2024-09-13T19:33:36.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.175+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c03db20 con 0x56537c0324e0 2024-09-13T19:33:36.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c03db20 con 0x56537c02db60 2024-09-13T19:33:36.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x7f4d58046040 2024-09-13T19:33:36.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x7f4d58046040 2024-09-13T19:33:36.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x7f4d58046040 2024-09-13T19:33:36.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.179+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c02db60 2024-09-13T19:33:36.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c02db60 2024-09-13T19:33:36.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c02db60 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x7f4d58046040 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x7f4d58046040 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c02db60 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c0324e0 2024-09-13T19:33:36.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x7f4d58046040 2024-09-13T19:33:36.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.183+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c0324e0 2024-09-13T19:33:36.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c036df0 2024-09-13T19:33:36.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c02db60 2024-09-13T19:33:36.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x7f4d58046040 2024-09-13T19:33:36.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56537c035790 con 0x56537c0324e0 2024-09-13T19:33:36.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.187+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.192 INFO:teuthology.orchestra.run.smithi144.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-13T19:33:36.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.191+0000 7f4c0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:36.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.191+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94916562905216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03fad0 con 0x56537c02db60 2024-09-13T19:33:36.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.191+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94916562905216] v30'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.191+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94916562892352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c0651d0 con 0x7f4d58046040 2024-09-13T19:33:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.191+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94916562892352] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.191+0000 7f4d6018d980 20 remove_watcher() i=0 2024-09-13T19:33:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.191+0000 7f4d6018d980 2 removed watcher, disabling cache 2024-09-13T19:33:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.191+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94916562895760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c0651d0 con 0x56537c02db60 2024-09-13T19:33:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94916562895760] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d6018d980 20 remove_watcher() i=1 2024-09-13T19:33:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94916562898464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c0651d0 con 0x56537c036df0 2024-09-13T19:33:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d5dc9d640 1 -- 172.21.15.144:0/1228332633 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94916562898464] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d58008030 con 0x56537c036df0 2024-09-13T19:33:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d6018d980 20 remove_watcher() i=2 2024-09-13T19:33:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94916562903088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03ce20 con 0x7f4d58046040 2024-09-13T19:33:36.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94916562903088] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x7f4d58046040 2024-09-13T19:33:36.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d6018d980 20 remove_watcher() i=3 2024-09-13T19:33:36.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.195+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94916562900592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03ce20 con 0x56537c02db60 2024-09-13T19:33:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.199+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94916562900592] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480b3040 con 0x56537c02db60 2024-09-13T19:33:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.199+0000 7f4d6018d980 20 remove_watcher() i=4 2024-09-13T19:33:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.199+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94916562908704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03d670 con 0x56537c0324e0 2024-09-13T19:33:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.199+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94916562908704] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.199+0000 7f4d6018d980 20 remove_watcher() i=5 2024-09-13T19:33:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.199+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94916562910832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03f620 con 0x56537c0324e0 2024-09-13T19:33:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94916562910832] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 20 remove_watcher() i=6 2024-09-13T19:33:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94916562914672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56537c03d670 con 0x56537c0324e0 2024-09-13T19:33:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d5e49e640 1 -- 172.21.15.144:0/1228332633 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94916562914672] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5002a070 con 0x56537c0324e0 2024-09-13T19:33:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 20 remove_watcher() i=7 2024-09-13T19:33:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537c0324e0 msgr2=0x56537c0348d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537c0324e0 0x56537c0348d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537c02db60 msgr2=0x56537c030020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537c02db60 0x56537c030020 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d58046040 msgr2=0x7f4d5802d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4d58046040 0x7f4d5802d3f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56537c036df0 msgr2=0x56537c0392b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.203+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56537c036df0 0x56537c0392b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c28034650 msgr2=0x7f4c28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c28034650 0x7f4c28036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4d5801a9f0 tx=0x7f4d5803a000 comp rx=0 tx=0).stop 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 msgr2=0x56537c022460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d5d49c640 1 -- 172.21.15.144:0/1228332633 reap_dead start 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c022460 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d50011b30 tx=0x7f4d5004a090 comp rx=0 tx=0).stop 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 shutdown_connections 2024-09-13T19:33:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1228332633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c01b100 0x56537c022460 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 >> 172.21.15.144:0/1228332633 conn(0x56537c017490 msgr2=0x56537c015560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 shutdown_connections 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1228332633 wait complete. 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1650001979 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c380346a0 msgr2=0x7f4c38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1650001979 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c380346a0 0x7f4c38036b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x56537bffb630 tx=0x7f4d5801af30 comp rx=0 tx=0).stop 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1650001979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c00e660 msgr2=0x56537c00ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1650001979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c00e660 0x56537c00ea80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x56537bffb590 tx=0x7f4d50018830 comp rx=0 tx=0).stop 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1650001979 shutdown_connections 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1650001979 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c380346a0 0x7f4c38036b60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/1650001979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537c00e660 0x56537c00ea80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1650001979 >> 172.21.15.144:0/1650001979 conn(0x56537c0037b0 msgr2=0x56537c006230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1650001979 shutdown_connections 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/1650001979 wait complete. 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537bffd4c0 msgr2=0x56537bfff8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537bffd4c0 0x56537bfff8b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537bf05ab0 msgr2=0x56537bffab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537bf05ab0 0x56537bffab50 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c44034650 msgr2=0x7f4c44036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c44034650 0x7f4c44036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d480ad000 tx=0x7f4d480a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 msgr2=0x56537bff3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bff3b60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x56537bfed9d0 tx=0x7f4d58000bd0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 shutdown_connections 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56537bf05ab0 0x56537bffab50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56537bffd4c0 0x56537bfff8b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4c44034650 0x7f4c44036b10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 --2- 172.21.15.144:0/492122437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56537be76280 0x56537bff3b60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 >> 172.21.15.144:0/492122437 conn(0x56537befc080 msgr2=0x56537bfe6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 shutdown_connections 2024-09-13T19:33:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.207+0000 7f4d6018d980 1 -- 172.21.15.144:0/492122437 wait complete. 2024-09-13T19:33:36.218 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-13T19:33:36.219 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T19:33:36.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T19:33:36.219 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T19:33:36.291 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:36.292 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:36.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f092a8ba980 1 Processor -- start 2024-09-13T19:33:36.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f092a8ba980 1 -- start start 2024-09-13T19:33:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f092a8ba980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55be504ce650 0x55be504cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f092a8ba980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be50356ae0 con 0x55be504cefa0 2024-09-13T19:33:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f092a8ba980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55be5037ae30 con 0x55be504ce650 2024-09-13T19:33:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f09283ca640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55be504ce650 0x55be504cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f091ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55be504cefa0 0x55be504d39d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44738/0 (socket says 172.21.15.144:44738) 2024-09-13T19:33:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f091ffff640 1 -- 172.21.15.144:0/3910550138 learned_addr learned my addr 172.21.15.144:0/3910550138 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f0927bc9640 1 -- 172.21.15.144:0/3910550138 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1691237697 0 0) 0x55be50356ae0 con 0x55be504cefa0 2024-09-13T19:33:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f0927bc9640 1 -- 172.21.15.144:0/3910550138 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0914001e20 con 0x55be504cefa0 2024-09-13T19:33:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f09283ca640 1 -- 172.21.15.144:0/3910550138 >> v1:172.21.15.18:6789/0 conn(0x55be504cefa0 legacy=0x55be504d39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.291+0000 7f09283ca640 1 -- 172.21.15.144:0/3910550138 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be504d6220 con 0x55be504ce650 2024-09-13T19:33:36.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f09283ca640 1 --2- 172.21.15.144:0/3910550138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be504cea30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f091800a480 tx=0x7f091801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3b2f7e706d3d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f0927bc9640 1 -- 172.21.15.144:0/3910550138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09180b0070 con 0x55be504ce650 2024-09-13T19:33:36.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f0927bc9640 1 -- 172.21.15.144:0/3910550138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09180ab540 con 0x55be504ce650 2024-09-13T19:33:36.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f0927bc9640 1 -- 172.21.15.144:0/3910550138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09180ab840 con 0x55be504ce650 2024-09-13T19:33:36.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f092a8ba980 1 -- 172.21.15.144:0/3910550138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 msgr2=0x55be504cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3910550138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be504cea30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f091800a480 tx=0x7f091801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:36.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f092a8ba980 1 -- 172.21.15.144:0/3910550138 shutdown_connections 2024-09-13T19:33:36.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3910550138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be504cea30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f092a8ba980 1 -- 172.21.15.144:0/3910550138 >> 172.21.15.144:0/3910550138 conn(0x55be504ca170 msgr2=0x55be504cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f092a8ba980 1 -- 172.21.15.144:0/3910550138 shutdown_connections 2024-09-13T19:33:36.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.295+0000 7f092a8ba980 1 -- 172.21.15.144:0/3910550138 wait complete. 2024-09-13T19:33:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.307+0000 7f092a8ba980 1 Processor -- start 2024-09-13T19:33:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.307+0000 7f092a8ba980 1 -- start start 2024-09-13T19:33:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.307+0000 7f092a8ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be50444b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.307+0000 7f092a8ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55be5037c200 con 0x55be504ce650 2024-09-13T19:33:36.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.307+0000 7f09283ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be50444b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.307+0000 7f09283ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be50444b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58442/0 (socket says 172.21.15.144:58442) 2024-09-13T19:33:36.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.307+0000 7f09283ca640 1 -- 172.21.15.144:0/1402238457 learned_addr learned my addr 172.21.15.144:0/1402238457 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.307+0000 7f09283ca640 1 -- 172.21.15.144:0/1402238457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be50445120 con 0x55be504ce650 2024-09-13T19:33:36.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f09283ca640 1 --2- 172.21.15.144:0/1402238457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be50444b50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f09180ae040 tx=0x7f0918003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db6ecbe920740e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f081660c640 1 -- 172.21.15.144:0/1402238457 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09180b0040 con 0x55be504ce650 2024-09-13T19:33:36.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f081660c640 1 -- 172.21.15.144:0/1402238457 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09180ab9d0 con 0x55be504ce650 2024-09-13T19:33:36.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f081660c640 1 -- 172.21.15.144:0/1402238457 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09180abcd0 con 0x55be504ce650 2024-09-13T19:33:36.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- 172.21.15.144:0/1402238457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 msgr2=0x55be50444b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 --2- 172.21.15.144:0/1402238457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be50444b50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f09180ae040 tx=0x7f0918003030 comp rx=0 tx=0).stop 2024-09-13T19:33:36.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- 172.21.15.144:0/1402238457 shutdown_connections 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 --2- 172.21.15.144:0/1402238457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be50444b50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- 172.21.15.144:0/1402238457 >> 172.21.15.144:0/1402238457 conn(0x55be504ca170 msgr2=0x55be505b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- 172.21.15.144:0/1402238457 shutdown_connections 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- 172.21.15.144:0/1402238457 wait complete. 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 Processor -- start 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- start start 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be505c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55be504d5c60 con 0x55be504ce650 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f09283ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be505c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f09283ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be505c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58458/0 (socket says 172.21.15.144:58458) 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f09283ca640 1 -- 172.21.15.144:0/3157341097 learned_addr learned my addr 172.21.15.144:0/3157341097 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f09283ca640 1 -- 172.21.15.144:0/3157341097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be505c3220 con 0x55be504ce650 2024-09-13T19:33:36.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f09283ca640 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be505c2ce0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0918018eb0 tx=0x7f0918018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f0814e09640 1 -- 172.21.15.144:0/3157341097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09180b0070 con 0x55be504ce650 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be505c34b0 con 0x55be504ce650 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f0814e09640 1 -- 172.21.15.144:0/3157341097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09180b6870 con 0x55be504ce650 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f0814e09640 1 -- 172.21.15.144:0/3157341097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09180b6b90 con 0x55be504ce650 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.311+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be505c6190 con 0x55be504ce650 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f0814e09640 1 -- 172.21.15.144:0/3157341097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f09180bf3f0 con 0x55be504ce650 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f0814e09640 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0810034650 0x7f0810036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f0814e09640 1 -- 172.21.15.144:0/3157341097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f09180bc070 con 0x55be504ce650 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f091ffff640 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0810034650 0x7f0810036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be504cefa0 0x55be505c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be505ca320 con 0x55be504cefa0 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f0928bcb640 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be504cefa0 0x55be505c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f091ffff640 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0810034650 0x7f0810036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0910000f70 tx=0x7f09100010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f0928bcb640 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be504cefa0 0x55be505c9de0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f0928bcb640 1 -- 172.21.15.144:0/3157341097 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f092000a4d0 con 0x55be504cefa0 2024-09-13T19:33:36.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be505c7390 con 0x55be504cefa0 2024-09-13T19:33:36.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f0928bcb640 1 -- 172.21.15.144:0/3157341097 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f092000a4d0 con 0x55be504cefa0 2024-09-13T19:33:36.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be505cc660 0x55be505cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be505cf120 con 0x55be505cc660 2024-09-13T19:33:36.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f09283ca640 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be505cc660 0x55be505cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.315+0000 7f09283ca640 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be505cc660 0x55be505cea50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f09283ca640 1 -- 172.21.15.144:0/3157341097 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f09180b3040 con 0x55be505cc660 2024-09-13T19:33:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be505cb500 con 0x55be504cefa0 2024-09-13T19:33:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f0928bcb640 1 -- 172.21.15.144:0/3157341097 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f092000a4d0 con 0x55be504cefa0 2024-09-13T19:33:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be505cb9e0 con 0x55be504cefa0 2024-09-13T19:33:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f0928bcb640 1 -- 172.21.15.144:0/3157341097 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f092000a4d0 con 0x55be504cefa0 2024-09-13T19:33:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f092a8ba980 1 Processor -- start 2024-09-13T19:33:36.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f092a8ba980 1 -- start start 2024-09-13T19:33:36.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f092a8ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505dd860 0x55be505ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f092a8ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55be503d5800 con 0x55be505dd860 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f0928bcb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505dd860 0x55be505ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f0928bcb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505dd860 0x55be505ddc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58460/0 (socket says 172.21.15.144:58460) 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f0928bcb640 1 -- 172.21.15.144:0/1265012620 learned_addr learned my addr 172.21.15.144:0/1265012620 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f0928bcb640 1 -- 172.21.15.144:0/1265012620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be505de1c0 con 0x55be505dd860 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f0928bcb640 1 --2- 172.21.15.144:0/1265012620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505dd860 0x55be505ddc80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x55be505c3be0 tx=0x7f0920018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f080dffb640 1 -- 172.21.15.144:0/1265012620 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0920014450 con 0x55be505dd860 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f080dffb640 1 -- 172.21.15.144:0/1265012620 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09200145f0 con 0x55be505dd860 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f092a8ba980 1 -- 172.21.15.144:0/1265012620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be505de450 con 0x55be505dd860 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f080dffb640 1 -- 172.21.15.144:0/1265012620 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0920014910 con 0x55be505dd860 2024-09-13T19:33:36.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.319+0000 7f092a8ba980 1 -- 172.21.15.144:0/1265012620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be505e10d0 con 0x55be505dd860 2024-09-13T19:33:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f080dffb640 1 -- 172.21.15.144:0/1265012620 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0920011040 con 0x55be505dd860 2024-09-13T19:33:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f080dffb640 1 --2- 172.21.15.144:0/1265012620 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0800034650 0x7f0800036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f080dffb640 1 -- 172.21.15.144:0/1265012620 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f092001e070 con 0x55be505dd860 2024-09-13T19:33:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f09283ca640 1 --2- 172.21.15.144:0/1265012620 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0800034650 0x7f0800036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 Processor -- start 2024-09-13T19:33:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- start start 2024-09-13T19:33:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f09283ca640 1 --2- 172.21.15.144:0/1265012620 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0800034650 0x7f0800036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55be505ca7d0 tx=0x7f09180e2800 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55be50443280 con 0x55be505ea3c0 2024-09-13T19:33:36.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f0928bcb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f0928bcb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505ea7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58472/0 (socket says 172.21.15.144:58472) 2024-09-13T19:33:36.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f0928bcb640 1 -- 172.21.15.144:0/57221594 learned_addr learned my addr 172.21.15.144:0/57221594 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f0928bcb640 1 -- 172.21.15.144:0/57221594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be505ead90 con 0x55be505ea3c0 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f0928bcb640 1 --2- 172.21.15.144:0/57221594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505ea7c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0920016900 tx=0x7f0920011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3ad84b99b22d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f08077fe640 1 -- 172.21.15.144:0/57221594 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0920022a80 con 0x55be505ea3c0 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f08077fe640 1 -- 172.21.15.144:0/57221594 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0920022c20 con 0x55be505ea3c0 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f08077fe640 1 -- 172.21.15.144:0/57221594 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f092003a8f0 con 0x55be505ea3c0 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- 172.21.15.144:0/57221594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 msgr2=0x55be505ea7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 --2- 172.21.15.144:0/57221594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505ea7c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0920016900 tx=0x7f0920011f00 comp rx=0 tx=0).stop 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- 172.21.15.144:0/57221594 shutdown_connections 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 --2- 172.21.15.144:0/57221594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505ea7c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- 172.21.15.144:0/57221594 >> 172.21.15.144:0/57221594 conn(0x55be505e6740 msgr2=0x55be505e4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- 172.21.15.144:0/57221594 shutdown_connections 2024-09-13T19:33:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- 172.21.15.144:0/57221594 wait complete. 2024-09-13T19:33:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 Processor -- start 2024-09-13T19:33:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- start start 2024-09-13T19:33:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f092a8ba980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55be505eb2d0 con 0x55be505ea3c0 2024-09-13T19:33:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f0928bcb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f0928bcb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505f16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58484/0 (socket says 172.21.15.144:58484) 2024-09-13T19:33:36.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.323+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 learned_addr learned my addr 172.21.15.144:0/3086473982 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be505f1c10 con 0x55be505ea3c0 2024-09-13T19:33:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f0928bcb640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505f16d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0920011f40 tx=0x7f0920049f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f0805ffb640 1 -- 172.21.15.144:0/3086473982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0920022a80 con 0x55be505ea3c0 2024-09-13T19:33:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be505f1ea0 con 0x55be505ea3c0 2024-09-13T19:33:36.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be505f4b80 con 0x55be505ea3c0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f0805ffb640 1 -- 172.21.15.144:0/3086473982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092004bba0 con 0x55be505ea3c0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f0805ffb640 1 -- 172.21.15.144:0/3086473982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09200135c0 con 0x55be505ea3c0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f0805ffb640 1 -- 172.21.15.144:0/3086473982 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0920013760 con 0x55be505ea3c0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f0805ffb640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8034650 0x7f07f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f0805ffb640 1 -- 172.21.15.144:0/3086473982 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0920034070 con 0x55be505ea3c0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f09283ca640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8034650 0x7f07f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be505fcd40 0x55be505ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be505ff950 con 0x55be505fcd40 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f091ffff640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be505fcd40 0x55be505ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f09283ca640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8034650 0x7f07f8036b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f091801b2c0 tx=0x7f09180d5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f091ffff640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be505fcd40 0x55be505ff200 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f091000e640 con 0x55be505fcd40 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 realm 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be505fc210 con 0x55be505fcd40 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f091000e640 con 0x55be505fcd40 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50600450 con 0x55be505fcd40 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f091000e640 con 0x55be505fcd40 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50600d20 con 0x55be505fcd40 2024-09-13T19:33:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f091000e640 con 0x55be505fcd40 2024-09-13T19:33:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be50601740 0x55be50603b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.327+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50604220 con 0x55be50601740 2024-09-13T19:33:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f0928bcb640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be50601740 0x55be50603b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f0928bcb640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be50601740 0x55be50603b30 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f092a8ba980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f092a8ba980 20 searching for the correct realm 2024-09-13T19:33:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55be50606170 0x55be50608580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f09283ca640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55be50606170 0x55be50608580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f09283ca640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55be50606170 0x55be50608580 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f09283ca640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f09180ab030 0x7f09180bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x7f09180ab030 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f091ffff640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f09180ab030 0x7f09180bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f091ffff640 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f09180ab030 0x7f09180bf730 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091000e640 con 0x7f09180ab030 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.331+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be505fcd40 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f091000e640 con 0x55be505fcd40 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be505fcd40 2024-09-13T19:33:36.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x7f09180ab030 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be505fcd40 2024-09-13T19:33:36.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be505fcd40 2024-09-13T19:33:36.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x7f09180ab030 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.335+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be505fcd40 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be505fcd40 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x7f09180ab030 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be505fcd40 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.339+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x7f09180ab030 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50606170 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be50601740 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x55be505fcd40 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55be50608c00 con 0x7f09180ab030 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50604be0 con 0x55be505fcd40 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be506047f0 con 0x55be505fcd40 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:36.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be506054d0 con 0x55be505fcd40 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 zone default found 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 4 Realm: () 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 zonegroup default 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.343+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50609080 con 0x55be50601740 2024-09-13T19:33:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be5060ae30 con 0x55be50606170 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be5060b300 con 0x55be50606170 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 20 started sync module instance, tier type = 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:36.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060a2a0 con 0x7f09180ab030 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94275880658848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060a2a0 con 0x7f09180ab030 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060be20 con 0x55be505fcd40 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94275880658848] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94275880663296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060a2a0 con 0x55be505fcd40 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.347+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060c830 con 0x55be50606170 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.351+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94275880663296] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.351+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.351+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94275880656368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060a210 con 0x55be50606170 2024-09-13T19:33:36.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.351+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060d530 con 0x7f09180ab030 2024-09-13T19:33:36.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.351+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.351+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94275880669616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060ddd0 con 0x7f09180ab030 2024-09-13T19:33:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.351+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060e790 con 0x55be505fcd40 2024-09-13T19:33:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.351+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94275880656368] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.355+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94275880669616] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.355+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.355+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94275880674016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060e700 con 0x55be505fcd40 2024-09-13T19:33:36.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.355+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060dd20 con 0x55be50601740 2024-09-13T19:33:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.355+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94275880674016] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.355+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.355+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94275880671344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060dc90 con 0x55be50601740 2024-09-13T19:33:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.355+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060f4e0 con 0x55be50601740 2024-09-13T19:33:36.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94275880677424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060f940 con 0x55be50601740 2024-09-13T19:33:36.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be50610450 con 0x55be50601740 2024-09-13T19:33:36.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94275880671344] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94275880677424] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94275880681216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be50610410 con 0x55be50601740 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 20 add_watcher() i=0 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 20 add_watcher() i=1 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 20 add_watcher() i=2 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 20 add_watcher() i=3 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 20 add_watcher() i=4 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 20 add_watcher() i=5 2024-09-13T19:33:36.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.359+0000 7f092a8ba980 20 add_watcher() i=6 2024-09-13T19:33:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94275880681216] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 20 add_watcher() i=7 2024-09-13T19:33:36.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:36.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50613440 con 0x55be505fcd40 2024-09-13T19:33:36.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94275880676144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be506108c0 con 0x55be505fcd40 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94275880676144] v30'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f07de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 5 note: GC not initialized 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f07dd7e2640 20 reqs_thread_entry: start 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 20 Filter name: none 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f074effd640 20 reqs_thread_entry: start 2024-09-13T19:33:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50636a00 con 0x55be505fcd40 2024-09-13T19:33:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.363+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50639490 con 0x7f09180ab030 2024-09-13T19:33:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 20 disabling bucket name=myfoo 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50637470 con 0x7f09180ab030 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50639c70 con 0x55be50606170 2024-09-13T19:33:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(65 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:36.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be506418f0 con 0x55be50606170 2024-09-13T19:33:36.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:36.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:36.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:36.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1, ofs0, ns] 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.367+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94275880854320 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be5063be70 con 0x7f09180ab030 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== watch-notify(notify (1) cookie 94275880658848 notify 128849018905 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f0914001e20 con 0x7f09180ab030 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018905 cookie 94275880658848 notifier 4587 bl.length()=752 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(67 notify.0 [notify cookie 94275880854320 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f07ec003eb0 con 0x7f09180ab030 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== watch-notify(notify_complete (2) cookie 94275880854320 notify 128849018905 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f091002d9b0 con 0x7f09180ab030 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_sources= new_sources= 2024-09-13T19:33:36.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential sources added=[] removed=[] 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_dests= new_dests= 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential dests added=[] removed=[] 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be50637fd0 con 0x55be505fcd40 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94275880854288 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55be50637fd0 con 0x55be505fcd40 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94275880674016 notify 128849018894 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f091002d9b0 con 0x55be505fcd40 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94275880674016 notifier 4587 bl.length()=567 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:36.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(70 notify.4 [notify cookie 94275880854288 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f08077fe640 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f07ec003eb0 con 0x55be505fcd40 2024-09-13T19:33:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94275880854288 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f091002ddf0 con 0x55be505fcd40 2024-09-13T19:33:36.377 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f07de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.371+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94275880676144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be50634830 con 0x55be505fcd40 2024-09-13T19:33:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94275880676144] v30'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94275880658848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be50634830 con 0x7f09180ab030 2024-09-13T19:33:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94275880658848] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f092a8ba980 20 remove_watcher() i=0 2024-09-13T19:33:36.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f092a8ba980 2 removed watcher, disabling cache 2024-09-13T19:33:36.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94275880663296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060a7a0 con 0x55be505fcd40 2024-09-13T19:33:36.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94275880663296] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f092a8ba980 20 remove_watcher() i=1 2024-09-13T19:33:36.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.375+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94275880656368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be50634830 con 0x55be50606170 2024-09-13T19:33:36.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.379+0000 7f09283ca640 1 -- 172.21.15.144:0/3086473982 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94275880656368] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09180b3040 con 0x55be50606170 2024-09-13T19:33:36.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.379+0000 7f092a8ba980 20 remove_watcher() i=2 2024-09-13T19:33:36.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.379+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94275880669616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060a7a0 con 0x7f09180ab030 2024-09-13T19:33:36.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.379+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94275880669616] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x7f09180ab030 2024-09-13T19:33:36.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.379+0000 7f092a8ba980 20 remove_watcher() i=3 2024-09-13T19:33:36.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.379+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94275880674016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be50609df0 con 0x55be505fcd40 2024-09-13T19:33:36.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.383+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94275880674016] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0910029040 con 0x55be505fcd40 2024-09-13T19:33:36.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.383+0000 7f092a8ba980 20 remove_watcher() i=4 2024-09-13T19:33:36.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.383+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94275880671344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be50634830 con 0x55be50601740 2024-09-13T19:33:36.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.383+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94275880671344] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.383+0000 7f092a8ba980 20 remove_watcher() i=5 2024-09-13T19:33:36.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.383+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94275880677424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060a7a0 con 0x55be50601740 2024-09-13T19:33:36.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94275880677424] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 20 remove_watcher() i=6 2024-09-13T19:33:36.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94275880681216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55be5060e2e0 con 0x55be50601740 2024-09-13T19:33:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f0928bcb640 1 -- 172.21.15.144:0/3086473982 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94275880681216] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920041020 con 0x55be50601740 2024-09-13T19:33:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 20 remove_watcher() i=7 2024-09-13T19:33:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be50601740 msgr2=0x55be50603b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be50601740 0x55be50603b30 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be505fcd40 msgr2=0x55be505ff200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be505fcd40 0x55be505ff200 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f09180ab030 msgr2=0x7f09180bf730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f09180ab030 0x7f09180bf730 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55be50606170 msgr2=0x55be50608580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55be50606170 0x55be50608580 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8034650 msgr2=0x7f07f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8034650 0x7f07f8036b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f091801b2c0 tx=0x7f09180d5000 comp rx=0 tx=0).stop 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 msgr2=0x55be505f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505f16d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0920011f40 tx=0x7f0920049f30 comp rx=0 tx=0).stop 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f091ffff640 1 -- 172.21.15.144:0/3086473982 reap_dead start 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 shutdown_connections 2024-09-13T19:33:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3086473982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505ea3c0 0x55be505f16d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 >> 172.21.15.144:0/3086473982 conn(0x55be505e6740 msgr2=0x55be505e4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 shutdown_connections 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/3086473982 wait complete. 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/1265012620 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0800034650 msgr2=0x7f0800036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/1265012620 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0800034650 0x7f0800036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55be505ca7d0 tx=0x7f09180e2800 comp rx=0 tx=0).stop 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/1265012620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505dd860 msgr2=0x55be505ddc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/1265012620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505dd860 0x55be505ddc80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x55be505c3be0 tx=0x7f0920018830 comp rx=0 tx=0).stop 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 -- 172.21.15.144:0/1265012620 shutdown_connections 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.387+0000 7f092a8ba980 1 --2- 172.21.15.144:0/1265012620 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0800034650 0x7f0800036b10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/1265012620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be505dd860 0x55be505ddc80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/1265012620 >> 172.21.15.144:0/1265012620 conn(0x55be505d29b0 msgr2=0x55be505d5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/1265012620 shutdown_connections 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/1265012620 wait complete. 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be505cc660 msgr2=0x55be505cea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be505cc660 0x55be505cea50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be504cefa0 msgr2=0x55be505c9de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be504cefa0 0x55be505c9de0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0810034650 msgr2=0x7f0810036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0810034650 0x7f0810036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0910000f70 tx=0x7f09100010b0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 msgr2=0x55be505c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be505c2ce0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0918018eb0 tx=0x7f0918018020 comp rx=0 tx=0).stop 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 shutdown_connections 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55be504cefa0 0x55be505c9de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55be505cc660 0x55be505cea50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0810034650 0x7f0810036b10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 --2- 172.21.15.144:0/3157341097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55be504ce650 0x55be505c2ce0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 >> 172.21.15.144:0/3157341097 conn(0x55be504ca170 msgr2=0x55be504437a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 shutdown_connections 2024-09-13T19:33:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.391+0000 7f092a8ba980 1 -- 172.21.15.144:0/3157341097 wait complete. 2024-09-13T19:33:36.402 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:36.404 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T19:33:36.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T19:33:36.404 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T19:33:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b65c6980 1 Processor -- start 2024-09-13T19:33:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b65c6980 1 -- start start 2024-09-13T19:33:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b65c6980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5580a211ab00 0x5580a21a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b65c6980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580a202eae0 con 0x5580a21a9870 2024-09-13T19:33:36.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b65c6980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5580a2052e30 con 0x5580a211ab00 2024-09-13T19:33:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b40d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5580a211ab00 0x5580a21a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b40d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5580a211ab00 0x5580a21a9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58488/0 (socket says 172.21.15.144:58488) 2024-09-13T19:33:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b40d6640 1 -- 172.21.15.144:0/551740056 learned_addr learned my addr 172.21.15.144:0/551740056 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b38d5640 1 --1- 172.21.15.144:0/551740056 >> v1:172.21.15.18:6789/0 conn(0x5580a21a9870 0x5580a21abc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:44744/0 (socket says 172.21.15.144:44744) 2024-09-13T19:33:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b40d6640 1 -- 172.21.15.144:0/551740056 >> v1:172.21.15.18:6789/0 conn(0x5580a21a9870 legacy=0x5580a21abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.475+0000 7f07b40d6640 1 -- 172.21.15.144:0/551740056 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a21ae390 con 0x5580a211ab00 2024-09-13T19:33:36.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b40d6640 1 --2- 172.21.15.144:0/551740056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a9330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00a4e0 tx=0x7f07ac01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e83b65138698e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b30d4640 1 -- 172.21.15.144:0/551740056 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ac0aa540 con 0x5580a211ab00 2024-09-13T19:33:36.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b30d4640 1 -- 172.21.15.144:0/551740056 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ac0aa6e0 con 0x5580a211ab00 2024-09-13T19:33:36.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b30d4640 1 -- 172.21.15.144:0/551740056 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ac0aaa40 con 0x5580a211ab00 2024-09-13T19:33:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b65c6980 1 -- 172.21.15.144:0/551740056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 msgr2=0x5580a21a9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b65c6980 1 --2- 172.21.15.144:0/551740056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a9330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00a4e0 tx=0x7f07ac01b090 comp rx=0 tx=0).stop 2024-09-13T19:33:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b65c6980 1 -- 172.21.15.144:0/551740056 shutdown_connections 2024-09-13T19:33:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b65c6980 1 --2- 172.21.15.144:0/551740056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a9330 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b65c6980 1 -- 172.21.15.144:0/551740056 >> 172.21.15.144:0/551740056 conn(0x5580a21a1060 msgr2=0x5580a21a3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b65c6980 1 -- 172.21.15.144:0/551740056 shutdown_connections 2024-09-13T19:33:36.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.479+0000 7f07b65c6980 1 -- 172.21.15.144:0/551740056 wait complete. 2024-09-13T19:33:36.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.491+0000 7f07b65c6980 1 Processor -- start 2024-09-13T19:33:36.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.491+0000 7f07b65c6980 1 -- start start 2024-09-13T19:33:36.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.491+0000 7f07b65c6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a2291a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.491+0000 7f07b65c6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5580a2054200 con 0x5580a211ab00 2024-09-13T19:33:36.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.491+0000 7f07b40d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a2291a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a2291a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58500/0 (socket says 172.21.15.144:58500) 2024-09-13T19:33:36.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 -- 172.21.15.144:0/484756767 learned_addr learned my addr 172.21.15.144:0/484756767 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 -- 172.21.15.144:0/484756767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a2292020 con 0x5580a211ab00 2024-09-13T19:33:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 --2- 172.21.15.144:0/484756767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a2291a50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f07ac017ca0 tx=0x7f07ac0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793f90621343a6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f06a260c640 1 -- 172.21.15.144:0/484756767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ac0b9070 con 0x5580a211ab00 2024-09-13T19:33:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f06a260c640 1 -- 172.21.15.144:0/484756767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ac0aaa80 con 0x5580a211ab00 2024-09-13T19:33:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f06a260c640 1 -- 172.21.15.144:0/484756767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ac0aad60 con 0x5580a211ab00 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 -- 172.21.15.144:0/484756767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 msgr2=0x5580a2291a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 --2- 172.21.15.144:0/484756767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a2291a50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f07ac017ca0 tx=0x7f07ac0033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 -- 172.21.15.144:0/484756767 shutdown_connections 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 --2- 172.21.15.144:0/484756767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a2291a50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 -- 172.21.15.144:0/484756767 >> 172.21.15.144:0/484756767 conn(0x5580a21a1060 msgr2=0x5580a228d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 -- 172.21.15.144:0/484756767 shutdown_connections 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 -- 172.21.15.144:0/484756767 wait complete. 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 Processor -- start 2024-09-13T19:33:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 -- start start 2024-09-13T19:33:36.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b65c6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5580a21ade30 con 0x5580a211ab00 2024-09-13T19:33:36.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58510/0 (socket says 172.21.15.144:58510) 2024-09-13T19:33:36.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 -- 172.21.15.144:0/3300216677 learned_addr learned my addr 172.21.15.144:0/3300216677 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 -- 172.21.15.144:0/3300216677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a21a5350 con 0x5580a211ab00 2024-09-13T19:33:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f07b40d6640 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a6c30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f07ac01aec0 tx=0x7f07ac017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.495+0000 7f06a0e09640 1 -- 172.21.15.144:0/3300216677 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ac0cc070 con 0x5580a211ab00 2024-09-13T19:33:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f06a0e09640 1 -- 172.21.15.144:0/3300216677 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ac0c7410 con 0x5580a211ab00 2024-09-13T19:33:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580a21a55e0 con 0x5580a211ab00 2024-09-13T19:33:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580a21a5b30 con 0x5580a211ab00 2024-09-13T19:33:36.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f06a0e09640 1 -- 172.21.15.144:0/3300216677 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ac0b9070 con 0x5580a211ab00 2024-09-13T19:33:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f06a0e09640 1 -- 172.21.15.144:0/3300216677 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07ac0b3040 con 0x5580a211ab00 2024-09-13T19:33:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f06a0e09640 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f069c034650 0x7f069c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f06a0e09640 1 -- 172.21.15.144:0/3300216677 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f07ac0c4070 con 0x5580a211ab00 2024-09-13T19:33:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b38d5640 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f069c034650 0x7f069c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a21a9870 0x5580a22a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22a2620 con 0x5580a21a9870 2024-09-13T19:33:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b48d7640 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a21a9870 0x5580a22a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b38d5640 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f069c034650 0x7f069c036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07a8000f70 tx=0x7f07a8001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b48d7640 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a21a9870 0x5580a22a20e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b48d7640 1 -- 172.21.15.144:0/3300216677 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a40083f0 con 0x5580a21a9870 2024-09-13T19:33:36.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a21a5f50 con 0x5580a21a9870 2024-09-13T19:33:36.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b48d7640 1 -- 172.21.15.144:0/3300216677 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07a40083f0 con 0x5580a21a9870 2024-09-13T19:33:36.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22a4910 0x5580a22a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22a73f0 con 0x5580a22a4910 2024-09-13T19:33:36.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b40d6640 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22a4910 0x5580a22a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.499+0000 7f07b40d6640 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22a4910 0x5580a22a6d00 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b40d6640 1 -- 172.21.15.144:0/3300216677 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22a4910 2024-09-13T19:33:36.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22a37b0 con 0x5580a21a9870 2024-09-13T19:33:36.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b48d7640 1 -- 172.21.15.144:0/3300216677 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07a40083f0 con 0x5580a21a9870 2024-09-13T19:33:36.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22a3c10 con 0x5580a21a9870 2024-09-13T19:33:36.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b48d7640 1 -- 172.21.15.144:0/3300216677 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07a40083f0 con 0x5580a21a9870 2024-09-13T19:33:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b65c6980 1 Processor -- start 2024-09-13T19:33:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b65c6980 1 -- start start 2024-09-13T19:33:36.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b65c6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22b5a90 0x5580a22b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b65c6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5580a20ad800 con 0x5580a22b5a90 2024-09-13T19:33:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b48d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22b5a90 0x5580a22b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b48d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22b5a90 0x5580a22b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58514/0 (socket says 172.21.15.144:58514) 2024-09-13T19:33:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b48d7640 1 -- 172.21.15.144:0/2585413707 learned_addr learned my addr 172.21.15.144:0/2585413707 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b48d7640 1 -- 172.21.15.144:0/2585413707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a22b63f0 con 0x5580a22b5a90 2024-09-13T19:33:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b48d7640 1 --2- 172.21.15.144:0/2585413707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22b5a90 0x5580a22b5eb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5580a21a6470 tx=0x7f07a400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f0699ffb640 1 -- 172.21.15.144:0/2585413707 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a4010db0 con 0x5580a22b5a90 2024-09-13T19:33:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b65c6980 1 -- 172.21.15.144:0/2585413707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580a22b6680 con 0x5580a22b5a90 2024-09-13T19:33:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f0699ffb640 1 -- 172.21.15.144:0/2585413707 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a401f020 con 0x5580a22b5a90 2024-09-13T19:33:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f07b65c6980 1 -- 172.21.15.144:0/2585413707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580a22b9300 con 0x5580a22b5a90 2024-09-13T19:33:36.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.503+0000 7f0699ffb640 1 -- 172.21.15.144:0/2585413707 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a401a560 con 0x5580a22b5a90 2024-09-13T19:33:36.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f0699ffb640 1 -- 172.21.15.144:0/2585413707 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07a4013030 con 0x5580a22b5a90 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f0699ffb640 1 --2- 172.21.15.144:0/2585413707 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f068c034650 0x7f068c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f0699ffb640 1 -- 172.21.15.144:0/2585413707 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f07a4020030 con 0x5580a22b5a90 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b40d6640 1 --2- 172.21.15.144:0/2585413707 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f068c034650 0x7f068c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 Processor -- start 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- start start 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b40d6640 1 --2- 172.21.15.144:0/2585413707 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f068c034650 0x7f068c036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07ac000f90 tx=0x7f07ac0b4f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5580a22922e0 con 0x5580a22c2480 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b48d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b48d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58524/0 (socket says 172.21.15.144:58524) 2024-09-13T19:33:36.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b48d7640 1 -- 172.21.15.144:0/38496589 learned_addr learned my addr 172.21.15.144:0/38496589 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b48d7640 1 -- 172.21.15.144:0/38496589 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a22c2e50 con 0x5580a22c2480 2024-09-13T19:33:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b48d7640 1 --2- 172.21.15.144:0/38496589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c2880 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f07a404a5a0 tx=0x7f07a4018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634ab383ed76e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f06937fe640 1 -- 172.21.15.144:0/38496589 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a401e040 con 0x5580a22c2480 2024-09-13T19:33:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f06937fe640 1 -- 172.21.15.144:0/38496589 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a4016810 con 0x5580a22c2480 2024-09-13T19:33:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f06937fe640 1 -- 172.21.15.144:0/38496589 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a4024410 con 0x5580a22c2480 2024-09-13T19:33:36.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- 172.21.15.144:0/38496589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 msgr2=0x5580a22c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 --2- 172.21.15.144:0/38496589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c2880 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f07a404a5a0 tx=0x7f07a4018fb0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- 172.21.15.144:0/38496589 shutdown_connections 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 --2- 172.21.15.144:0/38496589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c2880 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- 172.21.15.144:0/38496589 >> 172.21.15.144:0/38496589 conn(0x5580a22be8f0 msgr2=0x5580a22bc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- 172.21.15.144:0/38496589 shutdown_connections 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- 172.21.15.144:0/38496589 wait complete. 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 Processor -- start 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- start start 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.507+0000 7f07b65c6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5580a22c3480 con 0x5580a22c2480 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b48d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b48d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58540/0 (socket says 172.21.15.144:58540) 2024-09-13T19:33:36.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 learned_addr learned my addr 172.21.15.144:0/2241219872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:36.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a22c9d90 con 0x5580a22c2480 2024-09-13T19:33:36.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b48d7640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c9850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f07a4024fd0 tx=0x7f07a404a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f0691ffb640 1 -- 172.21.15.144:0/2241219872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a401e070 con 0x5580a22c2480 2024-09-13T19:33:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580a22ca020 con 0x5580a22c2480 2024-09-13T19:33:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f0691ffb640 1 -- 172.21.15.144:0/2241219872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a403c070 con 0x5580a22c2480 2024-09-13T19:33:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f0691ffb640 1 -- 172.21.15.144:0/2241219872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a40234f0 con 0x5580a22c2480 2024-09-13T19:33:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580a22ccd00 con 0x5580a22c2480 2024-09-13T19:33:36.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f0691ffb640 1 -- 172.21.15.144:0/2241219872 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07a4007380 con 0x5580a22c2480 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f0691ffb640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0684034650 0x7f0684036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f0691ffb640 1 -- 172.21.15.144:0/2241219872 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f07a4036030 con 0x5580a22c2480 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b40d6640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0684034650 0x7f0684036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a22d4d20 0x5580a22d71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22d7910 con 0x5580a22d4d20 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b38d5640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a22d4d20 0x5580a22d71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b40d6640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0684034650 0x7f0684036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f07ac005790 tx=0x7f07ac0df000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b38d5640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a22d4d20 0x5580a22d71c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a800f620 con 0x5580a22d4d20 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.511+0000 7f07b65c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 realm 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22d41f0 con 0x5580a22d4d20 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a800f620 con 0x5580a22d4d20 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22d8410 con 0x5580a22d4d20 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a800f620 con 0x5580a22d4d20 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22d8ce0 con 0x5580a22d4d20 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07a800f620 con 0x5580a22d4d20 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:36.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22d9620 0x5580a22dba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22dc1c0 con 0x5580a22d9620 2024-09-13T19:33:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b48d7640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22d9620 0x5580a22dba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b48d7640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22d9620 0x5580a22dba30 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 20 searching for the correct realm 2024-09-13T19:33:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5580a22de110 0x5580a22e0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b40d6640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5580a22de110 0x5580a22e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b40d6640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5580a22de110 0x5580a22e0520 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b40d6640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07ac0f2040 0x7f07ac0bd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x7f07ac0f2040 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b38d5640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07ac0f2040 0x7f07ac0bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b38d5640 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07ac0f2040 0x7f07ac0bd400 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800f620 con 0x7f07ac0f2040 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.515+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d4d20 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07a800f620 con 0x5580a22d4d20 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d4d20 2024-09-13T19:33:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x7f07ac0f2040 2024-09-13T19:33:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d4d20 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.519+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d4d20 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x7f07ac0f2040 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d4d20 2024-09-13T19:33:36.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d4d20 2024-09-13T19:33:36.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.523+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x7f07ac0f2040 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d4d20 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x7f07ac0f2040 2024-09-13T19:33:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22de110 2024-09-13T19:33:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d9620 2024-09-13T19:33:36.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x5580a22d4d20 2024-09-13T19:33:36.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e0bf0 con 0x7f07ac0f2040 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22dcb80 con 0x5580a22d4d20 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.527+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22dd420 con 0x5580a22d4d20 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22dc7c0 con 0x5580a22d4d20 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 zone default found 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 4 Realm: () 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:36.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 zonegroup default 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22dd010 con 0x5580a22d9620 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e3400 con 0x5580a22de110 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e37a0 con 0x5580a22de110 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:36.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 started sync module instance, tier type = 2024-09-13T19:33:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e2840 con 0x7f07ac0f2040 2024-09-13T19:33:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94010965110080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e2840 con 0x7f07ac0f2040 2024-09-13T19:33:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.531+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e41a0 con 0x5580a22d4d20 2024-09-13T19:33:36.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.535+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94010965110080] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.535+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.535+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94010965114032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e2840 con 0x5580a22d4d20 2024-09-13T19:33:36.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.535+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e4be0 con 0x5580a22de110 2024-09-13T19:33:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.535+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.535+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94010965116720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e5430 con 0x5580a22de110 2024-09-13T19:33:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.535+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e5df0 con 0x7f07ac0f2040 2024-09-13T19:33:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.535+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94010965114032] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94010965121344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e5d60 con 0x7f07ac0f2040 2024-09-13T19:33:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e6b40 con 0x5580a22d4d20 2024-09-13T19:33:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94010965116720] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94010965121344] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94010965118848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e6640 con 0x5580a22d4d20 2024-09-13T19:33:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e6e90 con 0x5580a22d9620 2024-09-13T19:33:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.539+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94010965118848] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.543+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.543+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94010965123744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e7280 con 0x5580a22d9620 2024-09-13T19:33:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.543+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e7c40 con 0x5580a22d9620 2024-09-13T19:33:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.543+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.543+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94010965129104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e8060 con 0x5580a22d9620 2024-09-13T19:33:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.543+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e8b10 con 0x5580a22d9620 2024-09-13T19:33:36.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.543+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94010965123744] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94010965129104] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94010965132784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e7bb0 con 0x5580a22d9620 2024-09-13T19:33:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 20 add_watcher() i=0 2024-09-13T19:33:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 20 add_watcher() i=1 2024-09-13T19:33:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 20 add_watcher() i=2 2024-09-13T19:33:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 20 add_watcher() i=3 2024-09-13T19:33:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 20 add_watcher() i=4 2024-09-13T19:33:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 20 add_watcher() i=5 2024-09-13T19:33:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 20 add_watcher() i=6 2024-09-13T19:33:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94010965132784] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 20 add_watcher() i=7 2024-09-13T19:33:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a22ebc10 con 0x5580a22d4d20 2024-09-13T19:33:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.547+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94010965124800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e9090 con 0x5580a22d4d20 2024-09-13T19:33:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94010965124800] v30'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f066a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 5 note: GC not initialized 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f06697e2640 20 reqs_thread_entry: start 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 Filter name: none 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f05daffd640 20 reqs_thread_entry: start 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a230f0c0 con 0x5580a22d4d20 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f07a802b040 con 0x5580a22d4d20 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a230ebe0 con 0x7f07ac0f2040 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 enabling bucket name=myfoo 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a230fb30 con 0x7f07ac0f2040 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 : miss 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 rados->read ofs=0 len=0 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a2311410 con 0x5580a22de110 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(65 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:36.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:36.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 2024-09-13T19:33:36.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.551+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 8.f 8:f2977782:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a231a000 con 0x5580a22de110 2024-09-13T19:33:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1, ofs0, ns] 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94010965311776 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a23149f0 con 0x7f07ac0f2040 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== watch-notify(notify (1) cookie 94010965110080 notify 128849018906 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f07a8018040 con 0x7f07ac0f2040 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f06937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018906 cookie 94010965110080 notifier 4594 bl.length()=752 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f06937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 info.flags=0x17 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f06937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1 to cache LRU end 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f06937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(67 notify.0 [notify cookie 94010965311776 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f06937fe640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0678003eb0 con 0x7f07ac0f2040 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a802b040 con 0x7f07ac0f2040 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== watch-notify(notify_complete (2) cookie 94010965311776 notify 128849018906 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f07a8043020 con 0x7f07ac0f2040 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_sources= new_sources= 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential sources added=[] removed=[] 2024-09-13T19:33:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): orig_dests= new_dests= 2024-09-13T19:33:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 20 handle_bi_update(): bucket=:myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1]): potential dests added=[] removed=[] 2024-09-13T19:33:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a2312b90 con 0x5580a22d4d20 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f07a804a040 con 0x5580a22d4d20 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.555+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94010965324784 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5580a2317cc0 con 0x5580a22d4d20 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94010965118848 notify 128849018895 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f07a8043020 con 0x5580a22d4d20 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f0692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94010965118848 notifier 4594 bl.length()=567 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f0692ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f0692ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f0692ffd640 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f05e8003440 con 0x5580a22d4d20 2024-09-13T19:33:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(70 notify.4 [notify cookie 94010965324784 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07a804a040 con 0x5580a22d4d20 2024-09-13T19:33:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 94010965324784 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5580a202eae0 con 0x5580a22d4d20 2024-09-13T19:33:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a804a040 con 0x5580a22d4d20 2024-09-13T19:33:36.563 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f066a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94010965124800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a230cef0 con 0x5580a22d4d20 2024-09-13T19:33:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94010965124800] v30'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07a804a040 con 0x5580a22d4d20 2024-09-13T19:33:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94010965110080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a230cef0 con 0x7f07ac0f2040 2024-09-13T19:33:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94010965110080] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a804a040 con 0x7f07ac0f2040 2024-09-13T19:33:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b65c6980 20 remove_watcher() i=0 2024-09-13T19:33:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b65c6980 2 removed watcher, disabling cache 2024-09-13T19:33:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.559+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94010965114032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e2d40 con 0x5580a22d4d20 2024-09-13T19:33:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.563+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94010965114032] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a804a040 con 0x5580a22d4d20 2024-09-13T19:33:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.563+0000 7f07b65c6980 20 remove_watcher() i=1 2024-09-13T19:33:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.563+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94010965116720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a230cef0 con 0x5580a22de110 2024-09-13T19:33:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.563+0000 7f07b40d6640 1 -- 172.21.15.144:0/2241219872 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94010965116720] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac0d1d50 con 0x5580a22de110 2024-09-13T19:33:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.563+0000 7f07b65c6980 20 remove_watcher() i=2 2024-09-13T19:33:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.563+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94010965121344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e3cb0 con 0x7f07ac0f2040 2024-09-13T19:33:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.567+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94010965121344] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a804a040 con 0x7f07ac0f2040 2024-09-13T19:33:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.567+0000 7f07b65c6980 20 remove_watcher() i=3 2024-09-13T19:33:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.567+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94010965118848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e2d40 con 0x5580a22d4d20 2024-09-13T19:33:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.567+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94010965118848] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a804a040 con 0x5580a22d4d20 2024-09-13T19:33:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.567+0000 7f07b65c6980 20 remove_watcher() i=4 2024-09-13T19:33:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.567+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94010965123744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e4730 con 0x5580a22d9620 2024-09-13T19:33:36.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.571+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94010965123744] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.571+0000 7f07b65c6980 20 remove_watcher() i=5 2024-09-13T19:33:36.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.571+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94010965129104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a230cef0 con 0x5580a22d9620 2024-09-13T19:33:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.571+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94010965129104] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.571+0000 7f07b65c6980 20 remove_watcher() i=6 2024-09-13T19:33:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.571+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94010965132784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5580a22e5940 con 0x5580a22d9620 2024-09-13T19:33:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b48d7640 1 -- 172.21.15.144:0/2241219872 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94010965132784] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a403d040 con 0x5580a22d9620 2024-09-13T19:33:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 20 remove_watcher() i=7 2024-09-13T19:33:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22d9620 msgr2=0x5580a22dba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22d9620 0x5580a22dba30 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a22d4d20 msgr2=0x5580a22d71c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a22d4d20 0x5580a22d71c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07ac0f2040 msgr2=0x7f07ac0bd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07ac0f2040 0x7f07ac0bd400 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5580a22de110 msgr2=0x5580a22e0520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5580a22de110 0x5580a22e0520 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0684034650 msgr2=0x7f0684036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f0684034650 0x7f0684036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f07ac005790 tx=0x7f07ac0df000 comp rx=0 tx=0).stop 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b38d5640 1 -- 172.21.15.144:0/2241219872 reap_dead start 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 msgr2=0x5580a22c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c9850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f07a4024fd0 tx=0x7f07a404a500 comp rx=0 tx=0).stop 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 shutdown_connections 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2241219872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22c2480 0x5580a22c9850 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 >> 172.21.15.144:0/2241219872 conn(0x5580a22be8f0 msgr2=0x5580a22bc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 shutdown_connections 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2241219872 wait complete. 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2585413707 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f068c034650 msgr2=0x7f068c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2585413707 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f068c034650 0x7f068c036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07ac000f90 tx=0x7f07ac0b4f00 comp rx=0 tx=0).stop 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2585413707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22b5a90 msgr2=0x5580a22b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2585413707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22b5a90 0x5580a22b5eb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5580a21a6470 tx=0x7f07a400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2585413707 shutdown_connections 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2585413707 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f068c034650 0x7f068c036b10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/2585413707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a22b5a90 0x5580a22b5eb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2585413707 >> 172.21.15.144:0/2585413707 conn(0x5580a22aabe0 msgr2=0x5580a22ad660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2585413707 shutdown_connections 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/2585413707 wait complete. 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22a4910 msgr2=0x5580a22a6d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22a4910 0x5580a22a6d00 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a21a9870 msgr2=0x5580a22a20e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a21a9870 0x5580a22a20e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f069c034650 msgr2=0x7f069c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f069c034650 0x7f069c036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07a8000f70 tx=0x7f07a8001380 comp rx=0 tx=0).stop 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 msgr2=0x5580a21a6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a6c30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f07ac01aec0 tx=0x7f07ac017e30 comp rx=0 tx=0).stop 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 shutdown_connections 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5580a21a9870 0x5580a22a20e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5580a22a4910 0x5580a22a6d00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f069c034650 0x7f069c036b10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 --2- 172.21.15.144:0/3300216677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5580a211ab00 0x5580a21a6c30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 >> 172.21.15.144:0/3300216677 conn(0x5580a21a1060 msgr2=0x5580a228c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:36.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 shutdown_connections 2024-09-13T19:33:36.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:36.575+0000 7f07b65c6980 1 -- 172.21.15.144:0/3300216677 wait complete. 2024-09-13T19:33:36.588 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:36.604 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:33:36.953 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-13T19:33:36.970 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:51.971 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T19:33:51.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T19:33:51.971 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T19:33:52.010 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:52.010 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:52.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6234765980 1 Processor -- start 2024-09-13T19:33:52.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6234765980 1 -- start start 2024-09-13T19:33:52.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6234765980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5646af8cdc60 0x5646af8d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6234765980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646af74fae0 con 0x5646af8c98e0 2024-09-13T19:33:52.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6234765980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5646af773e30 con 0x5646af8cdc60 2024-09-13T19:33:52.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6231a74640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5646af8cdc60 0x5646af8d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6231a74640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5646af8cdc60 0x5646af8d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39478/0 (socket says 172.21.15.144:39478) 2024-09-13T19:33:52.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6231a74640 1 -- 172.21.15.144:0/2518985757 learned_addr learned my addr 172.21.15.144:0/2518985757 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.007+0000 7f6232275640 1 --1- 172.21.15.144:0/2518985757 >> v1:172.21.15.18:6789/0 conn(0x5646af8c98e0 0x5646af8c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:60960/0 (socket says 172.21.15.144:60960) 2024-09-13T19:33:52.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6231a74640 1 -- 172.21.15.144:0/2518985757 >> v1:172.21.15.18:6789/0 conn(0x5646af8c98e0 legacy=0x5646af8c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6231273640 1 -- 172.21.15.144:0/2518985757 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771912904 0 0) 0x5646af74fae0 con 0x5646af8c98e0 2024-09-13T19:33:52.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6231a74640 1 -- 172.21.15.144:0/2518985757 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646af8d15a0 con 0x5646af8cdc60 2024-09-13T19:33:52.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6231a74640 1 --2- 172.21.15.144:0/2518985757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8cdc60 0x5646af8d0050 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f621c00a5c0 tx=0x7f621c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6828b4aa70392bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6231273640 1 -- 172.21.15.144:0/2518985757 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c0a6070 con 0x5646af8cdc60 2024-09-13T19:33:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6231273640 1 -- 172.21.15.144:0/2518985757 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c0af070 con 0x5646af8cdc60 2024-09-13T19:33:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6231273640 1 -- 172.21.15.144:0/2518985757 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c0aa5c0 con 0x5646af8cdc60 2024-09-13T19:33:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6234765980 1 -- 172.21.15.144:0/2518985757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8cdc60 msgr2=0x5646af8d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6234765980 1 --2- 172.21.15.144:0/2518985757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8cdc60 0x5646af8d0050 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f621c00a5c0 tx=0x7f621c01b340 comp rx=0 tx=0).stop 2024-09-13T19:33:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6234765980 1 -- 172.21.15.144:0/2518985757 shutdown_connections 2024-09-13T19:33:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6234765980 1 --2- 172.21.15.144:0/2518985757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8cdc60 0x5646af8d0050 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6234765980 1 -- 172.21.15.144:0/2518985757 >> 172.21.15.144:0/2518985757 conn(0x5646af83d230 msgr2=0x5646af83d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6234765980 1 -- 172.21.15.144:0/2518985757 shutdown_connections 2024-09-13T19:33:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.011+0000 7f6234765980 1 -- 172.21.15.144:0/2518985757 wait complete. 2024-09-13T19:33:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.027+0000 7f6234765980 1 Processor -- start 2024-09-13T19:33:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.027+0000 7f6234765980 1 -- start start 2024-09-13T19:33:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.027+0000 7f6234765980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646af775200 con 0x5646af8c98e0 2024-09-13T19:33:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39488/0 (socket says 172.21.15.144:39488) 2024-09-13T19:33:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 -- 172.21.15.144:0/2172123944 learned_addr learned my addr 172.21.15.144:0/2172123944 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 -- 172.21.15.144:0/2172123944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646af9b4fb0 con 0x5646af8c98e0 2024-09-13T19:33:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 --2- 172.21.15.144:0/2172123944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9b49e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f62240016c0 tx=0x7f6224001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835a3c9da51c704e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6120608640 1 -- 172.21.15.144:0/2172123944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224003460 con 0x5646af8c98e0 2024-09-13T19:33:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6120608640 1 -- 172.21.15.144:0/2172123944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6224003600 con 0x5646af8c98e0 2024-09-13T19:33:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6120608640 1 -- 172.21.15.144:0/2172123944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224003920 con 0x5646af8c98e0 2024-09-13T19:33:52.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 -- 172.21.15.144:0/2172123944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 msgr2=0x5646af9b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 --2- 172.21.15.144:0/2172123944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9b49e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f62240016c0 tx=0x7f6224001b80 comp rx=0 tx=0).stop 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 -- 172.21.15.144:0/2172123944 shutdown_connections 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 --2- 172.21.15.144:0/2172123944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9b49e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 -- 172.21.15.144:0/2172123944 >> 172.21.15.144:0/2172123944 conn(0x5646af83d230 msgr2=0x5646af9b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 -- 172.21.15.144:0/2172123944 shutdown_connections 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 -- 172.21.15.144:0/2172123944 wait complete. 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 Processor -- start 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 -- start start 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6234765980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646af8d10a0 con 0x5646af8c98e0 2024-09-13T19:33:52.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9bbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39500/0 (socket says 172.21.15.144:39500) 2024-09-13T19:33:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 -- 172.21.15.144:0/2763490076 learned_addr learned my addr 172.21.15.144:0/2763490076 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.031+0000 7f6232275640 1 -- 172.21.15.144:0/2763490076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646af9bc320 con 0x5646af8c98e0 2024-09-13T19:33:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6232275640 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9bbde0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f62240012f0 tx=0x7f6224001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f611ee05640 1 -- 172.21.15.144:0/2763490076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224013760 con 0x5646af8c98e0 2024-09-13T19:33:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f611ee05640 1 -- 172.21.15.144:0/2763490076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6224023070 con 0x5646af8c98e0 2024-09-13T19:33:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646af9bc5b0 con 0x5646af8c98e0 2024-09-13T19:33:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f611ee05640 1 -- 172.21.15.144:0/2763490076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224013a30 con 0x5646af8c98e0 2024-09-13T19:33:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646af9bf290 con 0x5646af8c98e0 2024-09-13T19:33:52.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f611ee05640 1 -- 172.21.15.144:0/2763490076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6224010070 con 0x5646af8c98e0 2024-09-13T19:33:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f611ee05640 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6118034650 0x7f6118036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f611ee05640 1 -- 172.21.15.144:0/2763490076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6224049ba0 con 0x5646af8c98e0 2024-09-13T19:33:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6231a74640 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6118034650 0x7f6118036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af8cdc60 0x5646af9c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9c3420 con 0x5646af8cdc60 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6232a76640 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af8cdc60 0x5646af9c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6231a74640 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6118034650 0x7f6118036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f621c0ae000 tx=0x7f621c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6232a76640 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af8cdc60 0x5646af9c2db0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6232a76640 1 -- 172.21.15.144:0/2763490076 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622c0083f0 con 0x5646af8cdc60 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9c04b0 con 0x5646af8cdc60 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6232a76640 1 -- 172.21.15.144:0/2763490076 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f622c0083f0 con 0x5646af8cdc60 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9c5750 0x5646af9c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.035+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9c8210 con 0x5646af9c5750 2024-09-13T19:33:52.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232275640 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9c5750 0x5646af9c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232275640 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9c5750 0x5646af9c7b40 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232275640 1 -- 172.21.15.144:0/2763490076 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6224041d70 con 0x5646af9c5750 2024-09-13T19:33:52.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9c45f0 con 0x5646af8cdc60 2024-09-13T19:33:52.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232a76640 1 -- 172.21.15.144:0/2763490076 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f622c0083f0 con 0x5646af8cdc60 2024-09-13T19:33:52.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9c4ad0 con 0x5646af8cdc60 2024-09-13T19:33:52.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232a76640 1 -- 172.21.15.144:0/2763490076 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f622c0083f0 con 0x5646af8cdc60 2024-09-13T19:33:52.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6234765980 1 Processor -- start 2024-09-13T19:33:52.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6234765980 1 -- start start 2024-09-13T19:33:52.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6234765980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9d6950 0x5646af9d6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6234765980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646af7ce800 con 0x5646af9d6950 2024-09-13T19:33:52.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232a76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9d6950 0x5646af9d6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232a76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9d6950 0x5646af9d6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39502/0 (socket says 172.21.15.144:39502) 2024-09-13T19:33:52.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232a76640 1 -- 172.21.15.144:0/3704677572 learned_addr learned my addr 172.21.15.144:0/3704677572 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.039+0000 7f6232a76640 1 -- 172.21.15.144:0/3704677572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646af9d72b0 con 0x5646af9d6950 2024-09-13T19:33:52.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6232a76640 1 --2- 172.21.15.144:0/3704677572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9d6950 0x5646af9d6d70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x5646af9bcce0 tx=0x7f622c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6117fff640 1 -- 172.21.15.144:0/3704677572 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c007dd0 con 0x5646af9d6950 2024-09-13T19:33:52.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6117fff640 1 -- 172.21.15.144:0/3704677572 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c01e020 con 0x5646af9d6950 2024-09-13T19:33:52.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6117fff640 1 -- 172.21.15.144:0/3704677572 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c019590 con 0x5646af9d6950 2024-09-13T19:33:52.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6234765980 1 -- 172.21.15.144:0/3704677572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646af9d7540 con 0x5646af9d6950 2024-09-13T19:33:52.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6234765980 1 -- 172.21.15.144:0/3704677572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646af9da1c0 con 0x5646af9d6950 2024-09-13T19:33:52.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6117fff640 1 -- 172.21.15.144:0/3704677572 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f622c016040 con 0x5646af9d6950 2024-09-13T19:33:52.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6117fff640 1 --2- 172.21.15.144:0/3704677572 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f610c034650 0x7f610c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6117fff640 1 -- 172.21.15.144:0/3704677572 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f622c01f030 con 0x5646af9d6950 2024-09-13T19:33:52.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6232275640 1 --2- 172.21.15.144:0/3704677572 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f610c034650 0x7f610c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6234765980 1 Processor -- start 2024-09-13T19:33:52.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6234765980 1 -- start start 2024-09-13T19:33:52.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6232275640 1 --2- 172.21.15.144:0/3704677572 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f610c034650 0x7f610c036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x5646af9c38a0 tx=0x7f6224047f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6234765980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9e3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6234765980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646af9b5330 con 0x5646af9e3380 2024-09-13T19:33:52.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6232a76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9e3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6232a76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9e3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39504/0 (socket says 172.21.15.144:39504) 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6232a76640 1 -- 172.21.15.144:0/328473607 learned_addr learned my addr 172.21.15.144:0/328473607 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.043+0000 7f6232a76640 1 -- 172.21.15.144:0/328473607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646af9e3d50 con 0x5646af9e3380 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6232a76640 1 --2- 172.21.15.144:0/328473607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9e3780 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f622c04a320 tx=0x7f622c023660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88b515a02ea52af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6115ffb640 1 -- 172.21.15.144:0/328473607 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c01d040 con 0x5646af9e3380 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6115ffb640 1 -- 172.21.15.144:0/328473607 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c015c90 con 0x5646af9e3380 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6115ffb640 1 -- 172.21.15.144:0/328473607 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c022a60 con 0x5646af9e3380 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- 172.21.15.144:0/328473607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 msgr2=0x5646af9e3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 --2- 172.21.15.144:0/328473607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9e3780 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f622c04a320 tx=0x7f622c023660 comp rx=0 tx=0).stop 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- 172.21.15.144:0/328473607 shutdown_connections 2024-09-13T19:33:52.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 --2- 172.21.15.144:0/328473607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9e3780 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- 172.21.15.144:0/328473607 >> 172.21.15.144:0/328473607 conn(0x5646af9df7b0 msgr2=0x5646af9dd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- 172.21.15.144:0/328473607 shutdown_connections 2024-09-13T19:33:52.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- 172.21.15.144:0/328473607 wait complete. 2024-09-13T19:33:52.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 Processor -- start 2024-09-13T19:33:52.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- start start 2024-09-13T19:33:52.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9ea730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646af9e43a0 con 0x5646af9e3380 2024-09-13T19:33:52.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6232a76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9ea730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6232a76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9ea730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39506/0 (socket says 172.21.15.144:39506) 2024-09-13T19:33:52.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 learned_addr learned my addr 172.21.15.144:0/2077899061 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646af9eac70 con 0x5646af9e3380 2024-09-13T19:33:52.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6232a76640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9ea730 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f622c0236a0 tx=0x7f622c0179a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6103fff640 1 -- 172.21.15.144:0/2077899061 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c01d040 con 0x5646af9e3380 2024-09-13T19:33:52.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6103fff640 1 -- 172.21.15.144:0/2077899061 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c015e40 con 0x5646af9e3380 2024-09-13T19:33:52.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646af9eac70 con 0x5646af9e3380 2024-09-13T19:33:52.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6103fff640 1 -- 172.21.15.144:0/2077899061 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622c017770 con 0x5646af9e3380 2024-09-13T19:33:52.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.047+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646af9eac70 con 0x5646af9e3380 2024-09-13T19:33:52.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6103fff640 1 -- 172.21.15.144:0/2077899061 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f622c0155f0 con 0x5646af9e3380 2024-09-13T19:33:52.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6103fff640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f60fc0345b0 0x7f60fc036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6103fff640 1 -- 172.21.15.144:0/2077899061 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f622c01a070 con 0x5646af9e3380 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6232275640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f60fc0345b0 0x7f60fc036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af9f5810 0x5646af9f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9f8400 con 0x5646af9f5810 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6231a74640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af9f5810 0x5646af9f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6232275640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f60fc0345b0 0x7f60fc036a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x5646af9c8610 tx=0x7f6224048260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6231a74640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af9f5810 0x5646af9f7cb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 realm 2024-09-13T19:33:52.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9f8830 con 0x5646af9f5810 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9f90d0 con 0x5646af9f5810 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9f9470 con 0x5646af9f5810 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:52.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9fa1d0 0x5646af9fc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9fcb00 con 0x5646af9fa1d0 2024-09-13T19:33:52.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6232a76640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9fa1d0 0x5646af9fc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.051+0000 7f6232a76640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9fa1d0 0x5646af9fc5c0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6234765980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:52.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6234765980 20 searching for the correct realm 2024-09-13T19:33:52.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5646af9fea50 0x5646afa00f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6232275640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5646af9fea50 0x5646afa00f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6232275640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5646af9fea50 0x5646afa00f10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622403c070 con 0x5646af9fea50 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6232275640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6224055040 0x7f62240123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x7f6224055040 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6224055040 0x7f62240123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6224055040 0x7f62240123c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.055+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x7f6224055040 2024-09-13T19:33:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622403c070 con 0x5646af9fea50 2024-09-13T19:33:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x7f6224055040 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622403c070 con 0x5646af9fea50 2024-09-13T19:33:52.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622403c070 con 0x5646af9fea50 2024-09-13T19:33:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.059+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622403c070 con 0x5646af9fea50 2024-09-13T19:33:52.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x7f6224055040 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.063+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x7f6224055040 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fea50 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x5646af9f5810 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646afa015e0 con 0x7f6224055040 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9fd4c0 con 0x5646af9f5810 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.067+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9fd940 con 0x5646af9f5810 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9fdd60 con 0x5646af9f5810 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 zone default found 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 4 Realm: () 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 zonegroup default 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646af9fdd60 con 0x5646af9fa1d0 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa038f0 con 0x5646af9fea50 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa03c90 con 0x5646af9fea50 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 started sync module instance, tier type = 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:52.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa02d30 con 0x7f6224055040 2024-09-13T19:33:52.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94861594210640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa02d30 con 0x7f6224055040 2024-09-13T19:33:52.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.071+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa04650 con 0x5646af9f5810 2024-09-13T19:33:52.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.075+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94861594210640] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.075+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.075+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94861594215088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa02d30 con 0x5646af9f5810 2024-09-13T19:33:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.075+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa05060 con 0x5646af9fea50 2024-09-13T19:33:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94861594217392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa058b0 con 0x5646af9fea50 2024-09-13T19:33:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa06270 con 0x7f6224055040 2024-09-13T19:33:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94861594215088] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94861594222016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa061e0 con 0x7f6224055040 2024-09-13T19:33:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa06fc0 con 0x5646af9f5810 2024-09-13T19:33:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94861594217392] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94861594222016] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94861594219520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa06a80 con 0x5646af9f5810 2024-09-13T19:33:52.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.079+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa07310 con 0x5646af9fa1d0 2024-09-13T19:33:52.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.083+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94861594219520] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.083+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.083+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94861594224352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa07700 con 0x5646af9fa1d0 2024-09-13T19:33:52.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.083+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa080c0 con 0x5646af9fa1d0 2024-09-13T19:33:52.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.083+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94861594224352] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94861594225472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa080c0 con 0x5646af9fa1d0 2024-09-13T19:33:52.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa08a80 con 0x5646af9fa1d0 2024-09-13T19:33:52.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94861594225472] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94861594230048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa08a80 con 0x5646af9fa1d0 2024-09-13T19:33:52.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 20 add_watcher() i=0 2024-09-13T19:33:52.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 20 add_watcher() i=1 2024-09-13T19:33:52.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 20 add_watcher() i=2 2024-09-13T19:33:52.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 20 add_watcher() i=3 2024-09-13T19:33:52.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 20 add_watcher() i=4 2024-09-13T19:33:52.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 20 add_watcher() i=5 2024-09-13T19:33:52.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.087+0000 7f6234765980 20 add_watcher() i=6 2024-09-13T19:33:52.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94861594230048] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6234765980 20 add_watcher() i=7 2024-09-13T19:33:52.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6234765980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:52.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa0bdf0 con 0x5646af9f5810 2024-09-13T19:33:52.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94861594245088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa08bf0 con 0x5646af9f5810 2024-09-13T19:33:52.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94861594245088] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f60e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:52.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6234765980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:52.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6234765980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:52.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.091+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa14520 con 0x5646af9f5810 2024-09-13T19:33:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.095+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.095+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa14a90 con 0x5646af9fa1d0 2024-09-13T19:33:52.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.099+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.099+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa14f40 con 0x5646af9fea50 2024-09-13T19:33:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.099+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.099+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa15790 con 0x5646af9f5810 2024-09-13T19:33:52.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.099+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'153 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.099+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa12500 con 0x7f6224055040 2024-09-13T19:33:52.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.103+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.103+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa12500 con 0x5646af9fea50 2024-09-13T19:33:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.103+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.103+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa162f0 con 0x5646af9f5810 2024-09-13T19:33:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.103+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.103+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa162f0 con 0x5646af9fa1d0 2024-09-13T19:33:52.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.107+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.107+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa162f0 con 0x7f6224055040 2024-09-13T19:33:52.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.111+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv18 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.111+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa16380 con 0x5646af9fea50 2024-09-13T19:33:52.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.111+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.111+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa16410 con 0x7f6224055040 2024-09-13T19:33:52.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.111+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.111+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa16410 con 0x5646af9fa1d0 2024-09-13T19:33:52.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.115+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.115+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa165e0 con 0x7f6224055040 2024-09-13T19:33:52.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.115+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.115+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa165e0 con 0x5646af9fa1d0 2024-09-13T19:33:52.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.119+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.119+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9f5810 2024-09-13T19:33:52.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.123+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'154 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.123+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.123+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.123+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x7f6224055040 2024-09-13T19:33:52.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.127+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.127+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.127+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.127+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9f5810 2024-09-13T19:33:52.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.131+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.131+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9f5810 2024-09-13T19:33:52.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.131+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'155 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.131+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.135+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.135+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x7f6224055040 2024-09-13T19:33:52.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.135+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.135+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.139+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.139+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.139+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.139+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.143+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.143+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.143+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.143+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fa1d0 2024-09-13T19:33:52.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.147+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.147+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.147+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.147+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fa1d0 2024-09-13T19:33:52.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.151+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.151+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fea50 2024-09-13T19:33:52.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.155+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.155+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x5646af9fa1d0 2024-09-13T19:33:52.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.159+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.159+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa169c0 con 0x7f6224055040 2024-09-13T19:33:52.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.159+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.159+0000 7f60637fe640 20 reqs_thread_entry: start 2024-09-13T19:33:52.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.159+0000 7f6234765980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:52.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6234765980 20 Filter name: none 2024-09-13T19:33:52.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f60617fa640 20 reqs_thread_entry: start 2024-09-13T19:33:52.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fa1d0 2024-09-13T19:33:52.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fa1d0 2024-09-13T19:33:52.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.163+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fa1d0 2024-09-13T19:33:52.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fea50 2024-09-13T19:33:52.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fea50 2024-09-13T19:33:52.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fea50 2024-09-13T19:33:52.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.167+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x7f6224055040 2024-09-13T19:33:52.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x7f6224055040 2024-09-13T19:33:52.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x7f6224055040 2024-09-13T19:33:52.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fea50 2024-09-13T19:33:52.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fea50 2024-09-13T19:33:52.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fea50 2024-09-13T19:33:52.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9f5810 2024-09-13T19:33:52.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa11380 con 0x5646af9fa1d0 2024-09-13T19:33:52.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.171+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa13e60 con 0x5646af9fa1d0 2024-09-13T19:33:52.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa13e60 con 0x5646af9fa1d0 2024-09-13T19:33:52.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa13e10 con 0x7f6224055040 2024-09-13T19:33:52.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv18 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa13e10 con 0x7f6224055040 2024-09-13T19:33:52.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv18 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa13e10 con 0x7f6224055040 2024-09-13T19:33:52.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(120 gc.8 [call out=1702b] v0'0 uv18 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.175+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x7f6224055040 2024-09-13T19:33:52.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fa1d0 2024-09-13T19:33:52.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x7f6224055040 2024-09-13T19:33:52.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.179+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fa1d0 2024-09-13T19:33:52.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9f5810 2024-09-13T19:33:52.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.183+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9f5810 2024-09-13T19:33:52.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9f5810 2024-09-13T19:33:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x7f6224055040 2024-09-13T19:33:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.187+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9f5810 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9f5810 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9f5810 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9f5810 2024-09-13T19:33:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9f5810 2024-09-13T19:33:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9f5810 2024-09-13T19:33:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.191+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x7f6224055040 2024-09-13T19:33:52.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.195+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fa1d0 2024-09-13T19:33:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.199+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fa1d0 2024-09-13T19:33:52.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fea50 2024-09-13T19:33:52.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.203+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fea50 2024-09-13T19:33:52.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.207+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.207+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.207+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.207+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x5646af9fa1d0 2024-09-13T19:33:52.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.207+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.207+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x5646af9fa1d0 2024-09-13T19:33:52.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.207+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.207+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.211+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.211+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa31ec0 con 0x7f6224055040 2024-09-13T19:33:52.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.211+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.211+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646afa32ed0 con 0x7f6224055040 2024-09-13T19:33:52.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.211+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.211+0000 7f60e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:52.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.211+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94861594245088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa135a0 con 0x5646af9f5810 2024-09-13T19:33:52.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.215+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94861594245088] v32'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.215+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94861594210640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa0b7e0 con 0x7f6224055040 2024-09-13T19:33:52.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.215+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94861594210640] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.215+0000 7f6234765980 20 remove_watcher() i=0 2024-09-13T19:33:52.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.215+0000 7f6234765980 2 removed watcher, disabling cache 2024-09-13T19:33:52.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.215+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94861594215088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa03150 con 0x5646af9f5810 2024-09-13T19:33:52.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94861594215088] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6234765980 20 remove_watcher() i=1 2024-09-13T19:33:52.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94861594217392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa042b0 con 0x5646af9fea50 2024-09-13T19:33:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6232275640 1 -- 172.21.15.144:0/2077899061 <== osd.3 v2:172.21.15.144:6800/1157716661 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94861594217392] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6224064040 con 0x5646af9fea50 2024-09-13T19:33:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6234765980 20 remove_watcher() i=2 2024-09-13T19:33:52.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94861594222016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa042b0 con 0x7f6224055040 2024-09-13T19:33:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.2 v2:172.21.15.144:6816/2341760841 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94861594222016] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x7f6224055040 2024-09-13T19:33:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6234765980 20 remove_watcher() i=3 2024-09-13T19:33:52.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.219+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94861594219520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa05dc0 con 0x5646af9f5810 2024-09-13T19:33:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.223+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 <== osd.1 v2:172.21.15.144:6808/3556169889 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94861594219520] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c0aa940 con 0x5646af9f5810 2024-09-13T19:33:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.223+0000 7f6234765980 20 remove_watcher() i=4 2024-09-13T19:33:52.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.223+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94861594224352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa042b0 con 0x5646af9fa1d0 2024-09-13T19:33:52.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.227+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94861594224352] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.227+0000 7f6234765980 20 remove_watcher() i=5 2024-09-13T19:33:52.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.227+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94861594225472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa05400 con 0x5646af9fa1d0 2024-09-13T19:33:52.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.227+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94861594225472] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.227+0000 7f6234765980 20 remove_watcher() i=6 2024-09-13T19:33:52.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.227+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94861594230048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646afa05dc0 con 0x5646af9fa1d0 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6232a76640 1 -- 172.21.15.144:0/2077899061 <== osd.0 v2:172.21.15.18:6800/2700511246 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94861594230048] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622c02a070 con 0x5646af9fa1d0 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 20 remove_watcher() i=7 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9fa1d0 msgr2=0x5646af9fc5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9fa1d0 0x5646af9fc5c0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af9f5810 msgr2=0x5646af9f7cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af9f5810 0x5646af9f7cb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6224055040 msgr2=0x7f62240123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6224055040 0x7f62240123c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5646af9fea50 msgr2=0x5646afa00f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5646af9fea50 0x5646afa00f10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f60fc0345b0 msgr2=0x7f60fc036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f60fc0345b0 0x7f60fc036a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x5646af9c8610 tx=0x7f6224048260 comp rx=0 tx=0).stop 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6231a74640 1 -- 172.21.15.144:0/2077899061 reap_dead start 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 msgr2=0x5646af9ea730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9ea730 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f622c0236a0 tx=0x7f622c0179a0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 shutdown_connections 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2077899061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9e3380 0x5646af9ea730 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 >> 172.21.15.144:0/2077899061 conn(0x5646af9df7b0 msgr2=0x5646af9dd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 shutdown_connections 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2077899061 wait complete. 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/3704677572 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f610c034650 msgr2=0x7f610c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/3704677572 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f610c034650 0x7f610c036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x5646af9c38a0 tx=0x7f6224047f10 comp rx=0 tx=0).stop 2024-09-13T19:33:52.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/3704677572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9d6950 msgr2=0x5646af9d6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/3704677572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9d6950 0x5646af9d6d70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x5646af9bcce0 tx=0x7f622c00af40 comp rx=0 tx=0).stop 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/3704677572 shutdown_connections 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/3704677572 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f610c034650 0x7f610c036b10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/3704677572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af9d6950 0x5646af9d6d70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/3704677572 >> 172.21.15.144:0/3704677572 conn(0x5646af9cbaa0 msgr2=0x5646af9ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/3704677572 shutdown_connections 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/3704677572 wait complete. 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9c5750 msgr2=0x5646af9c7b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9c5750 0x5646af9c7b40 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af8cdc60 msgr2=0x5646af9c2db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af8cdc60 0x5646af9c2db0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6118034650 msgr2=0x7f6118036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6118034650 0x7f6118036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f621c0ae000 tx=0x7f621c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 msgr2=0x5646af9bbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9bbde0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f62240012f0 tx=0x7f6224001260 comp rx=0 tx=0).stop 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 shutdown_connections 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646af8cdc60 0x5646af9c2db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646af9c5750 0x5646af9c7b40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6118034650 0x7f6118036b10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 --2- 172.21.15.144:0/2763490076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646af8c98e0 0x5646af9bbde0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 >> 172.21.15.144:0/2763490076 conn(0x5646af83d230 msgr2=0x5646af9af190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 shutdown_connections 2024-09-13T19:33:52.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.231+0000 7f6234765980 1 -- 172.21.15.144:0/2763490076 wait complete. 2024-09-13T19:33:52.255 INFO:teuthology.orchestra.run.smithi144.stdout:[{"tag":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.15507378242006388635\u0000","time":"2024-09-13T19:33:51.968507+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_7","key":"","instance":""}]}] 2024-09-13T19:33:52.255 DEBUG:tasks.util.rgw: json result: [{'tag': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.15507378242006388635\x00', 'time': '2024-09-13T19:33:51.968507+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_7', 'key': '', 'instance': ''}]}] 2024-09-13T19:33:52.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-13T19:33:52.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-13T19:33:52.256 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-13T19:33:52.331 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:52.331 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:52.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.327+0000 7f8043ed9980 1 Processor -- start 2024-09-13T19:33:52.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.327+0000 7f8043ed9980 1 -- start start 2024-09-13T19:33:52.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f8043ed9980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dbd9091530 0x55dbd9091910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f8043ed9980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dbd8f1aae0 con 0x55dbd9091e80 2024-09-13T19:33:52.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f8043ed9980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55dbd8f3ee30 con 0x55dbd9091530 2024-09-13T19:33:52.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80419e9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dbd9091530 0x55dbd9091910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80419e9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dbd9091530 0x55dbd9091910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39512/0 (socket says 172.21.15.144:39512) 2024-09-13T19:33:52.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80419e9640 1 -- 172.21.15.144:0/3830706825 learned_addr learned my addr 172.21.15.144:0/3830706825 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80411e8640 1 --1- 172.21.15.144:0/3830706825 >> v1:172.21.15.18:6789/0 conn(0x55dbd9091e80 0x55dbd9096900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:60964/0 (socket says 172.21.15.144:60964) 2024-09-13T19:33:52.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80419e9640 1 -- 172.21.15.144:0/3830706825 >> v1:172.21.15.18:6789/0 conn(0x55dbd9091e80 legacy=0x55dbd9096900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80419e9640 1 -- 172.21.15.144:0/3830706825 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd9099150 con 0x55dbd9091530 2024-09-13T19:33:52.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80419e9640 1 --2- 172.21.15.144:0/3830706825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9091910 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f803c00a4e0 tx=0x7f803c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f2af89dbfc1f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80409e7640 1 -- 172.21.15.144:0/3830706825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803c0aa540 con 0x55dbd9091530 2024-09-13T19:33:52.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80409e7640 1 -- 172.21.15.144:0/3830706825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803c0aa6e0 con 0x55dbd9091530 2024-09-13T19:33:52.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.331+0000 7f80409e7640 1 -- 172.21.15.144:0/3830706825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803c0aaa40 con 0x55dbd9091530 2024-09-13T19:33:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.335+0000 7f8043ed9980 1 -- 172.21.15.144:0/3830706825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 msgr2=0x55dbd9091910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.335+0000 7f8043ed9980 1 --2- 172.21.15.144:0/3830706825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9091910 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f803c00a4e0 tx=0x7f803c01b090 comp rx=0 tx=0).stop 2024-09-13T19:33:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.335+0000 7f8043ed9980 1 -- 172.21.15.144:0/3830706825 shutdown_connections 2024-09-13T19:33:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.335+0000 7f8043ed9980 1 --2- 172.21.15.144:0/3830706825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9091910 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.335+0000 7f8043ed9980 1 -- 172.21.15.144:0/3830706825 >> 172.21.15.144:0/3830706825 conn(0x55dbd908d050 msgr2=0x55dbd908f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.335+0000 7f8043ed9980 1 -- 172.21.15.144:0/3830706825 shutdown_connections 2024-09-13T19:33:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.335+0000 7f8043ed9980 1 -- 172.21.15.144:0/3830706825 wait complete. 2024-09-13T19:33:52.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 Processor -- start 2024-09-13T19:33:52.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- start start 2024-09-13T19:33:52.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd917b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbd8f40200 con 0x55dbd9091530 2024-09-13T19:33:52.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f80419e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd917b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f80419e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd917b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39522/0 (socket says 172.21.15.144:39522) 2024-09-13T19:33:52.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f80419e9640 1 -- 172.21.15.144:0/3161142754 learned_addr learned my addr 172.21.15.144:0/3161142754 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f80419e9640 1 -- 172.21.15.144:0/3161142754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd917be40 con 0x55dbd9091530 2024-09-13T19:33:52.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f80419e9640 1 --2- 172.21.15.144:0/3161142754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd917b870 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f803c017ca0 tx=0x7f803c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4091b5d33a2ad0d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f7f2fe07640 1 -- 172.21.15.144:0/3161142754 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803c0b9030 con 0x55dbd9091530 2024-09-13T19:33:52.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f7f2fe07640 1 -- 172.21.15.144:0/3161142754 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803c0aaac0 con 0x55dbd9091530 2024-09-13T19:33:52.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f7f2fe07640 1 -- 172.21.15.144:0/3161142754 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803c0aada0 con 0x55dbd9091530 2024-09-13T19:33:52.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- 172.21.15.144:0/3161142754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 msgr2=0x55dbd917b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 --2- 172.21.15.144:0/3161142754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd917b870 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f803c017ca0 tx=0x7f803c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- 172.21.15.144:0/3161142754 shutdown_connections 2024-09-13T19:33:52.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 --2- 172.21.15.144:0/3161142754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd917b870 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- 172.21.15.144:0/3161142754 >> 172.21.15.144:0/3161142754 conn(0x55dbd908d050 msgr2=0x55dbd91774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- 172.21.15.144:0/3161142754 shutdown_connections 2024-09-13T19:33:52.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- 172.21.15.144:0/3161142754 wait complete. 2024-09-13T19:33:52.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 Processor -- start 2024-09-13T19:33:52.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- start start 2024-09-13T19:33:52.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9182aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.351+0000 7f8043ed9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbd9098b90 con 0x55dbd9091530 2024-09-13T19:33:52.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f80419e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9182aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f80419e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9182aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39538/0 (socket says 172.21.15.144:39538) 2024-09-13T19:33:52.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f80419e9640 1 -- 172.21.15.144:0/263212528 learned_addr learned my addr 172.21.15.144:0/263212528 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f80419e9640 1 -- 172.21.15.144:0/263212528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd9182fe0 con 0x55dbd9091530 2024-09-13T19:33:52.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f80419e9640 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9182aa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f803c005cc0 tx=0x7f803c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f7f2e604640 1 -- 172.21.15.144:0/263212528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803c0b9030 con 0x55dbd9091530 2024-09-13T19:33:52.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f7f2e604640 1 -- 172.21.15.144:0/263212528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803c0c3070 con 0x55dbd9091530 2024-09-13T19:33:52.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbd9183270 con 0x55dbd9091530 2024-09-13T19:33:52.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f7f2e604640 1 -- 172.21.15.144:0/263212528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803c0bf750 con 0x55dbd9091530 2024-09-13T19:33:52.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd9185f50 con 0x55dbd9091530 2024-09-13T19:33:52.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f7f2e604640 1 -- 172.21.15.144:0/263212528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f803c0c5030 con 0x55dbd9091530 2024-09-13T19:33:52.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f7f2e604640 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f28034650 0x7f7f28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f7f2e604640 1 -- 172.21.15.144:0/263212528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f803c0ba070 con 0x55dbd9091530 2024-09-13T19:33:52.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f80411e8640 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f28034650 0x7f7f28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd9091e80 0x55dbd9189a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd918a0a0 con 0x55dbd9091e80 2024-09-13T19:33:52.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.355+0000 7f80421ea640 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd9091e80 0x55dbd9189a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80411e8640 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f28034650 0x7f7f28036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8038000f70 tx=0x7f8038008590 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80421ea640 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd9091e80 0x55dbd9189a30 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80421ea640 1 -- 172.21.15.144:0/263212528 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80340083f0 con 0x55dbd9091e80 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd9187170 con 0x55dbd9091e80 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80421ea640 1 -- 172.21.15.144:0/263212528 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80340083f0 con 0x55dbd9091e80 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd918c420 0x55dbd918e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd918eee0 con 0x55dbd918c420 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80419e9640 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd918c420 0x55dbd918e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80419e9640 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd918c420 0x55dbd918e810 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80419e9640 1 -- 172.21.15.144:0/263212528 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd918c420 2024-09-13T19:33:52.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd918b2c0 con 0x55dbd9091e80 2024-09-13T19:33:52.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80421ea640 1 -- 172.21.15.144:0/263212528 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80340083f0 con 0x55dbd9091e80 2024-09-13T19:33:52.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd918b7a0 con 0x55dbd9091e80 2024-09-13T19:33:52.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.359+0000 7f80421ea640 1 -- 172.21.15.144:0/263212528 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f80340083f0 con 0x55dbd9091e80 2024-09-13T19:33:52.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f8043ed9980 1 Processor -- start 2024-09-13T19:33:52.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f8043ed9980 1 -- start start 2024-09-13T19:33:52.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f8043ed9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91a1a30 0x55dbd91a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f8043ed9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbd8f99800 con 0x55dbd91a1a30 2024-09-13T19:33:52.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f80421ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91a1a30 0x55dbd91a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f80421ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91a1a30 0x55dbd91a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39550/0 (socket says 172.21.15.144:39550) 2024-09-13T19:33:52.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f80421ea640 1 -- 172.21.15.144:0/1055654166 learned_addr learned my addr 172.21.15.144:0/1055654166 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f80421ea640 1 -- 172.21.15.144:0/1055654166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd91a2390 con 0x55dbd91a1a30 2024-09-13T19:33:52.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f80421ea640 1 --2- 172.21.15.144:0/1055654166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91a1a30 0x55dbd91a1e50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55dbd91839a0 tx=0x7f803400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f7f277fe640 1 -- 172.21.15.144:0/1055654166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8034007d70 con 0x55dbd91a1a30 2024-09-13T19:33:52.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f7f277fe640 1 -- 172.21.15.144:0/1055654166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803401e020 con 0x55dbd91a1a30 2024-09-13T19:33:52.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f8043ed9980 1 -- 172.21.15.144:0/1055654166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbd91a2620 con 0x55dbd91a1a30 2024-09-13T19:33:52.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f7f277fe640 1 -- 172.21.15.144:0/1055654166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8034019590 con 0x55dbd91a1a30 2024-09-13T19:33:52.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f8043ed9980 1 -- 172.21.15.144:0/1055654166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd91a52a0 con 0x55dbd91a1a30 2024-09-13T19:33:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f7f277fe640 1 -- 172.21.15.144:0/1055654166 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8034016040 con 0x55dbd91a1a30 2024-09-13T19:33:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f7f277fe640 1 --2- 172.21.15.144:0/1055654166 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f1c0346a0 0x7f7f1c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f7f277fe640 1 -- 172.21.15.144:0/1055654166 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f803401f030 con 0x55dbd91a1a30 2024-09-13T19:33:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.363+0000 7f80419e9640 1 --2- 172.21.15.144:0/1055654166 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f1c0346a0 0x7f7f1c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 Processor -- start 2024-09-13T19:33:52.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- start start 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80419e9640 1 --2- 172.21.15.144:0/1055654166 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f1c0346a0 0x7f7f1c036b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55dbd918a570 tx=0x7f803c0a3bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbd917c100 con 0x55dbd91ae4e0 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39560/0 (socket says 172.21.15.144:39560) 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 -- 172.21.15.144:0/1392610046 learned_addr learned my addr 172.21.15.144:0/1392610046 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 -- 172.21.15.144:0/1392610046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd91aeeb0 con 0x55dbd91ae4e0 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 --2- 172.21.15.144:0/1392610046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91ae8e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f803404a2a0 tx=0x7f8034023610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09e649efb48e342 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f7f257fa640 1 -- 172.21.15.144:0/1392610046 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803401d040 con 0x55dbd91ae4e0 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f7f257fa640 1 -- 172.21.15.144:0/1392610046 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8034015ce0 con 0x55dbd91ae4e0 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f7f257fa640 1 -- 172.21.15.144:0/1392610046 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803403abc0 con 0x55dbd91ae4e0 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- 172.21.15.144:0/1392610046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 msgr2=0x55dbd91ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 --2- 172.21.15.144:0/1392610046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91ae8e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f803404a2a0 tx=0x7f8034023610 comp rx=0 tx=0).stop 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- 172.21.15.144:0/1392610046 shutdown_connections 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 --2- 172.21.15.144:0/1392610046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91ae8e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- 172.21.15.144:0/1392610046 >> 172.21.15.144:0/1392610046 conn(0x55dbd91aa8c0 msgr2=0x55dbd91a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- 172.21.15.144:0/1392610046 shutdown_connections 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- 172.21.15.144:0/1392610046 wait complete. 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 Processor -- start 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- start start 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f8043ed9980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbd91af450 con 0x55dbd91ae4e0 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39566/0 (socket says 172.21.15.144:39566) 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 learned_addr learned my addr 172.21.15.144:0/356031775 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.367+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd91b5e30 con 0x55dbd91ae4e0 2024-09-13T19:33:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f80421ea640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91b58f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8034023650 tx=0x7f803404a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f7f137fe640 1 -- 172.21.15.144:0/356031775 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803401d070 con 0x55dbd91ae4e0 2024-09-13T19:33:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f7f137fe640 1 -- 172.21.15.144:0/356031775 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8034033070 con 0x55dbd91ae4e0 2024-09-13T19:33:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f7f137fe640 1 -- 172.21.15.144:0/356031775 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803402b7d0 con 0x55dbd91ae4e0 2024-09-13T19:33:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbd91b60c0 con 0x55dbd91ae4e0 2024-09-13T19:33:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd91b64d0 con 0x55dbd91ae4e0 2024-09-13T19:33:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f7f137fe640 1 -- 172.21.15.144:0/356031775 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8034035030 con 0x55dbd91ae4e0 2024-09-13T19:33:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f7f137fe640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f0c034650 0x7f7f0c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f7f137fe640 1 -- 172.21.15.144:0/356031775 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8034038bc0 con 0x55dbd91ae4e0 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f80419e9640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f0c034650 0x7f7f0c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd91c0d80 0x55dbd91c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91c3990 con 0x55dbd91c0d80 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f80411e8640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd91c0d80 0x55dbd91c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f80411e8640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd91c0d80 0x55dbd91c3240 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f80419e9640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f0c034650 0x7f7f0c036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f803c01aec0 tx=0x7f803c0e1000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 20 realm 2024-09-13T19:33:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91c01d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.371+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91c4460 con 0x55dbd91c0d80 2024-09-13T19:33:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91c4d30 con 0x55dbd91c0d80 2024-09-13T19:33:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd91c5620 0x55dbd91c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91c81e0 con 0x55dbd91c5620 2024-09-13T19:33:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80421ea640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd91c5620 0x55dbd91c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80421ea640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd91c5620 0x55dbd91c7a50 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 20 searching for the correct realm 2024-09-13T19:33:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbd91ca130 0x55dbd91cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80419e9640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbd91ca130 0x55dbd91cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80419e9640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbd91ca130 0x55dbd91cc560 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80419e9640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f803c0bf9c0 0x7f803c0dc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x7f803c0bf9c0 2024-09-13T19:33:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80411e8640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f803c0bf9c0 0x7f803c0dc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.375+0000 7f80411e8640 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f803c0bf9c0 0x7f803c0dc3f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c5620 2024-09-13T19:33:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c5620 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x7f803c0bf9c0 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.379+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c5620 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x7f803c0bf9c0 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c5620 2024-09-13T19:33:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c5620 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.383+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x7f803c0bf9c0 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c5620 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c5620 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x7f803c0bf9c0 2024-09-13T19:33:52.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91ca130 2024-09-13T19:33:52.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c5620 2024-09-13T19:33:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.387+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x55dbd91c0d80 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ccc30 con 0x7f803c0bf9c0 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91c8ba0 con 0x55dbd91c0d80 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91c87b0 con 0x55dbd91c0d80 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91c9490 con 0x55dbd91c0d80 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 zone default found 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 4 Realm: () 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 zonegroup default 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91cd0f0 con 0x55dbd91c5620 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91cf3c0 con 0x55dbd91ca130 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91cf760 con 0x55dbd91ca130 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 started sync module instance, tier type = 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.391+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ce800 con 0x7f803c0bf9c0 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.395+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.395+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94402728750336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ce800 con 0x7f803c0bf9c0 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.395+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d0180 con 0x55dbd91c0d80 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.395+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94402728750336] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.395+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.395+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94402728754288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ce800 con 0x55dbd91c0d80 2024-09-13T19:33:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.395+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d0b90 con 0x55dbd91ca130 2024-09-13T19:33:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94402728756960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d13e0 con 0x55dbd91ca130 2024-09-13T19:33:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d1de0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94402728754288] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94402728747856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d21d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d2aa0 con 0x55dbd91c0d80 2024-09-13T19:33:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94402728756960] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94402728747856] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94402728761584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d2180 con 0x55dbd91c0d80 2024-09-13T19:33:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.399+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d3340 con 0x55dbd91c5620 2024-09-13T19:33:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.403+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.403+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94402728767120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d2180 con 0x55dbd91c5620 2024-09-13T19:33:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.403+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d41b0 con 0x55dbd91c5620 2024-09-13T19:33:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.403+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94402728761584] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94402728759088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d41b0 con 0x55dbd91c5620 2024-09-13T19:33:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d4b70 con 0x55dbd91c5620 2024-09-13T19:33:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94402728767120] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94402728759088] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94402728770816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d4120 con 0x55dbd91c5620 2024-09-13T19:33:52.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 20 add_watcher() i=0 2024-09-13T19:33:52.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 20 add_watcher() i=1 2024-09-13T19:33:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 20 add_watcher() i=2 2024-09-13T19:33:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 20 add_watcher() i=3 2024-09-13T19:33:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 20 add_watcher() i=4 2024-09-13T19:33:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 20 add_watcher() i=5 2024-09-13T19:33:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.407+0000 7f8043ed9980 20 add_watcher() i=6 2024-09-13T19:33:52.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94402728770816] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f8043ed9980 20 add_watcher() i=7 2024-09-13T19:33:52.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f8043ed9980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:52.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d7ba0 con 0x55dbd91c0d80 2024-09-13T19:33:52.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94402728773312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91d4f90 con 0x55dbd91c0d80 2024-09-13T19:33:52.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94402728773312] v32'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f7ef37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:52.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f8043ed9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:52.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f8043ed9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:52.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.411+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e03a0 con 0x55dbd91c0d80 2024-09-13T19:33:52.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.415+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.415+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e09f0 con 0x55dbd91c5620 2024-09-13T19:33:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.415+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.415+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e09f0 con 0x55dbd91ca130 2024-09-13T19:33:52.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.419+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.419+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e14d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.419+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'158 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.419+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91de1e0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.419+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.419+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91de1e0 con 0x55dbd91ca130 2024-09-13T19:33:52.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.423+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.423+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e1e60 con 0x55dbd91c0d80 2024-09-13T19:33:52.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.423+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.423+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e1e60 con 0x55dbd91c5620 2024-09-13T19:33:52.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.427+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.427+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e1e60 con 0x7f803c0bf9c0 2024-09-13T19:33:52.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.427+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'20 uv18 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.427+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e1ef0 con 0x55dbd91ca130 2024-09-13T19:33:52.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.431+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.431+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e23a0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.431+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.431+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e23a0 con 0x55dbd91c5620 2024-09-13T19:33:52.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.435+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.435+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e23a0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.435+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.435+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e2310 con 0x55dbd91c5620 2024-09-13T19:33:52.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.439+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.439+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91c0d80 2024-09-13T19:33:52.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.439+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'159 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.439+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.439+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.439+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.443+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.443+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.443+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.443+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91c0d80 2024-09-13T19:33:52.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.447+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.447+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91c0d80 2024-09-13T19:33:52.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.447+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'160 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.447+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.451+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.451+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.451+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.451+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.451+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.451+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.455+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.455+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.455+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.455+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.455+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.455+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91c5620 2024-09-13T19:33:52.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.459+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.459+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.459+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.459+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91c5620 2024-09-13T19:33:52.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.463+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.463+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91ca130 2024-09-13T19:33:52.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.467+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.467+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x55dbd91c5620 2024-09-13T19:33:52.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.467+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.467+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91e22a0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.471+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.471+0000 7f7ef27fc640 20 reqs_thread_entry: start 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.471+0000 7f8043ed9980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.471+0000 7f8043ed9980 20 Filter name: none 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.471+0000 7f7e63fff640 20 reqs_thread_entry: start 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.471+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.471+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:94 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(94 gc.12 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(95 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:96 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(96 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:97 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(97 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(98 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:99 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(99 gc.12 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-13T19:33:52.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.475+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.479+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(100 gc.13 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.479+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.479+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(101 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.479+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.479+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c5620 2024-09-13T19:33:52.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.483+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(102 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.483+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.483+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(103 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.483+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.483+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:104 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.483+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(104 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.483+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.483+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:105 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.487+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(105 gc.13 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.487+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-13T19:33:52.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.487+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:106 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.487+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(106 gc.14 [call] v32'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.487+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:107 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(107 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:108 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c0d80 2024-09-13T19:33:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(108 gc.14 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:109 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(109 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:110 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(110 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:111 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(111 gc.14 [call] v32'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-13T19:33:52.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.491+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:112 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(112 gc.15 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:113 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(113 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:114 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(114 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:115 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(115 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:116 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(116 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.495+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:117 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== osd_op_reply(117 gc.15 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-13T19:33:52.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:118 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(118 gc.16 [call] v32'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:119 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(119 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:120 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== osd_op_reply(120 gc.16 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:121 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== osd_op_reply(121 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:122 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(122 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.499+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:123 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== osd_op_reply(123 gc.16 [call] v32'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-13T19:33:52.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:124 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(124 gc.17 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:125 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 33 ==== osd_op_reply(125 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:126 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 34 ==== osd_op_reply(126 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:127 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 35 ==== osd_op_reply(127 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:128 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 36 ==== osd_op_reply(128 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.503+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:129 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.507+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 37 ==== osd_op_reply(129 gc.17 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.507+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-13T19:33:52.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.507+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:130 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.507+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(130 gc.18 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.507+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:131 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.507+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(131 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.507+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.507+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:132 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c0d80 2024-09-13T19:33:52.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 37 ==== osd_op_reply(132 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:133 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 38 ==== osd_op_reply(133 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:134 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 39 ==== osd_op_reply(134 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:135 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 40 ==== osd_op_reply(135 gc.18 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-13T19:33:52.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.511+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:136 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 41 ==== osd_op_reply(136 gc.19 [call] v32'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:137 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 42 ==== osd_op_reply(137 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:138 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c0d80 2024-09-13T19:33:52.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 43 ==== osd_op_reply(138 gc.19 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:139 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 44 ==== osd_op_reply(139 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:140 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 45 ==== osd_op_reply(140 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:141 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 46 ==== osd_op_reply(141 gc.19 [call] v32'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-13T19:33:52.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.515+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:142 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 38 ==== osd_op_reply(142 gc.20 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:143 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 39 ==== osd_op_reply(143 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:144 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 40 ==== osd_op_reply(144 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:145 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 41 ==== osd_op_reply(145 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:146 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 42 ==== osd_op_reply(146 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.519+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:147 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 43 ==== osd_op_reply(147 gc.20 [call] v32'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-13T19:33:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:148 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== osd_op_reply(148 gc.21 [call] v32'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:149 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== osd_op_reply(149 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:150 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(150 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.523+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:151 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== osd_op_reply(151 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:152 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 34 ==== osd_op_reply(152 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:153 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 35 ==== osd_op_reply(153 gc.21 [call] v32'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-13T19:33:52.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:154 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 44 ==== osd_op_reply(154 gc.22 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:155 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 45 ==== osd_op_reply(155 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.527+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:156 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 46 ==== osd_op_reply(156 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:157 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 47 ==== osd_op_reply(157 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:158 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 48 ==== osd_op_reply(158 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:159 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 49 ==== osd_op_reply(159 gc.22 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-13T19:33:52.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:160 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 50 ==== osd_op_reply(160 gc.23 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.531+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:161 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 51 ==== osd_op_reply(161 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:162 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 52 ==== osd_op_reply(162 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 53 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 54 ==== osd_op_reply(164 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 55 ==== osd_op_reply(165 gc.23 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-13T19:33:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.535+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 56 ==== osd_op_reply(166 gc.24 [call] v32'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 57 ==== osd_op_reply(167 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 58 ==== osd_op_reply(168 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:169 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 59 ==== osd_op_reply(169 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:170 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 60 ==== osd_op_reply(170 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:171 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 61 ==== osd_op_reply(171 gc.24 [call] v32'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.539+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-13T19:33:52.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:172 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 62 ==== osd_op_reply(172 gc.25 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:173 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 63 ==== osd_op_reply(173 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:174 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 64 ==== osd_op_reply(174 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:175 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 65 ==== osd_op_reply(175 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.543+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:176 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.547+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 66 ==== osd_op_reply(176 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.547+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.547+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:177 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.547+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 67 ==== osd_op_reply(177 gc.25 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.547+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-13T19:33:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.547+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:178 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.551+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(178 gc.26 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.551+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:179 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.551+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== osd_op_reply(179 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.551+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.551+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:180 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c5620 2024-09-13T19:33:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.551+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(180 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.551+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:181 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.555+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(181 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.555+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.555+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:182 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.555+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== osd_op_reply(182 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.555+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.555+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:183 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.559+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(183 gc.26 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.559+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-13T19:33:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.559+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:184 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.559+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 68 ==== osd_op_reply(184 gc.27 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.559+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:185 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 69 ==== osd_op_reply(185 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:186 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 70 ==== osd_op_reply(186 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:187 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 71 ==== osd_op_reply(187 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:188 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 72 ==== osd_op_reply(188 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:189 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 73 ==== osd_op_reply(189 gc.27 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-13T19:33:52.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.563+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:190 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.567+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== osd_op_reply(190 gc.28 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.567+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:191 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.567+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(191 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.567+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.567+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:192 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c5620 2024-09-13T19:33:52.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.571+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(192 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.571+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:193 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.571+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(193 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.571+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.571+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:194 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.571+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(194 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.571+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.571+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:195 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.575+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 41 ==== osd_op_reply(195 gc.28 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.575+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-13T19:33:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.575+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:196 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 74 ==== osd_op_reply(196 gc.29 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:197 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 75 ==== osd_op_reply(197 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:198 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 76 ==== osd_op_reply(198 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:199 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 77 ==== osd_op_reply(199 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:200 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 78 ==== osd_op_reply(200 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.579+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:201 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.583+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 79 ==== osd_op_reply(201 gc.29 [call] v32'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.583+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-13T19:33:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.583+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:202 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.587+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 42 ==== osd_op_reply(202 gc.30 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.587+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:203 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.587+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 43 ==== osd_op_reply(203 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.587+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.587+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:204 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c5620 2024-09-13T19:33:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.587+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 44 ==== osd_op_reply(204 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.587+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:205 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.591+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 45 ==== osd_op_reply(205 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.591+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.591+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:206 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.591+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 46 ==== osd_op_reply(206 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.591+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.591+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:207 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.595+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 47 ==== osd_op_reply(207 gc.30 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.595+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-13T19:33:52.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.595+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:208 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.595+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 36 ==== osd_op_reply(208 gc.31 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.595+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:209 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 37 ==== osd_op_reply(209 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:210 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 38 ==== osd_op_reply(210 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:211 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 39 ==== osd_op_reply(211 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:212 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 40 ==== osd_op_reply(212 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.599+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:213 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.603+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 41 ==== osd_op_reply(213 gc.31 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.603+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-13T19:33:52.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.603+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:214 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.603+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 47 ==== osd_op_reply(214 gc.0 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.603+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:215 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.603+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 48 ==== osd_op_reply(215 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.603+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.603+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:216 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c0d80 2024-09-13T19:33:52.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 49 ==== osd_op_reply(216 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:217 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 50 ==== osd_op_reply(217 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:218 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 51 ==== osd_op_reply(218 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:219 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.607+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 52 ==== osd_op_reply(219 gc.0 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.611+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-13T19:33:52.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.611+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:220 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.611+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 48 ==== osd_op_reply(220 gc.1 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.611+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:221 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 49 ==== osd_op_reply(221 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:222 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c5620 2024-09-13T19:33:52.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 50 ==== osd_op_reply(222 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:223 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 51 ==== osd_op_reply(223 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:224 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 52 ==== osd_op_reply(224 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.615+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:225 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.619+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 53 ==== osd_op_reply(225 gc.1 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.619+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-13T19:33:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.619+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:226 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 80 ==== osd_op_reply(226 gc.2 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:227 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 81 ==== osd_op_reply(227 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:228 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 82 ==== osd_op_reply(228 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:229 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 83 ==== osd_op_reply(229 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:230 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 84 ==== osd_op_reply(230 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.623+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:231 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.627+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 85 ==== osd_op_reply(231 gc.2 [call] v32'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.627+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-13T19:33:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.627+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:232 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.627+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 53 ==== osd_op_reply(232 gc.3 [call] v32'165 uv165 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.627+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:233 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 54 ==== osd_op_reply(233 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:234 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c0d80 2024-09-13T19:33:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 55 ==== osd_op_reply(234 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:235 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 56 ==== osd_op_reply(235 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:236 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 57 ==== osd_op_reply(236 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.631+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:237 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.635+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 58 ==== osd_op_reply(237 gc.3 [call] v32'166 uv166 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.635+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-13T19:33:52.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.635+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:238 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.635+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 42 ==== osd_op_reply(238 gc.4 [call] v32'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.635+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:239 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.635+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 43 ==== osd_op_reply(239 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.635+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.635+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:240 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 44 ==== osd_op_reply(240 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:241 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 45 ==== osd_op_reply(241 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:242 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 46 ==== osd_op_reply(242 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:243 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 47 ==== osd_op_reply(243 gc.4 [call] v32'53 uv53 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-13T19:33:52.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.639+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:244 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 86 ==== osd_op_reply(244 gc.5 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:245 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 87 ==== osd_op_reply(245 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:246 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91ca130 2024-09-13T19:33:52.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 88 ==== osd_op_reply(246 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:247 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 89 ==== osd_op_reply(247 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.643+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:248 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.647+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 90 ==== osd_op_reply(248 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.647+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.647+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:249 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91ca130 2024-09-13T19:33:52.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.647+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 91 ==== osd_op_reply(249 gc.5 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.647+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-13T19:33:52.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.647+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:250 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 59 ==== osd_op_reply(250 gc.6 [call] v32'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:251 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 60 ==== osd_op_reply(251 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:252 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c0d80 2024-09-13T19:33:52.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 61 ==== osd_op_reply(252 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:253 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 62 ==== osd_op_reply(253 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:254 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 63 ==== osd_op_reply(254 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.651+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:255 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.655+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 64 ==== osd_op_reply(255 gc.6 [call] v32'24 uv24 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.655+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-13T19:33:52.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.655+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:256 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.659+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 54 ==== osd_op_reply(256 gc.7 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.659+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:257 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.659+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 55 ==== osd_op_reply(257 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.659+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.659+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:258 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x55dbd91c5620 2024-09-13T19:33:52.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.659+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 56 ==== osd_op_reply(258 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.659+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:259 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.663+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 57 ==== osd_op_reply(259 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.663+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.663+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:260 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.663+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 58 ==== osd_op_reply(260 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.663+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.663+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:261 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x55dbd91c5620 2024-09-13T19:33:52.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.667+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 59 ==== osd_op_reply(261 gc.7 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.667+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-13T19:33:52.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.667+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:262 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 48 ==== osd_op_reply(262 gc.8 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:263 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 49 ==== osd_op_reply(263 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:264 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fd8c0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 50 ==== osd_op_reply(264 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:265 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 51 ==== osd_op_reply(265 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:266 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fe8d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 52 ==== osd_op_reply(266 gc.8 [call out=1702b] v0'0 uv21 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T19:33:52.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 20 garbage collection: RGWGC::process iterating over entry tag='c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.15507378242006388635', time=2024-09-13T19:33:51.968507+0000, chain.objs.size()=7 2024-09-13T19:33:52.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_1 2024-09-13T19:33:52.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:267 3.3f 3:fe19600a:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91fede0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_2 2024-09-13T19:33:52.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:268 3.1 3:82cc7cf5:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd9201a90 con 0x55dbd91c5620 2024-09-13T19:33:52.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_3 2024-09-13T19:33:52.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:269 3.2d 3:b7ec1b14:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd92046a0 con 0x55dbd91ca130 2024-09-13T19:33:52.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_4 2024-09-13T19:33:52.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:270 3.1a 3:59b452aa:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd9206f90 con 0x55dbd91c0d80 2024-09-13T19:33:52.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_5 2024-09-13T19:33:52.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:271 3.b 3:d30117d9:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd92046a0 con 0x55dbd91c5620 2024-09-13T19:33:52.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_6 2024-09-13T19:33:52.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:272 3.0 3:03aafc2f:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd920bd50 con 0x55dbd91c5620 2024-09-13T19:33:52.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_7 2024-09-13T19:33:52.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.671+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:273 3.34 3:2f4c8a48:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd920e620 con 0x55dbd91c0d80 2024-09-13T19:33:52.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.679+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 65 ==== osd_op_reply(273 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_7 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.679+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 60 ==== osd_op_reply(268 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_2 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.679+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 61 ==== osd_op_reply(271 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_5 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.679+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 92 ==== osd_op_reply(269 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_3 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.679+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 66 ==== osd_op_reply(270 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_4 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.683+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 62 ==== osd_op_reply(272 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_6 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.683+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 53 ==== osd_op_reply(267 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1__shadow_.iWn3UOCbm5FV6Tgdx40VEsLX3OcNOZe_1 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.683+0000 7f8043ed9980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T19:33:52.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.683+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:274 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd92046a0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.687+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 54 ==== osd_op_reply(274 gc.8 [call] v32'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.687+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:275 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd92046a0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.687+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 55 ==== osd_op_reply(275 gc.8 [call] v32'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.687+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-13T19:33:52.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.687+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:276 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd92046a0 con 0x55dbd91ca130 2024-09-13T19:33:52.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 93 ==== osd_op_reply(276 gc.9 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:277 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd92046a0 con 0x55dbd91ca130 2024-09-13T19:33:52.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 94 ==== osd_op_reply(277 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:278 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd920e620 con 0x55dbd91ca130 2024-09-13T19:33:52.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 95 ==== osd_op_reply(278 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:279 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd920e620 con 0x55dbd91ca130 2024-09-13T19:33:52.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 96 ==== osd_op_reply(279 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:280 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd920e620 con 0x55dbd91ca130 2024-09-13T19:33:52.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 97 ==== osd_op_reply(280 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.691+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:281 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd920e620 con 0x55dbd91ca130 2024-09-13T19:33:52.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.695+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 98 ==== osd_op_reply(281 gc.9 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.695+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-13T19:33:52.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.695+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:282 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd920e620 con 0x7f803c0bf9c0 2024-09-13T19:33:52.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 56 ==== osd_op_reply(282 gc.10 [call] v32'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:283 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff380 con 0x7f803c0bf9c0 2024-09-13T19:33:52.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 57 ==== osd_op_reply(283 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:284 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff380 con 0x7f803c0bf9c0 2024-09-13T19:33:52.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 58 ==== osd_op_reply(284 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:285 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff380 con 0x7f803c0bf9c0 2024-09-13T19:33:52.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 59 ==== osd_op_reply(285 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:286 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff380 con 0x7f803c0bf9c0 2024-09-13T19:33:52.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 60 ==== osd_op_reply(286 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.699+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:287 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff380 con 0x7f803c0bf9c0 2024-09-13T19:33:52.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.703+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 61 ==== osd_op_reply(287 gc.10 [call] v32'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.703+0000 7f8043ed9980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-13T19:33:52.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.703+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:288 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff380 con 0x55dbd91c5620 2024-09-13T19:33:52.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.707+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 63 ==== osd_op_reply(288 gc.11 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.707+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:289 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c5620 2024-09-13T19:33:52.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.707+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 64 ==== osd_op_reply(289 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.707+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.707+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:290 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c5620 2024-09-13T19:33:52.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.707+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 65 ==== osd_op_reply(290 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.707+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:291 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c5620 2024-09-13T19:33:52.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.711+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 66 ==== osd_op_reply(291 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.711+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:33:52.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.711+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:292 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c5620 2024-09-13T19:33:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.711+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 67 ==== osd_op_reply(292 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.711+0000 7f8043ed9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:33:52.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.711+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:293 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c5620 2024-09-13T19:33:52.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.715+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 68 ==== osd_op_reply(293 gc.11 [call] v32'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.715+0000 7f7ef37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:52.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.715+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94402728773312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c0d80 2024-09-13T19:33:52.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.719+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 67 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94402728773312] v32'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.719+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94402728750336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x7f803c0bf9c0 2024-09-13T19:33:52.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.719+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94402728750336] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.719+0000 7f8043ed9980 20 remove_watcher() i=0 2024-09-13T19:33:52.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.719+0000 7f8043ed9980 2 removed watcher, disabling cache 2024-09-13T19:33:52.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.719+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94402728754288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c0d80 2024-09-13T19:33:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.723+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 68 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94402728754288] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.723+0000 7f8043ed9980 20 remove_watcher() i=1 2024-09-13T19:33:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.723+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94402728756960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91ca130 2024-09-13T19:33:52.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.727+0000 7f80419e9640 1 -- 172.21.15.144:0/356031775 <== osd.3 v2:172.21.15.144:6800/1157716661 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94402728756960] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803c0ce070 con 0x55dbd91ca130 2024-09-13T19:33:52.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.727+0000 7f8043ed9980 20 remove_watcher() i=2 2024-09-13T19:33:52.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.727+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94402728747856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x7f803c0bf9c0 2024-09-13T19:33:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.727+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.2 v2:172.21.15.144:6816/2341760841 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94402728747856] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x7f803c0bf9c0 2024-09-13T19:33:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.727+0000 7f8043ed9980 20 remove_watcher() i=3 2024-09-13T19:33:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.727+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94402728761584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c0d80 2024-09-13T19:33:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.731+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 <== osd.1 v2:172.21.15.144:6808/3556169889 69 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94402728761584] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803800b7d0 con 0x55dbd91c0d80 2024-09-13T19:33:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.731+0000 7f8043ed9980 20 remove_watcher() i=4 2024-09-13T19:33:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.731+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94402728767120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c5620 2024-09-13T19:33:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.731+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94402728767120] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.731+0000 7f8043ed9980 20 remove_watcher() i=5 2024-09-13T19:33:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.731+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94402728759088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c5620 2024-09-13T19:33:52.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.735+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94402728759088] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.735+0000 7f8043ed9980 20 remove_watcher() i=6 2024-09-13T19:33:52.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.735+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94402728770816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbd91ff330 con 0x55dbd91c5620 2024-09-13T19:33:52.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f80421ea640 1 -- 172.21.15.144:0/356031775 <== osd.0 v2:172.21.15.18:6800/2700511246 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94402728770816] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8034051020 con 0x55dbd91c5620 2024-09-13T19:33:52.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 20 remove_watcher() i=7 2024-09-13T19:33:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd91c5620 msgr2=0x55dbd91c7a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd91c5620 0x55dbd91c7a50 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd91c0d80 msgr2=0x55dbd91c3240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd91c0d80 0x55dbd91c3240 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f803c0bf9c0 msgr2=0x7f803c0dc3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f803c0bf9c0 0x7f803c0dc3f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbd91ca130 msgr2=0x55dbd91cc560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbd91ca130 0x55dbd91cc560 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f0c034650 msgr2=0x7f7f0c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f0c034650 0x7f7f0c036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f803c01aec0 tx=0x7f803c0e1000 comp rx=0 tx=0).stop 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f80411e8640 1 -- 172.21.15.144:0/356031775 reap_dead start 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 msgr2=0x55dbd91b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91b58f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8034023650 tx=0x7f803404a200 comp rx=0 tx=0).stop 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 shutdown_connections 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/356031775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91ae4e0 0x55dbd91b58f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 >> 172.21.15.144:0/356031775 conn(0x55dbd91aa8c0 msgr2=0x55dbd91a8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 shutdown_connections 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/356031775 wait complete. 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/1055654166 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f1c0346a0 msgr2=0x7f7f1c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/1055654166 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f1c0346a0 0x7f7f1c036b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55dbd918a570 tx=0x7f803c0a3bc0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/1055654166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91a1a30 msgr2=0x55dbd91a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/1055654166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91a1a30 0x55dbd91a1e50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55dbd91839a0 tx=0x7f803400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/1055654166 shutdown_connections 2024-09-13T19:33:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/1055654166 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f1c0346a0 0x7f7f1c036b60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/1055654166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd91a1a30 0x55dbd91a1e50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/1055654166 >> 172.21.15.144:0/1055654166 conn(0x55dbd9192770 msgr2=0x55dbd91951f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/1055654166 shutdown_connections 2024-09-13T19:33:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/1055654166 wait complete. 2024-09-13T19:33:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd918c420 msgr2=0x55dbd918e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd918c420 0x55dbd918e810 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd9091e80 msgr2=0x55dbd9189a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd9091e80 0x55dbd9189a30 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f28034650 msgr2=0x7f7f28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f28034650 0x7f7f28036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8038000f70 tx=0x7f8038008590 comp rx=0 tx=0).stop 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 msgr2=0x55dbd9182aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.739+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9182aa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f803c005cc0 tx=0x7f803c017e30 comp rx=0 tx=0).stop 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.743+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 shutdown_connections 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.743+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbd9091e80 0x55dbd9189a30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.743+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbd918c420 0x55dbd918e810 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.743+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7f28034650 0x7f7f28036b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.743+0000 7f8043ed9980 1 --2- 172.21.15.144:0/263212528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbd9091530 0x55dbd9182aa0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.743+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 >> 172.21.15.144:0/263212528 conn(0x55dbd908d050 msgr2=0x55dbd9176020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.743+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 shutdown_connections 2024-09-13T19:33:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.743+0000 7f8043ed9980 1 -- 172.21.15.144:0/263212528 wait complete. 2024-09-13T19:33:52.759 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T19:33:52.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T19:33:52.759 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T19:33:52.837 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:52.838 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:52.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe662d980 1 Processor -- start 2024-09-13T19:33:52.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe662d980 1 -- start start 2024-09-13T19:33:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe662d980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55de5ac23c60 0x55de5ac26050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe662d980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de5aaa5ae0 con 0x55de5ac1f8e0 2024-09-13T19:33:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe662d980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55de5aac9e30 con 0x55de5ac23c60 2024-09-13T19:33:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe393c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55de5ac23c60 0x55de5ac26050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe413d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55de5ac1f8e0 0x55de5ac1fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:60976/0 (socket says 172.21.15.144:60976) 2024-09-13T19:33:52.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe413d640 1 -- 172.21.15.144:0/3158906987 learned_addr learned my addr 172.21.15.144:0/3158906987 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:52.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe393c640 1 -- 172.21.15.144:0/3158906987 >> v1:172.21.15.18:6789/0 conn(0x55de5ac1f8e0 legacy=0x55de5ac1fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe393c640 1 -- 172.21.15.144:0/3158906987 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5ac275a0 con 0x55de5ac23c60 2024-09-13T19:33:52.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.835+0000 7f6fe313b640 1 -- 172.21.15.144:0/3158906987 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1845508236 0 0) 0x55de5aaa5ae0 con 0x55de5ac1f8e0 2024-09-13T19:33:52.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe393c640 1 --2- 172.21.15.144:0/3158906987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac23c60 0x55de5ac26050 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800a480 tx=0x7f6fd801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e0d09d91bf9f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe313b640 1 -- 172.21.15.144:0/3158906987 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd80b0070 con 0x55de5ac23c60 2024-09-13T19:33:52.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe313b640 1 -- 172.21.15.144:0/3158906987 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd80ab540 con 0x55de5ac23c60 2024-09-13T19:33:52.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe313b640 1 -- 172.21.15.144:0/3158906987 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd80ab840 con 0x55de5ac23c60 2024-09-13T19:33:52.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe662d980 1 -- 172.21.15.144:0/3158906987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac23c60 msgr2=0x55de5ac26050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe662d980 1 --2- 172.21.15.144:0/3158906987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac23c60 0x55de5ac26050 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800a480 tx=0x7f6fd801b280 comp rx=0 tx=0).stop 2024-09-13T19:33:52.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe662d980 1 -- 172.21.15.144:0/3158906987 shutdown_connections 2024-09-13T19:33:52.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe662d980 1 --2- 172.21.15.144:0/3158906987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac23c60 0x55de5ac26050 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe662d980 1 -- 172.21.15.144:0/3158906987 >> 172.21.15.144:0/3158906987 conn(0x55de5ab93230 msgr2=0x55de5ab93640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe662d980 1 -- 172.21.15.144:0/3158906987 shutdown_connections 2024-09-13T19:33:52.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.839+0000 7f6fe662d980 1 -- 172.21.15.144:0/3158906987 wait complete. 2024-09-13T19:33:52.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.855+0000 7f6fe662d980 1 Processor -- start 2024-09-13T19:33:52.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.855+0000 7f6fe662d980 1 -- start start 2024-09-13T19:33:52.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.855+0000 7f6fe662d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad0a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.855+0000 7f6fe662d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de5aacb200 con 0x55de5ac1f8e0 2024-09-13T19:33:52.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.855+0000 7f6fe413d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad0a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.855+0000 7f6fe413d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad0a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39590/0 (socket says 172.21.15.144:39590) 2024-09-13T19:33:52.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.855+0000 7f6fe413d640 1 -- 172.21.15.144:0/2544909853 learned_addr learned my addr 172.21.15.144:0/2544909853 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe413d640 1 -- 172.21.15.144:0/2544909853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5ad0afb0 con 0x55de5ac1f8e0 2024-09-13T19:33:52.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe413d640 1 --2- 172.21.15.144:0/2544909853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad0a9e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40016c0 tx=0x7f6fd4001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbe13a4dd0290a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6ed260c640 1 -- 172.21.15.144:0/2544909853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd4003460 con 0x55de5ac1f8e0 2024-09-13T19:33:52.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6ed260c640 1 -- 172.21.15.144:0/2544909853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd4003600 con 0x55de5ac1f8e0 2024-09-13T19:33:52.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6ed260c640 1 -- 172.21.15.144:0/2544909853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd4003920 con 0x55de5ac1f8e0 2024-09-13T19:33:52.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- 172.21.15.144:0/2544909853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 msgr2=0x55de5ad0a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2544909853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad0a9e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40016c0 tx=0x7f6fd4001b80 comp rx=0 tx=0).stop 2024-09-13T19:33:52.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- 172.21.15.144:0/2544909853 shutdown_connections 2024-09-13T19:33:52.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2544909853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad0a9e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- 172.21.15.144:0/2544909853 >> 172.21.15.144:0/2544909853 conn(0x55de5ab93230 msgr2=0x55de5ad06610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- 172.21.15.144:0/2544909853 shutdown_connections 2024-09-13T19:33:52.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- 172.21.15.144:0/2544909853 wait complete. 2024-09-13T19:33:52.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 Processor -- start 2024-09-13T19:33:52.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- start start 2024-09-13T19:33:52.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad11de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de5ac270a0 con 0x55de5ac1f8e0 2024-09-13T19:33:52.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe413d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad11de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe413d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad11de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39602/0 (socket says 172.21.15.144:39602) 2024-09-13T19:33:52.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe413d640 1 -- 172.21.15.144:0/2408877729 learned_addr learned my addr 172.21.15.144:0/2408877729 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe413d640 1 -- 172.21.15.144:0/2408877729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5ad12320 con 0x55de5ac1f8e0 2024-09-13T19:33:52.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe413d640 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad11de0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40012f0 tx=0x7f6fd4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6ed0e09640 1 -- 172.21.15.144:0/2408877729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd4013760 con 0x55de5ac1f8e0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de5ad125b0 con 0x55de5ac1f8e0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6ed0e09640 1 -- 172.21.15.144:0/2408877729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd4023070 con 0x55de5ac1f8e0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6ed0e09640 1 -- 172.21.15.144:0/2408877729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd4013a30 con 0x55de5ac1f8e0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.859+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de5ad15290 con 0x55de5ac1f8e0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6ed0e09640 1 -- 172.21.15.144:0/2408877729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6fd4010070 con 0x55de5ac1f8e0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6ed0e09640 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ecc034650 0x7f6ecc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6ed0e09640 1 -- 172.21.15.144:0/2408877729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6fd4049b60 con 0x55de5ac1f8e0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe393c640 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ecc034650 0x7f6ecc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ac23c60 0x55de5ad18ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad19460 con 0x55de5ac23c60 2024-09-13T19:33:52.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe493e640 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ac23c60 0x55de5ad18ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe393c640 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ecc034650 0x7f6ecc036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80ad000 tx=0x7f6fd80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe493e640 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ac23c60 0x55de5ad18ee0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe493e640 1 -- 172.21.15.144:0/2408877729 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc0083f0 con 0x55de5ac23c60 2024-09-13T19:33:52.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad164b0 con 0x55de5ac23c60 2024-09-13T19:33:52.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe493e640 1 -- 172.21.15.144:0/2408877729 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fdc0083f0 con 0x55de5ac23c60 2024-09-13T19:33:52.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad1b7e0 0x55de5ad1dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad1e2a0 con 0x55de5ad1b7e0 2024-09-13T19:33:52.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe413d640 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad1b7e0 0x55de5ad1dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.863+0000 7f6fe413d640 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad1b7e0 0x55de5ad1dbd0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe413d640 1 -- 172.21.15.144:0/2408877729 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6fd400f030 con 0x55de5ad1b7e0 2024-09-13T19:33:52.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad1a680 con 0x55de5ac23c60 2024-09-13T19:33:52.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe493e640 1 -- 172.21.15.144:0/2408877729 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fdc0083f0 con 0x55de5ac23c60 2024-09-13T19:33:52.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad1ab10 con 0x55de5ac23c60 2024-09-13T19:33:52.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe493e640 1 -- 172.21.15.144:0/2408877729 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6fdc0083f0 con 0x55de5ac23c60 2024-09-13T19:33:52.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe662d980 1 Processor -- start 2024-09-13T19:33:52.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe662d980 1 -- start start 2024-09-13T19:33:52.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe662d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad2ca00 0x55de5ad2ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe662d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de5ab24800 con 0x55de5ad2ca00 2024-09-13T19:33:52.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe493e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad2ca00 0x55de5ad2ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe493e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad2ca00 0x55de5ad2ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39618/0 (socket says 172.21.15.144:39618) 2024-09-13T19:33:52.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe493e640 1 -- 172.21.15.144:0/607026994 learned_addr learned my addr 172.21.15.144:0/607026994 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe493e640 1 -- 172.21.15.144:0/607026994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5ad2d360 con 0x55de5ad2ca00 2024-09-13T19:33:52.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6fe493e640 1 --2- 172.21.15.144:0/607026994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad2ca00 0x55de5ad2ce20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55de5ad12ce0 tx=0x7f6fdc00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.867+0000 7f6ec9ffb640 1 -- 172.21.15.144:0/607026994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc007d70 con 0x55de5ad2ca00 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6ec9ffb640 1 -- 172.21.15.144:0/607026994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc01e020 con 0x55de5ad2ca00 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe662d980 1 -- 172.21.15.144:0/607026994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de5ad2d5f0 con 0x55de5ad2ca00 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6ec9ffb640 1 -- 172.21.15.144:0/607026994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc019550 con 0x55de5ad2ca00 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe662d980 1 -- 172.21.15.144:0/607026994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de5ad30270 con 0x55de5ad2ca00 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6ec9ffb640 1 -- 172.21.15.144:0/607026994 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6fdc016040 con 0x55de5ad2ca00 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6ec9ffb640 1 --2- 172.21.15.144:0/607026994 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ebc034650 0x7f6ebc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6ec9ffb640 1 -- 172.21.15.144:0/607026994 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6fdc01f030 con 0x55de5ad2ca00 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe413d640 1 --2- 172.21.15.144:0/607026994 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ebc034650 0x7f6ebc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe662d980 1 Processor -- start 2024-09-13T19:33:52.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe662d980 1 -- start start 2024-09-13T19:33:52.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe413d640 1 --2- 172.21.15.144:0/607026994 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ebc034650 0x7f6ebc036b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55de5ad19930 tx=0x7f6fd401d440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe662d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad39830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe662d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de5ad0b330 con 0x55de5ad39430 2024-09-13T19:33:52.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe493e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad39830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe493e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad39830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39626/0 (socket says 172.21.15.144:39626) 2024-09-13T19:33:52.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe493e640 1 -- 172.21.15.144:0/3970311953 learned_addr learned my addr 172.21.15.144:0/3970311953 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe493e640 1 -- 172.21.15.144:0/3970311953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5ad39e00 con 0x55de5ad39430 2024-09-13T19:33:52.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6fe493e640 1 --2- 172.21.15.144:0/3970311953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad39830 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc04a550 tx=0x7f6fdc017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b131a68f20981548 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6ec37fe640 1 -- 172.21.15.144:0/3970311953 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc01d040 con 0x55de5ad39430 2024-09-13T19:33:52.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6ec37fe640 1 -- 172.21.15.144:0/3970311953 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc015e30 con 0x55de5ad39430 2024-09-13T19:33:52.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.871+0000 7f6ec37fe640 1 -- 172.21.15.144:0/3970311953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc023580 con 0x55de5ad39430 2024-09-13T19:33:52.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- 172.21.15.144:0/3970311953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 msgr2=0x55de5ad39830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:52.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 --2- 172.21.15.144:0/3970311953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad39830 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc04a550 tx=0x7f6fdc017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- 172.21.15.144:0/3970311953 shutdown_connections 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 --2- 172.21.15.144:0/3970311953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad39830 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- 172.21.15.144:0/3970311953 >> 172.21.15.144:0/3970311953 conn(0x55de5ad35860 msgr2=0x55de5ad33960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- 172.21.15.144:0/3970311953 shutdown_connections 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- 172.21.15.144:0/3970311953 wait complete. 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 Processor -- start 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- start start 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad40810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de5ad3a450 con 0x55de5ad39430 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe493e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad40810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe493e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad40810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39634/0 (socket says 172.21.15.144:39634) 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 learned_addr learned my addr 172.21.15.144:0/798158405 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5ad40d50 con 0x55de5ad39430 2024-09-13T19:33:52.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe493e640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad40810 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc022a30 tx=0x7f6fdc04a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6ec1ffb640 1 -- 172.21.15.144:0/798158405 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc01d040 con 0x55de5ad39430 2024-09-13T19:33:52.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de5ad40fe0 con 0x55de5ad39430 2024-09-13T19:33:52.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6ec1ffb640 1 -- 172.21.15.144:0/798158405 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc02b350 con 0x55de5ad39430 2024-09-13T19:33:52.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6ec1ffb640 1 -- 172.21.15.144:0/798158405 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc015770 con 0x55de5ad39430 2024-09-13T19:33:52.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de5ad43cc0 con 0x55de5ad39430 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.875+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6ec1ffb640 1 -- 172.21.15.144:0/798158405 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6fdc015960 con 0x55de5ad39430 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6ec1ffb640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6eb4034650 0x7f6eb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6ec1ffb640 1 -- 172.21.15.144:0/798158405 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6fdc035070 con 0x55de5ad39430 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ad4bab0 0x55de5ad4df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe413d640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6eb4034650 0x7f6eb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad4e690 con 0x55de5ad4bab0 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe393c640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ad4bab0 0x55de5ad4df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe413d640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6eb4034650 0x7f6eb4036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4003560 tx=0x7f6fd403e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe393c640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ad4bab0 0x55de5ad4df40 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 realm 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad4eac0 con 0x55de5ad4bab0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad4f390 con 0x55de5ad4bab0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad4f730 con 0x55de5ad4bab0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad50490 0x55de5ad52880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad52dc0 con 0x55de5ad50490 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe493e640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad50490 0x55de5ad52880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.879+0000 7f6fe493e640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad50490 0x55de5ad52880 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe662d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe662d980 20 searching for the correct realm 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de5ad54da0 0x55de5ad57260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe413d640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de5ad54da0 0x55de5ad57260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe413d640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de5ad54da0 0x55de5ad57260 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe413d640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6fd4056040 0x7f6fd40273c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x7f6fd4056040 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe393c640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6fd4056040 0x7f6fd40273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe393c640 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6fd4056040 0x7f6fd40273c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad50490 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.883+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad50490 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x7f6fd4056040 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad50490 2024-09-13T19:33:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x7f6fd4056040 2024-09-13T19:33:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.887+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad50490 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad50490 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x7f6fd4056040 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad50490 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.891+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad50490 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x7f6fd4056040 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad54da0 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad50490 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x55de5ad4bab0 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad57930 con 0x7f6fd4056040 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad53740 con 0x55de5ad4bab0 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad53b60 con 0x55de5ad4bab0 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad53f80 con 0x55de5ad4bab0 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 zone default found 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 4 Realm: () 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 zonegroup default 2024-09-13T19:33:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.895+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad53f80 con 0x55de5ad50490 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad59c40 con 0x55de5ad54da0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad59fe0 con 0x55de5ad54da0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 20 started sync module instance, tier type = 2024-09-13T19:33:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:52.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad59080 con 0x7f6fd4056040 2024-09-13T19:33:52.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94413495047280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad59080 con 0x7f6fd4056040 2024-09-13T19:33:52.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.899+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5a9a0 con 0x55de5ad4bab0 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.903+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94413495047280] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.903+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.903+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94413495045344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5a9a0 con 0x55de5ad4bab0 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.903+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5b230 con 0x55de5ad54da0 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.903+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.903+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94413495052976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5bad0 con 0x55de5ad54da0 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.903+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5c490 con 0x7f6fd4056040 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94413495045344] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94413495058400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5c400 con 0x7f6fd4056040 2024-09-13T19:33:52.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5d1e0 con 0x55de5ad4bab0 2024-09-13T19:33:52.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94413495052976] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94413495058400] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94413495055904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5cca0 con 0x55de5ad4bab0 2024-09-13T19:33:52.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.907+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5d530 con 0x55de5ad50490 2024-09-13T19:33:52.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.911+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94413495055904] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.911+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.911+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94413495060336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5d040 con 0x55de5ad50490 2024-09-13T19:33:52.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.911+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5df40 con 0x55de5ad50490 2024-09-13T19:33:52.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.911+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94413495060336] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.911+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.911+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94413495061664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5df40 con 0x55de5ad50490 2024-09-13T19:33:52.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.911+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5e900 con 0x55de5ad50490 2024-09-13T19:33:52.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94413495061664] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94413495065712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5e900 con 0x55de5ad50490 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe662d980 20 add_watcher() i=0 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe662d980 20 add_watcher() i=1 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe662d980 20 add_watcher() i=2 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe662d980 20 add_watcher() i=3 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe662d980 20 add_watcher() i=4 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe662d980 20 add_watcher() i=5 2024-09-13T19:33:52.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.915+0000 7f6fe662d980 20 add_watcher() i=6 2024-09-13T19:33:52.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94413495065712] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe662d980 20 add_watcher() i=7 2024-09-13T19:33:52.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe662d980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:52.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad61d00 con 0x55de5ad4bab0 2024-09-13T19:33:52.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94413495068192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5f290 con 0x55de5ad4bab0 2024-09-13T19:33:52.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94413495068192] v32'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6e9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:52.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe662d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:52.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe662d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:52.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6a350 con 0x55de5ad4bab0 2024-09-13T19:33:52.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.919+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.923+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6a8c0 con 0x55de5ad50490 2024-09-13T19:33:52.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.923+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.923+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6ad70 con 0x55de5ad54da0 2024-09-13T19:33:52.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.923+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.923+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6b5c0 con 0x55de5ad4bab0 2024-09-13T19:33:52.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.927+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'169 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.927+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad683c0 con 0x7f6fd4056040 2024-09-13T19:33:52.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.927+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.927+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad683c0 con 0x55de5ad54da0 2024-09-13T19:33:52.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.927+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.927+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad683c0 con 0x55de5ad4bab0 2024-09-13T19:33:52.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.931+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.931+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad683c0 con 0x55de5ad50490 2024-09-13T19:33:52.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.935+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.935+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x7f6fd4056040 2024-09-13T19:33:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.935+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.935+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x55de5ad54da0 2024-09-13T19:33:52.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.935+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.935+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x7f6fd4056040 2024-09-13T19:33:52.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.939+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'57 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.939+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x55de5ad50490 2024-09-13T19:33:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.939+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.939+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x7f6fd4056040 2024-09-13T19:33:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.943+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.943+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x55de5ad50490 2024-09-13T19:33:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.943+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.943+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x55de5ad4bab0 2024-09-13T19:33:52.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.947+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.947+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x55de5ad54da0 2024-09-13T19:33:52.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.947+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.951+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x7f6fd4056040 2024-09-13T19:33:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.951+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.951+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad54da0 2024-09-13T19:33:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.951+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.951+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad4bab0 2024-09-13T19:33:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.955+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.955+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x55de5ad4bab0 2024-09-13T19:33:52.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.955+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.955+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad68470 con 0x55de5ad54da0 2024-09-13T19:33:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.959+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.959+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x7f6fd4056040 2024-09-13T19:33:52.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.959+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.959+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad54da0 2024-09-13T19:33:52.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.963+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.963+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad54da0 2024-09-13T19:33:52.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.963+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.963+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad54da0 2024-09-13T19:33:52.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.967+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.967+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad54da0 2024-09-13T19:33:52.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.967+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.967+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad50490 2024-09-13T19:33:52.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.971+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.971+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad54da0 2024-09-13T19:33:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.971+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.971+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad50490 2024-09-13T19:33:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.975+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.975+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad54da0 2024-09-13T19:33:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.975+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.975+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x55de5ad50490 2024-09-13T19:33:52.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.979+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.979+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad6c310 con 0x7f6fd4056040 2024-09-13T19:33:52.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6e997e2640 20 reqs_thread_entry: start 2024-09-13T19:33:52.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe662d980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:52.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe662d980 20 Filter name: none 2024-09-13T19:33:52.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6e0affd640 20 reqs_thread_entry: start 2024-09-13T19:33:52.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad4bab0 2024-09-13T19:33:52.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65ee0 con 0x55de5ad4bab0 2024-09-13T19:33:52.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad4bab0 2024-09-13T19:33:52.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad50490 2024-09-13T19:33:52.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.983+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad50490 2024-09-13T19:33:52.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad50490 2024-09-13T19:33:52.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad54da0 2024-09-13T19:33:52.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad54da0 2024-09-13T19:33:52.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad54da0 2024-09-13T19:33:52.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad4bab0 2024-09-13T19:33:52.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad4bab0 2024-09-13T19:33:52.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv166 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.987+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x55de5ad4bab0 2024-09-13T19:33:52.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad65a30 con 0x7f6fd4056040 2024-09-13T19:33:52.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:52.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv53 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:52.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:52.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:52.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:52.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:52.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:52.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad4bab0 2024-09-13T19:33:52.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad4bab0 2024-09-13T19:33:52.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv24 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad4bab0 2024-09-13T19:33:52.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:52.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.991+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:52.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad50490 2024-09-13T19:33:52.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:52.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:52.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.995+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:53.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:53.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad50490 2024-09-13T19:33:53.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad50490 2024-09-13T19:33:53.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:52.999+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad50490 2024-09-13T19:33:53.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:53.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:53.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:53.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad50490 2024-09-13T19:33:53.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.003+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:53.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad4bab0 2024-09-13T19:33:53.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad4bab0 2024-09-13T19:33:53.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad4bab0 2024-09-13T19:33:53.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.007+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad4bab0 2024-09-13T19:33:53.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad4bab0 2024-09-13T19:33:53.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad4bab0 2024-09-13T19:33:53.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad4bab0 2024-09-13T19:33:53.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad4bab0 2024-09-13T19:33:53.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.011+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad4bab0 2024-09-13T19:33:53.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:53.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.015+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.019+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:53.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad50490 2024-09-13T19:33:53.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:53.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.023+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad50490 2024-09-13T19:33:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:53.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad54da0 2024-09-13T19:33:53.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad54da0 2024-09-13T19:33:53.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.027+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:53.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad50490 2024-09-13T19:33:53.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x55de5ad50490 2024-09-13T19:33:53.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad87b60 con 0x7f6fd4056040 2024-09-13T19:33:53.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x7f6fd4056040 2024-09-13T19:33:53.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66a40 con 0x7f6fd4056040 2024-09-13T19:33:53.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.031+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.035+0000 7f6e9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:53.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.035+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94413495068192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad66ef0 con 0x55de5ad4bab0 2024-09-13T19:33:53.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.035+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94413495068192] v32'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.035+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94413495047280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5e5f0 con 0x7f6fd4056040 2024-09-13T19:33:53.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.039+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94413495047280] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.039+0000 7f6fe662d980 20 remove_watcher() i=0 2024-09-13T19:33:53.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.039+0000 7f6fe662d980 2 removed watcher, disabling cache 2024-09-13T19:33:53.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.039+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94413495045344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad59470 con 0x55de5ad4bab0 2024-09-13T19:33:53.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.039+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94413495045344] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.039+0000 7f6fe662d980 20 remove_watcher() i=1 2024-09-13T19:33:53.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.039+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94413495052976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad59470 con 0x55de5ad54da0 2024-09-13T19:33:53.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.043+0000 7f6fe413d640 1 -- 172.21.15.144:0/798158405 <== osd.3 v2:172.21.15.144:6800/1157716661 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94413495052976] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd4053070 con 0x55de5ad54da0 2024-09-13T19:33:53.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.043+0000 7f6fe662d980 20 remove_watcher() i=2 2024-09-13T19:33:53.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.043+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94413495058400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad59470 con 0x7f6fd4056040 2024-09-13T19:33:53.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.043+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.2 v2:172.21.15.144:6816/2341760841 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94413495058400] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x7f6fd4056040 2024-09-13T19:33:53.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.043+0000 7f6fe662d980 20 remove_watcher() i=3 2024-09-13T19:33:53.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.043+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94413495055904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5bfe0 con 0x55de5ad4bab0 2024-09-13T19:33:53.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.047+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 <== osd.1 v2:172.21.15.144:6808/3556169889 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94413495055904] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd80b3040 con 0x55de5ad4bab0 2024-09-13T19:33:53.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.047+0000 7f6fe662d980 20 remove_watcher() i=4 2024-09-13T19:33:53.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.047+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94413495060336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad59470 con 0x55de5ad50490 2024-09-13T19:33:53.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.047+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94413495060336] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.047+0000 7f6fe662d980 20 remove_watcher() i=5 2024-09-13T19:33:53.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.047+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94413495061664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5b620 con 0x55de5ad50490 2024-09-13T19:33:53.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.051+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94413495061664] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.051+0000 7f6fe662d980 20 remove_watcher() i=6 2024-09-13T19:33:53.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.051+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94413495065712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de5ad5c770 con 0x55de5ad50490 2024-09-13T19:33:53.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe493e640 1 -- 172.21.15.144:0/798158405 <== osd.0 v2:172.21.15.18:6800/2700511246 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94413495065712] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc02a070 con 0x55de5ad50490 2024-09-13T19:33:53.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 20 remove_watcher() i=7 2024-09-13T19:33:53.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad50490 msgr2=0x55de5ad52880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad50490 0x55de5ad52880 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ad4bab0 msgr2=0x55de5ad4df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ad4bab0 0x55de5ad4df40 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6fd4056040 msgr2=0x7f6fd40273c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6fd4056040 0x7f6fd40273c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de5ad54da0 msgr2=0x55de5ad57260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55de5ad54da0 0x55de5ad57260 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6eb4034650 msgr2=0x7f6eb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6eb4034650 0x7f6eb4036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4003560 tx=0x7f6fd403e000 comp rx=0 tx=0).stop 2024-09-13T19:33:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 msgr2=0x55de5ad40810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/798158405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad39430 0x55de5ad40810 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc022a30 tx=0x7f6fdc04a260 comp rx=0 tx=0).stop 2024-09-13T19:33:53.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 reap_dead start 2024-09-13T19:33:53.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe393c640 1 -- 172.21.15.144:0/798158405 reap_dead start 2024-09-13T19:33:53.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 shutdown_connections 2024-09-13T19:33:53.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 >> 172.21.15.144:0/798158405 conn(0x55de5ad35860 msgr2=0x55de5ad33930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 shutdown_connections 2024-09-13T19:33:53.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/798158405 wait complete. 2024-09-13T19:33:53.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/607026994 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ebc034650 msgr2=0x7f6ebc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/607026994 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ebc034650 0x7f6ebc036b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55de5ad19930 tx=0x7f6fd401d440 comp rx=0 tx=0).stop 2024-09-13T19:33:53.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/607026994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad2ca00 msgr2=0x55de5ad2ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/607026994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad2ca00 0x55de5ad2ce20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55de5ad12ce0 tx=0x7f6fdc00af40 comp rx=0 tx=0).stop 2024-09-13T19:33:53.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/607026994 shutdown_connections 2024-09-13T19:33:53.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/607026994 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ebc034650 0x7f6ebc036b10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/607026994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ad2ca00 0x55de5ad2ce20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/607026994 >> 172.21.15.144:0/607026994 conn(0x55de5ad21b50 msgr2=0x55de5ad245d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/607026994 shutdown_connections 2024-09-13T19:33:53.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/607026994 wait complete. 2024-09-13T19:33:53.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad1b7e0 msgr2=0x55de5ad1dbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad1b7e0 0x55de5ad1dbd0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ac23c60 msgr2=0x55de5ad18ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ac23c60 0x55de5ad18ee0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ecc034650 msgr2=0x7f6ecc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ecc034650 0x7f6ecc036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80ad000 tx=0x7f6fd80a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:53.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 msgr2=0x55de5ad11de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad11de0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40012f0 tx=0x7f6fd4001260 comp rx=0 tx=0).stop 2024-09-13T19:33:53.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 shutdown_connections 2024-09-13T19:33:53.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55de5ac23c60 0x55de5ad18ee0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55de5ad1b7e0 0x55de5ad1dbd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6ecc034650 0x7f6ecc036b10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 --2- 172.21.15.144:0/2408877729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de5ac1f8e0 0x55de5ad11de0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 >> 172.21.15.144:0/2408877729 conn(0x55de5ab93230 msgr2=0x55de5ad05190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 shutdown_connections 2024-09-13T19:33:53.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.055+0000 7f6fe662d980 1 -- 172.21.15.144:0/2408877729 wait complete. 2024-09-13T19:33:53.071 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-13T19:33:53.071 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:33:53.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:33:53.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:33:53.071 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:33:53.151 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:53.151 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:53.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.147+0000 7f1c11d4d980 1 Processor -- start 2024-09-13T19:33:53.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.147+0000 7f1c11d4d980 1 -- start start 2024-09-13T19:33:53.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.147+0000 7f1c11d4d980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x555630f4e290 0x555630fdc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.147+0000 7f1c11d4d980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555630e61ae0 con 0x555630fdc8e0 2024-09-13T19:33:53.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.147+0000 7f1c11d4d980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x555630e85e30 con 0x555630f4e290 2024-09-13T19:33:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0f85d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x555630f4e290 0x555630fdc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0f05c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x555630fdc8e0 0x555630fdecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:60986/0 (socket says 172.21.15.144:60986) 2024-09-13T19:33:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0f05c640 1 -- 172.21.15.144:0/3681869175 learned_addr learned my addr 172.21.15.144:0/3681869175 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0f85d640 1 -- 172.21.15.144:0/3681869175 >> v1:172.21.15.18:6789/0 conn(0x555630fdc8e0 legacy=0x555630fdecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0f85d640 1 -- 172.21.15.144:0/3681869175 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555630f4e820 con 0x555630f4e290 2024-09-13T19:33:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0e85b640 1 -- 172.21.15.144:0/3681869175 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196235393 0 0) 0x555630e61ae0 con 0x555630fdc8e0 2024-09-13T19:33:53.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/3681869175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x555630fdc3a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000a420 tx=0x7f1c0001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508f44d799a58606 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0e85b640 1 -- 172.21.15.144:0/3681869175 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c000af070 con 0x555630f4e290 2024-09-13T19:33:53.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0e85b640 1 -- 172.21.15.144:0/3681869175 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c000aa530 con 0x555630f4e290 2024-09-13T19:33:53.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.151+0000 7f1c0e85b640 1 -- 172.21.15.144:0/3681869175 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c000aa810 con 0x555630f4e290 2024-09-13T19:33:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.155+0000 7f1c11d4d980 1 -- 172.21.15.144:0/3681869175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 msgr2=0x555630fdc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.155+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/3681869175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x555630fdc3a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000a420 tx=0x7f1c0001afd0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.155+0000 7f1c11d4d980 1 -- 172.21.15.144:0/3681869175 shutdown_connections 2024-09-13T19:33:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.155+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/3681869175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x555630fdc3a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.155+0000 7f1c11d4d980 1 -- 172.21.15.144:0/3681869175 >> 172.21.15.144:0/3681869175 conn(0x555630fd4090 msgr2=0x555630fd64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.155+0000 7f1c11d4d980 1 -- 172.21.15.144:0/3681869175 shutdown_connections 2024-09-13T19:33:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.155+0000 7f1c11d4d980 1 -- 172.21.15.144:0/3681869175 wait complete. 2024-09-13T19:33:53.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c11d4d980 1 Processor -- start 2024-09-13T19:33:53.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c11d4d980 1 -- start start 2024-09-13T19:33:53.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c11d4d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c11d4d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555630e87200 con 0x555630f4e290 2024-09-13T19:33:53.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c0f85d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c0f85d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39644/0 (socket says 172.21.15.144:39644) 2024-09-13T19:33:53.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c0f85d640 1 -- 172.21.15.144:0/404955955 learned_addr learned my addr 172.21.15.144:0/404955955 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c0f85d640 1 -- 172.21.15.144:0/404955955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556310c4d60 con 0x555630f4e290 2024-09-13T19:33:53.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/404955955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310c4790 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000a420 tx=0x7f1c000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d1de25b35a0e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1afde0b640 1 -- 172.21.15.144:0/404955955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c000af050 con 0x555630f4e290 2024-09-13T19:33:53.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1afde0b640 1 -- 172.21.15.144:0/404955955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c000b0040 con 0x555630f4e290 2024-09-13T19:33:53.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1afde0b640 1 -- 172.21.15.144:0/404955955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c000aac60 con 0x555630f4e290 2024-09-13T19:33:53.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c11d4d980 1 -- 172.21.15.144:0/404955955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 msgr2=0x5556310c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.171+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/404955955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310c4790 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000a420 tx=0x7f1c000033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 -- 172.21.15.144:0/404955955 shutdown_connections 2024-09-13T19:33:53.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/404955955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310c4790 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 -- 172.21.15.144:0/404955955 >> 172.21.15.144:0/404955955 conn(0x555630fd4090 msgr2=0x5556310c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 -- 172.21.15.144:0/404955955 shutdown_connections 2024-09-13T19:33:53.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 -- 172.21.15.144:0/404955955 wait complete. 2024-09-13T19:33:53.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 Processor -- start 2024-09-13T19:33:53.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 -- start start 2024-09-13T19:33:53.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555630fe0f00 con 0x555630f4e290 2024-09-13T19:33:53.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c0f85d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c0f85d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39646/0 (socket says 172.21.15.144:39646) 2024-09-13T19:33:53.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c0f85d640 1 -- 172.21.15.144:0/4050561074 learned_addr learned my addr 172.21.15.144:0/4050561074 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c0f85d640 1 -- 172.21.15.144:0/4050561074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556310cbf20 con 0x555630f4e290 2024-09-13T19:33:53.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310cb9e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c0001b870 tx=0x7f1c00019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1af7fff640 1 -- 172.21.15.144:0/4050561074 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c000c5020 con 0x555630f4e290 2024-09-13T19:33:53.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1af7fff640 1 -- 172.21.15.144:0/4050561074 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c000b6cb0 con 0x555630f4e290 2024-09-13T19:33:53.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556310cc1b0 con 0x555630f4e290 2024-09-13T19:33:53.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1af7fff640 1 -- 172.21.15.144:0/4050561074 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c000c1480 con 0x555630f4e290 2024-09-13T19:33:53.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.175+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556310cee90 con 0x555630f4e290 2024-09-13T19:33:53.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1af7fff640 1 -- 172.21.15.144:0/4050561074 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1c000c8070 con 0x555630f4e290 2024-09-13T19:33:53.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1af7fff640 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1af8034650 0x7f1af8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1af7fff640 1 -- 172.21.15.144:0/4050561074 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1c000bb070 con 0x555630f4e290 2024-09-13T19:33:53.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c0f05c640 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1af8034650 0x7f1af8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555630fdc8e0 0x5556310d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556310d30b0 con 0x555630fdc8e0 2024-09-13T19:33:53.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c1005e640 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555630fdc8e0 0x5556310d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c0f05c640 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1af8034650 0x7f1af8036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8000c10 tx=0x7f1bf80013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c1005e640 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555630fdc8e0 0x5556310d2ae0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c1005e640 1 -- 172.21.15.144:0/4050561074 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c080083f0 con 0x555630fdc8e0 2024-09-13T19:33:53.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556310d0090 con 0x555630fdc8e0 2024-09-13T19:33:53.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c1005e640 1 -- 172.21.15.144:0/4050561074 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c080083f0 con 0x555630fdc8e0 2024-09-13T19:33:53.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5556310d5380 0x5556310d7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556310d7e40 con 0x5556310d5380 2024-09-13T19:33:53.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5556310d5380 0x5556310d7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5556310d5380 0x5556310d7770 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c0f85d640 1 -- 172.21.15.144:0/4050561074 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c000c7030 con 0x5556310d5380 2024-09-13T19:33:53.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.179+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556310d4220 con 0x555630fdc8e0 2024-09-13T19:33:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c1005e640 1 -- 172.21.15.144:0/4050561074 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c080083f0 con 0x555630fdc8e0 2024-09-13T19:33:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556310d4700 con 0x555630fdc8e0 2024-09-13T19:33:53.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c1005e640 1 -- 172.21.15.144:0/4050561074 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c080083f0 con 0x555630fdc8e0 2024-09-13T19:33:53.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c11d4d980 1 Processor -- start 2024-09-13T19:33:53.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c11d4d980 1 -- start start 2024-09-13T19:33:53.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c11d4d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310e6580 0x5556310e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c11d4d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555630ee0800 con 0x5556310e6580 2024-09-13T19:33:53.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c1005e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310e6580 0x5556310e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c1005e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310e6580 0x5556310e69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39658/0 (socket says 172.21.15.144:39658) 2024-09-13T19:33:53.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c1005e640 1 -- 172.21.15.144:0/2268494342 learned_addr learned my addr 172.21.15.144:0/2268494342 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c1005e640 1 -- 172.21.15.144:0/2268494342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556310e6ee0 con 0x5556310e6580 2024-09-13T19:33:53.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c1005e640 1 --2- 172.21.15.144:0/2268494342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310e6580 0x5556310e69a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5556310cc8e0 tx=0x7f1c0800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1af57fa640 1 -- 172.21.15.144:0/2268494342 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c08007dd0 con 0x5556310e6580 2024-09-13T19:33:53.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1af57fa640 1 -- 172.21.15.144:0/2268494342 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0801e020 con 0x5556310e6580 2024-09-13T19:33:53.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2268494342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556310e7170 con 0x5556310e6580 2024-09-13T19:33:53.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1af57fa640 1 -- 172.21.15.144:0/2268494342 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c08019590 con 0x5556310e6580 2024-09-13T19:33:53.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.183+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2268494342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556310e9df0 con 0x5556310e6580 2024-09-13T19:33:53.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1af57fa640 1 -- 172.21.15.144:0/2268494342 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1c08016040 con 0x5556310e6580 2024-09-13T19:33:53.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1af57fa640 1 --2- 172.21.15.144:0/2268494342 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ae8034650 0x7f1ae8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1af57fa640 1 -- 172.21.15.144:0/2268494342 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1c0801f030 con 0x5556310e6580 2024-09-13T19:33:53.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/2268494342 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ae8034650 0x7f1ae8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 Processor -- start 2024-09-13T19:33:53.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- start start 2024-09-13T19:33:53.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/2268494342 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ae8034650 0x7f1ae8036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5556310d34f0 tx=0x7f1c000c03e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5556310c5020 con 0x5556310f3000 2024-09-13T19:33:53.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c1005e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c1005e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39660/0 (socket says 172.21.15.144:39660) 2024-09-13T19:33:53.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c1005e640 1 -- 172.21.15.144:0/1397771260 learned_addr learned my addr 172.21.15.144:0/1397771260 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c1005e640 1 -- 172.21.15.144:0/1397771260 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556310f39b0 con 0x5556310f3000 2024-09-13T19:33:53.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c1005e640 1 --2- 172.21.15.144:0/1397771260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310f33e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1c0804a320 tx=0x7f1c08019c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b175805e6f1ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1aeeffd640 1 -- 172.21.15.144:0/1397771260 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0801d040 con 0x5556310f3000 2024-09-13T19:33:53.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1aeeffd640 1 -- 172.21.15.144:0/1397771260 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c08015c90 con 0x5556310f3000 2024-09-13T19:33:53.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1aeeffd640 1 -- 172.21.15.144:0/1397771260 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c08022a60 con 0x5556310f3000 2024-09-13T19:33:53.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- 172.21.15.144:0/1397771260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 msgr2=0x5556310f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/1397771260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310f33e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1c0804a320 tx=0x7f1c08019c50 comp rx=0 tx=0).stop 2024-09-13T19:33:53.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- 172.21.15.144:0/1397771260 shutdown_connections 2024-09-13T19:33:53.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/1397771260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310f33e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- 172.21.15.144:0/1397771260 >> 172.21.15.144:0/1397771260 conn(0x5556310ef3e0 msgr2=0x5556310ed4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- 172.21.15.144:0/1397771260 shutdown_connections 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- 172.21.15.144:0/1397771260 wait complete. 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 Processor -- start 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- start start 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310fa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.187+0000 7f1c11d4d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5556310f3fd0 con 0x5556310f3000 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c1005e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c1005e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310fa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39676/0 (socket says 172.21.15.144:39676) 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 learned_addr learned my addr 172.21.15.144:0/2148431975 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556310fa830 con 0x5556310f3000 2024-09-13T19:33:53.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c1005e640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310fa2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1c080491f0 tx=0x7f1c0804a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1aed7fa640 1 -- 172.21.15.144:0/2148431975 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0801d040 con 0x5556310f3000 2024-09-13T19:33:53.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556310faac0 con 0x5556310f3000 2024-09-13T19:33:53.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1aed7fa640 1 -- 172.21.15.144:0/2148431975 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c08015e40 con 0x5556310f3000 2024-09-13T19:33:53.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1aed7fa640 1 -- 172.21.15.144:0/2148431975 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c08015740 con 0x5556310f3000 2024-09-13T19:33:53.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556310faac0 con 0x5556310f3000 2024-09-13T19:33:53.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1aed7fa640 1 -- 172.21.15.144:0/2148431975 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1c080158e0 con 0x5556310f3000 2024-09-13T19:33:53.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1aed7fa640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ad8034650 0x7f1ad8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1aed7fa640 1 -- 172.21.15.144:0/2148431975 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1c08035030 con 0x5556310f3000 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ad8034650 0x7f1ad8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555631105600 0x555631107ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555631108210 con 0x555631105600 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c0f05c640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555631105600 0x555631107ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ad8034650 0x7f1ad8036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1c0001b010 tx=0x7f1c000d6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.191+0000 7f1c0f05c640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555631105600 0x555631107ac0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf800f600 con 0x555631105600 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 realm 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555631104a90 con 0x555631105600 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf800f600 con 0x555631105600 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555631108ce0 con 0x555631105600 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf800f600 con 0x555631105600 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556311095b0 con 0x555631105600 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bf800f600 con 0x555631105600 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555631109fd0 0x55563110c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55563110cb30 con 0x555631109fd0 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c1005e640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555631109fd0 0x55563110c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c1005e640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555631109fd0 0x55563110c3c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 20 searching for the correct realm 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55563110ea80 0x555631110e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55563110ea80 0x555631110e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55563110ea80 0x555631110e90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f85d640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1c000f1040 0x7f1c000b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x7f1c000f1040 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.195+0000 7f1c0f05c640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1c000f1040 0x7f1c000b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1c000f1040 0x7f1c000b4400 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800f600 con 0x7f1c000f1040 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631109fd0 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1bf800f600 con 0x555631105600 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631109fd0 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x7f1c000f1040 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.199+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631109fd0 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x7f1c000f1040 2024-09-13T19:33:53.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631109fd0 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.203+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631109fd0 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x7f1c000f1040 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631109fd0 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631109fd0 2024-09-13T19:33:53.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x7f1c000f1040 2024-09-13T19:33:53.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x55563110ea80 2024-09-13T19:33:53.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.207+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631109fd0 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x555631105600 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555631111510 con 0x7f1c000f1040 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:53.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55563110d4f0 con 0x555631105600 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55563110d100 con 0x555631105600 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55563110dde0 con 0x555631105600 2024-09-13T19:33:53.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 zone default found 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 4 Realm: () 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 zonegroup default 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555631111990 con 0x555631109fd0 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555631113c10 con 0x55563110ea80 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555631113fb0 con 0x55563110ea80 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 started sync module instance, tier type = 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.211+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311130a0 con 0x7f1c000f1040 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.215+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.215+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93828678759920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311130a0 con 0x7f1c000f1040 2024-09-13T19:33:53.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.215+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311149b0 con 0x555631105600 2024-09-13T19:33:53.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.215+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93828678759920] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.215+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.215+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93828678763712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311130a0 con 0x555631105600 2024-09-13T19:33:53.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.215+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311153c0 con 0x55563110ea80 2024-09-13T19:33:53.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.219+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.219+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93828678766352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631115c60 con 0x55563110ea80 2024-09-13T19:33:53.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.219+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631116620 con 0x7f1c000f1040 2024-09-13T19:33:53.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.219+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93828678763712] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.219+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.219+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93828678771056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631116590 con 0x7f1c000f1040 2024-09-13T19:33:53.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.219+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631117370 con 0x555631105600 2024-09-13T19:33:53.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.219+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93828678766352] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.223+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93828678771056] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.223+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.223+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93828678768560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631116e70 con 0x555631105600 2024-09-13T19:33:53.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.223+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631117c10 con 0x555631109fd0 2024-09-13T19:33:53.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.223+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.223+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93828678776672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631116e70 con 0x555631109fd0 2024-09-13T19:33:53.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.223+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631118a80 con 0x555631109fd0 2024-09-13T19:33:53.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.223+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93828678768560] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93828678773456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631118a80 con 0x555631109fd0 2024-09-13T19:33:53.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631119440 con 0x555631109fd0 2024-09-13T19:33:53.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93828678776672] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93828678773456] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93828678780368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311189f0 con 0x555631109fd0 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 20 add_watcher() i=0 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 20 add_watcher() i=1 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 20 add_watcher() i=2 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 20 add_watcher() i=3 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 20 add_watcher() i=4 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 20 add_watcher() i=5 2024-09-13T19:33:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.227+0000 7f1c11d4d980 20 add_watcher() i=6 2024-09-13T19:33:53.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93828678780368] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c11d4d980 20 add_watcher() i=7 2024-09-13T19:33:53.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c11d4d980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:53.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55563111c470 con 0x555631105600 2024-09-13T19:33:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93828678782864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631119860 con 0x555631105600 2024-09-13T19:33:53.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93828678782864] v32'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1ac5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:53.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c11d4d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:53.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c11d4d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:53.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.231+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631124c30 con 0x555631105600 2024-09-13T19:33:53.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.235+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.235+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631125300 con 0x555631109fd0 2024-09-13T19:33:53.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.235+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.235+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631125300 con 0x55563110ea80 2024-09-13T19:33:53.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.239+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.239+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631125b50 con 0x555631105600 2024-09-13T19:33:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.239+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'174 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.239+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631122a80 con 0x7f1c000f1040 2024-09-13T19:33:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.239+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'59 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.239+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631122a80 con 0x55563110ea80 2024-09-13T19:33:53.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.243+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.243+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631122a80 con 0x555631105600 2024-09-13T19:33:53.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.243+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.243+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631122b90 con 0x555631109fd0 2024-09-13T19:33:53.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.247+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.247+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631122ca0 con 0x7f1c000f1040 2024-09-13T19:33:53.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.247+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.247+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631122ca0 con 0x55563110ea80 2024-09-13T19:33:53.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.251+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.251+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311266b0 con 0x7f1c000f1040 2024-09-13T19:33:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.251+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'60 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.251+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311266b0 con 0x555631109fd0 2024-09-13T19:33:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.255+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.255+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311266b0 con 0x7f1c000f1040 2024-09-13T19:33:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.255+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.255+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311266b0 con 0x555631109fd0 2024-09-13T19:33:53.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.255+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.255+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311266b0 con 0x555631105600 2024-09-13T19:33:53.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.259+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'175 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.259+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311266b0 con 0x55563110ea80 2024-09-13T19:33:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.259+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.259+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126740 con 0x7f1c000f1040 2024-09-13T19:33:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.263+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.263+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126740 con 0x55563110ea80 2024-09-13T19:33:53.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.263+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.263+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126740 con 0x555631105600 2024-09-13T19:33:53.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.263+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.263+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126740 con 0x555631105600 2024-09-13T19:33:53.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.267+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'176 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.267+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126740 con 0x55563110ea80 2024-09-13T19:33:53.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.267+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.267+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126740 con 0x7f1c000f1040 2024-09-13T19:33:53.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.271+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.271+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126740 con 0x55563110ea80 2024-09-13T19:33:53.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.271+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.271+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126740 con 0x55563110ea80 2024-09-13T19:33:53.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.271+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.271+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126780 con 0x55563110ea80 2024-09-13T19:33:53.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.275+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.275+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126780 con 0x55563110ea80 2024-09-13T19:33:53.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.275+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.275+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126780 con 0x555631109fd0 2024-09-13T19:33:53.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.279+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.279+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126780 con 0x55563110ea80 2024-09-13T19:33:53.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.279+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.279+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126780 con 0x555631109fd0 2024-09-13T19:33:53.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.283+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.283+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126780 con 0x55563110ea80 2024-09-13T19:33:53.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.283+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.283+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126780 con 0x555631109fd0 2024-09-13T19:33:53.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.287+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.287+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631126780 con 0x7f1c000f1040 2024-09-13T19:33:53.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.287+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.287+0000 7f1ac4fe1640 20 reqs_thread_entry: start 2024-09-13T19:33:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.287+0000 7f1c11d4d980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.287+0000 7f1c11d4d980 20 Filter name: none 2024-09-13T19:33:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.287+0000 7f1a3e7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555631141d00 con 0x555631105600 2024-09-13T19:33:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:53.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:53.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:53.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:53.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556311441d0 con 0x7f1c000f1040 2024-09-13T19:33:53.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.295 INFO:teuthology.orchestra.run.smithi144.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:33:53.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1ac5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:53.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93828678782864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55563111e870 con 0x555631105600 2024-09-13T19:33:53.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93828678782864] v32'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.291+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93828678759920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631118f90 con 0x7f1c000f1040 2024-09-13T19:33:53.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.295+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93828678759920] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.295+0000 7f1c11d4d980 20 remove_watcher() i=0 2024-09-13T19:33:53.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.295+0000 7f1c11d4d980 2 removed watcher, disabling cache 2024-09-13T19:33:53.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.295+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93828678763712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631118f90 con 0x555631105600 2024-09-13T19:33:53.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.295+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93828678763712] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.295+0000 7f1c11d4d980 20 remove_watcher() i=1 2024-09-13T19:33:53.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.295+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93828678766352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311144c0 con 0x55563110ea80 2024-09-13T19:33:53.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.299+0000 7f1c0f85d640 1 -- 172.21.15.144:0/2148431975 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93828678766352] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c7030 con 0x55563110ea80 2024-09-13T19:33:53.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.299+0000 7f1c11d4d980 20 remove_watcher() i=2 2024-09-13T19:33:53.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.299+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93828678771056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631114f10 con 0x7f1c000f1040 2024-09-13T19:33:53.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.299+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93828678771056] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x7f1c000f1040 2024-09-13T19:33:53.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.299+0000 7f1c11d4d980 20 remove_watcher() i=3 2024-09-13T19:33:53.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.299+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93828678768560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311144c0 con 0x555631105600 2024-09-13T19:33:53.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.303+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93828678768560] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf802b040 con 0x555631105600 2024-09-13T19:33:53.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.303+0000 7f1c11d4d980 20 remove_watcher() i=4 2024-09-13T19:33:53.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.303+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93828678776672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631116170 con 0x555631109fd0 2024-09-13T19:33:53.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.303+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93828678776672] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.303+0000 7f1c11d4d980 20 remove_watcher() i=5 2024-09-13T19:33:53.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.303+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93828678773456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555631114f10 con 0x555631109fd0 2024-09-13T19:33:53.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.307+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93828678773456] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.307+0000 7f1c11d4d980 20 remove_watcher() i=6 2024-09-13T19:33:53.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.307+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93828678780368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556311157b0 con 0x555631109fd0 2024-09-13T19:33:53.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.307+0000 7f1c1005e640 1 -- 172.21.15.144:0/2148431975 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93828678780368] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0802a070 con 0x555631109fd0 2024-09-13T19:33:53.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.307+0000 7f1c11d4d980 20 remove_watcher() i=7 2024-09-13T19:33:53.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555631109fd0 msgr2=0x55563110c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555631109fd0 0x55563110c3c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555631105600 msgr2=0x555631107ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555631105600 0x555631107ac0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1c000f1040 msgr2=0x7f1c000b4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1c000f1040 0x7f1c000b4400 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55563110ea80 msgr2=0x555631110e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55563110ea80 0x555631110e90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ad8034650 msgr2=0x7f1ad8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ad8034650 0x7f1ad8036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1c0001b010 tx=0x7f1c000d6000 comp rx=0 tx=0).stop 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 msgr2=0x5556310fa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c0f05c640 1 -- 172.21.15.144:0/2148431975 reap_dead start 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310fa2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1c080491f0 tx=0x7f1c0804a2b0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 shutdown_connections 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2148431975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310f3000 0x5556310fa2f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 >> 172.21.15.144:0/2148431975 conn(0x5556310ef3e0 msgr2=0x5556310f4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 shutdown_connections 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2148431975 wait complete. 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2268494342 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ae8034650 msgr2=0x7f1ae8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2268494342 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ae8034650 0x7f1ae8036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5556310d34f0 tx=0x7f1c000c03e0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2268494342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310e6580 msgr2=0x5556310e69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2268494342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310e6580 0x5556310e69a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5556310cc8e0 tx=0x7f1c0800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2268494342 shutdown_connections 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2268494342 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1ae8034650 0x7f1ae8036b10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/2268494342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556310e6580 0x5556310e69a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2268494342 >> 172.21.15.144:0/2268494342 conn(0x5556310db6d0 msgr2=0x5556310de150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2268494342 shutdown_connections 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/2268494342 wait complete. 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5556310d5380 msgr2=0x5556310d7770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5556310d5380 0x5556310d7770 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555630fdc8e0 msgr2=0x5556310d2ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555630fdc8e0 0x5556310d2ae0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1af8034650 msgr2=0x7f1af8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1af8034650 0x7f1af8036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8000c10 tx=0x7f1bf80013c0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 msgr2=0x5556310cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310cb9e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c0001b870 tx=0x7f1c00019810 comp rx=0 tx=0).stop 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 shutdown_connections 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555630fdc8e0 0x5556310d2ae0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5556310d5380 0x5556310d7770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1af8034650 0x7f1af8036b10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 --2- 172.21.15.144:0/4050561074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555630f4e290 0x5556310cb9e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 >> 172.21.15.144:0/4050561074 conn(0x555630fd4090 msgr2=0x5556310bef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 shutdown_connections 2024-09-13T19:33:53.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.311+0000 7f1c11d4d980 1 -- 172.21.15.144:0/4050561074 wait complete. 2024-09-13T19:33:53.325 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:33:53.338 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-13T19:33:53.343 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:53.383 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:53.399 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:53.445 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T19:33:53.455 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:53.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:33:53.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:33:53.456 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:33:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:53.495 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.491+0000 7f4e0a31d980 1 Processor -- start 2024-09-13T19:33:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.491+0000 7f4e0a31d980 1 -- start start 2024-09-13T19:33:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.491+0000 7f4e0a31d980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56138da836e0 0x56138da83ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.491+0000 7f4e0a31d980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56138d994ae0 con 0x56138da84030 2024-09-13T19:33:53.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.491+0000 7f4e0a31d980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56138d9b8e30 con 0x56138da836e0 2024-09-13T19:33:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e07e2d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56138da836e0 0x56138da83ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e07e2d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56138da836e0 0x56138da83ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39690/0 (socket says 172.21.15.144:39690) 2024-09-13T19:33:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e07e2d640 1 -- 172.21.15.144:0/992360600 learned_addr learned my addr 172.21.15.144:0/992360600 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e0762c640 1 --1- 172.21.15.144:0/992360600 >> v1:172.21.15.18:6789/0 conn(0x56138da84030 0x56138da869b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:60994/0 (socket says 172.21.15.144:60994) 2024-09-13T19:33:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e07e2d640 1 -- 172.21.15.144:0/992360600 >> v1:172.21.15.18:6789/0 conn(0x56138da84030 legacy=0x56138da869b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e07e2d640 1 -- 172.21.15.144:0/992360600 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138da871e0 con 0x56138da836e0 2024-09-13T19:33:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/992360600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138da83ac0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4df800a4e0 tx=0x7f4df801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f3bf8427768406 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e06e2b640 1 -- 172.21.15.144:0/992360600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df80aa540 con 0x56138da836e0 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e06e2b640 1 -- 172.21.15.144:0/992360600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df80aa6e0 con 0x56138da836e0 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.495+0000 7f4e06e2b640 1 -- 172.21.15.144:0/992360600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df80aaa40 con 0x56138da836e0 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.499+0000 7f4e0a31d980 1 -- 172.21.15.144:0/992360600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 msgr2=0x56138da83ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.499+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/992360600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138da83ac0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4df800a4e0 tx=0x7f4df801b090 comp rx=0 tx=0).stop 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.499+0000 7f4e0a31d980 1 -- 172.21.15.144:0/992360600 shutdown_connections 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.499+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/992360600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138da83ac0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.499+0000 7f4e0a31d980 1 -- 172.21.15.144:0/992360600 >> 172.21.15.144:0/992360600 conn(0x56138da82290 msgr2=0x56138da826a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.499+0000 7f4e0a31d980 1 -- 172.21.15.144:0/992360600 shutdown_connections 2024-09-13T19:33:53.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.499+0000 7f4e0a31d980 1 -- 172.21.15.144:0/992360600 wait complete. 2024-09-13T19:33:53.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 Processor -- start 2024-09-13T19:33:53.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- start start 2024-09-13T19:33:53.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dbfec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56138d9ba200 con 0x56138da836e0 2024-09-13T19:33:53.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e07e2d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dbfec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e07e2d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dbfec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39692/0 (socket says 172.21.15.144:39692) 2024-09-13T19:33:53.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e07e2d640 1 -- 172.21.15.144:0/2305940674 learned_addr learned my addr 172.21.15.144:0/2305940674 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e07e2d640 1 -- 172.21.15.144:0/2305940674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138dbff1d0 con 0x56138da836e0 2024-09-13T19:33:53.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/2305940674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dbfec00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4df8017ca0 tx=0x7f4df80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e17c23b5b7ba49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4cf5e0b640 1 -- 172.21.15.144:0/2305940674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df80b9030 con 0x56138da836e0 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4cf5e0b640 1 -- 172.21.15.144:0/2305940674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df80aaac0 con 0x56138da836e0 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4cf5e0b640 1 -- 172.21.15.144:0/2305940674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df80aada0 con 0x56138da836e0 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2305940674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 msgr2=0x56138dbfec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/2305940674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dbfec00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4df8017ca0 tx=0x7f4df80033b0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2305940674 shutdown_connections 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/2305940674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dbfec00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2305940674 >> 172.21.15.144:0/2305940674 conn(0x56138da82290 msgr2=0x56138dbfa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2305940674 shutdown_connections 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2305940674 wait complete. 2024-09-13T19:33:53.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 Processor -- start 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- start start 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dc05df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e0a31d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56138db1d150 con 0x56138da836e0 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e07e2d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dc05df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e07e2d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dc05df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39706/0 (socket says 172.21.15.144:39706) 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.515+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3593998820 learned_addr learned my addr 172.21.15.144:0/3593998820 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3593998820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138dc06330 con 0x56138da836e0 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dc05df0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4df8005cc0 tx=0x7f4df8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4ceffff640 1 -- 172.21.15.144:0/3593998820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df80b9030 con 0x56138da836e0 2024-09-13T19:33:53.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4ceffff640 1 -- 172.21.15.144:0/3593998820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df80c3070 con 0x56138da836e0 2024-09-13T19:33:53.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56138dc065c0 con 0x56138da836e0 2024-09-13T19:33:53.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4ceffff640 1 -- 172.21.15.144:0/3593998820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df80bf750 con 0x56138da836e0 2024-09-13T19:33:53.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138dc092a0 con 0x56138da836e0 2024-09-13T19:33:53.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4ceffff640 1 -- 172.21.15.144:0/3593998820 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4df80c5030 con 0x56138da836e0 2024-09-13T19:33:53.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4ceffff640 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cf00346a0 0x7f4cf0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4ceffff640 1 -- 172.21.15.144:0/3593998820 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4df80ba070 con 0x56138da836e0 2024-09-13T19:33:53.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138da84030 0x56138dc0cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0762c640 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cf00346a0 0x7f4cf0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc0d3f0 con 0x56138da84030 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0862e640 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138da84030 0x56138dc0cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0762c640 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cf00346a0 0x7f4cf0036b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4df0001e50 tx=0x7f4df00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0862e640 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138da84030 0x56138dc0cd80 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0862e640 1 -- 172.21.15.144:0/3593998820 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e000083f0 con 0x56138da84030 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.519+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc0a4a0 con 0x56138da84030 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0862e640 1 -- 172.21.15.144:0/3593998820 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e000083f0 con 0x56138da84030 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc0f770 0x56138dc11b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc12230 con 0x56138dc0f770 2024-09-13T19:33:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc0f770 0x56138dc11b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc0f770 0x56138dc11b60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3593998820 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4df80ce070 con 0x56138dc0f770 2024-09-13T19:33:53.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc0e610 con 0x56138da84030 2024-09-13T19:33:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0862e640 1 -- 172.21.15.144:0/3593998820 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e000083f0 con 0x56138da84030 2024-09-13T19:33:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc0eaf0 con 0x56138da84030 2024-09-13T19:33:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0862e640 1 -- 172.21.15.144:0/3593998820 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4e000083f0 con 0x56138da84030 2024-09-13T19:33:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0a31d980 1 Processor -- start 2024-09-13T19:33:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0a31d980 1 -- start start 2024-09-13T19:33:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0a31d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc20970 0x56138dc20d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0a31d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56138da13800 con 0x56138dc20970 2024-09-13T19:33:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0862e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc20970 0x56138dc20d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0862e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc20970 0x56138dc20d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39718/0 (socket says 172.21.15.144:39718) 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.523+0000 7f4e0862e640 1 -- 172.21.15.144:0/2239848402 learned_addr learned my addr 172.21.15.144:0/2239848402 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0862e640 1 -- 172.21.15.144:0/2239848402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138dc212d0 con 0x56138dc20970 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0862e640 1 --2- 172.21.15.144:0/2239848402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc20970 0x56138dc20d90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x56138dc06cf0 tx=0x7f4e0000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4ced7fa640 1 -- 172.21.15.144:0/2239848402 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00007d70 con 0x56138dc20970 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4ced7fa640 1 -- 172.21.15.144:0/2239848402 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0001e020 con 0x56138dc20970 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4ced7fa640 1 -- 172.21.15.144:0/2239848402 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00019550 con 0x56138dc20970 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2239848402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56138dc21560 con 0x56138dc20970 2024-09-13T19:33:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2239848402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138dc241e0 con 0x56138dc20970 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4ced7fa640 1 -- 172.21.15.144:0/2239848402 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e00016040 con 0x56138dc20970 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4ced7fa640 1 --2- 172.21.15.144:0/2239848402 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ce0034650 0x7f4ce0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4ced7fa640 1 -- 172.21.15.144:0/2239848402 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4e0001f030 con 0x56138dc20970 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/2239848402 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ce0034650 0x7f4ce0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0a31d980 1 Processor -- start 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0a31d980 1 -- start start 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/2239848402 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ce0034650 0x7f4ce0036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56138dc0d8e0 tx=0x7f4df80c65a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0a31d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc2d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0a31d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56138dbff490 con 0x56138dc2d3f0 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0862e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc2d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0862e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc2d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39720/0 (socket says 172.21.15.144:39720) 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0862e640 1 -- 172.21.15.144:0/1925993312 learned_addr learned my addr 172.21.15.144:0/1925993312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.527+0000 7f4e0862e640 1 -- 172.21.15.144:0/1925993312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138dc2ddc0 con 0x56138dc2d3f0 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0862e640 1 --2- 172.21.15.144:0/1925993312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc2d7f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4e000226c0 tx=0x7f4e00017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e420b2a4acebcf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4ce6ffd640 1 -- 172.21.15.144:0/1925993312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e0001d040 con 0x56138dc2d3f0 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4ce6ffd640 1 -- 172.21.15.144:0/1925993312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e00023540 con 0x56138dc2d3f0 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4ce6ffd640 1 -- 172.21.15.144:0/1925993312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00019d80 con 0x56138dc2d3f0 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- 172.21.15.144:0/1925993312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 msgr2=0x56138dc2d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/1925993312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc2d7f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4e000226c0 tx=0x7f4e00017fa0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- 172.21.15.144:0/1925993312 shutdown_connections 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/1925993312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc2d7f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- 172.21.15.144:0/1925993312 >> 172.21.15.144:0/1925993312 conn(0x56138dc297d0 msgr2=0x56138dc278d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- 172.21.15.144:0/1925993312 shutdown_connections 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- 172.21.15.144:0/1925993312 wait complete. 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 Processor -- start 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- start start 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc34780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56138dc2e3c0 con 0x56138dc2d3f0 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0862e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc34780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0862e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc34780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39728/0 (socket says 172.21.15.144:39728) 2024-09-13T19:33:53.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 learned_addr learned my addr 172.21.15.144:0/3752900796 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138dc34cc0 con 0x56138dc2d3f0 2024-09-13T19:33:53.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0862e640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc34780 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4e00017b60 tx=0x7f4e0004a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4ce57fa640 1 -- 172.21.15.144:0/3752900796 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e0001d040 con 0x56138dc2d3f0 2024-09-13T19:33:53.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56138dc34f50 con 0x56138dc2d3f0 2024-09-13T19:33:53.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138dc37c30 con 0x56138dc2d3f0 2024-09-13T19:33:53.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4ce57fa640 1 -- 172.21.15.144:0/3752900796 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e00015770 con 0x56138dc2d3f0 2024-09-13T19:33:53.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.531+0000 7f4ce57fa640 1 -- 172.21.15.144:0/3752900796 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00017770 con 0x56138dc2d3f0 2024-09-13T19:33:53.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4ce57fa640 1 -- 172.21.15.144:0/3752900796 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e0002b790 con 0x56138dc2d3f0 2024-09-13T19:33:53.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4ce57fa640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cd0034650 0x7f4cd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4ce57fa640 1 -- 172.21.15.144:0/3752900796 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4e00035070 con 0x56138dc2d3f0 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cd0034650 0x7f4cd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138dc3fc20 0x56138dc420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc42830 con 0x56138dc3fc20 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0762c640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138dc3fc20 0x56138dc420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cd0034650 0x7f4cd0036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4df801aec0 tx=0x7f4df80e1000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0762c640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138dc3fc20 0x56138dc420e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df000f6a0 con 0x56138dc3fc20 2024-09-13T19:33:53.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 realm 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc3f070 con 0x56138dc3fc20 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df000f6a0 con 0x56138dc3fc20 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc43300 con 0x56138dc3fc20 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df000f6a0 con 0x56138dc3fc20 2024-09-13T19:33:53.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc43bd0 con 0x56138dc3fc20 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4df000f6a0 con 0x56138dc3fc20 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc444c0 0x56138dc468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc47080 con 0x56138dc444c0 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.535+0000 7f4e0862e640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc444c0 0x56138dc468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0862e640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc444c0 0x56138dc468f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0a31d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0a31d980 20 searching for the correct realm 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56138dc48fd0 0x56138dc4b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc48fd0 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56138dc48fd0 0x56138dc4b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56138dc48fd0 0x56138dc4b400 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e07e2d640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4df80bf8f0 0x7f4df80dc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0762c640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4df80bf8f0 0x7f4df80dc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0762c640 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4df80bf8f0 0x7f4df80dc3f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df000f6a0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc444c0 2024-09-13T19:33:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc3fc20 2024-09-13T19:33:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4df000f6a0 con 0x56138dc3fc20 2024-09-13T19:33:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc3fc20 2024-09-13T19:33:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.539+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc3fc20 2024-09-13T19:33:53.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc444c0 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc48fd0 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc3fc20 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc444c0 2024-09-13T19:33:53.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc3fc20 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bad0 con 0x56138dc48fd0 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc48fd0 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.543+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc444c0 2024-09-13T19:33:53.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc48fd0 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc48fd0 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc3fc20 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc3fc20 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc444c0 2024-09-13T19:33:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc48fd0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc3fc20 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc444c0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.547+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc48fd0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc444c0 2024-09-13T19:33:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc48fd0 2024-09-13T19:33:53.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc444c0 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x56138dc3fc20 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4df80fa040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:53.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc47a40 con 0x56138dc3fc20 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc47680 con 0x56138dc3fc20 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc483a0 con 0x56138dc3fc20 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 zone default found 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 4 Realm: () 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 zonegroup default 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.551+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4bf70 con 0x56138dc444c0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4e240 con 0x56138dc48fd0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4e5e0 con 0x56138dc48fd0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 20 started sync module instance, tier type = 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4d6d0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94641982856192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4d6d0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4f090 con 0x56138dc3fc20 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.555+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94641982856192] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.559+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.559+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94641982860144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4d6d0 con 0x56138dc3fc20 2024-09-13T19:33:53.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.559+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4faa0 con 0x56138dc48fd0 2024-09-13T19:33:53.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.559+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94641982860144] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.559+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.559+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94641982853664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc4d640 con 0x56138dc48fd0 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.559+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc507f0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.563+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.563+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94641982866512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc50ea0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.563+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc519c0 con 0x56138dc3fc20 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.563+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94641982853664] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.563+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94641982866512] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.563+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.563+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94641982870672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc51980 con 0x56138dc3fc20 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.563+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc51db0 con 0x56138dc444c0 2024-09-13T19:33:53.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.567+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94641982870672] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.567+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.567+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94641982867696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc51db0 con 0x56138dc444c0 2024-09-13T19:33:53.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.567+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc527c0 con 0x56138dc444c0 2024-09-13T19:33:53.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.567+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94641982867696] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.567+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.567+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94641982865040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc527c0 con 0x56138dc444c0 2024-09-13T19:33:53.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.567+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc53180 con 0x56138dc444c0 2024-09-13T19:33:53.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94641982865040] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94641982874656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc53180 con 0x56138dc444c0 2024-09-13T19:33:53.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 20 add_watcher() i=0 2024-09-13T19:33:53.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 20 add_watcher() i=1 2024-09-13T19:33:53.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 20 add_watcher() i=2 2024-09-13T19:33:53.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 20 add_watcher() i=3 2024-09-13T19:33:53.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 20 add_watcher() i=4 2024-09-13T19:33:53.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 20 add_watcher() i=5 2024-09-13T19:33:53.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 20 add_watcher() i=6 2024-09-13T19:33:53.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94641982874656] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 20 add_watcher() i=7 2024-09-13T19:33:53.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:53.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.571+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc56580 con 0x56138dc3fc20 2024-09-13T19:33:53.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94641982877344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc53a40 con 0x56138dc3fc20 2024-09-13T19:33:53.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94641982877344] v32'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4cbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:53.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:53.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:53.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 5 note: GC not initialized 2024-09-13T19:33:53.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4cbcfe1640 20 reqs_thread_entry: start 2024-09-13T19:33:53.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:53.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 20 Filter name: none 2024-09-13T19:33:53.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4c367fc640 20 reqs_thread_entry: start 2024-09-13T19:33:53.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.575+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7a210 con 0x7f4df80bf8f0 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 : miss 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.1e 8:785de77d:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7bc70 con 0x56138dc444c0 2024-09-13T19:33:53.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:53.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 info.flags=0x17 2024-09-13T19:33:53.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 to cache LRU end 2024-09-13T19:33:53.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:53.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:53.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 2024-09-13T19:33:53.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 20 get_obj_state: octx=0x7f4df000f620 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56138dc7de08 s->prefetch_data=0 2024-09-13T19:33:53.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 3.22 3:45aa53a6:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7eeb0 con 0x56138dc48fd0 2024-09-13T19:33:53.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 10 manifest: total_size = 5 2024-09-13T19:33:53.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 20 get_obj_state: setting s->obj_tag to _oBg_c1h8a60HE32M2WpG6dsEov8a4Hq 2024-09-13T19:33:53.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4cbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:53.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.579+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94641982877344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc77a80 con 0x56138dc3fc20 2024-09-13T19:33:53.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94641982877344] v32'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94641982856192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc52e70 con 0x7f4df80bf8f0 2024-09-13T19:33:53.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94641982856192] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0a31d980 20 remove_watcher() i=0 2024-09-13T19:33:53.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0a31d980 2 removed watcher, disabling cache 2024-09-13T19:33:53.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94641982860144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7eeb0 con 0x56138dc3fc20 2024-09-13T19:33:53.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94641982860144] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0a31d980 20 remove_watcher() i=1 2024-09-13T19:33:53.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.583+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94641982853664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7eeb0 con 0x56138dc48fd0 2024-09-13T19:33:53.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.587+0000 7f4e07e2d640 1 -- 172.21.15.144:0/3752900796 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94641982853664] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df80ea070 con 0x56138dc48fd0 2024-09-13T19:33:53.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.587+0000 7f4e0a31d980 20 remove_watcher() i=2 2024-09-13T19:33:53.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.587+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94641982866512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7eeb0 con 0x7f4df80bf8f0 2024-09-13T19:33:53.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.587+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94641982866512] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x7f4df80bf8f0 2024-09-13T19:33:53.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.587+0000 7f4e0a31d980 20 remove_watcher() i=3 2024-09-13T19:33:53.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.587+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94641982870672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7eeb0 con 0x56138dc3fc20 2024-09-13T19:33:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.591+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94641982870672] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df002b040 con 0x56138dc3fc20 2024-09-13T19:33:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.591+0000 7f4e0a31d980 20 remove_watcher() i=4 2024-09-13T19:33:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.591+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94641982867696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7eeb0 con 0x56138dc444c0 2024-09-13T19:33:53.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.591+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94641982867696] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.591+0000 7f4e0a31d980 20 remove_watcher() i=5 2024-09-13T19:33:53.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.591+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94641982865040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7eeb0 con 0x56138dc444c0 2024-09-13T19:33:53.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.595+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94641982865040] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.595+0000 7f4e0a31d980 20 remove_watcher() i=6 2024-09-13T19:33:53.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.595+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94641982874656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56138dc7eeb0 con 0x56138dc444c0 2024-09-13T19:33:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.595+0000 7f4e0862e640 1 -- 172.21.15.144:0/3752900796 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94641982874656] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0002a070 con 0x56138dc444c0 2024-09-13T19:33:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.595+0000 7f4e0a31d980 20 remove_watcher() i=7 2024-09-13T19:33:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc444c0 msgr2=0x56138dc468f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc444c0 0x56138dc468f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138dc3fc20 msgr2=0x56138dc420e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138dc3fc20 0x56138dc420e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4df80bf8f0 msgr2=0x7f4df80dc3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4df80bf8f0 0x7f4df80dc3f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56138dc48fd0 msgr2=0x56138dc4b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56138dc48fd0 0x56138dc4b400 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cd0034650 msgr2=0x7f4cd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cd0034650 0x7f4cd0036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4df801aec0 tx=0x7f4df80e1000 comp rx=0 tx=0).stop 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0762c640 1 -- 172.21.15.144:0/3752900796 reap_dead start 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 msgr2=0x56138dc34780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc34780 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4e00017b60 tx=0x7f4e0004a260 comp rx=0 tx=0).stop 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 shutdown_connections 2024-09-13T19:33:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3752900796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc2d3f0 0x56138dc34780 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 >> 172.21.15.144:0/3752900796 conn(0x56138dc297d0 msgr2=0x56138dc278a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 shutdown_connections 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3752900796 wait complete. 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2239848402 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ce0034650 msgr2=0x7f4ce0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/2239848402 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ce0034650 0x7f4ce0036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56138dc0d8e0 tx=0x7f4df80c65a0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2239848402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc20970 msgr2=0x56138dc20d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/2239848402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc20970 0x56138dc20d90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x56138dc06cf0 tx=0x7f4e0000af40 comp rx=0 tx=0).stop 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2239848402 shutdown_connections 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/2239848402 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ce0034650 0x7f4ce0036b10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/2239848402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138dc20970 0x56138dc20d90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2239848402 >> 172.21.15.144:0/2239848402 conn(0x56138dc15ac0 msgr2=0x56138dc18540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2239848402 shutdown_connections 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/2239848402 wait complete. 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc0f770 msgr2=0x56138dc11b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc0f770 0x56138dc11b60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138da84030 msgr2=0x56138dc0cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138da84030 0x56138dc0cd80 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cf00346a0 msgr2=0x7f4cf0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cf00346a0 0x7f4cf0036b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4df0001e50 tx=0x7f4df00013b0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 msgr2=0x56138dc05df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dc05df0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4df8005cc0 tx=0x7f4df8017e30 comp rx=0 tx=0).stop 2024-09-13T19:33:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 shutdown_connections 2024-09-13T19:33:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56138da84030 0x56138dc0cd80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56138dc0f770 0x56138dc11b60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4cf00346a0 0x7f4cf0036b60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 --2- 172.21.15.144:0/3593998820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56138da836e0 0x56138dc05df0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 >> 172.21.15.144:0/3593998820 conn(0x56138da82290 msgr2=0x56138dbf93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 shutdown_connections 2024-09-13T19:33:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.599+0000 7f4e0a31d980 1 -- 172.21.15.144:0/3593998820 wait complete. 2024-09-13T19:33:53.613 INFO:teuthology.orchestra.run.smithi144.stdout:fooFoofooFooFULL_CONTROL 2024-09-13T19:33:53.614 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-13T19:33:53.616 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-13T19:33:53.623 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:53.623 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:33:53.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:33:53.624 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:33:53.689 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:53.689 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:53.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17da784980 1 Processor -- start 2024-09-13T19:33:53.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17da784980 1 -- start start 2024-09-13T19:33:53.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17da784980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x561802049b10 0x5618020d8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17da784980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561801f5dae0 con 0x5618020d8880 2024-09-13T19:33:53.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17da784980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x561801f81e30 con 0x561802049b10 2024-09-13T19:33:53.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17d8294640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x561802049b10 0x5618020d8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17d8294640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x561802049b10 0x5618020d8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39740/0 (socket says 172.21.15.144:39740) 2024-09-13T19:33:53.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17d8294640 1 -- 172.21.15.144:0/3463251402 learned_addr learned my addr 172.21.15.144:0/3463251402 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17d7a93640 1 --1- 172.21.15.144:0/3463251402 >> v1:172.21.15.18:6789/0 conn(0x5618020d8880 0x5618020dac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:32768/0 (socket says 172.21.15.144:32768) 2024-09-13T19:33:53.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17d8294640 1 -- 172.21.15.144:0/3463251402 >> v1:172.21.15.18:6789/0 conn(0x5618020d8880 legacy=0x5618020dac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.687+0000 7f17d8294640 1 -- 172.21.15.144:0/3463251402 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618020dd3a0 con 0x561802049b10 2024-09-13T19:33:53.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17d8294640 1 --2- 172.21.15.144:0/3463251402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d8340 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f17c800a5c0 tx=0x7f17c801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43d1a979e48a07c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17d7292640 1 -- 172.21.15.144:0/3463251402 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c80a6070 con 0x561802049b10 2024-09-13T19:33:53.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17d7292640 1 -- 172.21.15.144:0/3463251402 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c80af070 con 0x561802049b10 2024-09-13T19:33:53.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17d7292640 1 -- 172.21.15.144:0/3463251402 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c80aa5c0 con 0x561802049b10 2024-09-13T19:33:53.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17da784980 1 -- 172.21.15.144:0/3463251402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 msgr2=0x5618020d8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17da784980 1 --2- 172.21.15.144:0/3463251402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d8340 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f17c800a5c0 tx=0x7f17c801b340 comp rx=0 tx=0).stop 2024-09-13T19:33:53.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17da784980 1 -- 172.21.15.144:0/3463251402 shutdown_connections 2024-09-13T19:33:53.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17da784980 1 --2- 172.21.15.144:0/3463251402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d8340 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17da784980 1 -- 172.21.15.144:0/3463251402 >> 172.21.15.144:0/3463251402 conn(0x5618020d0070 msgr2=0x5618020d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17da784980 1 -- 172.21.15.144:0/3463251402 shutdown_connections 2024-09-13T19:33:53.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.691+0000 7f17da784980 1 -- 172.21.15.144:0/3463251402 wait complete. 2024-09-13T19:33:53.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17da784980 1 Processor -- start 2024-09-13T19:33:53.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17da784980 1 -- start start 2024-09-13T19:33:53.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17da784980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618021c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17da784980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561801f83200 con 0x561802049b10 2024-09-13T19:33:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17d8294640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618021c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17d8294640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618021c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39744/0 (socket says 172.21.15.144:39744) 2024-09-13T19:33:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17d8294640 1 -- 172.21.15.144:0/3018863722 learned_addr learned my addr 172.21.15.144:0/3018863722 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17d8294640 1 -- 172.21.15.144:0/3018863722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618021c1090 con 0x561802049b10 2024-09-13T19:33:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.707+0000 7f17d8294640 1 --2- 172.21.15.144:0/3018863722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618021c0ac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f17c800a5c0 tx=0x7f17c8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4489cab552908438 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f16c660c640 1 -- 172.21.15.144:0/3018863722 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c80aa9b0 con 0x561802049b10 2024-09-13T19:33:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f16c660c640 1 -- 172.21.15.144:0/3018863722 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c80aab50 con 0x561802049b10 2024-09-13T19:33:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f16c660c640 1 -- 172.21.15.144:0/3018863722 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c80aae50 con 0x561802049b10 2024-09-13T19:33:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- 172.21.15.144:0/3018863722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 msgr2=0x5618021c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 --2- 172.21.15.144:0/3018863722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618021c0ac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f17c800a5c0 tx=0x7f17c8003030 comp rx=0 tx=0).stop 2024-09-13T19:33:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- 172.21.15.144:0/3018863722 shutdown_connections 2024-09-13T19:33:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 --2- 172.21.15.144:0/3018863722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618021c0ac0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- 172.21.15.144:0/3018863722 >> 172.21.15.144:0/3018863722 conn(0x5618020d0070 msgr2=0x5618021bc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- 172.21.15.144:0/3018863722 shutdown_connections 2024-09-13T19:33:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- 172.21.15.144:0/3018863722 wait complete. 2024-09-13T19:33:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 Processor -- start 2024-09-13T19:33:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- start start 2024-09-13T19:33:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5618020dce40 con 0x561802049b10 2024-09-13T19:33:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17d8294640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17d8294640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39756/0 (socket says 172.21.15.144:39756) 2024-09-13T19:33:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17d8294640 1 -- 172.21.15.144:0/2748488389 learned_addr learned my addr 172.21.15.144:0/2748488389 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17d8294640 1 -- 172.21.15.144:0/2748488389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618020d4360 con 0x561802049b10 2024-09-13T19:33:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17d8294640 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d5c40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f17c801bbe0 tx=0x7f17c80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f16c4e09640 1 -- 172.21.15.144:0/2748488389 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c80c6750 con 0x561802049b10 2024-09-13T19:33:53.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f16c4e09640 1 -- 172.21.15.144:0/2748488389 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c80c68f0 con 0x561802049b10 2024-09-13T19:33:53.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618020d45f0 con 0x561802049b10 2024-09-13T19:33:53.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f16c4e09640 1 -- 172.21.15.144:0/2748488389 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17c80c6c10 con 0x561802049b10 2024-09-13T19:33:53.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.711+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618020d4ae0 con 0x561802049b10 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f16c4e09640 1 -- 172.21.15.144:0/2748488389 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17c80ce020 con 0x561802049b10 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f16c4e09640 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16c0034650 0x7f16c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f16c4e09640 1 -- 172.21.15.144:0/2748488389 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f17c80cc020 con 0x561802049b10 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17d7a93640 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16c0034650 0x7f16c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5618020d8880 0x5618021d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618021d1650 con 0x5618020d8880 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17d8a95640 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5618020d8880 0x5618021d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17d7a93640 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16c0034650 0x7f16c0036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f17cc001e50 tx=0x7f17cc0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17d8a95640 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5618020d8880 0x5618021d1110 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17d8a95640 1 -- 172.21.15.144:0/2748488389 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17d000a4d0 con 0x5618020d8880 2024-09-13T19:33:53.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618021d1a50 con 0x5618020d8880 2024-09-13T19:33:53.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17d8a95640 1 -- 172.21.15.144:0/2748488389 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17d000a4d0 con 0x5618020d8880 2024-09-13T19:33:53.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5618021d3860 0x5618021d5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618021d6320 con 0x5618021d3860 2024-09-13T19:33:53.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17d8294640 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5618021d3860 0x5618021d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.715+0000 7f17d8294640 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5618021d3860 0x5618021d5c50 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17d8294640 1 -- 172.21.15.144:0/2748488389 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f17c80cf370 con 0x5618021d3860 2024-09-13T19:33:53.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618021d2700 con 0x5618020d8880 2024-09-13T19:33:53.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17d8a95640 1 -- 172.21.15.144:0/2748488389 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17d000a4d0 con 0x5618020d8880 2024-09-13T19:33:53.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618021d2be0 con 0x5618020d8880 2024-09-13T19:33:53.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17d8a95640 1 -- 172.21.15.144:0/2748488389 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f17d000a4d0 con 0x5618020d8880 2024-09-13T19:33:53.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17da784980 1 Processor -- start 2024-09-13T19:33:53.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17da784980 1 -- start start 2024-09-13T19:33:53.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17da784980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021e4a60 0x5618021e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17da784980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561801fdc800 con 0x5618021e4a60 2024-09-13T19:33:53.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17d8a95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021e4a60 0x5618021e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17d8a95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021e4a60 0x5618021e4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39768/0 (socket says 172.21.15.144:39768) 2024-09-13T19:33:53.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17d8a95640 1 -- 172.21.15.144:0/972459735 learned_addr learned my addr 172.21.15.144:0/972459735 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17d8a95640 1 -- 172.21.15.144:0/972459735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618021e53c0 con 0x5618021e4a60 2024-09-13T19:33:53.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17d8a95640 1 --2- 172.21.15.144:0/972459735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021e4a60 0x5618021e4e80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x5618020d5480 tx=0x7f17d0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f16bdffb640 1 -- 172.21.15.144:0/972459735 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17d0014450 con 0x5618021e4a60 2024-09-13T19:33:53.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f16bdffb640 1 -- 172.21.15.144:0/972459735 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d0014610 con 0x5618021e4a60 2024-09-13T19:33:53.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17da784980 1 -- 172.21.15.144:0/972459735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618021e5650 con 0x5618021e4a60 2024-09-13T19:33:53.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f16bdffb640 1 -- 172.21.15.144:0/972459735 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17d0014930 con 0x5618021e4a60 2024-09-13T19:33:53.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.719+0000 7f17da784980 1 -- 172.21.15.144:0/972459735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618021e82d0 con 0x5618021e4a60 2024-09-13T19:33:53.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f16bdffb640 1 -- 172.21.15.144:0/972459735 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17d0011040 con 0x5618021e4a60 2024-09-13T19:33:53.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f16bdffb640 1 --2- 172.21.15.144:0/972459735 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16b00346a0 0x7f16b0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f16bdffb640 1 -- 172.21.15.144:0/972459735 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f17d001e070 con 0x5618021e4a60 2024-09-13T19:33:53.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17d8294640 1 --2- 172.21.15.144:0/972459735 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16b00346a0 0x7f16b0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 Processor -- start 2024-09-13T19:33:53.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- start start 2024-09-13T19:33:53.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5618021c1350 con 0x5618021f1540 2024-09-13T19:33:53.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17d8294640 1 --2- 172.21.15.144:0/972459735 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16b00346a0 0x7f16b0036b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5618020d4dd0 tx=0x7f17c80c6db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17d8a95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17d8a95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39784/0 (socket says 172.21.15.144:39784) 2024-09-13T19:33:53.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17d8a95640 1 -- 172.21.15.144:0/2099708435 learned_addr learned my addr 172.21.15.144:0/2099708435 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17d8a95640 1 -- 172.21.15.144:0/2099708435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618021f1ef0 con 0x5618021f1540 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17d8a95640 1 --2- 172.21.15.144:0/2099708435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f1920 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f17d004a050 tx=0x7f17d0013c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6731d225d2f1a16f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f16b77fe640 1 -- 172.21.15.144:0/2099708435 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17d0045e60 con 0x5618021f1540 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f16b77fe640 1 -- 172.21.15.144:0/2099708435 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d000de50 con 0x5618021f1540 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f16b77fe640 1 -- 172.21.15.144:0/2099708435 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17d0016570 con 0x5618021f1540 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- 172.21.15.144:0/2099708435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 msgr2=0x5618021f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 --2- 172.21.15.144:0/2099708435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f1920 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f17d004a050 tx=0x7f17d0013c60 comp rx=0 tx=0).stop 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- 172.21.15.144:0/2099708435 shutdown_connections 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 --2- 172.21.15.144:0/2099708435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f1920 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- 172.21.15.144:0/2099708435 >> 172.21.15.144:0/2099708435 conn(0x5618021ed920 msgr2=0x5618021eba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- 172.21.15.144:0/2099708435 shutdown_connections 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- 172.21.15.144:0/2099708435 wait complete. 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 Processor -- start 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- start start 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.723+0000 7f17da784980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5618021f2510 con 0x5618021f1540 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17d8a95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17d8a95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39788/0 (socket says 172.21.15.144:39788) 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 learned_addr learned my addr 172.21.15.144:0/2121178619 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618021f8e10 con 0x5618021f1540 2024-09-13T19:33:53.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17d8a95640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f88d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f17d0047040 tx=0x7f17d0049fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f16b5ffb640 1 -- 172.21.15.144:0/2121178619 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17d00135c0 con 0x5618021f1540 2024-09-13T19:33:53.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618021f90a0 con 0x5618021f1540 2024-09-13T19:33:53.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f16b5ffb640 1 -- 172.21.15.144:0/2121178619 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d0013760 con 0x5618021f1540 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f16b5ffb640 1 -- 172.21.15.144:0/2121178619 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17d002b480 con 0x5618021f1540 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618021fbd80 con 0x5618021f1540 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f16b5ffb640 1 -- 172.21.15.144:0/2121178619 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17d002b670 con 0x5618021f1540 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f16b5ffb640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16a8034650 0x7f16a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f16b5ffb640 1 -- 172.21.15.144:0/2121178619 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f17d0034070 con 0x5618021f1540 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17d8294640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16a8034650 0x7f16a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561802203fa0 0x561802206440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561802206b90 con 0x561802203fa0 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17d7a93640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561802203fa0 0x561802206440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.727+0000 7f17d8294640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16a8034650 0x7f16a8036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f17c80cf680 tx=0x7f17c80de000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d7a93640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561802203fa0 0x561802206440 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17cc00f6a0 con 0x561802203fa0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 realm 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561802203470 con 0x561802203fa0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17cc00f6a0 con 0x561802203fa0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561802207660 con 0x561802203fa0 2024-09-13T19:33:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17cc00f6a0 con 0x561802203fa0 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561802207f30 con 0x561802203fa0 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17cc00f6a0 con 0x561802203fa0 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561802208820 0x56180220ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56180220b3e0 con 0x561802208820 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d8a95640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561802208820 0x56180220ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d8a95640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561802208820 0x56180220ac50 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 20 searching for the correct realm 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56180220d330 0x56180220f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d8294640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56180220d330 0x56180220f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.731+0000 7f17d8294640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56180220d330 0x56180220f760 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8294640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f17c8009040 0x7f17c80bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x7f17c8009040 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f17c8009040 0x7f17c80bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f17c8009040 0x7f17c80bc3a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc00f6a0 con 0x7f17c8009040 2024-09-13T19:33:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802208820 2024-09-13T19:33:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f17cc00f6a0 con 0x561802203fa0 2024-09-13T19:33:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802208820 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x7f17c8009040 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.735+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802208820 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x7f17c8009040 2024-09-13T19:33:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802208820 2024-09-13T19:33:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.739+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802208820 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x7f17c8009040 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802208820 2024-09-13T19:33:53.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802208820 2024-09-13T19:33:53.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x7f17c8009040 2024-09-13T19:33:53.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x56180220d330 2024-09-13T19:33:53.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.743+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802208820 2024-09-13T19:33:53.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x561802203fa0 2024-09-13T19:33:53.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56180220fe30 con 0x7f17c8009040 2024-09-13T19:33:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56180220bda0 con 0x561802203fa0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56180220b9b0 con 0x561802203fa0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56180220c690 con 0x561802203fa0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 zone default found 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 4 Realm: () 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 zonegroup default 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618022102b0 con 0x561802208820 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561802212530 con 0x56180220d330 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618022128d0 con 0x56180220d330 2024-09-13T19:33:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 started sync module instance, tier type = 2024-09-13T19:33:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.747+0000 7f17da784980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.751+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618022119c0 con 0x7f17c8009040 2024-09-13T19:33:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.751+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.751+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94661114928832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618022119c0 con 0x7f17c8009040 2024-09-13T19:33:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.751+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802213320 con 0x561802203fa0 2024-09-13T19:33:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.751+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94661114928832] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.751+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.751+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94661114932752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618022119c0 con 0x561802203fa0 2024-09-13T19:33:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.751+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802213d60 con 0x56180220d330 2024-09-13T19:33:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.755+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.755+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94661114935472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618022145b0 con 0x56180220d330 2024-09-13T19:33:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.755+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94661114932752] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.755+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802211510 con 0x7f17c8009040 2024-09-13T19:33:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.755+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.755+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94661114940096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802215390 con 0x7f17c8009040 2024-09-13T19:33:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.755+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802215d50 con 0x561802203fa0 2024-09-13T19:33:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94661114935472] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94661114940096] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94661114941152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802215300 con 0x561802203fa0 2024-09-13T19:33:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802216200 con 0x561802208820 2024-09-13T19:33:53.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94661114941152] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94661114943648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802216170 con 0x561802208820 2024-09-13T19:33:53.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.759+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802216a00 con 0x561802208820 2024-09-13T19:33:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.763+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.763+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94661114945904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618022170b0 con 0x561802208820 2024-09-13T19:33:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.763+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802217a70 con 0x561802208820 2024-09-13T19:33:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.763+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94661114943648] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94661114944704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802217a70 con 0x561802208820 2024-09-13T19:33:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 20 add_watcher() i=0 2024-09-13T19:33:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 20 add_watcher() i=1 2024-09-13T19:33:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 20 add_watcher() i=2 2024-09-13T19:33:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 20 add_watcher() i=3 2024-09-13T19:33:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 20 add_watcher() i=4 2024-09-13T19:33:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 20 add_watcher() i=5 2024-09-13T19:33:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94661114945904] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 20 add_watcher() i=6 2024-09-13T19:33:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94661114944704] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 20 add_watcher() i=7 2024-09-13T19:33:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56180221aaa0 con 0x561802203fa0 2024-09-13T19:33:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.767+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94661114951104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802217f00 con 0x561802203fa0 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94661114951104] v32'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f168e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 5 note: GC not initialized 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f168d7e2640 20 reqs_thread_entry: start 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 Filter name: none 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f15feffd640 20 reqs_thread_entry: start 2024-09-13T19:33:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56180223e500 con 0x7f17c8009040 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 : miss 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 rados->read ofs=0 len=0 2024-09-13T19:33:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.1e 8:785de77d:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56180223ff60 con 0x561802208820 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 info.flags=0x17 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 to cache LRU end 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 get_obj_state: octx=0x7f17cc00f620 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5618022420f8 s->prefetch_data=0 2024-09-13T19:33:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 3.22 3:45aa53a6:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561802243190 con 0x56180220d330 2024-09-13T19:33:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 10 manifest: total_size = 5 2024-09-13T19:33:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.771+0000 7f17da784980 20 get_obj_state: setting s->obj_tag to _KndCQrDSFGWZK5FpyrPZ5obIBhrOFA2 2024-09-13T19:33:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.775+0000 7f168e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.775+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94661114951104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802242bc0 con 0x561802203fa0 2024-09-13T19:33:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.775+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94661114951104] v32'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.775+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94661114928832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802242b90 con 0x7f17c8009040 2024-09-13T19:33:53.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.775+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94661114928832] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.775+0000 7f17da784980 20 remove_watcher() i=0 2024-09-13T19:33:53.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.775+0000 7f17da784980 2 removed watcher, disabling cache 2024-09-13T19:33:53.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.775+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94661114932752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802211ec0 con 0x561802203fa0 2024-09-13T19:33:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.779+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94661114932752] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.779+0000 7f17da784980 20 remove_watcher() i=1 2024-09-13T19:33:53.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.779+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94661114935472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802212e10 con 0x56180220d330 2024-09-13T19:33:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.779+0000 7f17d8294640 1 -- 172.21.15.144:0/2121178619 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94661114935472] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17c80cf370 con 0x56180220d330 2024-09-13T19:33:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.779+0000 7f17da784980 20 remove_watcher() i=2 2024-09-13T19:33:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.779+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94661114940096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802211ec0 con 0x7f17c8009040 2024-09-13T19:33:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.783+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94661114940096] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x7f17c8009040 2024-09-13T19:33:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.783+0000 7f17da784980 20 remove_watcher() i=3 2024-09-13T19:33:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.783+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94661114941152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618022138b0 con 0x561802203fa0 2024-09-13T19:33:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.783+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94661114941152] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17cc02b040 con 0x561802203fa0 2024-09-13T19:33:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.783+0000 7f17da784980 20 remove_watcher() i=4 2024-09-13T19:33:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.783+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94661114943648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802212e10 con 0x561802208820 2024-09-13T19:33:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.787+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94661114943648] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.787+0000 7f17da784980 20 remove_watcher() i=5 2024-09-13T19:33:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.787+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94661114945904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561802211ec0 con 0x561802208820 2024-09-13T19:33:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.787+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94661114945904] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.787+0000 7f17da784980 20 remove_watcher() i=6 2024-09-13T19:33:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.787+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94661114944704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618022138b0 con 0x561802208820 2024-09-13T19:33:53.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17d8a95640 1 -- 172.21.15.144:0/2121178619 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94661114944704] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17d002a070 con 0x561802208820 2024-09-13T19:33:53.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 20 remove_watcher() i=7 2024-09-13T19:33:53.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561802208820 msgr2=0x56180220ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x561802208820 0x56180220ac50 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561802203fa0 msgr2=0x561802206440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x561802203fa0 0x561802206440 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f17c8009040 msgr2=0x7f17c80bc3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f17c8009040 0x7f17c80bc3a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56180220d330 msgr2=0x56180220f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56180220d330 0x56180220f760 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16a8034650 msgr2=0x7f16a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16a8034650 0x7f16a8036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f17c80cf680 tx=0x7f17c80de000 comp rx=0 tx=0).stop 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 msgr2=0x5618021f88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2121178619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021f1540 0x5618021f88d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f17d0047040 tx=0x7f17d0049fe0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 reap_dead start 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17d7a93640 1 -- 172.21.15.144:0/2121178619 reap_dead start 2024-09-13T19:33:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 shutdown_connections 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 >> 172.21.15.144:0/2121178619 conn(0x5618021ed920 msgr2=0x5618021eb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 shutdown_connections 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2121178619 wait complete. 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/972459735 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16b00346a0 msgr2=0x7f16b0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/972459735 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16b00346a0 0x7f16b0036b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5618020d4dd0 tx=0x7f17c80c6db0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/972459735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021e4a60 msgr2=0x5618021e4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/972459735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021e4a60 0x5618021e4e80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x5618020d5480 tx=0x7f17d0018830 comp rx=0 tx=0).stop 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/972459735 shutdown_connections 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/972459735 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16b00346a0 0x7f16b0036b60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/972459735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618021e4a60 0x5618021e4e80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/972459735 >> 172.21.15.144:0/972459735 conn(0x5618021d9bb0 msgr2=0x5618021dc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/972459735 shutdown_connections 2024-09-13T19:33:53.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/972459735 wait complete. 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5618021d3860 msgr2=0x5618021d5c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5618021d3860 0x5618021d5c50 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5618020d8880 msgr2=0x5618021d1110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5618020d8880 0x5618021d1110 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16c0034650 msgr2=0x7f16c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16c0034650 0x7f16c0036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f17cc001e50 tx=0x7f17cc0013b0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 msgr2=0x5618020d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d5c40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f17c801bbe0 tx=0x7f17c80180e0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 shutdown_connections 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5618020d8880 0x5618021d1110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5618021d3860 0x5618021d5c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16c0034650 0x7f16c0036b10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 --2- 172.21.15.144:0/2748488389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561802049b10 0x5618020d5c40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 >> 172.21.15.144:0/2748488389 conn(0x5618020d0070 msgr2=0x5618021bb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 shutdown_connections 2024-09-13T19:33:53.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.791+0000 7f17da784980 1 -- 172.21.15.144:0/2748488389 wait complete. 2024-09-13T19:33:53.806 INFO:teuthology.orchestra.run.smithi144.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T19:33:53.807 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T19:33:53.809 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-13T19:33:53.827 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:53.937 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T19:33:53.937 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T19:33:53.938 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:33:53.938 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T19:33:53.938 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T19:33:53.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T19:33:53.938 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-13T19:33:53.977 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:53.978 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f482280c980 1 Processor -- start 2024-09-13T19:33:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f482280c980 1 -- start start 2024-09-13T19:33:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f482280c980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5644f0d77c70 0x5644f0d7a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f482280c980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5644f0bf9ae0 con 0x5644f0d738f0 2024-09-13T19:33:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f482280c980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5644f0c1de30 con 0x5644f0d77c70 2024-09-13T19:33:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f481fb1b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5644f0d77c70 0x5644f0d7a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f481fb1b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5644f0d77c70 0x5644f0d7a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39794/0 (socket says 172.21.15.144:39794) 2024-09-13T19:33:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f482031c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5644f0d738f0 0x5644f0d73cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:32774/0 (socket says 172.21.15.144:32774) 2024-09-13T19:33:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f481fb1b640 1 -- 172.21.15.144:0/411994875 learned_addr learned my addr 172.21.15.144:0/411994875 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f481fb1b640 1 -- 172.21.15.144:0/411994875 >> v1:172.21.15.18:6789/0 conn(0x5644f0d738f0 legacy=0x5644f0d73cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f481f31a640 1 -- 172.21.15.144:0/411994875 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1542963409 0 0) 0x5644f0bf9ae0 con 0x5644f0d738f0 2024-09-13T19:33:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.975+0000 7f481fb1b640 1 -- 172.21.15.144:0/411994875 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f0d7b5b0 con 0x5644f0d77c70 2024-09-13T19:33:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f481fb1b640 1 --2- 172.21.15.144:0/411994875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d77c70 0x5644f0d7a060 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f480800a5c0 tx=0x7f480801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e17f4f3b5466d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f481f31a640 1 -- 172.21.15.144:0/411994875 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48080a6070 con 0x5644f0d77c70 2024-09-13T19:33:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f481f31a640 1 -- 172.21.15.144:0/411994875 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48080af070 con 0x5644f0d77c70 2024-09-13T19:33:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f481f31a640 1 -- 172.21.15.144:0/411994875 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48080aa5c0 con 0x5644f0d77c70 2024-09-13T19:33:53.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f482280c980 1 -- 172.21.15.144:0/411994875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d77c70 msgr2=0x5644f0d7a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:53.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f482280c980 1 --2- 172.21.15.144:0/411994875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d77c70 0x5644f0d7a060 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f480800a5c0 tx=0x7f480801b340 comp rx=0 tx=0).stop 2024-09-13T19:33:53.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f482280c980 1 -- 172.21.15.144:0/411994875 shutdown_connections 2024-09-13T19:33:53.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f482280c980 1 --2- 172.21.15.144:0/411994875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d77c70 0x5644f0d7a060 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f482280c980 1 -- 172.21.15.144:0/411994875 >> 172.21.15.144:0/411994875 conn(0x5644f0ce7240 msgr2=0x5644f0ce7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f482280c980 1 -- 172.21.15.144:0/411994875 shutdown_connections 2024-09-13T19:33:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.979+0000 7f482280c980 1 -- 172.21.15.144:0/411994875 wait complete. 2024-09-13T19:33:53.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.995+0000 7f482280c980 1 Processor -- start 2024-09-13T19:33:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.995+0000 7f482280c980 1 -- start start 2024-09-13T19:33:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.995+0000 7f482280c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e5ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.995+0000 7f482280c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644f0c1f200 con 0x5644f0d738f0 2024-09-13T19:33:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.995+0000 7f482031c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e5ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.995+0000 7f482031c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e5ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39806/0 (socket says 172.21.15.144:39806) 2024-09-13T19:33:54.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.995+0000 7f482031c640 1 -- 172.21.15.144:0/354614358 learned_addr learned my addr 172.21.15.144:0/354614358 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482031c640 1 -- 172.21.15.144:0/354614358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f0e5f000 con 0x5644f0d738f0 2024-09-13T19:33:54.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482031c640 1 --2- 172.21.15.144:0/354614358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e5ea30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f48100016c0 tx=0x7f4810001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4512fd5aaf5e0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f470e60c640 1 -- 172.21.15.144:0/354614358 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4810003460 con 0x5644f0d738f0 2024-09-13T19:33:54.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f470e60c640 1 -- 172.21.15.144:0/354614358 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4810003600 con 0x5644f0d738f0 2024-09-13T19:33:54.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f470e60c640 1 -- 172.21.15.144:0/354614358 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4810003920 con 0x5644f0d738f0 2024-09-13T19:33:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 -- 172.21.15.144:0/354614358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 msgr2=0x5644f0e5ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 --2- 172.21.15.144:0/354614358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e5ea30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f48100016c0 tx=0x7f4810001b80 comp rx=0 tx=0).stop 2024-09-13T19:33:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 -- 172.21.15.144:0/354614358 shutdown_connections 2024-09-13T19:33:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 --2- 172.21.15.144:0/354614358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e5ea30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 -- 172.21.15.144:0/354614358 >> 172.21.15.144:0/354614358 conn(0x5644f0ce7240 msgr2=0x5644f0e5a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 -- 172.21.15.144:0/354614358 shutdown_connections 2024-09-13T19:33:54.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 -- 172.21.15.144:0/354614358 wait complete. 2024-09-13T19:33:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 Processor -- start 2024-09-13T19:33:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 -- start start 2024-09-13T19:33:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e65e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482280c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644f0d7b0b0 con 0x5644f0d738f0 2024-09-13T19:33:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482031c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e65e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482031c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e65e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39812/0 (socket says 172.21.15.144:39812) 2024-09-13T19:33:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482031c640 1 -- 172.21.15.144:0/1450671679 learned_addr learned my addr 172.21.15.144:0/1450671679 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482031c640 1 -- 172.21.15.144:0/1450671679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f0e66340 con 0x5644f0d738f0 2024-09-13T19:33:54.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:53.999+0000 7f482031c640 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e65e00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f48100012f0 tx=0x7f4810001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f470ce09640 1 -- 172.21.15.144:0/1450671679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4810013760 con 0x5644f0d738f0 2024-09-13T19:33:54.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644f0e665d0 con 0x5644f0d738f0 2024-09-13T19:33:54.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f470ce09640 1 -- 172.21.15.144:0/1450671679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4810023070 con 0x5644f0d738f0 2024-09-13T19:33:54.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f470ce09640 1 -- 172.21.15.144:0/1450671679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4810013a30 con 0x5644f0d738f0 2024-09-13T19:33:54.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f0e692b0 con 0x5644f0d738f0 2024-09-13T19:33:54.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f470ce09640 1 -- 172.21.15.144:0/1450671679 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4810010070 con 0x5644f0d738f0 2024-09-13T19:33:54.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f470ce09640 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47080346a0 0x7f4708036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f470ce09640 1 -- 172.21.15.144:0/1450671679 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4810049b60 con 0x5644f0d738f0 2024-09-13T19:33:54.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f481fb1b640 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47080346a0 0x7f4708036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0d77c70 0x5644f0e6cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0e6d430 con 0x5644f0d77c70 2024-09-13T19:33:54.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f4820b1d640 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0d77c70 0x5644f0e6cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f481fb1b640 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47080346a0 0x7f4708036b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f48080ae000 tx=0x7f48080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f4820b1d640 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0d77c70 0x5644f0e6cdf0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f4820b1d640 1 -- 172.21.15.144:0/1450671679 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48180083f0 con 0x5644f0d77c70 2024-09-13T19:33:54.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0e6a4d0 con 0x5644f0d77c70 2024-09-13T19:33:54.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f4820b1d640 1 -- 172.21.15.144:0/1450671679 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48180083f0 con 0x5644f0d77c70 2024-09-13T19:33:54.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0e6f760 0x5644f0e71b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0e72220 con 0x5644f0e6f760 2024-09-13T19:33:54.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.003+0000 7f482031c640 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0e6f760 0x5644f0e71b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f482031c640 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0e6f760 0x5644f0e71b50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f482031c640 1 -- 172.21.15.144:0/1450671679 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f481000f030 con 0x5644f0e6f760 2024-09-13T19:33:54.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0e6e600 con 0x5644f0d77c70 2024-09-13T19:33:54.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f4820b1d640 1 -- 172.21.15.144:0/1450671679 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48180083f0 con 0x5644f0d77c70 2024-09-13T19:33:54.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0e6eae0 con 0x5644f0d77c70 2024-09-13T19:33:54.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f4820b1d640 1 -- 172.21.15.144:0/1450671679 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48180083f0 con 0x5644f0d77c70 2024-09-13T19:33:54.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f482280c980 1 Processor -- start 2024-09-13T19:33:54.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f482280c980 1 -- start start 2024-09-13T19:33:54.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f482280c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e80900 0x5644f0e80d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f482280c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644f0c78800 con 0x5644f0e80900 2024-09-13T19:33:54.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f4820b1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e80900 0x5644f0e80d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f4820b1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e80900 0x5644f0e80d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39818/0 (socket says 172.21.15.144:39818) 2024-09-13T19:33:54.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f4820b1d640 1 -- 172.21.15.144:0/211197019 learned_addr learned my addr 172.21.15.144:0/211197019 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f4820b1d640 1 -- 172.21.15.144:0/211197019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f0e81260 con 0x5644f0e80900 2024-09-13T19:33:54.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.007+0000 7f4820b1d640 1 --2- 172.21.15.144:0/211197019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e80900 0x5644f0e80d20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x5644f0e6d810 tx=0x7f481800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4705ffb640 1 -- 172.21.15.144:0/211197019 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4818007e00 con 0x5644f0e80900 2024-09-13T19:33:54.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4705ffb640 1 -- 172.21.15.144:0/211197019 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481801e020 con 0x5644f0e80900 2024-09-13T19:33:54.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f482280c980 1 -- 172.21.15.144:0/211197019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644f0e814f0 con 0x5644f0e80900 2024-09-13T19:33:54.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4705ffb640 1 -- 172.21.15.144:0/211197019 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4818019590 con 0x5644f0e80900 2024-09-13T19:33:54.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f482280c980 1 -- 172.21.15.144:0/211197019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f0e84170 con 0x5644f0e80900 2024-09-13T19:33:54.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4705ffb640 1 -- 172.21.15.144:0/211197019 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4818016040 con 0x5644f0e80900 2024-09-13T19:33:54.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4705ffb640 1 --2- 172.21.15.144:0/211197019 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f80346f0 0x7f46f8036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4705ffb640 1 -- 172.21.15.144:0/211197019 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f481801f030 con 0x5644f0e80900 2024-09-13T19:33:54.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f482031c640 1 --2- 172.21.15.144:0/211197019 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f80346f0 0x7f46f8036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f482280c980 1 Processor -- start 2024-09-13T19:33:54.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f482280c980 1 -- start start 2024-09-13T19:33:54.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f482031c640 1 --2- 172.21.15.144:0/211197019 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f80346f0 0x7f46f8036bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5644f0e6d8b0 tx=0x7f4810011ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f482280c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e8d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f482280c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644f0e5f380 con 0x5644f0e8d350 2024-09-13T19:33:54.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4820b1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e8d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4820b1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e8d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39830/0 (socket says 172.21.15.144:39830) 2024-09-13T19:33:54.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4820b1d640 1 -- 172.21.15.144:0/2503347446 learned_addr learned my addr 172.21.15.144:0/2503347446 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4820b1d640 1 -- 172.21.15.144:0/2503347446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f0e8dd00 con 0x5644f0e8d350 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f4820b1d640 1 --2- 172.21.15.144:0/2503347446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e8d730 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f481804a310 tx=0x7f4818019d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dc260ead202ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.011+0000 7f46ff7fe640 1 -- 172.21.15.144:0/2503347446 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481801d040 con 0x5644f0e8d350 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f46ff7fe640 1 -- 172.21.15.144:0/2503347446 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481803bdf0 con 0x5644f0e8d350 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f46ff7fe640 1 -- 172.21.15.144:0/2503347446 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4818015c90 con 0x5644f0e8d350 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- 172.21.15.144:0/2503347446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 msgr2=0x5644f0e8d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 --2- 172.21.15.144:0/2503347446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e8d730 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f481804a310 tx=0x7f4818019d10 comp rx=0 tx=0).stop 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- 172.21.15.144:0/2503347446 shutdown_connections 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 --2- 172.21.15.144:0/2503347446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e8d730 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- 172.21.15.144:0/2503347446 >> 172.21.15.144:0/2503347446 conn(0x5644f0e89730 msgr2=0x5644f0e87830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- 172.21.15.144:0/2503347446 shutdown_connections 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- 172.21.15.144:0/2503347446 wait complete. 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 Processor -- start 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- start start 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e94720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644f0e8e320 con 0x5644f0e8d350 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f4820b1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e94720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f4820b1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e94720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39842/0 (socket says 172.21.15.144:39842) 2024-09-13T19:33:54.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 learned_addr learned my addr 172.21.15.144:0/931320023 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f0e94c60 con 0x5644f0e8d350 2024-09-13T19:33:54.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f4820b1d640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e94720 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4818019d50 tx=0x7f481804a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f46fdffb640 1 -- 172.21.15.144:0/931320023 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481801d040 con 0x5644f0e8d350 2024-09-13T19:33:54.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f46fdffb640 1 -- 172.21.15.144:0/931320023 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48180225d0 con 0x5644f0e8d350 2024-09-13T19:33:54.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644f0e94ef0 con 0x5644f0e8d350 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f46fdffb640 1 -- 172.21.15.144:0/931320023 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48180153e0 con 0x5644f0e8d350 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f0e97bd0 con 0x5644f0e8d350 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.015+0000 7f46fdffb640 1 -- 172.21.15.144:0/931320023 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4818015580 con 0x5644f0e8d350 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f46fdffb640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f0034650 0x7f46f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f46fdffb640 1 -- 172.21.15.144:0/931320023 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4818035030 con 0x5644f0e8d350 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482031c640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f0034650 0x7f46f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0e9fb90 0x5644f0ea2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ea27a0 con 0x5644f0e9fb90 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f481fb1b640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0e9fb90 0x5644f0ea2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482031c640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f0034650 0x7f46f0036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4810048000 tx=0x7f4810033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f481fb1b640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0e9fb90 0x5644f0ea2050 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 realm 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ea2bd0 con 0x5644f0e9fb90 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ea34a0 con 0x5644f0e9fb90 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ea3840 con 0x5644f0e9fb90 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0ea45a0 0x5644f0ea6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ea6fe0 con 0x5644f0ea45a0 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f4820b1d640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0ea45a0 0x5644f0ea6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.019+0000 7f4820b1d640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0ea45a0 0x5644f0ea6990 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482280c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482280c980 20 searching for the correct realm 2024-09-13T19:33:54.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5644f0ea8f30 0x5644f0eab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0ea8f30 2024-09-13T19:33:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482031c640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5644f0ea8f30 0x5644f0eab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482031c640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5644f0ea8f30 0x5644f0eab340 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482031c640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f481003f040 0x7f481001d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x7f481003f040 2024-09-13T19:33:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f481003f040 0x7f481001d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f481003f040 0x7f481001d590 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0ea45a0 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0e9fb90 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0e9fb90 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0e9fb90 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.023+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0ea45a0 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x7f481003f040 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0ea8f30 2024-09-13T19:33:54.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0e9fb90 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0ea45a0 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0e9fb90 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x7f481003f040 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0ea8f30 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaba10 con 0x5644f0ea8f30 2024-09-13T19:33:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea45a0 2024-09-13T19:33:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.027+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea8f30 2024-09-13T19:33:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea8f30 2024-09-13T19:33:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0e9fb90 2024-09-13T19:33:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0e9fb90 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea45a0 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea8f30 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x7f481003f040 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0e9fb90 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea45a0 2024-09-13T19:33:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea8f30 2024-09-13T19:33:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.031+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea45a0 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x7f481003f040 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea8f30 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0ea45a0 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x5644f0e9fb90 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4810061040 con 0x7f481003f040 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ea79a0 con 0x5644f0e9fb90 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ea8240 con 0x5644f0e9fb90 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ea75e0 con 0x5644f0e9fb90 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 zone default found 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 4 Realm: () 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 zonegroup default 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.035+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eabe90 con 0x5644f0ea45a0 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eadc10 con 0x5644f0ea8f30 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eae0d0 con 0x5644f0ea8f30 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 20 started sync module instance, tier type = 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:54.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ead0b0 con 0x7f481003f040 2024-09-13T19:33:54.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94854099686864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ead0b0 con 0x7f481003f040 2024-09-13T19:33:54.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaeb90 con 0x5644f0e9fb90 2024-09-13T19:33:54.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.039+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94854099686864] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.043+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.043+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94854099691168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ead0b0 con 0x5644f0e9fb90 2024-09-13T19:33:54.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.043+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaf5a0 con 0x5644f0ea8f30 2024-09-13T19:33:54.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.043+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94854099691168] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.043+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.043+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94854099684352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ead020 con 0x5644f0ea8f30 2024-09-13T19:33:54.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.043+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb02a0 con 0x7f481003f040 2024-09-13T19:33:54.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.047+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.047+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94854099697136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb06c0 con 0x7f481003f040 2024-09-13T19:33:54.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.047+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb10e0 con 0x5644f0e9fb90 2024-09-13T19:33:54.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.047+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94854099684352] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.047+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94854099697136] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.047+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.047+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94854099700688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb0210 con 0x5644f0e9fb90 2024-09-13T19:33:54.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.047+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb1980 con 0x5644f0ea45a0 2024-09-13T19:33:54.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.051+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94854099700688] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.051+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.051+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94854099702992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb0210 con 0x5644f0ea45a0 2024-09-13T19:33:54.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.051+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb21d0 con 0x5644f0ea45a0 2024-09-13T19:33:54.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.051+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.051+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94854099705120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb2140 con 0x5644f0ea45a0 2024-09-13T19:33:54.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.051+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb31c0 con 0x5644f0ea45a0 2024-09-13T19:33:54.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.051+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94854099702992] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94854099705120] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94854099707328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eaf940 con 0x5644f0ea45a0 2024-09-13T19:33:54.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 20 add_watcher() i=0 2024-09-13T19:33:54.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 20 add_watcher() i=1 2024-09-13T19:33:54.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 20 add_watcher() i=2 2024-09-13T19:33:54.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 20 add_watcher() i=3 2024-09-13T19:33:54.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 20 add_watcher() i=4 2024-09-13T19:33:54.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 20 add_watcher() i=5 2024-09-13T19:33:54.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 20 add_watcher() i=6 2024-09-13T19:33:54.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94854099707328] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 20 add_watcher() i=7 2024-09-13T19:33:54.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:54.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.055+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb61b0 con 0x5644f0e9fb90 2024-09-13T19:33:54.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.059+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.059+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94854099709072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb3630 con 0x5644f0e9fb90 2024-09-13T19:33:54.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.059+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94854099709072] v32'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.059+0000 7f46d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:54.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.059+0000 7f482280c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:54.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.059+0000 7f482280c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:54.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.059+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebe980 con 0x5644f0e9fb90 2024-09-13T19:33:54.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.063+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.063+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebf050 con 0x5644f0ea45a0 2024-09-13T19:33:54.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.063+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.063+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebf050 con 0x5644f0ea8f30 2024-09-13T19:33:54.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.063+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.063+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebf640 con 0x5644f0e9fb90 2024-09-13T19:33:54.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.067+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'183 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.067+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebfaf0 con 0x7f481003f040 2024-09-13T19:33:54.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.067+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.067+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebc940 con 0x5644f0ea8f30 2024-09-13T19:33:54.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.067+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.067+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebca50 con 0x5644f0e9fb90 2024-09-13T19:33:54.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.071+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.071+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebcb40 con 0x5644f0ea45a0 2024-09-13T19:33:54.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.071+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.071+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x7f481003f040 2024-09-13T19:33:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.075+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.075+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea8f30 2024-09-13T19:33:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.075+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.075+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x7f481003f040 2024-09-13T19:33:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.079+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'63 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.079+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea45a0 2024-09-13T19:33:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.079+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.079+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x7f481003f040 2024-09-13T19:33:54.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.083+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.083+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea45a0 2024-09-13T19:33:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.083+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.083+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0e9fb90 2024-09-13T19:33:54.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.087+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'184 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.087+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea8f30 2024-09-13T19:33:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.087+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.087+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x7f481003f040 2024-09-13T19:33:54.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.087+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'64 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.087+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea8f30 2024-09-13T19:33:54.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.091+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.091+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0e9fb90 2024-09-13T19:33:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.091+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.091+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0e9fb90 2024-09-13T19:33:54.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.095+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'185 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.095+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea8f30 2024-09-13T19:33:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.095+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.095+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x7f481003f040 2024-09-13T19:33:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.095+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.095+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea8f30 2024-09-13T19:33:54.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.099+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.099+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea8f30 2024-09-13T19:33:54.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.099+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.099+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea8f30 2024-09-13T19:33:54.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.099+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.099+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea8f30 2024-09-13T19:33:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.103+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.103+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0650 con 0x5644f0ea45a0 2024-09-13T19:33:54.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.103+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.103+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0820 con 0x5644f0ea8f30 2024-09-13T19:33:54.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.107+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.107+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0820 con 0x5644f0ea45a0 2024-09-13T19:33:54.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.107+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.107+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0820 con 0x5644f0ea8f30 2024-09-13T19:33:54.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.111+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.111+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0820 con 0x5644f0ea45a0 2024-09-13T19:33:54.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ec0820 con 0x7f481003f040 2024-09-13T19:33:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f46d57e2640 20 reqs_thread_entry: start 2024-09-13T19:33:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 20 Filter name: none 2024-09-13T19:33:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f4646ffd640 20 reqs_thread_entry: start 2024-09-13T19:33:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:33:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ebc290 con 0x7f481003f040 2024-09-13T19:33:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:33:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:33:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:33:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 : miss 2024-09-13T19:33:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.115+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:95 8.1e 8:785de77d:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edd350 con 0x5644f0ea45a0 2024-09-13T19:33:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(95 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:33:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 info.flags=0x17 2024-09-13T19:33:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 to cache LRU end 2024-09-13T19:33:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:33:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 2024-09-13T19:33:54.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:96 4.29 4:95d4db07:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5a850 con 0x5644f0ea8f30 2024-09-13T19:33:54.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(96 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:97 4.31 4:8c881980:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5a850 con 0x5644f0e9fb90 2024-09-13T19:33:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(97 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:98 4.3b 4:dc2ced1f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5a850 con 0x5644f0ea8f30 2024-09-13T19:33:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(98 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-13T19:33:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:99 4.1a 4:5b0e4ece:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5a880 con 0x7f481003f040 2024-09-13T19:33:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(99 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:100 4.0 4:010e619f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5a880 con 0x5644f0ea8f30 2024-09-13T19:33:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(100 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.119+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:101 4.30 4:0ea2f259:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5ae80 con 0x5644f0ea8f30 2024-09-13T19:33:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(101 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:102 4.36 4:6d49c457:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5ae80 con 0x5644f0e9fb90 2024-09-13T19:33:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(102 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-13T19:33:54.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:103 4.3a 4:5e3c66b3:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5ae80 con 0x5644f0ea8f30 2024-09-13T19:33:54.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(103 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:104 4.2f 4:f64db92d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5ae80 con 0x5644f0e9fb90 2024-09-13T19:33:54.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(104 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T19:33:54.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:105 4.13 4:cbad9ac4:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5ae80 con 0x7f481003f040 2024-09-13T19:33:54.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(105 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:106 4.4 4:20f1ae23:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f5ae80 con 0x5644f0ea45a0 2024-09-13T19:33:54.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(106 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 [call out=697b] v0'0 uv9 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-13T19:33:54.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:33:54.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:107 3.9 3:9194fe39:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f58390 con 0x5644f0ea8f30 2024-09-13T19:33:54.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.123+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== osd_op_reply(107 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 10 manifest: total_size = 6 2024-09-13T19:33:54.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 20 get_obj_state: setting s->obj_tag to c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10479133829683381199 2024-09-13T19:33:54.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 20 prepare_atomic_modification: state is not atomic. state=0x5644f0eddbf8 2024-09-13T19:33:54.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2 2024-09-13T19:33:54.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:108 4.3b 4:dc2ced1f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee26b0 con 0x5644f0ea8f30 2024-09-13T19:33:54.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(108 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:109 3.9 3:9194fe39:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee26b0 con 0x5644f0ea8f30 2024-09-13T19:33:54.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 33 ==== osd_op_reply(109 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:110 4.3b 4:dc2ced1f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3140 con 0x5644f0ea8f30 2024-09-13T19:33:54.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.127+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:111 3.18 3:1b70206e:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3140 con 0x5644f0ea8f30 2024-09-13T19:33:54.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 34 ==== osd_op_reply(111 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 10 manifest: total_size = 3 2024-09-13T19:33:54.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 get_obj_state: setting s->obj_tag to c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.15823229361632287405 2024-09-13T19:33:54.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 prepare_atomic_modification: state is not atomic. state=0x5644f0eddbf8 2024-09-13T19:33:54.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6 2024-09-13T19:33:54.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:112 4.36 4:6d49c457:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3140 con 0x5644f0e9fb90 2024-09-13T19:33:54.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(112 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:113 3.18 3:1b70206e:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3140 con 0x5644f0ea8f30 2024-09-13T19:33:54.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 35 ==== osd_op_reply(110 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f46ff7fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 36 ==== osd_op_reply(113 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:114 4.36 4:6d49c457:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3d90 con 0x5644f0e9fb90 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:115 3.17 3:e8bc9490:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee48d0 con 0x5644f0e9fb90 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(115 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 10 manifest: total_size = 4 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 get_obj_state: setting s->obj_tag to c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.8823419905330839656 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 prepare_atomic_modification: state is not atomic. state=0x5644f0eddbf8 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8 2024-09-13T19:33:54.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.131+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:116 4.2f 4:f64db92d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3d90 con 0x5644f0e9fb90 2024-09-13T19:33:54.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.135+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(114 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.135+0000 7f46feffd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-13T19:33:54.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.135+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(116 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.135+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:117 3.17 3:e8bc9490:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee48d0 con 0x5644f0e9fb90 2024-09-13T19:33:54.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.135+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(117 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.135+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:118 4.2f 4:f64db92d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3d90 con 0x5644f0e9fb90 2024-09-13T19:33:54.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.135+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.135+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:119 3.22 3:45caebc2:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3d90 con 0x5644f0ea8f30 2024-09-13T19:33:54.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 37 ==== osd_op_reply(119 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f482280c980 10 manifest: total_size = 5 2024-09-13T19:33:54.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f482280c980 20 get_obj_state: setting s->obj_tag to c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.8812491436587384391 2024-09-13T19:33:54.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f482280c980 20 prepare_atomic_modification: state is not atomic. state=0x5644f0eddbf8 2024-09-13T19:33:54.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f482280c980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 2024-09-13T19:33:54.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:120 4.4 4:20f1ae23:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3d90 con 0x5644f0ea45a0 2024-09-13T19:33:54.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 37 ==== osd_op_reply(118 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f46ff7fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T19:33:54.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(120 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.139+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:121 3.22 3:45caebc2:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee38e0 con 0x5644f0ea8f30 2024-09-13T19:33:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 38 ==== osd_op_reply(121 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'5 uv5 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:122 4.4 4:20f1ae23:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee3d90 con 0x5644f0ea45a0 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:123 3.22 3:45aa53a6:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edef40 con 0x5644f0ea8f30 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 39 ==== osd_op_reply(123 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 10 manifest: total_size = 5 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 20 get_obj_state: setting s->obj_tag to _KndCQrDSFGWZK5FpyrPZ5obIBhrOFA2 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 20 get_obj_state: octx=0x7f48080aa9b0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5644f0eddbf8 s->prefetch_data=0 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 20 prepare_atomic_modification: state is not atomic. state=0x5644f0eddbf8 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 2024-09-13T19:33:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:124 4.4 4:20f1ae23:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee1f70 con 0x5644f0ea45a0 2024-09-13T19:33:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(122 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.143+0000 7f46feffd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-13T19:33:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(124 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:125 3.22 3:45aa53a6:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee5ce0 con 0x5644f0ea8f30 2024-09-13T19:33:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 40 ==== osd_op_reply(125 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:126 4.4 4:20f1ae23:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edef40 con 0x5644f0ea45a0 2024-09-13T19:33:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 20 list_objects_ordered: starting attempt 1 2024-09-13T19:33:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:127 4.29 4:95d4db07:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edef40 con 0x5644f0ea8f30 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:128 4.31 4:8c881980:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eddec0 con 0x5644f0e9fb90 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:129 4.3b 4:dc2ced1f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ee1ba0 con 0x5644f0ea8f30 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:130 4.1a 4:5b0e4ece:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edef40 con 0x7f481003f040 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:131 4.0 4:010e619f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eddec0 con 0x5644f0ea8f30 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:132 4.30 4:0ea2f259:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edef40 con 0x5644f0ea8f30 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:133 4.36 4:6d49c457:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ef6db0 con 0x5644f0e9fb90 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:134 4.3a 4:5e3c66b3:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edef40 con 0x5644f0ea8f30 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:135 4.2f 4:f64db92d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efbc60 con 0x5644f0e9fb90 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:136 4.13 4:cbad9ac4:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efbce0 con 0x7f481003f040 2024-09-13T19:33:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:137 4.4 4:20f1ae23:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x5644f0ea45a0 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 38 ==== osd_op_reply(128 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 39 ==== osd_op_reply(133 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 40 ==== osd_op_reply(135 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 41 ==== osd_op_reply(127 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(130 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(136 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 42 ==== osd_op_reply(129 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 43 ==== osd_op_reply(131 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 44 ==== osd_op_reply(132 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.147+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 45 ==== osd_op_reply(134 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(126 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f46feffd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(137 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5])"; uploads.size()=0; is_truncated=0 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:138 4.29 4:95d4db07:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efbc60 con 0x5644f0ea8f30 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:139 4.31 4:8c881980:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x5644f0e9fb90 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:140 4.3b 4:dc2ced1f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ef6760 con 0x5644f0ea8f30 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:141 4.1a 4:5b0e4ece:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f00870 con 0x7f481003f040 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:142 4.0 4:010e619f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f00ca0 con 0x5644f0ea8f30 2024-09-13T19:33:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:143 4.30 4:0ea2f259:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efbc60 con 0x5644f0ea8f30 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:144 4.36 4:6d49c457:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0ef6760 con 0x5644f0e9fb90 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:145 4.3a 4:5e3c66b3:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f00ca0 con 0x5644f0ea8f30 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:146 4.2f 4:f64db92d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efbc60 con 0x5644f0e9fb90 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:147 4.13 4:cbad9ac4:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f00ca0 con 0x7f481003f040 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:148 4.4 4:20f1ae23:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f00870 con 0x5644f0ea45a0 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(141 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 41 ==== osd_op_reply(144 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(147 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 46 ==== osd_op_reply(138 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 47 ==== osd_op_reply(140 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 48 ==== osd_op_reply(142 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 42 ==== osd_op_reply(139 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 49 ==== osd_op_reply(145 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 43 ==== osd_op_reply(146 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== osd_op_reply(148 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 50 ==== osd_op_reply(143 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.151+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efbc60 con 0x7f481003f040 2024-09-13T19:33:54.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f482280c980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-13T19:33:54.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efbc60 con 0x7f481003f040 2024-09-13T19:33:54.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== osd_op_reply(150 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f482280c980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:33:54.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f482280c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:33:54.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94854099901856 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x5644f0ea45a0 2024-09-13T19:33:54.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== watch-notify(notify (1) cookie 94854099705120 notify 137438953486 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5644f0ebbd10 con 0x5644f0ea45a0 2024-09-13T19:33:54.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(151 notify.6 [notify cookie 94854099901856 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f46ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94854099705120 notifier 4643 bl.length()=149 2024-09-13T19:33:54.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.155+0000 7f46ff7fe640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f46e4003d70 con 0x5644f0ea45a0 2024-09-13T19:33:54.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.159+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.159+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== watch-notify(notify_complete (2) cookie 94854099901856 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5644f0e94c60 con 0x5644f0ea45a0 2024-09-13T19:33:54.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.159+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:153 8.1e 8:785de77d:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x5644f0ea45a0 2024-09-13T19:33:54.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.159+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== osd_op_reply(153 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.159+0000 7f482280c980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 from cache 2024-09-13T19:33:54.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.159+0000 7f482280c980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5, ofs0, ns] 2024-09-13T19:33:54.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.159+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94854099888784 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x7f481003f040 2024-09-13T19:33:54.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== watch-notify(notify (1) cookie 94854099686864 notify 137438953503 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5644f0ebe600 con 0x7f481003f040 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f46ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94854099686864 notifier 4643 bl.length()=206 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(154 notify.0 [notify cookie 94854099888784 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f46ff7fe640 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f46e4003d70 con 0x7f481003f040 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== watch-notify(notify_complete (2) cookie 94854099888784 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5644f0ebe3a0 con 0x7f481003f040 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:156 4.29 4:95d4db07:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x5644f0ea8f30 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:157 4.31 4:8c881980:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f58730 con 0x5644f0e9fb90 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:158 4.3b 4:dc2ced1f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edd050 con 0x5644f0ea8f30 2024-09-13T19:33:54.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:159 4.1a 4:5b0e4ece:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x7f481003f040 2024-09-13T19:33:54.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:160 4.0 4:010e619f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edd050 con 0x5644f0ea8f30 2024-09-13T19:33:54.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:161 4.30 4:0ea2f259:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x5644f0ea8f30 2024-09-13T19:33:54.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:162 4.36 4:6d49c457:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efe720 con 0x5644f0e9fb90 2024-09-13T19:33:54.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:163 4.3a 4:5e3c66b3:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edd050 con 0x5644f0ea8f30 2024-09-13T19:33:54.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:164 4.2f 4:f64db92d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x5644f0e9fb90 2024-09-13T19:33:54.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:165 4.13 4:cbad9ac4:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0efe720 con 0x7f481003f040 2024-09-13T19:33:54.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:166 4.4 4:20f1ae23:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0f01080 con 0x5644f0ea45a0 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 44 ==== osd_op_reply(157 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.1 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== osd_op_reply(159 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.3 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.163+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 45 ==== osd_op_reply(164 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 51 ==== osd_op_reply(160 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.4 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 52 ==== osd_op_reply(156 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.0 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 46 ==== osd_op_reply(162 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.6 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 53 ==== osd_op_reply(161 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.5 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 54 ==== osd_op_reply(158 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.2 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 55 ==== osd_op_reply(163 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(165 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.9 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(166 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5.10 [delete] v32'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482280c980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 : miss 2024-09-13T19:33:54.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482280c980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:167 6.9 6:965c49b8:::pubsub..bucket.myfoo%2fc35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edd050 con 0x5644f0ea8f30 2024-09-13T19:33:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 56 ==== osd_op_reply(167 pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482280c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482280c980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 info.flags=0x0 2024-09-13T19:33:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482280c980 10 adding default.rgw.log++pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 to cache LRU end 2024-09-13T19:33:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:168 6.9 6:965c49b8:::pubsub..bucket.myfoo%2fc35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edd050 con 0x5644f0ea8f30 2024-09-13T19:33:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 57 ==== osd_op_reply(168 pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.5 [delete] v32'43 uv36 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.167+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edd050 con 0x7f481003f040 2024-09-13T19:33:54.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.171+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== osd_op_reply(169 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.171+0000 7f46d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:54.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.171+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94854099709072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0edcfd0 con 0x5644f0e9fb90 2024-09-13T19:33:54.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 47 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94854099709072] v32'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94854099686864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb2c90 con 0x7f481003f040 2024-09-13T19:33:54.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 34 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94854099686864] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f482280c980 20 remove_watcher() i=0 2024-09-13T19:33:54.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f482280c980 2 removed watcher, disabling cache 2024-09-13T19:33:54.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94854099691168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb2c90 con 0x5644f0e9fb90 2024-09-13T19:33:54.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 48 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94854099691168] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f482280c980 20 remove_watcher() i=1 2024-09-13T19:33:54.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.175+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94854099684352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eae6a0 con 0x5644f0ea8f30 2024-09-13T19:33:54.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.179+0000 7f482031c640 1 -- 172.21.15.144:0/931320023 <== osd.3 v2:172.21.15.144:6800/1157716661 58 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94854099684352] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481003c070 con 0x5644f0ea8f30 2024-09-13T19:33:54.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.179+0000 7f482280c980 20 remove_watcher() i=2 2024-09-13T19:33:54.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.179+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94854099697136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eae6a0 con 0x7f481003f040 2024-09-13T19:33:54.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.183+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.2 v2:172.21.15.144:6816/2341760841 35 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94854099697136] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x7f481003f040 2024-09-13T19:33:54.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.183+0000 7f482280c980 20 remove_watcher() i=3 2024-09-13T19:33:54.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.183+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94854099700688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eae6a0 con 0x5644f0e9fb90 2024-09-13T19:33:54.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.183+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 <== osd.1 v2:172.21.15.144:6808/3556169889 49 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94854099700688] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48080aaa30 con 0x5644f0e9fb90 2024-09-13T19:33:54.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.183+0000 7f482280c980 20 remove_watcher() i=4 2024-09-13T19:33:54.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.183+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94854099702992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb0bd0 con 0x5644f0ea45a0 2024-09-13T19:33:54.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.187+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94854099702992] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.187+0000 7f482280c980 20 remove_watcher() i=5 2024-09-13T19:33:54.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.187+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94854099705120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eae6a0 con 0x5644f0ea45a0 2024-09-13T19:33:54.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.187+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94854099705120] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.187+0000 7f482280c980 20 remove_watcher() i=6 2024-09-13T19:33:54.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.187+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94854099707328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644f0eb14d0 con 0x5644f0ea45a0 2024-09-13T19:33:54.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f4820b1d640 1 -- 172.21.15.144:0/931320023 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94854099707328] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4818052070 con 0x5644f0ea45a0 2024-09-13T19:33:54.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 20 remove_watcher() i=7 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0ea45a0 msgr2=0x5644f0ea6990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0ea45a0 0x5644f0ea6990 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0e9fb90 msgr2=0x5644f0ea2050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0e9fb90 0x5644f0ea2050 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f481003f040 msgr2=0x7f481001d590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f481003f040 0x7f481001d590 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5644f0ea8f30 msgr2=0x5644f0eab340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5644f0ea8f30 0x5644f0eab340 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f0034650 msgr2=0x7f46f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f0034650 0x7f46f0036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4810048000 tx=0x7f4810033000 comp rx=0 tx=0).stop 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 msgr2=0x5644f0e94720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f481fb1b640 1 -- 172.21.15.144:0/931320023 reap_dead start 2024-09-13T19:33:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e94720 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4818019d50 tx=0x7f481804a2a0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 shutdown_connections 2024-09-13T19:33:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/931320023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e8d350 0x5644f0e94720 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 >> 172.21.15.144:0/931320023 conn(0x5644f0e89730 msgr2=0x5644f0e87800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 shutdown_connections 2024-09-13T19:33:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/931320023 wait complete. 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/211197019 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f80346f0 msgr2=0x7f46f8036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/211197019 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f80346f0 0x7f46f8036bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5644f0e6d8b0 tx=0x7f4810011ec0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/211197019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e80900 msgr2=0x5644f0e80d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/211197019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e80900 0x5644f0e80d20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x5644f0e6d810 tx=0x7f481800af40 comp rx=0 tx=0).stop 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/211197019 shutdown_connections 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/211197019 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f46f80346f0 0x7f46f8036bb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/211197019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0e80900 0x5644f0e80d20 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/211197019 >> 172.21.15.144:0/211197019 conn(0x5644f0e75a50 msgr2=0x5644f0e784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/211197019 shutdown_connections 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/211197019 wait complete. 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0e6f760 msgr2=0x5644f0e71b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0e6f760 0x5644f0e71b50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0d77c70 msgr2=0x5644f0e6cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0d77c70 0x5644f0e6cdf0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47080346a0 msgr2=0x7f4708036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47080346a0 0x7f4708036b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f48080ae000 tx=0x7f48080a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 msgr2=0x5644f0e65e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e65e00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f48100012f0 tx=0x7f4810001260 comp rx=0 tx=0).stop 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 shutdown_connections 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5644f0d77c70 0x5644f0e6cdf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5644f0e6f760 0x5644f0e71b50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47080346a0 0x7f4708036b60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 --2- 172.21.15.144:0/1450671679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f0d738f0 0x5644f0e65e00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 >> 172.21.15.144:0/1450671679 conn(0x5644f0ce7240 msgr2=0x5644f0e591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 shutdown_connections 2024-09-13T19:33:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.191+0000 7f482280c980 1 -- 172.21.15.144:0/1450671679 wait complete. 2024-09-13T19:33:54.209 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:33:54.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:33:54.209 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-13T19:33:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:54.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefce52980 1 Processor -- start 2024-09-13T19:33:54.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefce52980 1 -- start start 2024-09-13T19:33:54.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefce52980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e83acd1a20 0x55e83acd3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefce52980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e83ab55ae0 con 0x55e83accd6a0 2024-09-13T19:33:54.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefce52980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55e83ab79e30 con 0x55e83acd1a20 2024-09-13T19:33:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefa161640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e83acd1a20 0x55e83acd3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefa161640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55e83acd1a20 0x55e83acd3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39856/0 (socket says 172.21.15.144:39856) 2024-09-13T19:33:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefa962640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55e83accd6a0 0x55e83accda80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:32780/0 (socket says 172.21.15.144:32780) 2024-09-13T19:33:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefa161640 1 -- 172.21.15.144:0/605875545 learned_addr learned my addr 172.21.15.144:0/605875545 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefa161640 1 -- 172.21.15.144:0/605875545 >> v1:172.21.15.18:6789/0 conn(0x55e83accd6a0 legacy=0x55e83accda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.291+0000 7faefa161640 1 -- 172.21.15.144:0/605875545 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83acd5360 con 0x55e83acd1a20 2024-09-13T19:33:54.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faefa161640 1 --2- 172.21.15.144:0/605875545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83acd1a20 0x55e83acd3e10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faee400a5c0 tx=0x7faee401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf03b20e1b555a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faef9960640 1 -- 172.21.15.144:0/605875545 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee40a6070 con 0x55e83acd1a20 2024-09-13T19:33:54.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faef9960640 1 -- 172.21.15.144:0/605875545 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee40af070 con 0x55e83acd1a20 2024-09-13T19:33:54.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faef9960640 1 -- 172.21.15.144:0/605875545 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faee40aa5c0 con 0x55e83acd1a20 2024-09-13T19:33:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faefce52980 1 -- 172.21.15.144:0/605875545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83acd1a20 msgr2=0x55e83acd3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faefce52980 1 --2- 172.21.15.144:0/605875545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83acd1a20 0x55e83acd3e10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faee400a5c0 tx=0x7faee401b340 comp rx=0 tx=0).stop 2024-09-13T19:33:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faefce52980 1 -- 172.21.15.144:0/605875545 shutdown_connections 2024-09-13T19:33:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faefce52980 1 --2- 172.21.15.144:0/605875545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83acd1a20 0x55e83acd3e10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faefce52980 1 -- 172.21.15.144:0/605875545 >> 172.21.15.144:0/605875545 conn(0x55e83acc91c0 msgr2=0x55e83accb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faefce52980 1 -- 172.21.15.144:0/605875545 shutdown_connections 2024-09-13T19:33:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.295+0000 7faefce52980 1 -- 172.21.15.144:0/605875545 wait complete. 2024-09-13T19:33:54.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefce52980 1 Processor -- start 2024-09-13T19:33:54.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefce52980 1 -- start start 2024-09-13T19:33:54.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefce52980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adb8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefce52980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e83ab7b200 con 0x55e83accd6a0 2024-09-13T19:33:54.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefa962640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adb8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefa962640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adb8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39864/0 (socket says 172.21.15.144:39864) 2024-09-13T19:33:54.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefa962640 1 -- 172.21.15.144:0/4008280577 learned_addr learned my addr 172.21.15.144:0/4008280577 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefa962640 1 -- 172.21.15.144:0/4008280577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83adb9000 con 0x55e83accd6a0 2024-09-13T19:33:54.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefa962640 1 --2- 172.21.15.144:0/4008280577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adb8a30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faeec001690 tx=0x7faeec001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309150a3e645f086 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7fade8e09640 1 -- 172.21.15.144:0/4008280577 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec003460 con 0x55e83accd6a0 2024-09-13T19:33:54.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7fade8e09640 1 -- 172.21.15.144:0/4008280577 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec003600 con 0x55e83accd6a0 2024-09-13T19:33:54.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7fade8e09640 1 -- 172.21.15.144:0/4008280577 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec003920 con 0x55e83accd6a0 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefce52980 1 -- 172.21.15.144:0/4008280577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 msgr2=0x55e83adb8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefce52980 1 --2- 172.21.15.144:0/4008280577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adb8a30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faeec001690 tx=0x7faeec001b50 comp rx=0 tx=0).stop 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefce52980 1 -- 172.21.15.144:0/4008280577 shutdown_connections 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.311+0000 7faefce52980 1 --2- 172.21.15.144:0/4008280577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adb8a30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 -- 172.21.15.144:0/4008280577 >> 172.21.15.144:0/4008280577 conn(0x55e83acc91c0 msgr2=0x55e83adb4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 -- 172.21.15.144:0/4008280577 shutdown_connections 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 -- 172.21.15.144:0/4008280577 wait complete. 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 Processor -- start 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 -- start start 2024-09-13T19:33:54.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adbfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e83acd4e60 con 0x55e83accd6a0 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefa962640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adbfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefa962640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adbfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39874/0 (socket says 172.21.15.144:39874) 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefa962640 1 -- 172.21.15.144:0/1738940784 learned_addr learned my addr 172.21.15.144:0/1738940784 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefa962640 1 -- 172.21.15.144:0/1738940784 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83adc0230 con 0x55e83accd6a0 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefa962640 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adbfcf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7faeec001360 tx=0x7faeec001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7fade7606640 1 -- 172.21.15.144:0/1738940784 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec022020 con 0x55e83accd6a0 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e83adc04c0 con 0x55e83accd6a0 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7fade7606640 1 -- 172.21.15.144:0/1738940784 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec006840 con 0x55e83accd6a0 2024-09-13T19:33:54.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7fade7606640 1 -- 172.21.15.144:0/1738940784 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec01e7c0 con 0x55e83accd6a0 2024-09-13T19:33:54.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e83adc31a0 con 0x55e83accd6a0 2024-09-13T19:33:54.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7fade7606640 1 -- 172.21.15.144:0/1738940784 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faeec025020 con 0x55e83accd6a0 2024-09-13T19:33:54.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7fade7606640 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fade0034600 0x7fade0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.315+0000 7fade7606640 1 -- 172.21.15.144:0/1738940784 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faeec049b40 con 0x55e83accd6a0 2024-09-13T19:33:54.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefa161640 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fade0034600 0x7fade0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83acd1a20 0x55e83adc6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adc7370 con 0x55e83acd1a20 2024-09-13T19:33:54.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefb163640 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83acd1a20 0x55e83adc6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefb163640 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83acd1a20 0x55e83adc6df0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefa161640 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fade0034600 0x7fade0036ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faee40ae000 tx=0x7faee40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefb163640 1 -- 172.21.15.144:0/1738940784 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faef40083f0 con 0x55e83acd1a20 2024-09-13T19:33:54.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adc43c0 con 0x55e83acd1a20 2024-09-13T19:33:54.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefb163640 1 -- 172.21.15.144:0/1738940784 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faef40083f0 con 0x55e83acd1a20 2024-09-13T19:33:54.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83adc96a0 0x55e83adcba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adcc160 con 0x55e83adc96a0 2024-09-13T19:33:54.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefa962640 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83adc96a0 0x55e83adcba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefa962640 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83adc96a0 0x55e83adcba90 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefa962640 1 -- 172.21.15.144:0/1738940784 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faeec01b040 con 0x55e83adc96a0 2024-09-13T19:33:54.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adc8540 con 0x55e83acd1a20 2024-09-13T19:33:54.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefb163640 1 -- 172.21.15.144:0/1738940784 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faef40083f0 con 0x55e83acd1a20 2024-09-13T19:33:54.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.319+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adc8a20 con 0x55e83acd1a20 2024-09-13T19:33:54.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefb163640 1 -- 172.21.15.144:0/1738940784 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faef40083f0 con 0x55e83acd1a20 2024-09-13T19:33:54.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefce52980 1 Processor -- start 2024-09-13T19:33:54.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefce52980 1 -- start start 2024-09-13T19:33:54.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefce52980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ac445a0 0x55e83ac42c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefce52980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e83abd4800 con 0x55e83ac445a0 2024-09-13T19:33:54.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefb163640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ac445a0 0x55e83ac42c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefb163640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ac445a0 0x55e83ac42c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39882/0 (socket says 172.21.15.144:39882) 2024-09-13T19:33:54.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefb163640 1 -- 172.21.15.144:0/1801248618 learned_addr learned my addr 172.21.15.144:0/1801248618 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefb163640 1 -- 172.21.15.144:0/1801248618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83ac449c0 con 0x55e83ac445a0 2024-09-13T19:33:54.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefb163640 1 --2- 172.21.15.144:0/1801248618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ac445a0 0x55e83ac42c20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55e83adc0f40 tx=0x7faef400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7fade4e01640 1 -- 172.21.15.144:0/1801248618 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4007dd0 con 0x55e83ac445a0 2024-09-13T19:33:54.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7fade4e01640 1 -- 172.21.15.144:0/1801248618 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef401e020 con 0x55e83ac445a0 2024-09-13T19:33:54.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefce52980 1 -- 172.21.15.144:0/1801248618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e83ac431c0 con 0x55e83ac445a0 2024-09-13T19:33:54.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7fade4e01640 1 -- 172.21.15.144:0/1801248618 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4019590 con 0x55e83ac445a0 2024-09-13T19:33:54.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefce52980 1 -- 172.21.15.144:0/1801248618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e83ac43690 con 0x55e83ac445a0 2024-09-13T19:33:54.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7fade4e01640 1 -- 172.21.15.144:0/1801248618 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faef4016040 con 0x55e83ac445a0 2024-09-13T19:33:54.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7fade4e01640 1 --2- 172.21.15.144:0/1801248618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadd40346a0 0x7fadd4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7fade4e01640 1 -- 172.21.15.144:0/1801248618 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faef401f030 con 0x55e83ac445a0 2024-09-13T19:33:54.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.323+0000 7faefa962640 1 --2- 172.21.15.144:0/1801248618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadd40346a0 0x7fadd4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 Processor -- start 2024-09-13T19:33:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- start start 2024-09-13T19:33:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefa962640 1 --2- 172.21.15.144:0/1801248618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadd40346a0 0x7fadd4036b60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55e83adc77f0 tx=0x7faeec032040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83ade9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e83adb9320 con 0x55e83ade9540 2024-09-13T19:33:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83ade9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83ade9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39896/0 (socket says 172.21.15.144:39896) 2024-09-13T19:33:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 -- 172.21.15.144:0/1413937240 learned_addr learned my addr 172.21.15.144:0/1413937240 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 -- 172.21.15.144:0/1413937240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83ade9f10 con 0x55e83ade9540 2024-09-13T19:33:54.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 --2- 172.21.15.144:0/1413937240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83ade9940 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faef4023550 tx=0x7faef4023640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe716ed118831431 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7fadde7fc640 1 -- 172.21.15.144:0/1413937240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef401d040 con 0x55e83ade9540 2024-09-13T19:33:54.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7fadde7fc640 1 -- 172.21.15.144:0/1413937240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4015c90 con 0x55e83ade9540 2024-09-13T19:33:54.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7fadde7fc640 1 -- 172.21.15.144:0/1413937240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef40433a0 con 0x55e83ade9540 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- 172.21.15.144:0/1413937240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 msgr2=0x55e83ade9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 --2- 172.21.15.144:0/1413937240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83ade9940 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faef4023550 tx=0x7faef4023640 comp rx=0 tx=0).stop 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- 172.21.15.144:0/1413937240 shutdown_connections 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 --2- 172.21.15.144:0/1413937240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83ade9940 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- 172.21.15.144:0/1413937240 >> 172.21.15.144:0/1413937240 conn(0x55e83ade58c0 msgr2=0x55e83ade39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- 172.21.15.144:0/1413937240 shutdown_connections 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- 172.21.15.144:0/1413937240 wait complete. 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 Processor -- start 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- start start 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83adf08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefce52980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e83adea450 con 0x55e83ade9540 2024-09-13T19:33:54.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83adf08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83adf08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39902/0 (socket says 172.21.15.144:39902) 2024-09-13T19:33:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 learned_addr learned my addr 172.21.15.144:0/987147110 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.327+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83adf0e10 con 0x55e83ade9540 2024-09-13T19:33:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefb163640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83adf08d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7faef4023680 tx=0x7faef404a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faddcff9640 1 -- 172.21.15.144:0/987147110 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef401d040 con 0x55e83ade9540 2024-09-13T19:33:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e83adf10a0 con 0x55e83ade9540 2024-09-13T19:33:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faddcff9640 1 -- 172.21.15.144:0/987147110 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4015a90 con 0x55e83ade9540 2024-09-13T19:33:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e83adf3d80 con 0x55e83ade9540 2024-09-13T19:33:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faddcff9640 1 -- 172.21.15.144:0/987147110 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4015e40 con 0x55e83ade9540 2024-09-13T19:33:54.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faddcff9640 1 -- 172.21.15.144:0/987147110 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faef402b790 con 0x55e83ade9540 2024-09-13T19:33:54.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faddcff9640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadc40346f0 0x7fadc4036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faddcff9640 1 -- 172.21.15.144:0/987147110 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faef4035070 con 0x55e83ade9540 2024-09-13T19:33:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefa962640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadc40346f0 0x7fadc4036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83adfbd50 0x55e83adfe210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adfe960 con 0x55e83adfbd50 2024-09-13T19:33:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefa161640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83adfbd50 0x55e83adfe210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefa962640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadc40346f0 0x7fadc4036bb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faeec026ff0 tx=0x7faeec038000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefa161640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83adfbd50 0x55e83adfe210 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 20 realm 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adfed90 con 0x55e83adfbd50 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.331+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adff660 con 0x55e83adfbd50 2024-09-13T19:33:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83adffa00 con 0x55e83adfbd50 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83ae00760 0x55e83ae02b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae03160 con 0x55e83ae00760 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefb163640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83ae00760 0x55e83ae02b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefb163640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83ae00760 0x55e83ae02b50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 20 searching for the correct realm 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e83ae05040 0x55e83ae074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa962640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e83ae05040 0x55e83ae074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa962640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e83ae05040 0x55e83ae074b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa962640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7faeec027020 0x7faeec049190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x7faeec027020 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa161640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7faeec027020 0x7faeec049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.335+0000 7faefa161640 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7faeec027020 0x7faeec049190 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae00760 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae00760 2024-09-13T19:33:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x7faeec027020 2024-09-13T19:33:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.339+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae00760 2024-09-13T19:33:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x7faeec027020 2024-09-13T19:33:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae00760 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.343+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae00760 2024-09-13T19:33:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x7faeec027020 2024-09-13T19:33:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae00760 2024-09-13T19:33:54.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae00760 2024-09-13T19:33:54.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x7faeec027020 2024-09-13T19:33:54.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae05040 2024-09-13T19:33:54.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.347+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83ae00760 2024-09-13T19:33:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x55e83adfbd50 2024-09-13T19:33:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae07b80 con 0x7faeec027020 2024-09-13T19:33:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae03ab0 con 0x55e83adfbd50 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae036f0 con 0x55e83adfbd50 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae03700 con 0x55e83adfbd50 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:54.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 zone default found 2024-09-13T19:33:54.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 4 Realm: () 2024-09-13T19:33:54.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:54.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:54.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:54.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 zonegroup default 2024-09-13T19:33:54.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae08040 con 0x55e83ae00760 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0a310 con 0x55e83ae05040 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0a6b0 con 0x55e83ae05040 2024-09-13T19:33:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 started sync module instance, tier type = 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.351+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae097a0 con 0x7faeec027020 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.355+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.355+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94455908572320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae097a0 con 0x7faeec027020 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.355+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0b0b0 con 0x55e83adfbd50 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.355+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94455908572320] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.355+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.355+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94455908576192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae097a0 con 0x55e83adfbd50 2024-09-13T19:33:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.355+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0bac0 con 0x55e83ae05040 2024-09-13T19:33:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.359+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94455908576192] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.359+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.359+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94455908569840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae09710 con 0x55e83ae05040 2024-09-13T19:33:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.359+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0c7c0 con 0x7faeec027020 2024-09-13T19:33:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.359+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.359+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94455908582432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0d060 con 0x7faeec027020 2024-09-13T19:33:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.359+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0da20 con 0x55e83adfbd50 2024-09-13T19:33:54.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.359+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94455908569840] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.363+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94455908582432] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.363+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.363+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94455908586864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0d990 con 0x55e83adfbd50 2024-09-13T19:33:54.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.363+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0cfb0 con 0x55e83ae00760 2024-09-13T19:33:54.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.363+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94455908586864] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.363+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.363+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94455908584192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0cf20 con 0x55e83ae00760 2024-09-13T19:33:54.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.363+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0e770 con 0x55e83ae00760 2024-09-13T19:33:54.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94455908584192] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94455908589072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0e6e0 con 0x55e83ae00760 2024-09-13T19:33:54.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0f120 con 0x55e83ae00760 2024-09-13T19:33:54.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94455908592624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0f590 con 0x55e83ae00760 2024-09-13T19:33:54.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 20 add_watcher() i=0 2024-09-13T19:33:54.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 20 add_watcher() i=1 2024-09-13T19:33:54.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 20 add_watcher() i=2 2024-09-13T19:33:54.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 20 add_watcher() i=3 2024-09-13T19:33:54.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 20 add_watcher() i=4 2024-09-13T19:33:54.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 20 add_watcher() i=5 2024-09-13T19:33:54.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94455908589072] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.367+0000 7faefce52980 20 add_watcher() i=6 2024-09-13T19:33:54.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94455908592624] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefce52980 20 add_watcher() i=7 2024-09-13T19:33:54.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefce52980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:54.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0e230 con 0x55e83adfbd50 2024-09-13T19:33:54.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94455908590128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0fb10 con 0x55e83adfbd50 2024-09-13T19:33:54.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94455908590128] v32'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7fadb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:54.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefce52980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:54.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.371+0000 7faefce52980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:54.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 5 note: GC not initialized 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7fad2bfff640 20 reqs_thread_entry: start 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 20 Filter name: none 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7fad29ffb640 20 reqs_thread_entry: start 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae35bc0 con 0x55e83adfbd50 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:54.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:54.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae3bd80 con 0x55e83adfbd50 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94455908775920 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae37640 con 0x55e83adfbd50 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== watch-notify(notify (1) cookie 94455908586864 notify 137438953488 ret 0) ==== 621+0+0 (crc 0 0 0) 0x55e83acd5360 con 0x55e83adfbd50 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7fadde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94455908586864 notifier 4650 bl.length()=579 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7fadde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7fadde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(64 notify.4 [notify cookie 94455908775920 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7fadde7fc640 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fadc0003eb0 con 0x55e83adfbd50 2024-09-13T19:33:54.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.375+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== watch-notify(notify_complete (2) cookie 94455908775920 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faee40df480 con 0x55e83adfbd50 2024-09-13T19:33:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:54.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.379+0000 7fadb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:54.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.379+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94455908590128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae339f0 con 0x55e83adfbd50 2024-09-13T19:33:54.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.379+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94455908590128] v32'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.379+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94455908572320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae339f0 con 0x7faeec027020 2024-09-13T19:33:54.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.379+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94455908572320] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.379+0000 7faefce52980 20 remove_watcher() i=0 2024-09-13T19:33:54.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.379+0000 7faefce52980 2 removed watcher, disabling cache 2024-09-13T19:33:54.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.379+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94455908576192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae339f0 con 0x55e83adfbd50 2024-09-13T19:33:54.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.383+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94455908576192] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.383+0000 7faefce52980 20 remove_watcher() i=1 2024-09-13T19:33:54.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.383+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94455908569840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0abc0 con 0x55e83ae05040 2024-09-13T19:33:54.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.383+0000 7faefa962640 1 -- 172.21.15.144:0/987147110 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94455908569840] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec01b040 con 0x55e83ae05040 2024-09-13T19:33:54.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.383+0000 7faefce52980 20 remove_watcher() i=2 2024-09-13T19:33:54.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.383+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94455908582432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae339f0 con 0x7faeec027020 2024-09-13T19:33:54.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.387+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94455908582432] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x7faeec027020 2024-09-13T19:33:54.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.387+0000 7faefce52980 20 remove_watcher() i=3 2024-09-13T19:33:54.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.387+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94455908586864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0c420 con 0x55e83adfbd50 2024-09-13T19:33:54.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.387+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94455908586864] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee40aaab0 con 0x55e83adfbd50 2024-09-13T19:33:54.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.387+0000 7faefce52980 20 remove_watcher() i=4 2024-09-13T19:33:54.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.387+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94455908584192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae339f0 con 0x55e83ae00760 2024-09-13T19:33:54.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.391+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94455908584192] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.391+0000 7faefce52980 20 remove_watcher() i=5 2024-09-13T19:33:54.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.391+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94455908589072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0d570 con 0x55e83ae00760 2024-09-13T19:33:54.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.391+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94455908589072] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.391+0000 7faefce52980 20 remove_watcher() i=6 2024-09-13T19:33:54.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.391+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94455908592624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e83ae0c420 con 0x55e83ae00760 2024-09-13T19:33:54.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefb163640 1 -- 172.21.15.144:0/987147110 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94455908592624] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef402a070 con 0x55e83ae00760 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 20 remove_watcher() i=7 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83ae00760 msgr2=0x55e83ae02b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83ae00760 0x55e83ae02b50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83adfbd50 msgr2=0x55e83adfe210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83adfbd50 0x55e83adfe210 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7faeec027020 msgr2=0x7faeec049190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7faeec027020 0x7faeec049190 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e83ae05040 msgr2=0x55e83ae074b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55e83ae05040 0x55e83ae074b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadc40346f0 msgr2=0x7fadc4036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadc40346f0 0x7fadc4036bb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faeec026ff0 tx=0x7faeec038000 comp rx=0 tx=0).stop 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 msgr2=0x55e83adf08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefa161640 1 -- 172.21.15.144:0/987147110 reap_dead start 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83adf08d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7faef4023680 tx=0x7faef404a260 comp rx=0 tx=0).stop 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 shutdown_connections 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/987147110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ade9540 0x55e83adf08d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 >> 172.21.15.144:0/987147110 conn(0x55e83ade58c0 msgr2=0x55e83ade3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 shutdown_connections 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/987147110 wait complete. 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1801248618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadd40346a0 msgr2=0x7fadd4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1801248618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadd40346a0 0x7fadd4036b60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55e83adc77f0 tx=0x7faeec032040 comp rx=0 tx=0).stop 2024-09-13T19:33:54.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1801248618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ac445a0 msgr2=0x55e83ac42c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1801248618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ac445a0 0x55e83ac42c20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55e83adc0f40 tx=0x7faef400af40 comp rx=0 tx=0).stop 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1801248618 shutdown_connections 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1801248618 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fadd40346a0 0x7fadd4036b60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1801248618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83ac445a0 0x55e83ac42c20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1801248618 >> 172.21.15.144:0/1801248618 conn(0x55e83adcf9f0 msgr2=0x55e83add2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1801248618 shutdown_connections 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1801248618 wait complete. 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83adc96a0 msgr2=0x55e83adcba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83adc96a0 0x55e83adcba90 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83acd1a20 msgr2=0x55e83adc6df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83acd1a20 0x55e83adc6df0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fade0034600 msgr2=0x7fade0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fade0034600 0x7fade0036ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faee40ae000 tx=0x7faee40a6000 comp rx=0 tx=0).stop 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 msgr2=0x55e83adbfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adbfcf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7faeec001360 tx=0x7faeec001260 comp rx=0 tx=0).stop 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 shutdown_connections 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55e83acd1a20 0x55e83adc6df0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55e83adc96a0 0x55e83adcba90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fade0034600 0x7fade0036ac0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 --2- 172.21.15.144:0/1738940784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e83accd6a0 0x55e83adbfcf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 >> 172.21.15.144:0/1738940784 conn(0x55e83acc91c0 msgr2=0x55e83adb31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 shutdown_connections 2024-09-13T19:33:54.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.395+0000 7faefce52980 1 -- 172.21.15.144:0/1738940784 wait complete. 2024-09-13T19:33:54.410 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:54.410 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:33:54.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:33:54.411 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-13T19:33:54.486 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:54.486 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:54.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61676d0980 1 Processor -- start 2024-09-13T19:33:54.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61676d0980 1 -- start start 2024-09-13T19:33:54.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61676d0980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dd6cd7f580 0x55dd6cd7f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61676d0980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dd6cc08ae0 con 0x55dd6cd7fed0 2024-09-13T19:33:54.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61676d0980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55dd6cc2ce30 con 0x55dd6cd7f580 2024-09-13T19:33:54.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61651e0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dd6cd7f580 0x55dd6cd7f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61651e0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dd6cd7f580 0x55dd6cd7f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39912/0 (socket says 172.21.15.144:39912) 2024-09-13T19:33:54.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61649df640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55dd6cd7fed0 0x55dd6cd84900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:32786/0 (socket says 172.21.15.144:32786) 2024-09-13T19:33:54.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.483+0000 7f61651e0640 1 -- 172.21.15.144:0/1365639713 learned_addr learned my addr 172.21.15.144:0/1365639713 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61651e0640 1 -- 172.21.15.144:0/1365639713 >> v1:172.21.15.18:6789/0 conn(0x55dd6cd7fed0 legacy=0x55dd6cd84900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61651e0640 1 -- 172.21.15.144:0/1365639713 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6cd87150 con 0x55dd6cd7f580 2024-09-13T19:33:54.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61651e0640 1 --2- 172.21.15.144:0/1365639713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6cd7f960 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f615800a5c0 tx=0x7f615801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a990efac2e984f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f615ffff640 1 -- 172.21.15.144:0/1365639713 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61580a6070 con 0x55dd6cd7f580 2024-09-13T19:33:54.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f615ffff640 1 -- 172.21.15.144:0/1365639713 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61580af070 con 0x55dd6cd7f580 2024-09-13T19:33:54.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f615ffff640 1 -- 172.21.15.144:0/1365639713 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61580aa5c0 con 0x55dd6cd7f580 2024-09-13T19:33:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61676d0980 1 -- 172.21.15.144:0/1365639713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 msgr2=0x55dd6cd7f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61676d0980 1 --2- 172.21.15.144:0/1365639713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6cd7f960 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f615800a5c0 tx=0x7f615801b340 comp rx=0 tx=0).stop 2024-09-13T19:33:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61676d0980 1 -- 172.21.15.144:0/1365639713 shutdown_connections 2024-09-13T19:33:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61676d0980 1 --2- 172.21.15.144:0/1365639713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6cd7f960 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61676d0980 1 -- 172.21.15.144:0/1365639713 >> 172.21.15.144:0/1365639713 conn(0x55dd6cd7b0a0 msgr2=0x55dd6cd7d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61676d0980 1 -- 172.21.15.144:0/1365639713 shutdown_connections 2024-09-13T19:33:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.487+0000 7f61676d0980 1 -- 172.21.15.144:0/1365639713 wait complete. 2024-09-13T19:33:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.503+0000 7f61676d0980 1 Processor -- start 2024-09-13T19:33:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.503+0000 7f61676d0980 1 -- start start 2024-09-13T19:33:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.503+0000 7f61676d0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6ccf4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.503+0000 7f61676d0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dd6cc2e200 con 0x55dd6cd7f580 2024-09-13T19:33:54.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.503+0000 7f61651e0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6ccf4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.503+0000 7f61651e0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6ccf4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39926/0 (socket says 172.21.15.144:39926) 2024-09-13T19:33:54.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.503+0000 7f61651e0640 1 -- 172.21.15.144:0/437762567 learned_addr learned my addr 172.21.15.144:0/437762567 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61651e0640 1 -- 172.21.15.144:0/437762567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6ccf51e0 con 0x55dd6cd7f580 2024-09-13T19:33:54.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61651e0640 1 --2- 172.21.15.144:0/437762567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6ccf4c10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f61580199f0 tx=0x7f6158003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5512eb7945f89b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f6053606640 1 -- 172.21.15.144:0/437762567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61580aaa00 con 0x55dd6cd7f580 2024-09-13T19:33:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f6053606640 1 -- 172.21.15.144:0/437762567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61580aaba0 con 0x55dd6cd7f580 2024-09-13T19:33:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f6053606640 1 -- 172.21.15.144:0/437762567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61580bd3f0 con 0x55dd6cd7f580 2024-09-13T19:33:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 -- 172.21.15.144:0/437762567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 msgr2=0x55dd6ccf4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 --2- 172.21.15.144:0/437762567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6ccf4c10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f61580199f0 tx=0x7f6158003030 comp rx=0 tx=0).stop 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 -- 172.21.15.144:0/437762567 shutdown_connections 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 --2- 172.21.15.144:0/437762567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7f580 0x55dd6ccf4c10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 -- 172.21.15.144:0/437762567 >> 172.21.15.144:0/437762567 conn(0x55dd6cd7b0a0 msgr2=0x55dd6ce66570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 -- 172.21.15.144:0/437762567 shutdown_connections 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 -- 172.21.15.144:0/437762567 wait complete. 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 Processor -- start 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 -- start start 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7fed0 0x55dd6ce75020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61676d0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dd6cd86b90 con 0x55dd6cd7fed0 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61651e0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7fed0 0x55dd6ce75020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61651e0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7fed0 0x55dd6ce75020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39940/0 (socket says 172.21.15.144:39940) 2024-09-13T19:33:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61651e0640 1 -- 172.21.15.144:0/1990516772 learned_addr learned my addr 172.21.15.144:0/1990516772 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61651e0640 1 -- 172.21.15.144:0/1990516772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6ce75560 con 0x55dd6cd7fed0 2024-09-13T19:33:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f61651e0640 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7fed0 0x55dd6ce75020 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61580199f0 tx=0x7f61580180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.507+0000 7f6051e03640 1 -- 172.21.15.144:0/1990516772 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61580c6690 con 0x55dd6cd7fed0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f6051e03640 1 -- 172.21.15.144:0/1990516772 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61580c6830 con 0x55dd6cd7fed0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd6ce757f0 con 0x55dd6cd7fed0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f6051e03640 1 -- 172.21.15.144:0/1990516772 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61580c6b10 con 0x55dd6cd7fed0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd6ce784d0 con 0x55dd6cd7fed0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f6051e03640 1 -- 172.21.15.144:0/1990516772 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f61580ce020 con 0x55dd6cd7fed0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f6051e03640 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f604c0346a0 0x7f604c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f6051e03640 1 -- 172.21.15.144:0/1990516772 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f61580cc020 con 0x55dd6cd7fed0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61649df640 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f604c0346a0 0x7f604c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ce79fa0 0x55dd6ce7c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ce7ca00 con 0x55dd6ce79fa0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61659e1640 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ce79fa0 0x55dd6ce7c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61649df640 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f604c0346a0 0x7f604c036b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f61500012f0 tx=0x7f6150006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61659e1640 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ce79fa0 0x55dd6ce7c390 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61659e1640 1 -- 172.21.15.144:0/1990516772 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61600083f0 con 0x55dd6ce79fa0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ce796f0 con 0x55dd6ce79fa0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61659e1640 1 -- 172.21.15.144:0/1990516772 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61600083f0 con 0x55dd6ce79fa0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ce7ed80 0x55dd6ce81170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ce81840 con 0x55dd6ce7ed80 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.511+0000 7f61651e0640 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ce7ed80 0x55dd6ce81170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61651e0640 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ce7ed80 0x55dd6ce81170 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61651e0640 1 -- 172.21.15.144:0/1990516772 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ce7ed80 2024-09-13T19:33:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ce7dc20 con 0x55dd6ce79fa0 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61659e1640 1 -- 172.21.15.144:0/1990516772 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61600083f0 con 0x55dd6ce79fa0 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ce7e100 con 0x55dd6ce79fa0 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61659e1640 1 -- 172.21.15.144:0/1990516772 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61600083f0 con 0x55dd6ce79fa0 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61676d0980 1 Processor -- start 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61676d0980 1 -- start start 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61676d0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce8ff80 0x55dd6ce903a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61676d0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dd6cc87800 con 0x55dd6ce8ff80 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61659e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce8ff80 0x55dd6ce903a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61659e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce8ff80 0x55dd6ce903a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39946/0 (socket says 172.21.15.144:39946) 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61659e1640 1 -- 172.21.15.144:0/2760857112 learned_addr learned my addr 172.21.15.144:0/2760857112 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61659e1640 1 -- 172.21.15.144:0/2760857112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6ce908e0 con 0x55dd6ce8ff80 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.515+0000 7f61659e1640 1 --2- 172.21.15.144:0/2760857112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce8ff80 0x55dd6ce903a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55dd6ce75f20 tx=0x7f616000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f604affd640 1 -- 172.21.15.144:0/2760857112 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6160007d70 con 0x55dd6ce8ff80 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f604affd640 1 -- 172.21.15.144:0/2760857112 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616001e020 con 0x55dd6ce8ff80 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61676d0980 1 -- 172.21.15.144:0/2760857112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd6ce90b70 con 0x55dd6ce8ff80 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f604affd640 1 -- 172.21.15.144:0/2760857112 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6160019590 con 0x55dd6ce8ff80 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61676d0980 1 -- 172.21.15.144:0/2760857112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd6ce937f0 con 0x55dd6ce8ff80 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f604affd640 1 -- 172.21.15.144:0/2760857112 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6160016040 con 0x55dd6ce8ff80 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f604affd640 1 --2- 172.21.15.144:0/2760857112 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c034650 0x7f603c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f604affd640 1 -- 172.21.15.144:0/2760857112 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f616001f030 con 0x55dd6ce8ff80 2024-09-13T19:33:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61651e0640 1 --2- 172.21.15.144:0/2760857112 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c034650 0x7f603c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61676d0980 1 Processor -- start 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61676d0980 1 -- start start 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61651e0640 1 --2- 172.21.15.144:0/2760857112 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c034650 0x7f603c036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55dd6ce7ced0 tx=0x7f61580e5050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61676d0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6ce9cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61676d0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dd6ccf54a0 con 0x55dd6ce9cac0 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61659e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6ce9cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61659e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6ce9cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39962/0 (socket says 172.21.15.144:39962) 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61659e1640 1 -- 172.21.15.144:0/121919144 learned_addr learned my addr 172.21.15.144:0/121919144 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61659e1640 1 -- 172.21.15.144:0/121919144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6ce9d470 con 0x55dd6ce9cac0 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f61659e1640 1 --2- 172.21.15.144:0/121919144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6ce9cea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f616004a2a0 tx=0x7f6160023610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4931b66398ec9ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f6048ff9640 1 -- 172.21.15.144:0/121919144 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f616001d030 con 0x55dd6ce9cac0 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.519+0000 7f6048ff9640 1 -- 172.21.15.144:0/121919144 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6160043380 con 0x55dd6ce9cac0 2024-09-13T19:33:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f6048ff9640 1 -- 172.21.15.144:0/121919144 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6160043660 con 0x55dd6ce9cac0 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- 172.21.15.144:0/121919144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 msgr2=0x55dd6ce9cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 --2- 172.21.15.144:0/121919144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6ce9cea0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f616004a2a0 tx=0x7f6160023610 comp rx=0 tx=0).stop 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- 172.21.15.144:0/121919144 shutdown_connections 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 --2- 172.21.15.144:0/121919144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6ce9cea0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- 172.21.15.144:0/121919144 >> 172.21.15.144:0/121919144 conn(0x55dd6ce98ea0 msgr2=0x55dd6ce96fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- 172.21.15.144:0/121919144 shutdown_connections 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- 172.21.15.144:0/121919144 wait complete. 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 Processor -- start 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- start start 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6cea3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dd6ce9da90 con 0x55dd6ce9cac0 2024-09-13T19:33:54.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61659e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6cea3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61659e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6cea3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39970/0 (socket says 172.21.15.144:39970) 2024-09-13T19:33:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 learned_addr learned my addr 172.21.15.144:0/3232796420 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6cea4390 con 0x55dd6ce9cac0 2024-09-13T19:33:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61659e1640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6cea3e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6160023650 tx=0x7f616004a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f603affd640 1 -- 172.21.15.144:0/3232796420 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6160017770 con 0x55dd6ce9cac0 2024-09-13T19:33:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd6cea4620 con 0x55dd6ce9cac0 2024-09-13T19:33:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f603affd640 1 -- 172.21.15.144:0/3232796420 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616002b7d0 con 0x55dd6ce9cac0 2024-09-13T19:33:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f603affd640 1 -- 172.21.15.144:0/3232796420 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f616002baf0 con 0x55dd6ce9cac0 2024-09-13T19:33:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.523+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd6cea7300 con 0x55dd6ce9cac0 2024-09-13T19:33:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f603affd640 1 -- 172.21.15.144:0/3232796420 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6160037070 con 0x55dd6ce9cac0 2024-09-13T19:33:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f603affd640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6030034650 0x7f6030036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f603affd640 1 -- 172.21.15.144:0/3232796420 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6160056bf0 con 0x55dd6ce9cac0 2024-09-13T19:33:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61651e0640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6030034650 0x7f6030036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ceaf300 0x55dd6ceb17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceb1f10 con 0x55dd6ceaf300 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61649df640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ceaf300 0x55dd6ceb17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61651e0640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6030034650 0x7f6030036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f61580cf510 tx=0x7f61580e8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61649df640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ceaf300 0x55dd6ceb17c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 realm 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceae7a0 con 0x55dd6ceaf300 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceb2a10 con 0x55dd6ceaf300 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceb32e0 con 0x55dd6ceaf300 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ceb3d00 0x55dd6ceb60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceb67c0 con 0x55dd6ceb3d00 2024-09-13T19:33:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61659e1640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ceb3d00 0x55dd6ceb60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.527+0000 7f61659e1640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ceb3d00 0x55dd6ceb60f0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61676d0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61676d0980 20 searching for the correct realm 2024-09-13T19:33:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dd6ceb8710 0x55dd6cebab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61651e0640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dd6ceb8710 0x55dd6cebab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61651e0640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dd6ceb8710 0x55dd6cebab40 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61651e0640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f61580fa040 0x7f61580cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x7f61580fa040 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f61580fa040 0x7f61580cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f61580fa040 0x7f61580cf580 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb3d00 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.531+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb3d00 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x7f61580fa040 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb3d00 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x7f61580fa040 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb3d00 2024-09-13T19:33:54.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.535+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb3d00 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x7f61580fa040 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb3d00 2024-09-13T19:33:54.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.539+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb3d00 2024-09-13T19:33:54.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x7f61580fa040 2024-09-13T19:33:54.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb8710 2024-09-13T19:33:54.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceb3d00 2024-09-13T19:33:54.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x55dd6ceaf300 2024-09-13T19:33:54.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb210 con 0x7f61580fa040 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceb7180 con 0x55dd6ceaf300 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceb6dc0 con 0x55dd6ceaf300 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceb7ae0 con 0x55dd6ceaf300 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 zone default found 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 4 Realm: () 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 zonegroup default 2024-09-13T19:33:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.543+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebb690 con 0x55dd6ceb3d00 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebd910 con 0x55dd6ceb8710 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebdcb0 con 0x55dd6ceb8710 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 20 started sync module instance, tier type = 2024-09-13T19:33:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:54.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebcd50 con 0x7f61580fa040 2024-09-13T19:33:54.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94409503527584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebcd50 con 0x7f61580fa040 2024-09-13T19:33:54.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.547+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebe6d0 con 0x55dd6ceaf300 2024-09-13T19:33:54.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.551+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94409503527584] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.551+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.551+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94409503531456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebcd50 con 0x55dd6ceaf300 2024-09-13T19:33:54.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.551+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebf0e0 con 0x55dd6ceb8710 2024-09-13T19:33:54.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.551+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94409503531456] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.551+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.551+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94409503525024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebccc0 con 0x55dd6ceb8710 2024-09-13T19:33:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.551+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebfe30 con 0x7f61580fa040 2024-09-13T19:33:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.555+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.555+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94409503537808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec04c0 con 0x7f61580fa040 2024-09-13T19:33:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.555+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec0fe0 con 0x55dd6ceaf300 2024-09-13T19:33:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.555+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94409503525024] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.555+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94409503537808] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.555+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.555+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94409503541936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec0fa0 con 0x55dd6ceaf300 2024-09-13T19:33:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.555+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec1880 con 0x55dd6ceb3d00 2024-09-13T19:33:54.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.559+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94409503541936] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.559+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.559+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94409503544272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec0fa0 con 0x55dd6ceb3d00 2024-09-13T19:33:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.559+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec20d0 con 0x55dd6ceb3d00 2024-09-13T19:33:54.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.559+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94409503544272] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94409503536336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec20d0 con 0x55dd6ceb3d00 2024-09-13T19:33:54.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec2b30 con 0x55dd6ceb3d00 2024-09-13T19:33:54.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94409503548944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec2fe0 con 0x55dd6ceb3d00 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 20 add_watcher() i=0 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 20 add_watcher() i=1 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 20 add_watcher() i=2 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 20 add_watcher() i=3 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 20 add_watcher() i=4 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 20 add_watcher() i=5 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94409503536336] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.563+0000 7f61676d0980 20 add_watcher() i=6 2024-09-13T19:33:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94409503548944] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 20 add_watcher() i=7 2024-09-13T19:33:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec2fe0 con 0x55dd6ceaf300 2024-09-13T19:33:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94409503550256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cec2f50 con 0x55dd6ceaf300 2024-09-13T19:33:54.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94409503550256] v32'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f601b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 5 note: GC not initialized 2024-09-13T19:33:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f601a7e4640 20 reqs_thread_entry: start 2024-09-13T19:33:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 20 Filter name: none 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f5f8bfff640 20 reqs_thread_entry: start 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cee96d0 con 0x55dd6ceaf300 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 20 rados_obj.operate() r=0 bl.length=403 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:54.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:54.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.567+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceef850 con 0x55dd6ceaf300 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61676d0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61676d0980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61676d0980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94409503732416 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd6ceeb150 con 0x55dd6ceaf300 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== watch-notify(notify (1) cookie 94409503541936 notify 137438953489 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f615001b040 con 0x55dd6ceaf300 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f6048ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94409503541936 notifier 4657 bl.length()=567 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f6048ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f6048ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(64 notify.4 [notify cookie 94409503732416 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f6048ff9640 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6028003eb0 con 0x55dd6ceaf300 2024-09-13T19:33:54.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== watch-notify(notify_complete (2) cookie 94409503732416 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd6cc08ae0 con 0x55dd6ceaf300 2024-09-13T19:33:54.575 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:33:27.796986Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:33:27.796964Z","tags":[],"group_ids":[]} 2024-09-13T19:33:54.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f601b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:54.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.571+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94409503550256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cee7530 con 0x55dd6ceaf300 2024-09-13T19:33:54.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.575+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94409503550256] v32'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.575+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94409503527584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cee7530 con 0x7f61580fa040 2024-09-13T19:33:54.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.575+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94409503527584] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.575+0000 7f61676d0980 20 remove_watcher() i=0 2024-09-13T19:33:54.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.575+0000 7f61676d0980 2 removed watcher, disabling cache 2024-09-13T19:33:54.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.575+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94409503531456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cee7530 con 0x55dd6ceaf300 2024-09-13T19:33:54.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.575+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94409503531456] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.579+0000 7f61676d0980 20 remove_watcher() i=1 2024-09-13T19:33:54.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.579+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94409503525024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cee7530 con 0x55dd6ceb8710 2024-09-13T19:33:54.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.579+0000 7f61651e0640 1 -- 172.21.15.144:0/3232796420 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94409503525024] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61580c5ce0 con 0x55dd6ceb8710 2024-09-13T19:33:54.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.579+0000 7f61676d0980 20 remove_watcher() i=2 2024-09-13T19:33:54.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.579+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94409503537808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebd2a0 con 0x7f61580fa040 2024-09-13T19:33:54.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.579+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94409503537808] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x7f61580fa040 2024-09-13T19:33:54.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.579+0000 7f61676d0980 20 remove_watcher() i=3 2024-09-13T19:33:54.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.579+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94409503541936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebe1c0 con 0x55dd6ceaf300 2024-09-13T19:33:54.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.583+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94409503541936] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615000f070 con 0x55dd6ceaf300 2024-09-13T19:33:54.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.583+0000 7f61676d0980 20 remove_watcher() i=4 2024-09-13T19:33:54.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.583+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94409503544272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebc8a0 con 0x55dd6ceb3d00 2024-09-13T19:33:54.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.583+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94409503544272] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.583+0000 7f61676d0980 20 remove_watcher() i=5 2024-09-13T19:33:54.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.583+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94409503536336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebfa90 con 0x55dd6ceb3d00 2024-09-13T19:33:54.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.587+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94409503536336] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.587+0000 7f61676d0980 20 remove_watcher() i=6 2024-09-13T19:33:54.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.587+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94409503548944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd6cebd2a0 con 0x55dd6ceb3d00 2024-09-13T19:33:54.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61659e1640 1 -- 172.21.15.144:0/3232796420 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94409503548944] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f616005e040 con 0x55dd6ceb3d00 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 20 remove_watcher() i=7 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ceb3d00 msgr2=0x55dd6ceb60f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ceb3d00 0x55dd6ceb60f0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ceaf300 msgr2=0x55dd6ceb17c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ceaf300 0x55dd6ceb17c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f61580fa040 msgr2=0x7f61580cf580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f61580fa040 0x7f61580cf580 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dd6ceb8710 msgr2=0x55dd6cebab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dd6ceb8710 0x55dd6cebab40 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6030034650 msgr2=0x7f6030036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6030034650 0x7f6030036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f61580cf510 tx=0x7f61580e8000 comp rx=0 tx=0).stop 2024-09-13T19:33:54.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 msgr2=0x55dd6cea3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61649df640 1 -- 172.21.15.144:0/3232796420 reap_dead start 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6cea3e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6160023650 tx=0x7f616004a230 comp rx=0 tx=0).stop 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 shutdown_connections 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/3232796420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce9cac0 0x55dd6cea3e50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 >> 172.21.15.144:0/3232796420 conn(0x55dd6ce98ea0 msgr2=0x55dd6ce96f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 shutdown_connections 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/3232796420 wait complete. 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/2760857112 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c034650 msgr2=0x7f603c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/2760857112 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c034650 0x7f603c036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55dd6ce7ced0 tx=0x7f61580e5050 comp rx=0 tx=0).stop 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/2760857112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce8ff80 msgr2=0x55dd6ce903a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/2760857112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce8ff80 0x55dd6ce903a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55dd6ce75f20 tx=0x7f616000af40 comp rx=0 tx=0).stop 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/2760857112 shutdown_connections 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/2760857112 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c034650 0x7f603c036b10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/2760857112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6ce8ff80 0x55dd6ce903a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/2760857112 >> 172.21.15.144:0/2760857112 conn(0x55dd6ce850d0 msgr2=0x55dd6ce87b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/2760857112 shutdown_connections 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/2760857112 wait complete. 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ce7ed80 msgr2=0x55dd6ce81170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ce7ed80 0x55dd6ce81170 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ce79fa0 msgr2=0x55dd6ce7c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ce79fa0 0x55dd6ce7c390 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f604c0346a0 msgr2=0x7f604c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f604c0346a0 0x7f604c036b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f61500012f0 tx=0x7f6150006700 comp rx=0 tx=0).stop 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7fed0 msgr2=0x55dd6ce75020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7fed0 0x55dd6ce75020 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61580199f0 tx=0x7f61580180e0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 shutdown_connections 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dd6ce79fa0 0x55dd6ce7c390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dd6ce7ed80 0x55dd6ce81170 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f604c0346a0 0x7f604c036b60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 --2- 172.21.15.144:0/1990516772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd6cd7fed0 0x55dd6ce75020 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 >> 172.21.15.144:0/1990516772 conn(0x55dd6cd7b0a0 msgr2=0x55dd6ce650f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 shutdown_connections 2024-09-13T19:33:54.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.591+0000 7f61676d0980 1 -- 172.21.15.144:0/1990516772 wait complete. 2024-09-13T19:33:54.605 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:33:27.796986Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:33:27.796964Z', 'tags': [], 'group_ids': []} 2024-09-13T19:33:54.621 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:54.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:33:54.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:33:54.622 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:33:54.679 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:33:54.680 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:33:54.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac415fe980 1 Processor -- start 2024-09-13T19:33:54.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac415fe980 1 -- start start 2024-09-13T19:33:54.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac415fe980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5565004c3910 0x5565004c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac415fe980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556500348ae0 con 0x5565004bf540 2024-09-13T19:33:54.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac415fe980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55650036ce30 con 0x5565004c3910 2024-09-13T19:33:54.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac3e90d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5565004c3910 0x5565004c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac3f10e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5565004bf540 0x5565004bf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:32802/0 (socket says 172.21.15.144:32802) 2024-09-13T19:33:54.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac3e90d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5565004c3910 0x5565004c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39980/0 (socket says 172.21.15.144:39980) 2024-09-13T19:33:54.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac3f10e640 1 -- 172.21.15.144:0/3297750842 learned_addr learned my addr 172.21.15.144:0/3297750842 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:33:54.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac3e90d640 1 -- 172.21.15.144:0/3297750842 >> v1:172.21.15.18:6789/0 conn(0x5565004bf540 legacy=0x5565004bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac3e90d640 1 -- 172.21.15.144:0/3297750842 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565004c7250 con 0x5565004c3910 2024-09-13T19:33:54.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.679+0000 7fac3e90d640 1 --2- 172.21.15.144:0/3297750842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004c3910 0x5565004c5d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fac3400a480 tx=0x7fac3401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12841704f234586 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac3e10c640 1 -- 172.21.15.144:0/3297750842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac340b0070 con 0x5565004c3910 2024-09-13T19:33:54.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac3e10c640 1 -- 172.21.15.144:0/3297750842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac340ab540 con 0x5565004c3910 2024-09-13T19:33:54.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac3e10c640 1 -- 172.21.15.144:0/3297750842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac340ab840 con 0x5565004c3910 2024-09-13T19:33:54.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac415fe980 1 -- 172.21.15.144:0/3297750842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004c3910 msgr2=0x5565004c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac415fe980 1 --2- 172.21.15.144:0/3297750842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004c3910 0x5565004c5d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fac3400a480 tx=0x7fac3401b280 comp rx=0 tx=0).stop 2024-09-13T19:33:54.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac415fe980 1 -- 172.21.15.144:0/3297750842 shutdown_connections 2024-09-13T19:33:54.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac415fe980 1 --2- 172.21.15.144:0/3297750842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004c3910 0x5565004c5d00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac415fe980 1 -- 172.21.15.144:0/3297750842 >> 172.21.15.144:0/3297750842 conn(0x5565004bb060 msgr2=0x5565004bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac415fe980 1 -- 172.21.15.144:0/3297750842 shutdown_connections 2024-09-13T19:33:54.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.683+0000 7fac415fe980 1 -- 172.21.15.144:0/3297750842 wait complete. 2024-09-13T19:33:54.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac415fe980 1 Processor -- start 2024-09-13T19:33:54.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac415fe980 1 -- start start 2024-09-13T19:33:54.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac415fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac415fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55650036e200 con 0x5565004bf540 2024-09-13T19:33:54.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac3f10e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac3f10e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39984/0 (socket says 172.21.15.144:39984) 2024-09-13T19:33:54.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac3f10e640 1 -- 172.21.15.144:0/2050245988 learned_addr learned my addr 172.21.15.144:0/2050245988 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac3f10e640 1 -- 172.21.15.144:0/2050245988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565005aaf30 con 0x5565004bf540 2024-09-13T19:33:54.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fac3f10e640 1 --2- 172.21.15.144:0/2050245988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005aa960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fac380015f0 tx=0x7fac38001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b47609be9132552 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fab2d60a640 1 -- 172.21.15.144:0/2050245988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac38004530 con 0x5565004bf540 2024-09-13T19:33:54.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fab2d60a640 1 -- 172.21.15.144:0/2050245988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac380046f0 con 0x5565004bf540 2024-09-13T19:33:54.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.699+0000 7fab2d60a640 1 -- 172.21.15.144:0/2050245988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac38004a90 con 0x5565004bf540 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- 172.21.15.144:0/2050245988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 msgr2=0x5565005aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 --2- 172.21.15.144:0/2050245988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005aa960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fac380015f0 tx=0x7fac38001ab0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- 172.21.15.144:0/2050245988 shutdown_connections 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 --2- 172.21.15.144:0/2050245988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005aa960 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- 172.21.15.144:0/2050245988 >> 172.21.15.144:0/2050245988 conn(0x5565004bb060 msgr2=0x5565005a6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- 172.21.15.144:0/2050245988 shutdown_connections 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- 172.21.15.144:0/2050245988 wait complete. 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 Processor -- start 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- start start 2024-09-13T19:33:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5565004c6d50 con 0x5565004bf540 2024-09-13T19:33:54.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac3f10e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac3f10e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:39988/0 (socket says 172.21.15.144:39988) 2024-09-13T19:33:54.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac3f10e640 1 -- 172.21.15.144:0/3786743213 learned_addr learned my addr 172.21.15.144:0/3786743213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac3f10e640 1 -- 172.21.15.144:0/3786743213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565005b2230 con 0x5565004bf540 2024-09-13T19:33:54.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac3f10e640 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005b1cf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x5565005abb40 tx=0x7fac38000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fab2be07640 1 -- 172.21.15.144:0/3786743213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac38013760 con 0x5565004bf540 2024-09-13T19:33:54.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565005b24c0 con 0x5565004bf540 2024-09-13T19:33:54.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565005b51a0 con 0x5565004bf540 2024-09-13T19:33:54.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fab2be07640 1 -- 172.21.15.144:0/3786743213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac38013900 con 0x5565004bf540 2024-09-13T19:33:54.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fab2be07640 1 -- 172.21.15.144:0/3786743213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac38013be0 con 0x5565004bf540 2024-09-13T19:33:54.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.703+0000 7fab2be07640 1 -- 172.21.15.144:0/3786743213 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fac38010070 con 0x5565004bf540 2024-09-13T19:33:54.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fab2be07640 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab240346f0 0x7fab24036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fab2be07640 1 -- 172.21.15.144:0/3786743213 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fac38018070 con 0x5565004bf540 2024-09-13T19:33:54.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3e90d640 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab240346f0 0x7fab24036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565004c3910 0x5565005b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005b92d0 con 0x5565004c3910 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3f90f640 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565004c3910 0x5565005b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3e90d640 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab240346f0 0x7fab24036bb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fac340ad000 tx=0x7fac340a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3f90f640 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565004c3910 0x5565005b8c80 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3f90f640 1 -- 172.21.15.144:0/3786743213 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac300083f0 con 0x5565004c3910 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005b63c0 con 0x5565004c3910 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3f90f640 1 -- 172.21.15.144:0/3786743213 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac300083f0 con 0x5565004c3910 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005bb620 0x5565005bda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005be0e0 con 0x5565005bb620 2024-09-13T19:33:54.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3f10e640 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005bb620 0x5565005bda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3f10e640 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005bb620 0x5565005bda10 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac3f10e640 1 -- 172.21.15.144:0/3786743213 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fac3801b030 con 0x5565005bb620 2024-09-13T19:33:54.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.707+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005ba4c0 con 0x5565004c3910 2024-09-13T19:33:54.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac3f90f640 1 -- 172.21.15.144:0/3786743213 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac300083f0 con 0x5565004c3910 2024-09-13T19:33:54.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005ba9a0 con 0x5565004c3910 2024-09-13T19:33:54.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac3f90f640 1 -- 172.21.15.144:0/3786743213 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fac300083f0 con 0x5565004c3910 2024-09-13T19:33:54.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac415fe980 1 Processor -- start 2024-09-13T19:33:54.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac415fe980 1 -- start start 2024-09-13T19:33:54.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac415fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556500434c90 0x5565005d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac415fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5565003c7800 con 0x556500434c90 2024-09-13T19:33:54.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac3f90f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556500434c90 0x5565005d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac3f90f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556500434c90 0x5565005d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:40002/0 (socket says 172.21.15.144:40002) 2024-09-13T19:33:54.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac3f90f640 1 -- 172.21.15.144:0/514286001 learned_addr learned my addr 172.21.15.144:0/514286001 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac3f90f640 1 -- 172.21.15.144:0/514286001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565005d0ae0 con 0x556500434c90 2024-09-13T19:33:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac3f90f640 1 --2- 172.21.15.144:0/514286001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556500434c90 0x5565005d05a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x5565005b96d0 tx=0x7fac3000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fab29602640 1 -- 172.21.15.144:0/514286001 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30007e00 con 0x556500434c90 2024-09-13T19:33:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fab29602640 1 -- 172.21.15.144:0/514286001 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3001e020 con 0x556500434c90 2024-09-13T19:33:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac415fe980 1 -- 172.21.15.144:0/514286001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565005d0cb0 con 0x556500434c90 2024-09-13T19:33:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fab29602640 1 -- 172.21.15.144:0/514286001 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30019590 con 0x556500434c90 2024-09-13T19:33:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.711+0000 7fac415fe980 1 -- 172.21.15.144:0/514286001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565005d1120 con 0x556500434c90 2024-09-13T19:33:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fab29602640 1 -- 172.21.15.144:0/514286001 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fac30016040 con 0x556500434c90 2024-09-13T19:33:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fab29602640 1 --2- 172.21.15.144:0/514286001 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab18034740 0x7fab18036c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fab29602640 1 -- 172.21.15.144:0/514286001 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fac3001f030 con 0x556500434c90 2024-09-13T19:33:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac3f10e640 1 --2- 172.21.15.144:0/514286001 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab18034740 0x7fab18036c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 Processor -- start 2024-09-13T19:33:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- start start 2024-09-13T19:33:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac3f10e640 1 --2- 172.21.15.144:0/514286001 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab18034740 0x7fab18036c00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5565005b9770 tx=0x7fac3801e500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005da680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5565005ab2b0 con 0x5565005da280 2024-09-13T19:33:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac3f90f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005da680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac3f90f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005da680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:40012/0 (socket says 172.21.15.144:40012) 2024-09-13T19:33:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac3f90f640 1 -- 172.21.15.144:0/470694520 learned_addr learned my addr 172.21.15.144:0/470694520 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac3f90f640 1 -- 172.21.15.144:0/470694520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565005dac50 con 0x5565005da280 2024-09-13T19:33:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac3f90f640 1 --2- 172.21.15.144:0/470694520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005da680 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fac3000afd0 tx=0x7fac300234d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecfdc36a5c7e949 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fab22ffd640 1 -- 172.21.15.144:0/470694520 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30046070 con 0x5565005da280 2024-09-13T19:33:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fab22ffd640 1 -- 172.21.15.144:0/470694520 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac300174e0 con 0x5565005da280 2024-09-13T19:33:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fab22ffd640 1 -- 172.21.15.144:0/470694520 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac3001d040 con 0x5565005da280 2024-09-13T19:33:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- 172.21.15.144:0/470694520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 msgr2=0x5565005da680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 --2- 172.21.15.144:0/470694520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005da680 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fac3000afd0 tx=0x7fac300234d0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- 172.21.15.144:0/470694520 shutdown_connections 2024-09-13T19:33:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 --2- 172.21.15.144:0/470694520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005da680 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- 172.21.15.144:0/470694520 >> 172.21.15.144:0/470694520 conn(0x5565005d66b0 msgr2=0x5565005d47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- 172.21.15.144:0/470694520 shutdown_connections 2024-09-13T19:33:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- 172.21.15.144:0/470694520 wait complete. 2024-09-13T19:33:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 Processor -- start 2024-09-13T19:33:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- start start 2024-09-13T19:33:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.715+0000 7fac415fe980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5565005db2a0 con 0x5565005da280 2024-09-13T19:33:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac3f90f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac3f90f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005e16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:40014/0 (socket says 172.21.15.144:40014) 2024-09-13T19:33:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 learned_addr learned my addr 172.21.15.144:0/1421655450 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:33:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565005e1be0 con 0x5565005da280 2024-09-13T19:33:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac3f90f640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005e16a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fac30023720 tx=0x7fac3004a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fab217fa640 1 -- 172.21.15.144:0/1421655450 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac3001d030 con 0x5565005da280 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565005e1e70 con 0x5565005da280 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fab217fa640 1 -- 172.21.15.144:0/1421655450 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac30015740 con 0x5565005da280 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fab217fa640 1 -- 172.21.15.144:0/1421655450 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30015a20 con 0x5565005da280 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565005e4b50 con 0x5565005da280 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fab217fa640 1 -- 172.21.15.144:0/1421655450 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fac30022a80 con 0x5565005da280 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fab217fa640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab08034650 0x7fab08036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fab217fa640 1 -- 172.21.15.144:0/1421655450 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fac30034070 con 0x5565005da280 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac3f10e640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab08034650 0x7fab08036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565005ecb80 0x5565005ef010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005ef760 con 0x5565005ecb80 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac3e90d640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565005ecb80 0x5565005ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.719+0000 7fac3f10e640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab08034650 0x7fab08036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fac38010670 tx=0x7fac38049000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3e90d640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565005ecb80 0x5565005ef010 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 realm 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005efb90 con 0x5565005ecb80 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005f0460 con 0x5565005ecb80 2024-09-13T19:33:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005f0800 con 0x5565005ecb80 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005f1560 0x5565005f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005f3f60 con 0x5565005f1560 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3f90f640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005f1560 0x5565005f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3f90f640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005f1560 0x5565005f3950 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 20 searching for the correct realm 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5565005f5e40 0x5565005f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3f10e640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5565005f5e40 0x5565005f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.723+0000 7fac3f10e640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5565005f5e40 0x5565005f82b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac3803e070 con 0x5565005f5e40 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f10e640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fac38041040 0x7fac38029470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x7fac38041040 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fac38041040 0x7fac38029470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:33:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fac38041040 0x7fac38029470 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:33:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f1560 2024-09-13T19:33:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f1560 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x7fac38041040 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac3803e070 con 0x5565005f5e40 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.727+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f1560 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x7fac38041040 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac3803e070 con 0x5565005f5e40 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f1560 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.731+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f1560 2024-09-13T19:33:54.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x7fac38041040 2024-09-13T19:33:54.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f1560 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f1560 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x7fac38041040 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.735+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f5e40 2024-09-13T19:33:54.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005f1560 2024-09-13T19:33:54.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x5565005ecb80 2024-09-13T19:33:54.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565005f8980 con 0x7fac38041040 2024-09-13T19:33:54.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:33:54.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005f48b0 con 0x5565005ecb80 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005f4ca0 con 0x5565005ecb80 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:33:54.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005f4ca0 con 0x5565005ecb80 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 zone default found 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 4 Realm: () 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 zonegroup default 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005f50c0 con 0x5565005f1560 2024-09-13T19:33:54.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005fa7e0 con 0x5565005f5e40 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.739+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005fac20 con 0x5565005f5e40 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac415fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac415fe980 20 started sync module instance, tier type = 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac415fe980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005f9c80 con 0x7fac38041040 2024-09-13T19:33:54.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93892286325120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005f9c80 con 0x7fac38041040 2024-09-13T19:33:54.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fb6e0 con 0x5565005ecb80 2024-09-13T19:33:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93892286325120] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93892286329296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005f9c80 con 0x5565005ecb80 2024-09-13T19:33:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.743+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fc0f0 con 0x5565005f5e40 2024-09-13T19:33:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.747+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.747+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93892286331968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fc940 con 0x5565005f5e40 2024-09-13T19:33:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.747+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fd300 con 0x7fac38041040 2024-09-13T19:33:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.747+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93892286329296] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.747+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.747+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93892286322640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fd300 con 0x7fac38041040 2024-09-13T19:33:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.747+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fdd10 con 0x5565005ecb80 2024-09-13T19:33:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93892286331968] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93892286334096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fdd10 con 0x5565005ecb80 2024-09-13T19:33:54.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fe5a0 con 0x5565005f1560 2024-09-13T19:33:54.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93892286322640] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93892286334096] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93892286336592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fdd10 con 0x5565005f1560 2024-09-13T19:33:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.751+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fee40 con 0x5565005f1560 2024-09-13T19:33:54.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.755+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93892286336592] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.755+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.755+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93892286339168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005fdc80 con 0x5565005f1560 2024-09-13T19:33:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.755+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005ff460 con 0x5565005f1560 2024-09-13T19:33:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93892286345136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005ff8c0 con 0x5565005f1560 2024-09-13T19:33:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 20 add_watcher() i=0 2024-09-13T19:33:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 20 add_watcher() i=1 2024-09-13T19:33:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 20 add_watcher() i=2 2024-09-13T19:33:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 20 add_watcher() i=3 2024-09-13T19:33:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 20 add_watcher() i=4 2024-09-13T19:33:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 20 add_watcher() i=5 2024-09-13T19:33:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93892286339168] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 20 add_watcher() i=6 2024-09-13T19:33:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93892286345136] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 20 add_watcher() i=7 2024-09-13T19:33:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 2 all 8 watchers are set, enabling cache 2024-09-13T19:33:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565005fe9e0 con 0x5565005ecb80 2024-09-13T19:33:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.759+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93892286346192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556500600250 con 0x5565005ecb80 2024-09-13T19:33:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.763+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93892286346192] v32'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.763+0000 7faaf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.763+0000 7fac415fe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:33:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.763+0000 7fac415fe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:33:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.763+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060b190 con 0x5565005ecb80 2024-09-13T19:33:54.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.763+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.763+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060b860 con 0x5565005f1560 2024-09-13T19:33:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.767+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.767+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060b860 con 0x5565005f5e40 2024-09-13T19:33:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.767+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.767+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060be70 con 0x5565005ecb80 2024-09-13T19:33:54.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.767+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'192 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.767+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c320 con 0x7fac38041040 2024-09-13T19:33:54.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.771+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'65 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.771+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565006090b0 con 0x5565005f5e40 2024-09-13T19:33:54.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.771+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.771+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565006090b0 con 0x5565005ecb80 2024-09-13T19:33:54.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.775+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.775+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556500609190 con 0x5565005f1560 2024-09-13T19:33:54.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.775+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.775+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556500609190 con 0x7fac38041040 2024-09-13T19:33:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.779+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.779+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556500609190 con 0x5565005f5e40 2024-09-13T19:33:54.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.779+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.779+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556500609190 con 0x7fac38041040 2024-09-13T19:33:54.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.779+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'66 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.779+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556500609190 con 0x5565005f1560 2024-09-13T19:33:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.783+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.783+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556500609190 con 0x7fac38041040 2024-09-13T19:33:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.783+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.783+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f1560 2024-09-13T19:33:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.787+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.787+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005ecb80 2024-09-13T19:33:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.787+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'193 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.787+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.791+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.791+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x7fac38041040 2024-09-13T19:33:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.791+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'67 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.791+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.795+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.795+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005ecb80 2024-09-13T19:33:54.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.795+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.795+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005ecb80 2024-09-13T19:33:54.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.799+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'194 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.799+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.799+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.799+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x7fac38041040 2024-09-13T19:33:54.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.799+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.803+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.803+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.803+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.803+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.803+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.807+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.807+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.807+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.807+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f1560 2024-09-13T19:33:54.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.807+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.807+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.811+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.811+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f1560 2024-09-13T19:33:54.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.811+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.811+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f5e40 2024-09-13T19:33:54.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.815+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.815+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x5565005f1560 2024-09-13T19:33:54.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.815+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.815+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060cd50 con 0x7fac38041040 2024-09-13T19:33:54.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7faaf4fe1640 20 reqs_thread_entry: start 2024-09-13T19:33:54.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 20 init_complete bucket index max shards: 11 2024-09-13T19:33:54.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 20 Filter name: none 2024-09-13T19:33:54.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7faa6e7fc640 20 reqs_thread_entry: start 2024-09-13T19:33:54.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:33:54.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 20 rados->read ofs=0 len=0 2024-09-13T19:33:54.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556500608a70 con 0x5565005ecb80 2024-09-13T19:33:54.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:33:54.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:33:54.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:33:54.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:33:54.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.819+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55650062ab10 con 0x7fac38041040 2024-09-13T19:33:54.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv42 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.825 INFO:teuthology.orchestra.run.smithi144.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:33:54.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7faaf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:33:54.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93892286346192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565005e6d60 con 0x5565005ecb80 2024-09-13T19:33:54.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93892286346192] v32'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93892286325120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c7c0 con 0x7fac38041040 2024-09-13T19:33:54.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93892286325120] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7fac415fe980 20 remove_watcher() i=0 2024-09-13T19:33:54.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7fac415fe980 2 removed watcher, disabling cache 2024-09-13T19:33:54.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.823+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93892286329296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c7c0 con 0x5565005ecb80 2024-09-13T19:33:54.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.827+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93892286329296] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.827+0000 7fac415fe980 20 remove_watcher() i=1 2024-09-13T19:33:54.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.827+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93892286331968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c7c0 con 0x5565005f5e40 2024-09-13T19:33:54.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.827+0000 7fac3f10e640 1 -- 172.21.15.144:0/1421655450 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93892286331968] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac38063040 con 0x5565005f5e40 2024-09-13T19:33:54.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.827+0000 7fac415fe980 20 remove_watcher() i=2 2024-09-13T19:33:54.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.827+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93892286322640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c7c0 con 0x7fac38041040 2024-09-13T19:33:54.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.831+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93892286322640] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x7fac38041040 2024-09-13T19:33:54.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.831+0000 7fac415fe980 20 remove_watcher() i=3 2024-09-13T19:33:54.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.831+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93892286334096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c7c0 con 0x5565005ecb80 2024-09-13T19:33:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.831+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93892286334096] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac340b3040 con 0x5565005ecb80 2024-09-13T19:33:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.831+0000 7fac415fe980 20 remove_watcher() i=4 2024-09-13T19:33:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.831+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93892286336592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c7c0 con 0x5565005f1560 2024-09-13T19:33:54.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.835+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93892286336592] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.835+0000 7fac415fe980 20 remove_watcher() i=5 2024-09-13T19:33:54.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.835+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93892286339168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c7c0 con 0x5565005f1560 2024-09-13T19:33:54.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.835+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93892286339168] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.835+0000 7fac415fe980 20 remove_watcher() i=6 2024-09-13T19:33:54.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.835+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93892286345136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55650060c7c0 con 0x5565005f1560 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac3f90f640 1 -- 172.21.15.144:0/1421655450 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93892286345136] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30042020 con 0x5565005f1560 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 20 remove_watcher() i=7 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005f1560 msgr2=0x5565005f3950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005f1560 0x5565005f3950 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565005ecb80 msgr2=0x5565005ef010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565005ecb80 0x5565005ef010 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fac38041040 msgr2=0x7fac38029470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fac38041040 0x7fac38029470 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5565005f5e40 msgr2=0x5565005f82b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5565005f5e40 0x5565005f82b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab08034650 msgr2=0x7fab08036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab08034650 0x7fab08036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fac38010670 tx=0x7fac38049000 comp rx=0 tx=0).stop 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 msgr2=0x5565005e16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005e16a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fac30023720 tx=0x7fac3004a270 comp rx=0 tx=0).stop 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac3e90d640 1 -- 172.21.15.144:0/1421655450 reap_dead start 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 shutdown_connections 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/1421655450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565005da280 0x5565005e16a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 >> 172.21.15.144:0/1421655450 conn(0x5565005d66b0 msgr2=0x5565005d4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 shutdown_connections 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/1421655450 wait complete. 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/514286001 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab18034740 msgr2=0x7fab18036c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/514286001 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab18034740 0x7fab18036c00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5565005b9770 tx=0x7fac3801e500 comp rx=0 tx=0).stop 2024-09-13T19:33:54.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/514286001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556500434c90 msgr2=0x5565005d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/514286001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556500434c90 0x5565005d05a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x5565005b96d0 tx=0x7fac3000af40 comp rx=0 tx=0).stop 2024-09-13T19:33:54.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/514286001 shutdown_connections 2024-09-13T19:33:54.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/514286001 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab18034740 0x7fab18036c00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/514286001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556500434c90 0x5565005d05a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/514286001 >> 172.21.15.144:0/514286001 conn(0x5565005c1910 msgr2=0x5565005c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/514286001 shutdown_connections 2024-09-13T19:33:54.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/514286001 wait complete. 2024-09-13T19:33:54.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005bb620 msgr2=0x5565005bda10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005bb620 0x5565005bda10 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565004c3910 msgr2=0x5565005b8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565004c3910 0x5565005b8c80 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab240346f0 msgr2=0x7fab24036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab240346f0 0x7fab24036bb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fac340ad000 tx=0x7fac340a5040 comp rx=0 tx=0).stop 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 msgr2=0x5565005b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005b1cf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x5565005abb40 tx=0x7fac38000f50 comp rx=0 tx=0).stop 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 shutdown_connections 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5565004c3910 0x5565005b8c80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5565005bb620 0x5565005bda10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fab240346f0 0x7fab24036bb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 --2- 172.21.15.144:0/3786743213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5565004bf540 0x5565005b1cf0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 >> 172.21.15.144:0/3786743213 conn(0x5565004bb060 msgr2=0x5565005a5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 shutdown_connections 2024-09-13T19:33:54.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:33:54.839+0000 7fac415fe980 1 -- 172.21.15.144:0/3786743213 wait complete. 2024-09-13T19:33:54.856 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:33:54.875 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:33:54.881 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T19:34:29.882 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-13T19:34:29.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-13T19:34:29.883 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-13T19:34:29.923 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:29.923 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:29.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14596a0980 1 Processor -- start 2024-09-13T19:34:29.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14596a0980 1 -- start start 2024-09-13T19:34:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14596a0980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56146fb18c60 0x56146fb1b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14596a0980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56146f99aae0 con 0x56146fb148e0 2024-09-13T19:34:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14596a0980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56146f9bee30 con 0x56146fb18c60 2024-09-13T19:34:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14569af640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56146fb18c60 0x56146fb1b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14571b0640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x56146fb148e0 0x56146fb14cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37790/0 (socket says 172.21.15.144:37790) 2024-09-13T19:34:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14569af640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56146fb18c60 0x56146fb1b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34416/0 (socket says 172.21.15.144:34416) 2024-09-13T19:34:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.918+0000 7f14571b0640 1 -- 172.21.15.144:0/1163621525 learned_addr learned my addr 172.21.15.144:0/1163621525 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:34:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14569af640 1 -- 172.21.15.144:0/1163621525 >> v1:172.21.15.18:6789/0 conn(0x56146fb148e0 legacy=0x56146fb14cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14569af640 1 -- 172.21.15.144:0/1163621525 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56146fb1c5a0 con 0x56146fb18c60 2024-09-13T19:34:29.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14569af640 1 --2- 172.21.15.144:0/1163621525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb18c60 0x56146fb1b050 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f144c00a480 tx=0x7f144c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef531046af7e765 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14561ae640 1 -- 172.21.15.144:0/1163621525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144c0b0070 con 0x56146fb18c60 2024-09-13T19:34:29.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14561ae640 1 -- 172.21.15.144:0/1163621525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144c0ab540 con 0x56146fb18c60 2024-09-13T19:34:29.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14561ae640 1 -- 172.21.15.144:0/1163621525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144c0ab840 con 0x56146fb18c60 2024-09-13T19:34:29.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14596a0980 1 -- 172.21.15.144:0/1163621525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb18c60 msgr2=0x56146fb1b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:29.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14596a0980 1 --2- 172.21.15.144:0/1163621525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb18c60 0x56146fb1b050 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f144c00a480 tx=0x7f144c01b280 comp rx=0 tx=0).stop 2024-09-13T19:34:29.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14596a0980 1 -- 172.21.15.144:0/1163621525 shutdown_connections 2024-09-13T19:34:29.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14596a0980 1 --2- 172.21.15.144:0/1163621525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb18c60 0x56146fb1b050 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:29.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14596a0980 1 -- 172.21.15.144:0/1163621525 >> 172.21.15.144:0/1163621525 conn(0x56146fa88230 msgr2=0x56146fa88640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:29.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14596a0980 1 -- 172.21.15.144:0/1163621525 shutdown_connections 2024-09-13T19:34:29.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.922+0000 7f14596a0980 1 -- 172.21.15.144:0/1163621525 wait complete. 2024-09-13T19:34:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.938+0000 7f14596a0980 1 Processor -- start 2024-09-13T19:34:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.938+0000 7f14596a0980 1 -- start start 2024-09-13T19:34:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.938+0000 7f14596a0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fbffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.938+0000 7f14596a0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56146f9c0200 con 0x56146fb148e0 2024-09-13T19:34:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fbffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fbffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34430/0 (socket says 172.21.15.144:34430) 2024-09-13T19:34:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 -- 172.21.15.144:0/46092855 learned_addr learned my addr 172.21.15.144:0/46092855 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 -- 172.21.15.144:0/46092855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56146fc00260 con 0x56146fb148e0 2024-09-13T19:34:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 --2- 172.21.15.144:0/46092855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fbffc90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f14480017b0 tx=0x7f1448001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2956d55362441257 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f134560a640 1 -- 172.21.15.144:0/46092855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448016070 con 0x56146fb148e0 2024-09-13T19:34:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f134560a640 1 -- 172.21.15.144:0/46092855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1448004530 con 0x56146fb148e0 2024-09-13T19:34:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f134560a640 1 -- 172.21.15.144:0/46092855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448004870 con 0x56146fb148e0 2024-09-13T19:34:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 -- 172.21.15.144:0/46092855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 msgr2=0x56146fbffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 --2- 172.21.15.144:0/46092855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fbffc90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f14480017b0 tx=0x7f1448001c70 comp rx=0 tx=0).stop 2024-09-13T19:34:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 -- 172.21.15.144:0/46092855 shutdown_connections 2024-09-13T19:34:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 --2- 172.21.15.144:0/46092855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fbffc90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 -- 172.21.15.144:0/46092855 >> 172.21.15.144:0/46092855 conn(0x56146fa88230 msgr2=0x56146fbfb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 -- 172.21.15.144:0/46092855 shutdown_connections 2024-09-13T19:34:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 -- 172.21.15.144:0/46092855 wait complete. 2024-09-13T19:34:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 Processor -- start 2024-09-13T19:34:29.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 -- start start 2024-09-13T19:34:29.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fc07040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14596a0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56146fb1c0a0 con 0x56146fb148e0 2024-09-13T19:34:29.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fc07040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fc07040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34438/0 (socket says 172.21.15.144:34438) 2024-09-13T19:34:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 -- 172.21.15.144:0/3812078415 learned_addr learned my addr 172.21.15.144:0/3812078415 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.942+0000 7f14571b0640 1 -- 172.21.15.144:0/3812078415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56146fc07580 con 0x56146fb148e0 2024-09-13T19:34:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14571b0640 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fc07040 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1448000f90 tx=0x7f1448001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f1343e07640 1 -- 172.21.15.144:0/3812078415 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448020070 con 0x56146fb148e0 2024-09-13T19:34:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f1343e07640 1 -- 172.21.15.144:0/3812078415 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1448011400 con 0x56146fb148e0 2024-09-13T19:34:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56146fc07810 con 0x56146fb148e0 2024-09-13T19:34:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f1343e07640 1 -- 172.21.15.144:0/3812078415 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448016040 con 0x56146fb148e0 2024-09-13T19:34:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56146fc0a4f0 con 0x56146fb148e0 2024-09-13T19:34:29.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f1343e07640 1 -- 172.21.15.144:0/3812078415 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1448023070 con 0x56146fb148e0 2024-09-13T19:34:29.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f1343e07640 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f133c034650 0x7f133c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f1343e07640 1 -- 172.21.15.144:0/3812078415 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1448049180 con 0x56146fb148e0 2024-09-13T19:34:29.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14569af640 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f133c034650 0x7f133c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fb18c60 0x56146fc0e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc0e680 con 0x56146fb18c60 2024-09-13T19:34:29.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14579b1640 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fb18c60 0x56146fc0e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14569af640 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f133c034650 0x7f133c036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f144c0ad000 tx=0x7f144c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14579b1640 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fb18c60 0x56146fc0e140 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14579b1640 1 -- 172.21.15.144:0/3812078415 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14500083f0 con 0x56146fb18c60 2024-09-13T19:34:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc0b6f0 con 0x56146fb18c60 2024-09-13T19:34:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14579b1640 1 -- 172.21.15.144:0/3812078415 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14500083f0 con 0x56146fb18c60 2024-09-13T19:34:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc109a0 0x56146fc12d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc13460 con 0x56146fc109a0 2024-09-13T19:34:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.946+0000 7f14571b0640 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc109a0 0x56146fc12d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14571b0640 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc109a0 0x56146fc12d90 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14571b0640 1 -- 172.21.15.144:0/3812078415 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f144802c070 con 0x56146fc109a0 2024-09-13T19:34:29.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc0f810 con 0x56146fb18c60 2024-09-13T19:34:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14579b1640 1 -- 172.21.15.144:0/3812078415 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14500083f0 con 0x56146fb18c60 2024-09-13T19:34:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc0fcf0 con 0x56146fb18c60 2024-09-13T19:34:29.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14579b1640 1 -- 172.21.15.144:0/3812078415 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f14500083f0 con 0x56146fb18c60 2024-09-13T19:34:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14596a0980 1 Processor -- start 2024-09-13T19:34:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14596a0980 1 -- start start 2024-09-13T19:34:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14596a0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc21b60 0x56146fc21f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14596a0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56146fa19800 con 0x56146fc21b60 2024-09-13T19:34:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14579b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc21b60 0x56146fc21f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14579b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc21b60 0x56146fc21f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34442/0 (socket says 172.21.15.144:34442) 2024-09-13T19:34:29.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.950+0000 7f14579b1640 1 -- 172.21.15.144:0/4147956407 learned_addr learned my addr 172.21.15.144:0/4147956407 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14579b1640 1 -- 172.21.15.144:0/4147956407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56146fc224c0 con 0x56146fc21b60 2024-09-13T19:34:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14579b1640 1 --2- 172.21.15.144:0/4147956407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc21b60 0x56146fc21f80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56146fc07f40 tx=0x7f145000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f1341602640 1 -- 172.21.15.144:0/4147956407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450007d70 con 0x56146fc21b60 2024-09-13T19:34:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f1341602640 1 -- 172.21.15.144:0/4147956407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145001e020 con 0x56146fc21b60 2024-09-13T19:34:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14596a0980 1 -- 172.21.15.144:0/4147956407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56146fc22750 con 0x56146fc21b60 2024-09-13T19:34:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f1341602640 1 -- 172.21.15.144:0/4147956407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450019590 con 0x56146fc21b60 2024-09-13T19:34:29.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14596a0980 1 -- 172.21.15.144:0/4147956407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56146fc253d0 con 0x56146fc21b60 2024-09-13T19:34:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f1341602640 1 -- 172.21.15.144:0/4147956407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1450016040 con 0x56146fc21b60 2024-09-13T19:34:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f1341602640 1 --2- 172.21.15.144:0/4147956407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1330034650 0x7f1330036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f1341602640 1 -- 172.21.15.144:0/4147956407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f145001f030 con 0x56146fc21b60 2024-09-13T19:34:29.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14571b0640 1 --2- 172.21.15.144:0/4147956407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1330034650 0x7f1330036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14596a0980 1 Processor -- start 2024-09-13T19:34:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14596a0980 1 -- start start 2024-09-13T19:34:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14571b0640 1 --2- 172.21.15.144:0/4147956407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1330034650 0x7f1330036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1448047620 tx=0x7f1448024410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14596a0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc2eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14596a0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56146fc005e0 con 0x56146fc2e750 2024-09-13T19:34:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14579b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc2eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14579b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc2eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34456/0 (socket says 172.21.15.144:34456) 2024-09-13T19:34:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14579b1640 1 -- 172.21.15.144:0/729642124 learned_addr learned my addr 172.21.15.144:0/729642124 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.954+0000 7f14579b1640 1 -- 172.21.15.144:0/729642124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56146fc2f120 con 0x56146fc2e750 2024-09-13T19:34:29.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14579b1640 1 --2- 172.21.15.144:0/729642124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc2eb50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f145004a2a0 tx=0x7f1450023610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428655bdf8b64dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f133affd640 1 -- 172.21.15.144:0/729642124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145001d030 con 0x56146fc2e750 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f133affd640 1 -- 172.21.15.144:0/729642124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450043380 con 0x56146fc2e750 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f133affd640 1 -- 172.21.15.144:0/729642124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450043660 con 0x56146fc2e750 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- 172.21.15.144:0/729642124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 msgr2=0x56146fc2eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 --2- 172.21.15.144:0/729642124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc2eb50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f145004a2a0 tx=0x7f1450023610 comp rx=0 tx=0).stop 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- 172.21.15.144:0/729642124 shutdown_connections 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 --2- 172.21.15.144:0/729642124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc2eb50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- 172.21.15.144:0/729642124 >> 172.21.15.144:0/729642124 conn(0x56146fc2aa80 msgr2=0x56146fc28b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- 172.21.15.144:0/729642124 shutdown_connections 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- 172.21.15.144:0/729642124 wait complete. 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 Processor -- start 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- start start 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc35a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56146fc2f670 con 0x56146fc2e750 2024-09-13T19:34:29.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14579b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc35a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14579b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc35a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34468/0 (socket says 172.21.15.144:34468) 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 learned_addr learned my addr 172.21.15.144:0/4134491052 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56146fc35f40 con 0x56146fc2e750 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14579b1640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc35a00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1450023f70 tx=0x7f145004a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f13397fa640 1 -- 172.21.15.144:0/4134491052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450017770 con 0x56146fc2e750 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56146fc361d0 con 0x56146fc2e750 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f13397fa640 1 -- 172.21.15.144:0/4134491052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145002b7d0 con 0x56146fc2e750 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f13397fa640 1 -- 172.21.15.144:0/4134491052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145002bab0 con 0x56146fc2e750 2024-09-13T19:34:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.958+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56146fc38eb0 con 0x56146fc2e750 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f13397fa640 1 -- 172.21.15.144:0/4134491052 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1450037070 con 0x56146fc2e750 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f13397fa640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1320034650 0x7f1320036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f13397fa640 1 -- 172.21.15.144:0/4134491052 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1450056bf0 con 0x56146fc2e750 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14571b0640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1320034650 0x7f1320036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fc40e80 0x56146fc43320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc43a70 con 0x56146fc40e80 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14569af640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fc40e80 0x56146fc43320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14571b0640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1320034650 0x7f1320036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x56146fc13860 tx=0x7f1448038000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14569af640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fc40e80 0x56146fc43320 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 realm 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc43ea0 con 0x56146fc40e80 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc44770 con 0x56146fc40e80 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc44b10 con 0x56146fc40e80 2024-09-13T19:34:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc45870 0x56146fc47c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc481a0 con 0x56146fc45870 2024-09-13T19:34:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.962+0000 7f14579b1640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc45870 0x56146fc47c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14579b1640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc45870 0x56146fc47c60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14596a0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14596a0980 20 searching for the correct realm 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56146fc4a0f0 0x56146fc4c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14571b0640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56146fc4a0f0 0x56146fc4c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14571b0640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56146fc4a0f0 0x56146fc4c5b0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14571b0640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1448025070 0x7f1448026040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x7f1448025070 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14569af640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1448025070 0x7f1448026040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14569af640 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1448025070 0x7f1448026040 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc45870 2024-09-13T19:34:29.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.966+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc45870 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x7f1448025070 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc45870 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x7f1448025070 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.970+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc45870 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc45870 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x7f1448025070 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.974+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc45870 2024-09-13T19:34:29.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc45870 2024-09-13T19:34:29.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x7f1448025070 2024-09-13T19:34:29.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc4a0f0 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc45870 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x56146fc40e80 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4cc80 con 0x7f1448025070 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14596a0980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14596a0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14596a0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14596a0980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:29.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14596a0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14596a0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.978+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc48b60 con 0x56146fc40e80 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc48f50 con 0x56146fc40e80 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc48f50 con 0x56146fc40e80 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:29.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 zone default found 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 4 Realm: () 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 zonegroup default 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc486b0 con 0x56146fc45870 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4eae0 con 0x56146fc4a0f0 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados->read ofs=0 len=0 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4ee80 con 0x56146fc4a0f0 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 started sync module instance, tier type = 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4df80 con 0x7f1448025070 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94645774509184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4df80 con 0x7f1448025070 2024-09-13T19:34:29.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.982+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4f840 con 0x56146fc40e80 2024-09-13T19:34:29.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.986+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94645774509184] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.986+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.986+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94645774513312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4df80 con 0x56146fc40e80 2024-09-13T19:34:29.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.986+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc50140 con 0x56146fc4a0f0 2024-09-13T19:34:29.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.986+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94645774513312] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94645774506704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4def0 con 0x56146fc4a0f0 2024-09-13T19:34:29.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc50e90 con 0x7f1448025070 2024-09-13T19:34:29.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94645774519024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc515a0 con 0x7f1448025070 2024-09-13T19:34:29.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc520c0 con 0x56146fc40e80 2024-09-13T19:34:29.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94645774506704] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:29.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94645774519024] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:29.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94645774523280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc52080 con 0x56146fc40e80 2024-09-13T19:34:29.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.990+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc524b0 con 0x56146fc45870 2024-09-13T19:34:29.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.994+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94645774523280] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:29.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.994+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:29.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.994+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94645774520304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc528a0 con 0x56146fc45870 2024-09-13T19:34:29.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.994+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc53260 con 0x56146fc45870 2024-09-13T19:34:30.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94645774520304] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94645774517552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc53260 con 0x56146fc45870 2024-09-13T19:34:30.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc53c20 con 0x56146fc45870 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94645774517552] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94645774528400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc53c20 con 0x56146fc45870 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 20 add_watcher() i=0 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 20 add_watcher() i=1 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 20 add_watcher() i=2 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 20 add_watcher() i=3 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 20 add_watcher() i=4 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 20 add_watcher() i=5 2024-09-13T19:34:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:29.998+0000 7f14596a0980 20 add_watcher() i=6 2024-09-13T19:34:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94645774528400] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 20 add_watcher() i=7 2024-09-13T19:34:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc56f90 con 0x56146fc40e80 2024-09-13T19:34:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94645774543232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc53d90 con 0x56146fc40e80 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94645774543232] v32'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f130dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 5 note: GC not initialized 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f130cfe1640 20 reqs_thread_entry: start 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 20 Filter name: none 2024-09-13T19:34:30.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f12867fc640 20 reqs_thread_entry: start 2024-09-13T19:34:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7abd0 con 0x56146fc40e80 2024-09-13T19:34:30.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7abd0 con 0x7f1448025070 2024-09-13T19:34:30.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:30.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.002+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7ab90 con 0x56146fc40e80 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7ab90 con 0x56146fc4a0f0 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7b0a0 con 0x56146fc4a0f0 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7b500 con 0x56146fc4a0f0 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7b500 con 0x56146fc40e80 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7b500 con 0x56146fc40e80 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7b500 con 0x56146fc4a0f0 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7b460 con 0x56146fc4a0f0 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7b460 con 0x56146fc45870 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc40e80 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x7f1448025070 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:30.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.006+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc4a0f0 2024-09-13T19:34:30.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc45870 2024-09-13T19:34:30.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc45870 2024-09-13T19:34:30.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc4a0f0 2024-09-13T19:34:30.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc45870 2024-09-13T19:34:30.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc40e80 2024-09-13T19:34:30.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc4a0f0 2024-09-13T19:34:30.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.010+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc45870 2024-09-13T19:34:30.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x7f1448025070 2024-09-13T19:34:30.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:30.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc45870 2024-09-13T19:34:30.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc40e80 2024-09-13T19:34:30.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc40e80 2024-09-13T19:34:30.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc4a0f0 2024-09-13T19:34:30.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc40e80 2024-09-13T19:34:30.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc40e80 2024-09-13T19:34:30.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc4a0f0 2024-09-13T19:34:30.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc4a0f0 2024-09-13T19:34:30.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc4a0f0 2024-09-13T19:34:30.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.014+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56146fc7d100 con 0x56146fc45870 2024-09-13T19:34:30.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.018+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.018+0000 7f130dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.018+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94645774543232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc78df0 con 0x56146fc40e80 2024-09-13T19:34:30.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.018+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94645774543232] v32'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.018+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94645774509184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc56980 con 0x7f1448025070 2024-09-13T19:34:30.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.022+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94645774509184] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:30.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.022+0000 7f14596a0980 20 remove_watcher() i=0 2024-09-13T19:34:30.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.022+0000 7f14596a0980 2 removed watcher, disabling cache 2024-09-13T19:34:30.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.022+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94645774513312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc56980 con 0x56146fc40e80 2024-09-13T19:34:30.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.022+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94645774513312] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.022+0000 7f14596a0980 20 remove_watcher() i=1 2024-09-13T19:34:30.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.022+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94645774506704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4f4a0 con 0x56146fc4a0f0 2024-09-13T19:34:30.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.026+0000 7f14571b0640 1 -- 172.21.15.144:0/4134491052 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94645774506704] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144802c070 con 0x56146fc4a0f0 2024-09-13T19:34:30.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.026+0000 7f14596a0980 20 remove_watcher() i=2 2024-09-13T19:34:30.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.026+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94645774519024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4dad0 con 0x7f1448025070 2024-09-13T19:34:30.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.026+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94645774519024] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x7f1448025070 2024-09-13T19:34:30.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.026+0000 7f14596a0980 20 remove_watcher() i=3 2024-09-13T19:34:30.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.026+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94645774523280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4f4a0 con 0x56146fc40e80 2024-09-13T19:34:30.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.030+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94645774523280] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f144c0b3040 con 0x56146fc40e80 2024-09-13T19:34:30.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.030+0000 7f14596a0980 20 remove_watcher() i=4 2024-09-13T19:34:30.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.030+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94645774520304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4dad0 con 0x56146fc45870 2024-09-13T19:34:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.030+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94645774520304] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.030+0000 7f14596a0980 20 remove_watcher() i=5 2024-09-13T19:34:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.030+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94645774517552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4f4a0 con 0x56146fc45870 2024-09-13T19:34:30.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94645774517552] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 20 remove_watcher() i=6 2024-09-13T19:34:30.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94645774528400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56146fc4dad0 con 0x56146fc45870 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14579b1640 1 -- 172.21.15.144:0/4134491052 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94645774528400] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145005e040 con 0x56146fc45870 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 20 remove_watcher() i=7 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc45870 msgr2=0x56146fc47c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc45870 0x56146fc47c60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fc40e80 msgr2=0x56146fc43320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fc40e80 0x56146fc43320 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1448025070 msgr2=0x7f1448026040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1448025070 0x7f1448026040 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56146fc4a0f0 msgr2=0x56146fc4c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56146fc4a0f0 0x56146fc4c5b0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1320034650 msgr2=0x7f1320036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1320034650 0x7f1320036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x56146fc13860 tx=0x7f1448038000 comp rx=0 tx=0).stop 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 msgr2=0x56146fc35a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4134491052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc2e750 0x56146fc35a00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1450023f70 tx=0x7f145004a230 comp rx=0 tx=0).stop 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 reap_dead start 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14569af640 1 -- 172.21.15.144:0/4134491052 reap_dead start 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 shutdown_connections 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 >> 172.21.15.144:0/4134491052 conn(0x56146fc2aa80 msgr2=0x56146fc2fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 shutdown_connections 2024-09-13T19:34:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4134491052 wait complete. 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4147956407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1330034650 msgr2=0x7f1330036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4147956407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1330034650 0x7f1330036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1448047620 tx=0x7f1448024410 comp rx=0 tx=0).stop 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4147956407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc21b60 msgr2=0x56146fc21f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4147956407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc21b60 0x56146fc21f80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56146fc07f40 tx=0x7f145000af40 comp rx=0 tx=0).stop 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4147956407 shutdown_connections 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4147956407 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1330034650 0x7f1330036b10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 --2- 172.21.15.144:0/4147956407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fc21b60 0x56146fc21f80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4147956407 >> 172.21.15.144:0/4147956407 conn(0x56146fc16cb0 msgr2=0x56146fc19730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4147956407 shutdown_connections 2024-09-13T19:34:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.034+0000 7f14596a0980 1 -- 172.21.15.144:0/4147956407 wait complete. 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc109a0 msgr2=0x56146fc12d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc109a0 0x56146fc12d90 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fb18c60 msgr2=0x56146fc0e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fb18c60 0x56146fc0e140 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f133c034650 msgr2=0x7f133c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f133c034650 0x7f133c036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f144c0ad000 tx=0x7f144c0a5040 comp rx=0 tx=0).stop 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 msgr2=0x56146fc07040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fc07040 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1448000f90 tx=0x7f1448001260 comp rx=0 tx=0).stop 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 shutdown_connections 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56146fb18c60 0x56146fc0e140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56146fc109a0 0x56146fc12d90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f133c034650 0x7f133c036b10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 --2- 172.21.15.144:0/3812078415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56146fb148e0 0x56146fc07040 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 >> 172.21.15.144:0/3812078415 conn(0x56146fa88230 msgr2=0x56146fbfa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 shutdown_connections 2024-09-13T19:34:30.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.038+0000 7f14596a0980 1 -- 172.21.15.144:0/3812078415 wait complete. 2024-09-13T19:34:30.051 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T19:34:30.052 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:34:30.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T19:34:30.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T19:34:30.052 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T19:34:30.124 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:30.124 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:30.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.118+0000 7fdb8606e980 1 Processor -- start 2024-09-13T19:34:30.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.118+0000 7fdb8606e980 1 -- start start 2024-09-13T19:34:30.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.118+0000 7fdb8606e980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5641e4752de0 0x5641e47551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.118+0000 7fdb8606e980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641e45d8ae0 con 0x5641e4755740 2024-09-13T19:34:30.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.118+0000 7fdb8606e980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5641e45fce30 con 0x5641e4752de0 2024-09-13T19:34:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb83b7e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5641e4752de0 0x5641e47551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb83b7e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5641e4752de0 0x5641e47551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34474/0 (socket says 172.21.15.144:34474) 2024-09-13T19:34:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb83b7e640 1 -- 172.21.15.144:0/535128622 learned_addr learned my addr 172.21.15.144:0/535128622 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb8337d640 1 --1- 172.21.15.144:0/535128622 >> v1:172.21.15.18:6789/0 conn(0x5641e4755740 0x5641e4757b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37800/0 (socket says 172.21.15.144:37800) 2024-09-13T19:34:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb83b7e640 1 -- 172.21.15.144:0/535128622 >> v1:172.21.15.18:6789/0 conn(0x5641e4755740 legacy=0x5641e4757b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb83b7e640 1 -- 172.21.15.144:0/535128622 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e475a3e0 con 0x5641e4752de0 2024-09-13T19:34:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/535128622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e47551d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a4e0 tx=0x7fdb7401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec0ba5e83149c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb82b7c640 1 -- 172.21.15.144:0/535128622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb740aa540 con 0x5641e4752de0 2024-09-13T19:34:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb82b7c640 1 -- 172.21.15.144:0/535128622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb740aa6e0 con 0x5641e4752de0 2024-09-13T19:34:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.122+0000 7fdb82b7c640 1 -- 172.21.15.144:0/535128622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb740aaa40 con 0x5641e4752de0 2024-09-13T19:34:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.126+0000 7fdb8606e980 1 -- 172.21.15.144:0/535128622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 msgr2=0x5641e47551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.126+0000 7fdb8606e980 1 --2- 172.21.15.144:0/535128622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e47551d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a4e0 tx=0x7fdb7401b090 comp rx=0 tx=0).stop 2024-09-13T19:34:30.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.126+0000 7fdb8606e980 1 -- 172.21.15.144:0/535128622 shutdown_connections 2024-09-13T19:34:30.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.126+0000 7fdb8606e980 1 --2- 172.21.15.144:0/535128622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e47551d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.126+0000 7fdb8606e980 1 -- 172.21.15.144:0/535128622 >> 172.21.15.144:0/535128622 conn(0x5641e46c6270 msgr2=0x5641e46c6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.126+0000 7fdb8606e980 1 -- 172.21.15.144:0/535128622 shutdown_connections 2024-09-13T19:34:30.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.126+0000 7fdb8606e980 1 -- 172.21.15.144:0/535128622 wait complete. 2024-09-13T19:34:30.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.138+0000 7fdb8606e980 1 Processor -- start 2024-09-13T19:34:30.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.138+0000 7fdb8606e980 1 -- start start 2024-09-13T19:34:30.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e483dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641e45fe200 con 0x5641e4752de0 2024-09-13T19:34:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e483dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e483dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34476/0 (socket says 172.21.15.144:34476) 2024-09-13T19:34:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 -- 172.21.15.144:0/1235400492 learned_addr learned my addr 172.21.15.144:0/1235400492 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 -- 172.21.15.144:0/1235400492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e483e270 con 0x5641e4752de0 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/1235400492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e483dca0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdb74017ca0 tx=0x7fdb740033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3c4e90b9a5672e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fda71e0b640 1 -- 172.21.15.144:0/1235400492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb740b9030 con 0x5641e4752de0 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fda71e0b640 1 -- 172.21.15.144:0/1235400492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb740aaac0 con 0x5641e4752de0 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fda71e0b640 1 -- 172.21.15.144:0/1235400492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb740aada0 con 0x5641e4752de0 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 -- 172.21.15.144:0/1235400492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 msgr2=0x5641e483dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 --2- 172.21.15.144:0/1235400492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e483dca0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdb74017ca0 tx=0x7fdb740033b0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 -- 172.21.15.144:0/1235400492 shutdown_connections 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 --2- 172.21.15.144:0/1235400492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e483dca0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 -- 172.21.15.144:0/1235400492 >> 172.21.15.144:0/1235400492 conn(0x5641e46c6270 msgr2=0x5641e48398d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 -- 172.21.15.144:0/1235400492 shutdown_connections 2024-09-13T19:34:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 -- 172.21.15.144:0/1235400492 wait complete. 2024-09-13T19:34:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 Processor -- start 2024-09-13T19:34:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 -- start start 2024-09-13T19:34:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e4844df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb8606e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641e4759e20 con 0x5641e4752de0 2024-09-13T19:34:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e4844df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e4844df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34486/0 (socket says 172.21.15.144:34486) 2024-09-13T19:34:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 -- 172.21.15.144:0/2141287448 learned_addr learned my addr 172.21.15.144:0/2141287448 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.142+0000 7fdb83b7e640 1 -- 172.21.15.144:0/2141287448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e4845330 con 0x5641e4752de0 2024-09-13T19:34:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e4844df0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdb74005cc0 tx=0x7fdb74017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fda6bfff640 1 -- 172.21.15.144:0/2141287448 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb740b9030 con 0x5641e4752de0 2024-09-13T19:34:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fda6bfff640 1 -- 172.21.15.144:0/2141287448 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb740c3070 con 0x5641e4752de0 2024-09-13T19:34:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e48455c0 con 0x5641e4752de0 2024-09-13T19:34:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fda6bfff640 1 -- 172.21.15.144:0/2141287448 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb740bf750 con 0x5641e4752de0 2024-09-13T19:34:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e48482a0 con 0x5641e4752de0 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fda6bfff640 1 -- 172.21.15.144:0/2141287448 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdb740c5030 con 0x5641e4752de0 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fda6bfff640 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda6c0346a0 0x7fda6c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fda6bfff640 1 -- 172.21.15.144:0/2141287448 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb740ba070 con 0x5641e4752de0 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8337d640 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda6c0346a0 0x7fda6c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e4755740 0x5641e484bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e484c3d0 con 0x5641e4755740 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8437f640 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e4755740 0x5641e484bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8337d640 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda6c0346a0 0x7fda6c036b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c000f70 tx=0x7fdb6c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8437f640 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e4755740 0x5641e484bd80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8437f640 1 -- 172.21.15.144:0/2141287448 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb7c0083f0 con 0x5641e4755740 2024-09-13T19:34:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48494c0 con 0x5641e4755740 2024-09-13T19:34:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8437f640 1 -- 172.21.15.144:0/2141287448 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb7c0083f0 con 0x5641e4755740 2024-09-13T19:34:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e484e770 0x5641e4850b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e4851230 con 0x5641e484e770 2024-09-13T19:34:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.146+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e484e770 0x5641e4850b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e484e770 0x5641e4850b60 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb83b7e640 1 -- 172.21.15.144:0/2141287448 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb740ce070 con 0x5641e484e770 2024-09-13T19:34:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e484d610 con 0x5641e4755740 2024-09-13T19:34:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8437f640 1 -- 172.21.15.144:0/2141287448 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb7c0083f0 con 0x5641e4755740 2024-09-13T19:34:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e484daf0 con 0x5641e4755740 2024-09-13T19:34:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8437f640 1 -- 172.21.15.144:0/2141287448 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb7c0083f0 con 0x5641e4755740 2024-09-13T19:34:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8606e980 1 Processor -- start 2024-09-13T19:34:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8606e980 1 -- start start 2024-09-13T19:34:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8606e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e485f970 0x5641e485fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8606e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641e4657800 con 0x5641e485f970 2024-09-13T19:34:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8437f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e485f970 0x5641e485fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8437f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e485f970 0x5641e485fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34500/0 (socket says 172.21.15.144:34500) 2024-09-13T19:34:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8437f640 1 -- 172.21.15.144:0/1174694643 learned_addr learned my addr 172.21.15.144:0/1174694643 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.150+0000 7fdb8437f640 1 -- 172.21.15.144:0/1174694643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e48602d0 con 0x5641e485f970 2024-09-13T19:34:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8437f640 1 --2- 172.21.15.144:0/1174694643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e485f970 0x5641e485fd90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x5641e4845cf0 tx=0x7fdb7c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fda697fa640 1 -- 172.21.15.144:0/1174694643 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c007d70 con 0x5641e485f970 2024-09-13T19:34:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fda697fa640 1 -- 172.21.15.144:0/1174694643 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c01e020 con 0x5641e485f970 2024-09-13T19:34:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8606e980 1 -- 172.21.15.144:0/1174694643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e4860560 con 0x5641e485f970 2024-09-13T19:34:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fda697fa640 1 -- 172.21.15.144:0/1174694643 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c019590 con 0x5641e485f970 2024-09-13T19:34:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8606e980 1 -- 172.21.15.144:0/1174694643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e48631e0 con 0x5641e485f970 2024-09-13T19:34:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fda697fa640 1 -- 172.21.15.144:0/1174694643 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdb7c016040 con 0x5641e485f970 2024-09-13T19:34:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fda697fa640 1 --2- 172.21.15.144:0/1174694643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda5c0346a0 0x7fda5c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fda697fa640 1 -- 172.21.15.144:0/1174694643 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb7c01f030 con 0x5641e485f970 2024-09-13T19:34:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/1174694643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda5c0346a0 0x7fda5c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8606e980 1 Processor -- start 2024-09-13T19:34:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8606e980 1 -- start start 2024-09-13T19:34:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/1174694643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda5c0346a0 0x7fda5c036b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5641e484c8c0 tx=0x7fdb740a3bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8606e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e486c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8606e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641e483e530 con 0x5641e486c400 2024-09-13T19:34:30.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8437f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e486c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8437f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e486c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34506/0 (socket says 172.21.15.144:34506) 2024-09-13T19:34:30.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8437f640 1 -- 172.21.15.144:0/1869845587 learned_addr learned my addr 172.21.15.144:0/1869845587 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.154+0000 7fdb8437f640 1 -- 172.21.15.144:0/1869845587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e486cdb0 con 0x5641e486c400 2024-09-13T19:34:30.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8437f640 1 --2- 172.21.15.144:0/1869845587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e486c7e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c04a2a0 tx=0x7fdb7c023610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605045fceb069ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fda62ffd640 1 -- 172.21.15.144:0/1869845587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c01d040 con 0x5641e486c400 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fda62ffd640 1 -- 172.21.15.144:0/1869845587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c015ce0 con 0x5641e486c400 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fda62ffd640 1 -- 172.21.15.144:0/1869845587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c03abc0 con 0x5641e486c400 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- 172.21.15.144:0/1869845587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 msgr2=0x5641e486c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 --2- 172.21.15.144:0/1869845587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e486c7e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c04a2a0 tx=0x7fdb7c023610 comp rx=0 tx=0).stop 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- 172.21.15.144:0/1869845587 shutdown_connections 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 --2- 172.21.15.144:0/1869845587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e486c7e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- 172.21.15.144:0/1869845587 >> 172.21.15.144:0/1869845587 conn(0x5641e48687e0 msgr2=0x5641e48668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- 172.21.15.144:0/1869845587 shutdown_connections 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- 172.21.15.144:0/1869845587 wait complete. 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 Processor -- start 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- start start 2024-09-13T19:34:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e48737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641e486d3d0 con 0x5641e486c400 2024-09-13T19:34:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8437f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e48737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8437f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e48737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34510/0 (socket says 172.21.15.144:34510) 2024-09-13T19:34:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 learned_addr learned my addr 172.21.15.144:0/4146487665 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e4873d30 con 0x5641e486c400 2024-09-13T19:34:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8437f640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e48737f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c023650 tx=0x7fdb7c04a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fda617fa640 1 -- 172.21.15.144:0/4146487665 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c01d070 con 0x5641e486c400 2024-09-13T19:34:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e4873fc0 con 0x5641e486c400 2024-09-13T19:34:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fda617fa640 1 -- 172.21.15.144:0/4146487665 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c033070 con 0x5641e486c400 2024-09-13T19:34:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fda617fa640 1 -- 172.21.15.144:0/4146487665 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c02b7d0 con 0x5641e486c400 2024-09-13T19:34:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.158+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e48743d0 con 0x5641e486c400 2024-09-13T19:34:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fda617fa640 1 -- 172.21.15.144:0/4146487665 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdb7c035030 con 0x5641e486c400 2024-09-13T19:34:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fda617fa640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda4c034650 0x7fda4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fda617fa640 1 -- 172.21.15.144:0/4146487665 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb7c038bc0 con 0x5641e486c400 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda4c034650 0x7fda4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e487ecb0 0x5641e4881150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48818a0 con 0x5641e487ecb0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8337d640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e487ecb0 0x5641e4881150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda4c034650 0x7fda4c036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb74003430 tx=0x7fdb740d8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8337d640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e487ecb0 0x5641e4881150 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb6c00f620 con 0x5641e487ecb0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 realm 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e487e180 con 0x5641e487ecb0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb6c00f620 con 0x5641e487ecb0 2024-09-13T19:34:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48823a0 con 0x5641e487ecb0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb6c00f620 con 0x5641e487ecb0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48828d0 con 0x5641e487ecb0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb6c00f620 con 0x5641e487ecb0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e48836d0 0x5641e4885ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e4886040 con 0x5641e48836d0 2024-09-13T19:34:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8437f640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e48836d0 0x5641e4885ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.162+0000 7fdb8437f640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e48836d0 0x5641e4885ac0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8606e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8606e980 20 searching for the correct realm 2024-09-13T19:34:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5641e4888020 0x5641e488a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5641e4888020 0x5641e488a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5641e4888020 0x5641e488a4e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb83b7e640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb740b4a20 0x7fdb740bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x7fdb740b4a20 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb740b4a20 0x7fdb740bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb740b4a20 0x7fdb740bf9c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c00f620 con 0x7fdb740b4a20 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e48836d0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb6c00f620 con 0x5641e487ecb0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.166+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e48836d0 2024-09-13T19:34:30.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x7fdb740b4a20 2024-09-13T19:34:30.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e48836d0 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x7fdb740b4a20 2024-09-13T19:34:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.170+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e48836d0 2024-09-13T19:34:30.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e48836d0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x7fdb740b4a20 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.174+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e48836d0 2024-09-13T19:34:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e48836d0 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x7fdb740b4a20 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e4888020 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e48836d0 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x5641e487ecb0 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e488abb0 con 0x7fdb740b4a20 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e4886a00 con 0x5641e487ecb0 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e4886e20 con 0x5641e487ecb0 2024-09-13T19:34:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.178+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e4887280 con 0x5641e487ecb0 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 zone default found 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 4 Realm: () 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 zonegroup default 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e488b030 con 0x5641e48836d0 2024-09-13T19:34:30.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e4886640 con 0x5641e4888020 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e488d380 con 0x5641e4888020 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 started sync module instance, tier type = 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488c6f0 con 0x7fdb740b4a20 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94841007033376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488c6f0 con 0x7fdb740b4a20 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.182+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488df30 con 0x5641e487ecb0 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.186+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94841007033376] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.186+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.186+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94841007036928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488c6f0 con 0x5641e487ecb0 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.186+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488e940 con 0x5641e4888020 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.186+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.186+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94841007036928] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.186+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94841007030848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488c660 con 0x5641e4888020 2024-09-13T19:34:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488f640 con 0x7fdb740b4a20 2024-09-13T19:34:30.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94841007043232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488fd30 con 0x7fdb740b4a20 2024-09-13T19:34:30.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e4890850 con 0x5641e487ecb0 2024-09-13T19:34:30.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94841007030848] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94841007043232] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94841007047456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e4890810 con 0x5641e487ecb0 2024-09-13T19:34:30.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.190+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e4890c40 con 0x5641e48836d0 2024-09-13T19:34:30.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.194+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94841007047456] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.194+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.194+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94841007044480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e4890fe0 con 0x5641e48836d0 2024-09-13T19:34:30.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.194+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e48919a0 con 0x5641e48836d0 2024-09-13T19:34:30.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.194+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94841007044480] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.194+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.194+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94841007041760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e48919a0 con 0x5641e48836d0 2024-09-13T19:34:30.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.194+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e4892360 con 0x5641e48836d0 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94841007041760] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94841007052016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e4892540 con 0x5641e48836d0 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 20 add_watcher() i=0 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 20 add_watcher() i=1 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 20 add_watcher() i=2 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 20 add_watcher() i=3 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 20 add_watcher() i=4 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 20 add_watcher() i=5 2024-09-13T19:34:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 20 add_watcher() i=6 2024-09-13T19:34:30.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94841007052016] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 20 add_watcher() i=7 2024-09-13T19:34:30.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.198+0000 7fdb8606e980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:30.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48956f0 con 0x5641e487ecb0 2024-09-13T19:34:30.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94841007067360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e48924b0 con 0x5641e487ecb0 2024-09-13T19:34:30.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94841007067360] v32'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fda39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:30.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:30.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 5 note: GC not initialized 2024-09-13T19:34:30.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fda38fe1640 20 reqs_thread_entry: start 2024-09-13T19:34:30.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:30.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 20 Filter name: none 2024-09-13T19:34:30.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fd9b27fc640 20 reqs_thread_entry: start 2024-09-13T19:34:30.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9390 con 0x5641e487ecb0 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9390 con 0x7fdb740b4a20 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e487ecb0 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e4888020 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.202+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e4888020 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e4888020 2024-09-13T19:34:30.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e487ecb0 2024-09-13T19:34:30.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e487ecb0 2024-09-13T19:34:30.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e4888020 2024-09-13T19:34:30.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e4888020 2024-09-13T19:34:30.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b9350 con 0x5641e48836d0 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e487ecb0 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x7fdb740b4a20 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e4888020 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.206+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e48836d0 2024-09-13T19:34:30.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e48836d0 2024-09-13T19:34:30.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e4888020 2024-09-13T19:34:30.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e48836d0 2024-09-13T19:34:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e487ecb0 2024-09-13T19:34:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e4888020 2024-09-13T19:34:30.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e48836d0 2024-09-13T19:34:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x7fdb740b4a20 2024-09-13T19:34:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.210+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e48836d0 2024-09-13T19:34:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e487ecb0 2024-09-13T19:34:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e487ecb0 2024-09-13T19:34:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e4888020 2024-09-13T19:34:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e487ecb0 2024-09-13T19:34:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e487ecb0 2024-09-13T19:34:30.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e4888020 2024-09-13T19:34:30.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e4888020 2024-09-13T19:34:30.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e4888020 2024-09-13T19:34:30.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e48bb080 con 0x5641e48836d0 2024-09-13T19:34:30.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.214+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.218+0000 7fda39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.218+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94841007067360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e48b7180 con 0x5641e487ecb0 2024-09-13T19:34:30.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.218+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94841007067360] v32'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.218+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94841007033376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e48950e0 con 0x7fdb740b4a20 2024-09-13T19:34:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.218+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94841007033376] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.218+0000 7fdb8606e980 20 remove_watcher() i=0 2024-09-13T19:34:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.218+0000 7fdb8606e980 2 removed watcher, disabling cache 2024-09-13T19:34:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.218+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94841007036928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488cc20 con 0x5641e487ecb0 2024-09-13T19:34:30.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.222+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94841007036928] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.222+0000 7fdb8606e980 20 remove_watcher() i=1 2024-09-13T19:34:30.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.222+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94841007030848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488cc20 con 0x5641e4888020 2024-09-13T19:34:30.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.222+0000 7fdb83b7e640 1 -- 172.21.15.144:0/4146487665 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94841007030848] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb740e7040 con 0x5641e4888020 2024-09-13T19:34:30.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.222+0000 7fdb8606e980 20 remove_watcher() i=2 2024-09-13T19:34:30.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.222+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94841007043232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488c240 con 0x7fdb740b4a20 2024-09-13T19:34:30.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.226+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94841007043232] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x7fdb740b4a20 2024-09-13T19:34:30.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.226+0000 7fdb8606e980 20 remove_watcher() i=3 2024-09-13T19:34:30.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.226+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94841007047456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488cc20 con 0x5641e487ecb0 2024-09-13T19:34:30.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.226+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94841007047456] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c02b040 con 0x5641e487ecb0 2024-09-13T19:34:30.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.226+0000 7fdb8606e980 20 remove_watcher() i=4 2024-09-13T19:34:30.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.226+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94841007044480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488f2a0 con 0x5641e48836d0 2024-09-13T19:34:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.230+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94841007044480] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.230+0000 7fdb8606e980 20 remove_watcher() i=5 2024-09-13T19:34:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.230+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94841007041760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488c240 con 0x5641e48836d0 2024-09-13T19:34:30.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.230+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94841007041760] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.230+0000 7fdb8606e980 20 remove_watcher() i=6 2024-09-13T19:34:30.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.230+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94841007052016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e488cc20 con 0x5641e48836d0 2024-09-13T19:34:30.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8437f640 1 -- 172.21.15.144:0/4146487665 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94841007052016] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c051020 con 0x5641e48836d0 2024-09-13T19:34:30.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 20 remove_watcher() i=7 2024-09-13T19:34:30.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e48836d0 msgr2=0x5641e4885ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e48836d0 0x5641e4885ac0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e487ecb0 msgr2=0x5641e4881150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e487ecb0 0x5641e4881150 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb740b4a20 msgr2=0x7fdb740bf9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb740b4a20 0x7fdb740bf9c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5641e4888020 msgr2=0x5641e488a4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5641e4888020 0x5641e488a4e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda4c034650 msgr2=0x7fda4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda4c034650 0x7fda4c036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb74003430 tx=0x7fdb740d8000 comp rx=0 tx=0).stop 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 msgr2=0x5641e48737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/4146487665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e486c400 0x5641e48737f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c023650 tx=0x7fdb7c04a200 comp rx=0 tx=0).stop 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8337d640 1 -- 172.21.15.144:0/4146487665 reap_dead start 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 shutdown_connections 2024-09-13T19:34:30.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 >> 172.21.15.144:0/4146487665 conn(0x5641e48687e0 msgr2=0x5641e48668b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 shutdown_connections 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/4146487665 wait complete. 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/1174694643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda5c0346a0 msgr2=0x7fda5c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/1174694643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda5c0346a0 0x7fda5c036b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5641e484c8c0 tx=0x7fdb740a3bc0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/1174694643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e485f970 msgr2=0x5641e485fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/1174694643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e485f970 0x5641e485fd90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x5641e4845cf0 tx=0x7fdb7c00af40 comp rx=0 tx=0).stop 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/1174694643 shutdown_connections 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/1174694643 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda5c0346a0 0x7fda5c036b60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/1174694643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e485f970 0x5641e485fd90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/1174694643 >> 172.21.15.144:0/1174694643 conn(0x5641e4854ac0 msgr2=0x5641e4857540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/1174694643 shutdown_connections 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/1174694643 wait complete. 2024-09-13T19:34:30.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e484e770 msgr2=0x5641e4850b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e484e770 0x5641e4850b60 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e4755740 msgr2=0x5641e484bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e4755740 0x5641e484bd80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda6c0346a0 msgr2=0x7fda6c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda6c0346a0 0x7fda6c036b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c000f70 tx=0x7fdb6c001380 comp rx=0 tx=0).stop 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 msgr2=0x5641e4844df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e4844df0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdb74005cc0 tx=0x7fdb74017e30 comp rx=0 tx=0).stop 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 shutdown_connections 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5641e4755740 0x5641e484bd80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5641e484e770 0x5641e4850b60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fda6c0346a0 0x7fda6c036b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 --2- 172.21.15.144:0/2141287448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641e4752de0 0x5641e4844df0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 >> 172.21.15.144:0/2141287448 conn(0x5641e46c6270 msgr2=0x5641e4838450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 shutdown_connections 2024-09-13T19:34:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.234+0000 7fdb8606e980 1 -- 172.21.15.144:0/2141287448 wait complete. 2024-09-13T19:34:30.250 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T19:34:30.250 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T19:34:30.251 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T19:34:30.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T19:34:30.251 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T19:34:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813f916980 1 Processor -- start 2024-09-13T19:34:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813f916980 1 -- start start 2024-09-13T19:34:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813f916980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5599980aa290 0x5599981383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813f916980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559997fbdae0 con 0x5599981388e0 2024-09-13T19:34:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813f916980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x559997fe1e30 con 0x5599980aa290 2024-09-13T19:34:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813d426640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5599980aa290 0x5599981383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813d426640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5599980aa290 0x5599981383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34524/0 (socket says 172.21.15.144:34524) 2024-09-13T19:34:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813d426640 1 -- 172.21.15.144:0/1355051931 learned_addr learned my addr 172.21.15.144:0/1355051931 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813d426640 1 -- 172.21.15.144:0/1355051931 >> v1:172.21.15.18:6789/0 conn(0x5599981388e0 legacy=0x55999813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.326+0000 7f813d426640 1 -- 172.21.15.144:0/1355051931 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599980aa820 con 0x5599980aa290 2024-09-13T19:34:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f813d426640 1 --2- 172.21.15.144:0/1355051931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x5599981383a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f813000a4e0 tx=0x7f813001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b7056b76aee5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f8137fff640 1 -- 172.21.15.144:0/1355051931 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81300aa540 con 0x5599980aa290 2024-09-13T19:34:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f8137fff640 1 -- 172.21.15.144:0/1355051931 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81300aa6e0 con 0x5599980aa290 2024-09-13T19:34:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f8137fff640 1 -- 172.21.15.144:0/1355051931 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81300aaa40 con 0x5599980aa290 2024-09-13T19:34:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f813f916980 1 -- 172.21.15.144:0/1355051931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 msgr2=0x5599981383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f813f916980 1 --2- 172.21.15.144:0/1355051931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x5599981383a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f813000a4e0 tx=0x7f813001b090 comp rx=0 tx=0).stop 2024-09-13T19:34:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f813f916980 1 -- 172.21.15.144:0/1355051931 shutdown_connections 2024-09-13T19:34:30.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f813f916980 1 --2- 172.21.15.144:0/1355051931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x5599981383a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f813f916980 1 -- 172.21.15.144:0/1355051931 >> 172.21.15.144:0/1355051931 conn(0x559998130090 msgr2=0x5599981324b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f813f916980 1 -- 172.21.15.144:0/1355051931 shutdown_connections 2024-09-13T19:34:30.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.330+0000 7f813f916980 1 -- 172.21.15.144:0/1355051931 wait complete. 2024-09-13T19:34:30.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.346+0000 7f813f916980 1 Processor -- start 2024-09-13T19:34:30.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.346+0000 7f813f916980 1 -- start start 2024-09-13T19:34:30.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.346+0000 7f813f916980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998220a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.346+0000 7f813f916980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559997fe3200 con 0x5599980aa290 2024-09-13T19:34:30.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.346+0000 7f813d426640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998220a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.346+0000 7f813d426640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998220a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34530/0 (socket says 172.21.15.144:34530) 2024-09-13T19:34:30.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813d426640 1 -- 172.21.15.144:0/769236615 learned_addr learned my addr 172.21.15.144:0/769236615 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813d426640 1 -- 172.21.15.144:0/769236615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559998220fd0 con 0x5599980aa290 2024-09-13T19:34:30.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813d426640 1 --2- 172.21.15.144:0/769236615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998220a00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8130017ca0 tx=0x7f81300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c50784e5cd350e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f802b606640 1 -- 172.21.15.144:0/769236615 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81300b9030 con 0x5599980aa290 2024-09-13T19:34:30.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f802b606640 1 -- 172.21.15.144:0/769236615 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81300aaac0 con 0x5599980aa290 2024-09-13T19:34:30.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f802b606640 1 -- 172.21.15.144:0/769236615 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81300aada0 con 0x5599980aa290 2024-09-13T19:34:30.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 -- 172.21.15.144:0/769236615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 msgr2=0x559998220a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 --2- 172.21.15.144:0/769236615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998220a00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8130017ca0 tx=0x7f81300033b0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 -- 172.21.15.144:0/769236615 shutdown_connections 2024-09-13T19:34:30.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 --2- 172.21.15.144:0/769236615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998220a00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 -- 172.21.15.144:0/769236615 >> 172.21.15.144:0/769236615 conn(0x559998130090 msgr2=0x55999821c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 -- 172.21.15.144:0/769236615 shutdown_connections 2024-09-13T19:34:30.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 -- 172.21.15.144:0/769236615 wait complete. 2024-09-13T19:34:30.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 Processor -- start 2024-09-13T19:34:30.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 -- start start 2024-09-13T19:34:30.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813f916980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55999813cf00 con 0x5599980aa290 2024-09-13T19:34:30.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813d426640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813d426640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998135c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34536/0 (socket says 172.21.15.144:34536) 2024-09-13T19:34:30.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.350+0000 7f813d426640 1 -- 172.21.15.144:0/2264469472 learned_addr learned my addr 172.21.15.144:0/2264469472 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813d426640 1 -- 172.21.15.144:0/2264469472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599981361c0 con 0x5599980aa290 2024-09-13T19:34:30.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813d426640 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998135c80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8130005cc0 tx=0x7f8130017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f8029e03640 1 -- 172.21.15.144:0/2264469472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81300b9030 con 0x5599980aa290 2024-09-13T19:34:30.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599981343a0 con 0x5599980aa290 2024-09-13T19:34:30.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f8029e03640 1 -- 172.21.15.144:0/2264469472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81300c3070 con 0x5599980aa290 2024-09-13T19:34:30.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f8029e03640 1 -- 172.21.15.144:0/2264469472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81300bf750 con 0x5599980aa290 2024-09-13T19:34:30.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559998134890 con 0x5599980aa290 2024-09-13T19:34:30.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f8029e03640 1 -- 172.21.15.144:0/2264469472 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f81300c5030 con 0x5599980aa290 2024-09-13T19:34:30.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f8029e03640 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80240346a0 0x7f8024036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f8029e03640 1 -- 172.21.15.144:0/2264469472 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f81300ba070 con 0x5599980aa290 2024-09-13T19:34:30.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813cc25640 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80240346a0 0x7f8024036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5599981388e0 0x559998231050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998231590 con 0x5599981388e0 2024-09-13T19:34:30.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813dc27640 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5599981388e0 0x559998231050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813cc25640 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80240346a0 0x7f8024036b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8128001e20 tx=0x7f81280013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.354+0000 7f813dc27640 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5599981388e0 0x559998231050 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813dc27640 1 -- 172.21.15.144:0/2264469472 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x5599981388e0 2024-09-13T19:34:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998231930 con 0x5599981388e0 2024-09-13T19:34:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813dc27640 1 -- 172.21.15.144:0/2264469472 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81380083f0 con 0x5599981388e0 2024-09-13T19:34:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559998233710 0x559998235b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599982361d0 con 0x559998233710 2024-09-13T19:34:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813d426640 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559998233710 0x559998235b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813d426640 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559998233710 0x559998235b00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813d426640 1 -- 172.21.15.144:0/2264469472 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81300ce070 con 0x559998233710 2024-09-13T19:34:30.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599982325b0 con 0x5599981388e0 2024-09-13T19:34:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813dc27640 1 -- 172.21.15.144:0/2264469472 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81380083f0 con 0x5599981388e0 2024-09-13T19:34:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998232a90 con 0x5599981388e0 2024-09-13T19:34:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813dc27640 1 -- 172.21.15.144:0/2264469472 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81380083f0 con 0x5599981388e0 2024-09-13T19:34:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 Processor -- start 2024-09-13T19:34:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 -- start start 2024-09-13T19:34:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982448f0 0x559998244d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813f916980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55999803c800 con 0x5599982448f0 2024-09-13T19:34:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813dc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982448f0 0x559998244d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813dc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982448f0 0x559998244d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34550/0 (socket says 172.21.15.144:34550) 2024-09-13T19:34:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.358+0000 7f813dc27640 1 -- 172.21.15.144:0/1739730025 learned_addr learned my addr 172.21.15.144:0/1739730025 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813dc27640 1 -- 172.21.15.144:0/1739730025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559998245250 con 0x5599982448f0 2024-09-13T19:34:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813dc27640 1 --2- 172.21.15.144:0/1739730025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982448f0 0x559998244d10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x5599981359f0 tx=0x7f813800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f8022ffd640 1 -- 172.21.15.144:0/1739730025 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8138007dd0 con 0x5599982448f0 2024-09-13T19:34:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f8022ffd640 1 -- 172.21.15.144:0/1739730025 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813801e020 con 0x5599982448f0 2024-09-13T19:34:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813f916980 1 -- 172.21.15.144:0/1739730025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599982454e0 con 0x5599982448f0 2024-09-13T19:34:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f8022ffd640 1 -- 172.21.15.144:0/1739730025 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8138019590 con 0x5599982448f0 2024-09-13T19:34:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813f916980 1 -- 172.21.15.144:0/1739730025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559998248160 con 0x5599982448f0 2024-09-13T19:34:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f8022ffd640 1 -- 172.21.15.144:0/1739730025 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8138016040 con 0x5599982448f0 2024-09-13T19:34:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f8022ffd640 1 --2- 172.21.15.144:0/1739730025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80180346a0 0x7f8018036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f8022ffd640 1 -- 172.21.15.144:0/1739730025 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f813801f030 con 0x5599982448f0 2024-09-13T19:34:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813d426640 1 --2- 172.21.15.144:0/1739730025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80180346a0 0x7f8018036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813f916980 1 Processor -- start 2024-09-13T19:34:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813f916980 1 -- start start 2024-09-13T19:34:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813d426640 1 --2- 172.21.15.144:0/1739730025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80180346a0 0x7f8018036b60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x559998134b80 tx=0x7f81300c67e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813f916980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813f916980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559998221290 con 0x5599982513a0 2024-09-13T19:34:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813dc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813dc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34564/0 (socket says 172.21.15.144:34564) 2024-09-13T19:34:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.362+0000 7f813dc27640 1 -- 172.21.15.144:0/3829523748 learned_addr learned my addr 172.21.15.144:0/3829523748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813dc27640 1 -- 172.21.15.144:0/3829523748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559998251d70 con 0x5599982513a0 2024-09-13T19:34:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813dc27640 1 --2- 172.21.15.144:0/3829523748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982517a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f813804a2e0 tx=0x7f8138023730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a4ca665d36a9bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f8020ff9640 1 -- 172.21.15.144:0/3829523748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f813801d040 con 0x5599982513a0 2024-09-13T19:34:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f8020ff9640 1 -- 172.21.15.144:0/3829523748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8138015c90 con 0x5599982513a0 2024-09-13T19:34:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f8020ff9640 1 -- 172.21.15.144:0/3829523748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8138022a60 con 0x5599982513a0 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- 172.21.15.144:0/3829523748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 msgr2=0x5599982517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 --2- 172.21.15.144:0/3829523748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982517a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f813804a2e0 tx=0x7f8138023730 comp rx=0 tx=0).stop 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- 172.21.15.144:0/3829523748 shutdown_connections 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 --2- 172.21.15.144:0/3829523748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982517a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- 172.21.15.144:0/3829523748 >> 172.21.15.144:0/3829523748 conn(0x55999824d780 msgr2=0x55999824b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- 172.21.15.144:0/3829523748 shutdown_connections 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- 172.21.15.144:0/3829523748 wait complete. 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 Processor -- start 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- start start 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559998252370 con 0x5599982513a0 2024-09-13T19:34:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813dc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813dc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34580/0 (socket says 172.21.15.144:34580) 2024-09-13T19:34:30.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 learned_addr learned my addr 172.21.15.144:0/208059883 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559998258ce0 con 0x5599982513a0 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813dc27640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982587a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8138023770 tx=0x7f813804a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f800effd640 1 -- 172.21.15.144:0/208059883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f813801d030 con 0x5599982513a0 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559998258f70 con 0x5599982513a0 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f800effd640 1 -- 172.21.15.144:0/208059883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8138015e40 con 0x5599982513a0 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f800effd640 1 -- 172.21.15.144:0/208059883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8138017770 con 0x5599982513a0 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.366+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55999825bc50 con 0x5599982513a0 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f800effd640 1 -- 172.21.15.144:0/208059883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f81380155f0 con 0x5599982513a0 2024-09-13T19:34:30.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f800effd640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80080345b0 0x7f8008036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f800effd640 1 -- 172.21.15.144:0/208059883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8138034070 con 0x5599982513a0 2024-09-13T19:34:30.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813d426640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80080345b0 0x7f8008036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559998263c40 0x5599982660e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998266830 con 0x559998263c40 2024-09-13T19:34:30.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813cc25640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559998263c40 0x5599982660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813d426640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80080345b0 0x7f8008036a70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f81300b7010 tx=0x7f81300e1000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813cc25640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559998263c40 0x5599982660e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f812800d040 con 0x559998263c40 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 realm 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998263110 con 0x559998263c40 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f812800d040 con 0x559998263c40 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998267330 con 0x559998263c40 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f812800d040 con 0x559998263c40 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998267c00 con 0x559998263c40 2024-09-13T19:34:30.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f812800d040 con 0x559998263c40 2024-09-13T19:34:30.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599982684b0 0x55999826a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.370+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999826b000 con 0x5599982684b0 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813dc27640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599982684b0 0x55999826a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813dc27640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599982684b0 0x55999826a8a0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813f916980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813f916980 20 searching for the correct realm 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55999826cfd0 0x55999826f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x55999826cfd0 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813d426640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55999826cfd0 0x55999826f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813d426640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55999826cfd0 0x55999826f490 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813d426640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81300a98c0 0x7f81300dc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x7f81300a98c0 2024-09-13T19:34:30.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813cc25640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81300a98c0 0x7f81300dc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813cc25640 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81300a98c0 0x7f81300dc3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812800d040 con 0x7f81300a98c0 2024-09-13T19:34:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x5599982684b0 2024-09-13T19:34:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.374+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x559998263c40 2024-09-13T19:34:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f812800d040 con 0x559998263c40 2024-09-13T19:34:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x559998263c40 2024-09-13T19:34:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x559998263c40 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x5599982684b0 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x7f81300a98c0 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x55999826cfd0 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x559998263c40 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x5599982684b0 2024-09-13T19:34:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x559998263c40 2024-09-13T19:34:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x7f81300a98c0 2024-09-13T19:34:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999826fb60 con 0x55999826cfd0 2024-09-13T19:34:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.378+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x55999826cfd0 2024-09-13T19:34:30.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x5599982684b0 2024-09-13T19:34:30.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x55999826cfd0 2024-09-13T19:34:30.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x55999826cfd0 2024-09-13T19:34:30.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x559998263c40 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x559998263c40 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x5599982684b0 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x55999826cfd0 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x7f81300a98c0 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x559998263c40 2024-09-13T19:34:30.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.382+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x5599982684b0 2024-09-13T19:34:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x55999826cfd0 2024-09-13T19:34:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x5599982684b0 2024-09-13T19:34:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x7f81300a98c0 2024-09-13T19:34:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x55999826cfd0 2024-09-13T19:34:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x5599982684b0 2024-09-13T19:34:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x559998263c40 2024-09-13T19:34:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f81300fa040 con 0x7f81300a98c0 2024-09-13T19:34:30.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813f916980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:30.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813f916980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:30.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813f916980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813f916980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813f916980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813f916980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.386+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999826b9f0 con 0x559998263c40 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999826be70 con 0x559998263c40 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999826c290 con 0x559998263c40 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 zone default found 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 4 Realm: () 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 zonegroup default 2024-09-13T19:34:30.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999826c290 con 0x5599982684b0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998271e70 con 0x55999826cfd0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998272210 con 0x55999826cfd0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 started sync module instance, tier type = 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:30.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599982712b0 con 0x7f81300a98c0 2024-09-13T19:34:30.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94118171056080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599982712b0 con 0x7f81300a98c0 2024-09-13T19:34:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.390+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998272bd0 con 0x559998263c40 2024-09-13T19:34:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.394+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94118171056080] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.394+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.394+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94118171053872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998272bd0 con 0x559998263c40 2024-09-13T19:34:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.394+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998273590 con 0x55999826cfd0 2024-09-13T19:34:30.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94118171053872] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94118171060000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998272b40 con 0x55999826cfd0 2024-09-13T19:34:30.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998274290 con 0x7f81300a98c0 2024-09-13T19:34:30.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94118171066096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998274b30 con 0x7f81300a98c0 2024-09-13T19:34:30.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599982754f0 con 0x559998263c40 2024-09-13T19:34:30.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94118171060000] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94118171066096] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94118171070528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998274a80 con 0x559998263c40 2024-09-13T19:34:30.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.398+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998275460 con 0x5599982684b0 2024-09-13T19:34:30.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.402+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94118171070528] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.402+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.402+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94118171067856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599982749f0 con 0x5599982684b0 2024-09-13T19:34:30.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.402+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998276270 con 0x5599982684b0 2024-09-13T19:34:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.402+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94118171067856] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94118171072784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599982761e0 con 0x5599982684b0 2024-09-13T19:34:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998276c30 con 0x5599982684b0 2024-09-13T19:34:30.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94118171076384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599982770e0 con 0x5599982684b0 2024-09-13T19:34:30.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 20 add_watcher() i=0 2024-09-13T19:34:30.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 20 add_watcher() i=1 2024-09-13T19:34:30.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 20 add_watcher() i=2 2024-09-13T19:34:30.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 20 add_watcher() i=3 2024-09-13T19:34:30.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 20 add_watcher() i=4 2024-09-13T19:34:30.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 20 add_watcher() i=5 2024-09-13T19:34:30.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94118171072784] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.406+0000 7f813f916980 20 add_watcher() i=6 2024-09-13T19:34:30.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94118171076384] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 20 add_watcher() i=7 2024-09-13T19:34:30.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:30.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559998275d30 con 0x559998263c40 2024-09-13T19:34:30.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94118171073840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998277660 con 0x559998263c40 2024-09-13T19:34:30.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94118171073840] v32'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f7ff37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:30.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:30.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 5 note: GC not initialized 2024-09-13T19:34:30.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f7ff27e4640 20 reqs_thread_entry: start 2024-09-13T19:34:30.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:30.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 20 Filter name: none 2024-09-13T19:34:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f7f63fff640 20 reqs_thread_entry: start 2024-09-13T19:34:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999829d260 con 0x559998263c40 2024-09-13T19:34:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:34:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.410+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999829e7b0 con 0x5599982684b0 2024-09-13T19:34:30.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.414+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.414+0000 7f7ff37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.414+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94118171073840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999829c610 con 0x559998263c40 2024-09-13T19:34:30.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.414+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94118171073840] v32'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.414+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94118171056080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999829c610 con 0x7f81300a98c0 2024-09-13T19:34:30.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.418+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94118171056080] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.418+0000 7f813f916980 20 remove_watcher() i=0 2024-09-13T19:34:30.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.418+0000 7f813f916980 2 removed watcher, disabling cache 2024-09-13T19:34:30.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.418+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94118171053872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999829c610 con 0x559998263c40 2024-09-13T19:34:30.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.418+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94118171053872] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.418+0000 7f813f916980 20 remove_watcher() i=1 2024-09-13T19:34:30.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.418+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94118171060000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998270f30 con 0x55999826cfd0 2024-09-13T19:34:30.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.422+0000 7f813d426640 1 -- 172.21.15.144:0/208059883 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94118171060000] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300ea070 con 0x55999826cfd0 2024-09-13T19:34:30.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.422+0000 7f813f916980 20 remove_watcher() i=2 2024-09-13T19:34:30.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.422+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94118171066096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999829c610 con 0x7f81300a98c0 2024-09-13T19:34:30.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.422+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94118171066096] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x7f81300a98c0 2024-09-13T19:34:30.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.422+0000 7f813f916980 20 remove_watcher() i=3 2024-09-13T19:34:30.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.422+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94118171070528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998272720 con 0x559998263c40 2024-09-13T19:34:30.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.426+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94118171070528] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f812802a040 con 0x559998263c40 2024-09-13T19:34:30.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.426+0000 7f813f916980 20 remove_watcher() i=4 2024-09-13T19:34:30.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.426+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94118171067856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998273ef0 con 0x5599982684b0 2024-09-13T19:34:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.426+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94118171067856] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.426+0000 7f813f916980 20 remove_watcher() i=5 2024-09-13T19:34:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.426+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94118171072784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999829c610 con 0x5599982684b0 2024-09-13T19:34:30.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94118171072784] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 20 remove_watcher() i=6 2024-09-13T19:34:30.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94118171076384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559998275040 con 0x5599982684b0 2024-09-13T19:34:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813dc27640 1 -- 172.21.15.144:0/208059883 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94118171076384] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8138042020 con 0x5599982684b0 2024-09-13T19:34:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 20 remove_watcher() i=7 2024-09-13T19:34:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599982684b0 msgr2=0x55999826a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5599982684b0 0x55999826a8a0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559998263c40 msgr2=0x5599982660e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559998263c40 0x5599982660e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81300a98c0 msgr2=0x7f81300dc3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f81300a98c0 0x7f81300dc3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55999826cfd0 msgr2=0x55999826f490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55999826cfd0 0x55999826f490 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80080345b0 msgr2=0x7f8008036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80080345b0 0x7f8008036a70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f81300b7010 tx=0x7f81300e1000 comp rx=0 tx=0).stop 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 msgr2=0x5599982587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813cc25640 1 -- 172.21.15.144:0/208059883 reap_dead start 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982587a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8138023770 tx=0x7f813804a240 comp rx=0 tx=0).stop 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 shutdown_connections 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/208059883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982513a0 0x5599982587a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 >> 172.21.15.144:0/208059883 conn(0x55999824d780 msgr2=0x55999824b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 shutdown_connections 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/208059883 wait complete. 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/1739730025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80180346a0 msgr2=0x7f8018036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/1739730025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80180346a0 0x7f8018036b60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x559998134b80 tx=0x7f81300c67e0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/1739730025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982448f0 msgr2=0x559998244d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/1739730025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982448f0 0x559998244d10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x5599981359f0 tx=0x7f813800af40 comp rx=0 tx=0).stop 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/1739730025 shutdown_connections 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/1739730025 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80180346a0 0x7f8018036b60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/1739730025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599982448f0 0x559998244d10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/1739730025 >> 172.21.15.144:0/1739730025 conn(0x559998239a40 msgr2=0x55999823c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/1739730025 shutdown_connections 2024-09-13T19:34:30.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/1739730025 wait complete. 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559998233710 msgr2=0x559998235b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559998233710 0x559998235b00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5599981388e0 msgr2=0x559998231050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.430+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5599981388e0 0x559998231050 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80240346a0 msgr2=0x7f8024036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80240346a0 0x7f8024036b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8128001e20 tx=0x7f81280013a0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 msgr2=0x559998135c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998135c80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8130005cc0 tx=0x7f8130017e30 comp rx=0 tx=0).stop 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 shutdown_connections 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5599981388e0 0x559998231050 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559998233710 0x559998235b00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f80240346a0 0x7f8024036b60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 --2- 172.21.15.144:0/2264469472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599980aa290 0x559998135c80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 >> 172.21.15.144:0/2264469472 conn(0x559998130090 msgr2=0x55999821b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 shutdown_connections 2024-09-13T19:34:30.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.434+0000 7f813f916980 1 -- 172.21.15.144:0/2264469472 wait complete. 2024-09-13T19:34:30.448 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T19:34:30.448 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T19:34:30.449 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T19:34:30.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T19:34:30.449 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-13T19:34:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0f01d2980 1 Processor -- start 2024-09-13T19:34:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0f01d2980 1 -- start start 2024-09-13T19:34:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0f01d2980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560767a833c0 0x560767a81b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0f01d2980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560767994ae0 con 0x560767a837d0 2024-09-13T19:34:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0f01d2980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5607679b8e30 con 0x560767a833c0 2024-09-13T19:34:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0edce2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560767a833c0 0x560767a81b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0edce2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560767a833c0 0x560767a81b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34594/0 (socket says 172.21.15.144:34594) 2024-09-13T19:34:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0edce2640 1 -- 172.21.15.144:0/2234160285 learned_addr learned my addr 172.21.15.144:0/2234160285 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0edce2640 1 -- 172.21.15.144:0/2234160285 >> v1:172.21.15.18:6789/0 conn(0x560767a837d0 legacy=0x560767a820c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.518+0000 7ff0edce2640 1 -- 172.21.15.144:0/2234160285 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560767a828f0 con 0x560767a833c0 2024-09-13T19:34:30.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0edce2640 1 --2- 172.21.15.144:0/2234160285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767a81b80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000a5c0 tx=0x7ff0e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5fa742123f88f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0ecce0640 1 -- 172.21.15.144:0/2234160285 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e00a6070 con 0x560767a833c0 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0ecce0640 1 -- 172.21.15.144:0/2234160285 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e00af070 con 0x560767a833c0 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0ecce0640 1 -- 172.21.15.144:0/2234160285 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e00aa5c0 con 0x560767a833c0 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0f01d2980 1 -- 172.21.15.144:0/2234160285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 msgr2=0x560767a81b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/2234160285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767a81b80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000a5c0 tx=0x7ff0e001b340 comp rx=0 tx=0).stop 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0f01d2980 1 -- 172.21.15.144:0/2234160285 shutdown_connections 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/2234160285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767a81b80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0f01d2980 1 -- 172.21.15.144:0/2234160285 >> 172.21.15.144:0/2234160285 conn(0x560767b081c0 msgr2=0x560767b0a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0f01d2980 1 -- 172.21.15.144:0/2234160285 shutdown_connections 2024-09-13T19:34:30.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.522+0000 7ff0f01d2980 1 -- 172.21.15.144:0/2234160285 wait complete. 2024-09-13T19:34:30.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0f01d2980 1 Processor -- start 2024-09-13T19:34:30.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0f01d2980 1 -- start start 2024-09-13T19:34:30.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0f01d2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767bf9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0f01d2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5607679ba200 con 0x560767a833c0 2024-09-13T19:34:30.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0edce2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767bf9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0edce2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767bf9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34610/0 (socket says 172.21.15.144:34610) 2024-09-13T19:34:30.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0edce2640 1 -- 172.21.15.144:0/1012670873 learned_addr learned my addr 172.21.15.144:0/1012670873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0edce2640 1 -- 172.21.15.144:0/1012670873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560767bfa1c0 con 0x560767a833c0 2024-09-13T19:34:30.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7ff0edce2640 1 --2- 172.21.15.144:0/1012670873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767bf9bf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0017f50 tx=0x7ff0e0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769a0e381dd08616 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7fefdbe07640 1 -- 172.21.15.144:0/1012670873 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e00aa8f0 con 0x560767a833c0 2024-09-13T19:34:30.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7fefdbe07640 1 -- 172.21.15.144:0/1012670873 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e00aaa90 con 0x560767a833c0 2024-09-13T19:34:30.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.538+0000 7fefdbe07640 1 -- 172.21.15.144:0/1012670873 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e00aad70 con 0x560767a833c0 2024-09-13T19:34:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1012670873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 msgr2=0x560767bf9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1012670873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767bf9bf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0017f50 tx=0x7ff0e0003030 comp rx=0 tx=0).stop 2024-09-13T19:34:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1012670873 shutdown_connections 2024-09-13T19:34:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1012670873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a833c0 0x560767bf9bf0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1012670873 >> 172.21.15.144:0/1012670873 conn(0x560767b081c0 msgr2=0x560767bf5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1012670873 shutdown_connections 2024-09-13T19:34:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1012670873 wait complete. 2024-09-13T19:34:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 Processor -- start 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- start start 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a837d0 0x560767c01050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560767b18210 con 0x560767a837d0 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0edce2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a837d0 0x560767c01050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0edce2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a837d0 0x560767c01050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34626/0 (socket says 172.21.15.144:34626) 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0edce2640 1 -- 172.21.15.144:0/3634006339 learned_addr learned my addr 172.21.15.144:0/3634006339 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0edce2640 1 -- 172.21.15.144:0/3634006339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560767c01590 con 0x560767a837d0 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0edce2640 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a837d0 0x560767c01050 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff0e001b820 tx=0x7ff0e00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7fefda604640 1 -- 172.21.15.144:0/3634006339 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e00aa890 con 0x560767a837d0 2024-09-13T19:34:30.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560767c01820 con 0x560767a837d0 2024-09-13T19:34:30.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7fefda604640 1 -- 172.21.15.144:0/3634006339 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e00cd070 con 0x560767a837d0 2024-09-13T19:34:30.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560767c04500 con 0x560767a837d0 2024-09-13T19:34:30.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7fefda604640 1 -- 172.21.15.144:0/3634006339 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e00bd9e0 con 0x560767a837d0 2024-09-13T19:34:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.542+0000 7fefda604640 1 -- 172.21.15.144:0/3634006339 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff0e00bdb80 con 0x560767a837d0 2024-09-13T19:34:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7fefda604640 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefd40346a0 0x7fefd4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7fefda604640 1 -- 172.21.15.144:0/3634006339 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff0e00e5850 con 0x560767a837d0 2024-09-13T19:34:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0ed4e1640 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefd40346a0 0x7fefd4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c06140 0x560767c08530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c08a70 con 0x560767c06140 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0ee4e3640 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c06140 0x560767c08530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0ed4e1640 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefd40346a0 0x7fefd4036b60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4001e20 tx=0x7ff0e40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0ee4e3640 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c06140 0x560767c08530 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/3634006339 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e800a4d0 con 0x560767c06140 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c09340 con 0x560767c06140 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/3634006339 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0e800a4d0 con 0x560767c06140 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c0ac90 0x560767c0d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c0d8b0 con 0x560767c0ac90 2024-09-13T19:34:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0edce2640 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c0ac90 0x560767c0d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.546+0000 7ff0edce2640 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c0ac90 0x560767c0d120 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0edce2640 1 -- 172.21.15.144:0/3634006339 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c0ac90 2024-09-13T19:34:30.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c09b90 con 0x560767c06140 2024-09-13T19:34:30.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/3634006339 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0e800a4d0 con 0x560767c06140 2024-09-13T19:34:30.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c09f70 con 0x560767c06140 2024-09-13T19:34:30.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/3634006339 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0e800a4d0 con 0x560767c06140 2024-09-13T19:34:30.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0f01d2980 1 Processor -- start 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0f01d2980 1 -- start start 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0f01d2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c1bfb0 0x560767c1c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0f01d2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560767a13800 con 0x560767c1bfb0 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0ee4e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c1bfb0 0x560767c1c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0ee4e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c1bfb0 0x560767c1c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34638/0 (socket says 172.21.15.144:34638) 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/654570865 learned_addr learned my addr 172.21.15.144:0/654570865 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/654570865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560767c1c910 con 0x560767c1bfb0 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0ee4e3640 1 --2- 172.21.15.144:0/654570865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c1bfb0 0x560767c1c3d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x560767c02480 tx=0x7ff0e8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7fefd37fe640 1 -- 172.21.15.144:0/654570865 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e8014450 con 0x560767c1bfb0 2024-09-13T19:34:30.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0f01d2980 1 -- 172.21.15.144:0/654570865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560767c1cba0 con 0x560767c1bfb0 2024-09-13T19:34:30.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7fefd37fe640 1 -- 172.21.15.144:0/654570865 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e80145f0 con 0x560767c1bfb0 2024-09-13T19:34:30.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7ff0f01d2980 1 -- 172.21.15.144:0/654570865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560767c1f820 con 0x560767c1bfb0 2024-09-13T19:34:30.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.550+0000 7fefd37fe640 1 -- 172.21.15.144:0/654570865 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e8028060 con 0x560767c1bfb0 2024-09-13T19:34:30.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7fefd37fe640 1 -- 172.21.15.144:0/654570865 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff0e8011040 con 0x560767c1bfb0 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7fefd37fe640 1 --2- 172.21.15.144:0/654570865 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefc80346a0 0x7fefc8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7fefd37fe640 1 -- 172.21.15.144:0/654570865 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff0e801e070 con 0x560767c1bfb0 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0edce2640 1 --2- 172.21.15.144:0/654570865 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefc80346a0 0x7fefc8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 Processor -- start 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- start start 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0edce2640 1 --2- 172.21.15.144:0/654570865 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefc80346a0 0x7fefc8036b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x560767c05850 tx=0x7ff0e00e3c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c28dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560767bfa480 con 0x560767c289f0 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0ee4e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c28dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0ee4e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c28dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34650/0 (socket says 172.21.15.144:34650) 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/3895910441 learned_addr learned my addr 172.21.15.144:0/3895910441 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/3895910441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560767c293a0 con 0x560767c289f0 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0ee4e3640 1 --2- 172.21.15.144:0/3895910441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c28dd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80165b0 tx=0x7ff0e80149d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e636614c5f8b24e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7fefd17fa640 1 -- 172.21.15.144:0/3895910441 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e8022d20 con 0x560767c289f0 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7fefd17fa640 1 -- 172.21.15.144:0/3895910441 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e8043350 con 0x560767c289f0 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7fefd17fa640 1 -- 172.21.15.144:0/3895910441 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e802c3a0 con 0x560767c289f0 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3895910441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 msgr2=0x560767c28dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3895910441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c28dd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80165b0 tx=0x7ff0e80149d0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3895910441 shutdown_connections 2024-09-13T19:34:30.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3895910441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c28dd0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3895910441 >> 172.21.15.144:0/3895910441 conn(0x560767c24dd0 msgr2=0x560767c22ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3895910441 shutdown_connections 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3895910441 wait complete. 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 Processor -- start 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- start start 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c2fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.554+0000 7ff0f01d2980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560767c299c0 con 0x560767c289f0 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0ee4e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c2fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0ee4e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c2fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34666/0 (socket says 172.21.15.144:34666) 2024-09-13T19:34:30.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 learned_addr learned my addr 172.21.15.144:0/1461833269 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560767c30360 con 0x560767c289f0 2024-09-13T19:34:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0ee4e3640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c2fe20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8018430 tx=0x7ff0e8049fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7fefbf7fe640 1 -- 172.21.15.144:0/1461833269 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e8022d20 con 0x560767c289f0 2024-09-13T19:34:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560767c305f0 con 0x560767c289f0 2024-09-13T19:34:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7fefbf7fe640 1 -- 172.21.15.144:0/1461833269 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e8014cc0 con 0x560767c289f0 2024-09-13T19:34:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7fefbf7fe640 1 -- 172.21.15.144:0/1461833269 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e80223d0 con 0x560767c289f0 2024-09-13T19:34:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560767c332d0 con 0x560767c289f0 2024-09-13T19:34:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7fefbf7fe640 1 -- 172.21.15.144:0/1461833269 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff0e803bd10 con 0x560767c289f0 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7fefbf7fe640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefb8034650 0x7fefb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7fefbf7fe640 1 -- 172.21.15.144:0/1461833269 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff0e800e040 con 0x560767c289f0 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0edce2640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefb8034650 0x7fefb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c3b250 0x560767c3d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c3de40 con 0x560767c3b250 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0ed4e1640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c3b250 0x560767c3d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0edce2640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefb8034650 0x7fefb8036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00db3f0 tx=0x7ff0e00e9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.558+0000 7ff0ed4e1640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c3b250 0x560767c3d6f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e400d040 con 0x560767c3b250 2024-09-13T19:34:30.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 realm 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c3a720 con 0x560767c3b250 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e400d040 con 0x560767c3b250 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c3e940 con 0x560767c3b250 2024-09-13T19:34:30.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e400d040 con 0x560767c3b250 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c3f210 con 0x560767c3b250 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0e400d040 con 0x560767c3b250 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c3fac0 0x560767c41eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c42610 con 0x560767c3fac0 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0ee4e3640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c3fac0 0x560767c41eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0ee4e3640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c3fac0 0x560767c41eb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 20 searching for the correct realm 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560767c445b0 0x560767c46a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0edce2640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560767c445b0 0x560767c46a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0edce2640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560767c445b0 0x560767c46a70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.562+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0edce2640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560767a833c0 0x7ff0e00b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767a833c0 2024-09-13T19:34:30.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560767a833c0 0x7ff0e00b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560767a833c0 0x7ff0e00b33f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e400d040 con 0x560767a833c0 2024-09-13T19:34:30.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3fac0 2024-09-13T19:34:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff0e400d040 con 0x560767c3b250 2024-09-13T19:34:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3fac0 2024-09-13T19:34:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767a833c0 2024-09-13T19:34:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.566+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3fac0 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767a833c0 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3fac0 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.570+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3fac0 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767a833c0 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3fac0 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3fac0 2024-09-13T19:34:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.574+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767a833c0 2024-09-13T19:34:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c445b0 2024-09-13T19:34:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3fac0 2024-09-13T19:34:30.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767c3b250 2024-09-13T19:34:30.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560767c47140 con 0x560767a833c0 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c42fd0 con 0x560767c3b250 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c43450 con 0x560767c3b250 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c43460 con 0x560767c3b250 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 zone default found 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 4 Realm: () 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 zonegroup default 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c43900 con 0x560767c3fac0 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c49450 con 0x560767c445b0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.578+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c497f0 con 0x560767c445b0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 20 started sync module instance, tier type = 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c48890 con 0x560767a833c0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94589805694128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c48890 con 0x560767a833c0 2024-09-13T19:34:30.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4a1b0 con 0x560767c3b250 2024-09-13T19:34:30.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.582+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94589805694128] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94589805692144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4a1b0 con 0x560767c3b250 2024-09-13T19:34:30.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4aa40 con 0x560767c445b0 2024-09-13T19:34:30.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94589805699808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4b2e0 con 0x560767c445b0 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4bca0 con 0x560767a833c0 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94589805692144] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94589805705200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4bc10 con 0x560767a833c0 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.586+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4c9f0 con 0x560767c3b250 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.590+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94589805699808] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.590+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94589805705200] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.590+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.590+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94589805702704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4c4b0 con 0x560767c3b250 2024-09-13T19:34:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.590+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4cd40 con 0x560767c3fac0 2024-09-13T19:34:30.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.590+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94589805702704] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.594+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.594+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94589805707536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4d130 con 0x560767c3fac0 2024-09-13T19:34:30.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.594+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4daf0 con 0x560767c3fac0 2024-09-13T19:34:30.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.594+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.594+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94589805712960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4df10 con 0x560767c3fac0 2024-09-13T19:34:30.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.594+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4ea00 con 0x560767c3fac0 2024-09-13T19:34:30.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.594+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94589805707536] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94589805712960] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94589805716688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4daa0 con 0x560767c3fac0 2024-09-13T19:34:30.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 20 add_watcher() i=0 2024-09-13T19:34:30.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 20 add_watcher() i=1 2024-09-13T19:34:30.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 20 add_watcher() i=2 2024-09-13T19:34:30.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 20 add_watcher() i=3 2024-09-13T19:34:30.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 20 add_watcher() i=4 2024-09-13T19:34:30.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 20 add_watcher() i=5 2024-09-13T19:34:30.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 20 add_watcher() i=6 2024-09-13T19:34:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94589805716688] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 20 add_watcher() i=7 2024-09-13T19:34:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c51b00 con 0x560767c3b250 2024-09-13T19:34:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.598+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94589805708688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4ef80 con 0x560767c3b250 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94589805708688] v32'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7fef9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 5 note: GC not initialized 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7fef9e7fc640 20 reqs_thread_entry: start 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 20 Filter name: none 2024-09-13T19:34:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7fef0ffff640 20 reqs_thread_entry: start 2024-09-13T19:34:30.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c74ad0 con 0x560767c3b250 2024-09-13T19:34:30.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:34:30.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560767c76020 con 0x560767c3fac0 2024-09-13T19:34:30.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.602+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.606+0000 7fef9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.606+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94589805708688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c736e0 con 0x560767c3b250 2024-09-13T19:34:30.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.606+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94589805708688] v32'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.606+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94589805694128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4c590 con 0x560767a833c0 2024-09-13T19:34:30.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.606+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94589805694128] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.606+0000 7ff0f01d2980 20 remove_watcher() i=0 2024-09-13T19:34:30.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.606+0000 7ff0f01d2980 2 removed watcher, disabling cache 2024-09-13T19:34:30.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.606+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94589805692144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c48cb0 con 0x560767c3b250 2024-09-13T19:34:30.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.610+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94589805692144] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.610+0000 7ff0f01d2980 20 remove_watcher() i=1 2024-09-13T19:34:30.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.610+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94589805699808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c48cb0 con 0x560767c445b0 2024-09-13T19:34:30.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.610+0000 7ff0edce2640 1 -- 172.21.15.144:0/1461833269 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94589805699808] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e00c5d00 con 0x560767c445b0 2024-09-13T19:34:30.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.610+0000 7ff0f01d2980 20 remove_watcher() i=2 2024-09-13T19:34:30.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.610+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94589805705200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c48cb0 con 0x560767a833c0 2024-09-13T19:34:30.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.614+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94589805705200] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767a833c0 2024-09-13T19:34:30.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.614+0000 7ff0f01d2980 20 remove_watcher() i=3 2024-09-13T19:34:30.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.614+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94589805702704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4b7f0 con 0x560767c3b250 2024-09-13T19:34:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.614+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94589805702704] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e402a040 con 0x560767c3b250 2024-09-13T19:34:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.614+0000 7ff0f01d2980 20 remove_watcher() i=4 2024-09-13T19:34:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.614+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94589805707536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c48cb0 con 0x560767c3fac0 2024-09-13T19:34:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.618+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94589805707536] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.618+0000 7ff0f01d2980 20 remove_watcher() i=5 2024-09-13T19:34:30.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.618+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94589805712960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4ae30 con 0x560767c3fac0 2024-09-13T19:34:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.618+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94589805712960] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.618+0000 7ff0f01d2980 20 remove_watcher() i=6 2024-09-13T19:34:30.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.618+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94589805716688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560767c4b7f0 con 0x560767c3fac0 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0ee4e3640 1 -- 172.21.15.144:0/1461833269 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94589805716688] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e8052070 con 0x560767c3fac0 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 20 remove_watcher() i=7 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c3fac0 msgr2=0x560767c41eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c3fac0 0x560767c41eb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c3b250 msgr2=0x560767c3d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c3b250 0x560767c3d6f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560767a833c0 msgr2=0x7ff0e00b33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560767a833c0 0x7ff0e00b33f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560767c445b0 msgr2=0x560767c46a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560767c445b0 0x560767c46a70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefb8034650 msgr2=0x7fefb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefb8034650 0x7fefb8036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00db3f0 tx=0x7ff0e00e9000 comp rx=0 tx=0).stop 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 msgr2=0x560767c2fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0ed4e1640 1 -- 172.21.15.144:0/1461833269 reap_dead start 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c2fe20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8018430 tx=0x7ff0e8049fb0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 shutdown_connections 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/1461833269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c289f0 0x560767c2fe20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 >> 172.21.15.144:0/1461833269 conn(0x560767c24dd0 msgr2=0x560767c2a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 shutdown_connections 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/1461833269 wait complete. 2024-09-13T19:34:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/654570865 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefc80346a0 msgr2=0x7fefc8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/654570865 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefc80346a0 0x7fefc8036b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x560767c05850 tx=0x7ff0e00e3c90 comp rx=0 tx=0).stop 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/654570865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c1bfb0 msgr2=0x560767c1c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/654570865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c1bfb0 0x560767c1c3d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x560767c02480 tx=0x7ff0e8018830 comp rx=0 tx=0).stop 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/654570865 shutdown_connections 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/654570865 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefc80346a0 0x7fefc8036b60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/654570865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767c1bfb0 0x560767c1c3d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/654570865 >> 172.21.15.144:0/654570865 conn(0x560767c11100 msgr2=0x560767c13b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/654570865 shutdown_connections 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/654570865 wait complete. 2024-09-13T19:34:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c0ac90 msgr2=0x560767c0d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c0ac90 0x560767c0d120 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c06140 msgr2=0x560767c08530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c06140 0x560767c08530 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefd40346a0 msgr2=0x7fefd4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefd40346a0 0x7fefd4036b60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4001e20 tx=0x7ff0e40013a0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a837d0 msgr2=0x560767c01050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a837d0 0x560767c01050 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff0e001b820 tx=0x7ff0e00180e0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 shutdown_connections 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560767c06140 0x560767c08530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560767c0ac90 0x560767c0d120 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fefd40346a0 0x7fefd4036b60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 --2- 172.21.15.144:0/3634006339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560767a837d0 0x560767c01050 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 >> 172.21.15.144:0/3634006339 conn(0x560767b081c0 msgr2=0x560767bf43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 shutdown_connections 2024-09-13T19:34:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.622+0000 7ff0f01d2980 1 -- 172.21.15.144:0/3634006339 wait complete. 2024-09-13T19:34:30.638 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-13T19:34:30.639 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-13T19:34:30.639 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T19:34:30.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T19:34:30.639 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-13T19:34:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.710+0000 7f9f0974b980 1 Processor -- start 2024-09-13T19:34:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.710+0000 7f9f0974b980 1 -- start start 2024-09-13T19:34:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.710+0000 7f9f0974b980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56205a9d62a0 0x56205aa667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.710+0000 7f9f0974b980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56205a8e9ae0 con 0x56205aa66cf0 2024-09-13T19:34:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.710+0000 7f9f0974b980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56205a90de30 con 0x56205a9d62a0 2024-09-13T19:34:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.710+0000 7f9f0725b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56205a9d62a0 0x56205aa667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.710+0000 7f9f06a5a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x56205aa66cf0 0x56205aa690e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37828/0 (socket says 172.21.15.144:37828) 2024-09-13T19:34:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.710+0000 7f9f06a5a640 1 -- 172.21.15.144:0/2434115933 learned_addr learned my addr 172.21.15.144:0/2434115933 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:34:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0725b640 1 -- 172.21.15.144:0/2434115933 >> v1:172.21.15.18:6789/0 conn(0x56205aa66cf0 legacy=0x56205aa690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0725b640 1 -- 172.21.15.144:0/2434115933 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205a9d6680 con 0x56205a9d62a0 2024-09-13T19:34:30.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0725b640 1 --2- 172.21.15.144:0/2434115933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205aa667b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000a420 tx=0x7f9f0001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1575069d166f446 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f06259640 1 -- 172.21.15.144:0/2434115933 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f000af070 con 0x56205a9d62a0 2024-09-13T19:34:30.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f06259640 1 -- 172.21.15.144:0/2434115933 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000aa530 con 0x56205a9d62a0 2024-09-13T19:34:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f06259640 1 -- 172.21.15.144:0/2434115933 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f000aa850 con 0x56205a9d62a0 2024-09-13T19:34:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0974b980 1 -- 172.21.15.144:0/2434115933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 msgr2=0x56205aa667b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0974b980 1 --2- 172.21.15.144:0/2434115933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205aa667b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000a420 tx=0x7f9f0001afd0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0974b980 1 -- 172.21.15.144:0/2434115933 shutdown_connections 2024-09-13T19:34:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0974b980 1 --2- 172.21.15.144:0/2434115933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205aa667b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0974b980 1 -- 172.21.15.144:0/2434115933 >> 172.21.15.144:0/2434115933 conn(0x56205aa5c0a0 msgr2=0x56205aa5e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0974b980 1 -- 172.21.15.144:0/2434115933 shutdown_connections 2024-09-13T19:34:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.714+0000 7f9f0974b980 1 -- 172.21.15.144:0/2434115933 wait complete. 2024-09-13T19:34:30.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0974b980 1 Processor -- start 2024-09-13T19:34:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0974b980 1 -- start start 2024-09-13T19:34:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0974b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab4eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0974b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56205a90f200 con 0x56205a9d62a0 2024-09-13T19:34:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0725b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab4eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0725b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab4eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34674/0 (socket says 172.21.15.144:34674) 2024-09-13T19:34:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0725b640 1 -- 172.21.15.144:0/1176204596 learned_addr learned my addr 172.21.15.144:0/1176204596 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0725b640 1 -- 172.21.15.144:0/1176204596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205ab4f270 con 0x56205a9d62a0 2024-09-13T19:34:30.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9f0725b640 1 --2- 172.21.15.144:0/1176204596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab4eca0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9f000ad040 tx=0x7f9f000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a7751ccb581255 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.730+0000 7f9df560a640 1 -- 172.21.15.144:0/1176204596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f000af040 con 0x56205a9d62a0 2024-09-13T19:34:30.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9df560a640 1 -- 172.21.15.144:0/1176204596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000aa9a0 con 0x56205a9d62a0 2024-09-13T19:34:30.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9df560a640 1 -- 172.21.15.144:0/1176204596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f000aac80 con 0x56205a9d62a0 2024-09-13T19:34:30.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- 172.21.15.144:0/1176204596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 msgr2=0x56205ab4eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 --2- 172.21.15.144:0/1176204596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab4eca0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9f000ad040 tx=0x7f9f000033b0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- 172.21.15.144:0/1176204596 shutdown_connections 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 --2- 172.21.15.144:0/1176204596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab4eca0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- 172.21.15.144:0/1176204596 >> 172.21.15.144:0/1176204596 conn(0x56205aa5c0a0 msgr2=0x56205ab4a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- 172.21.15.144:0/1176204596 shutdown_connections 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- 172.21.15.144:0/1176204596 wait complete. 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 Processor -- start 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- start start 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab55e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56205aa6d230 con 0x56205a9d62a0 2024-09-13T19:34:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0725b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab55e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0725b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab55e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34680/0 (socket says 172.21.15.144:34680) 2024-09-13T19:34:30.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0725b640 1 -- 172.21.15.144:0/990082142 learned_addr learned my addr 172.21.15.144:0/990082142 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0725b640 1 -- 172.21.15.144:0/990082142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205ab563b0 con 0x56205a9d62a0 2024-09-13T19:34:30.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0725b640 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab55e70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9f000aa500 tx=0x7f9f00017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9df3e07640 1 -- 172.21.15.144:0/990082142 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f000c5070 con 0x56205a9d62a0 2024-09-13T19:34:30.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56205ab56640 con 0x56205a9d62a0 2024-09-13T19:34:30.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56205ab59320 con 0x56205a9d62a0 2024-09-13T19:34:30.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9df3e07640 1 -- 172.21.15.144:0/990082142 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000c1880 con 0x56205a9d62a0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.734+0000 7f9df3e07640 1 -- 172.21.15.144:0/990082142 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f000ce060 con 0x56205a9d62a0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9df3e07640 1 -- 172.21.15.144:0/990082142 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9f000c1b60 con 0x56205a9d62a0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9df3e07640 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dec0346a0 0x7f9dec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9df3e07640 1 -- 172.21.15.144:0/990082142 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9f000bb070 con 0x56205a9d62a0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f06a5a640 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dec0346a0 0x7f9dec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205aa66cf0 0x56205ab5cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab5d4f0 con 0x56205aa66cf0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f07a5c640 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205aa66cf0 0x56205ab5cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f07a5c640 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205aa66cf0 0x56205ab5cf70 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f06a5a640 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dec0346a0 0x7f9dec036b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0000f70 tx=0x7f9ef00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f07a5c640 1 -- 172.21.15.144:0/990082142 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205aa66cf0 2024-09-13T19:34:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab5a520 con 0x56205aa66cf0 2024-09-13T19:34:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f07a5c640 1 -- 172.21.15.144:0/990082142 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205aa66cf0 2024-09-13T19:34:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab5f850 0x56205ab61c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab62330 con 0x56205ab5f850 2024-09-13T19:34:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f0725b640 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab5f850 0x56205ab61c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.738+0000 7f9f0725b640 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab5f850 0x56205ab61c40 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0725b640 1 -- 172.21.15.144:0/990082142 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab5f850 2024-09-13T19:34:30.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab5e6f0 con 0x56205aa66cf0 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f07a5c640 1 -- 172.21.15.144:0/990082142 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205aa66cf0 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab5ebd0 con 0x56205aa66cf0 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f07a5c640 1 -- 172.21.15.144:0/990082142 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205aa66cf0 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0974b980 1 Processor -- start 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0974b980 1 -- start start 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0974b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab70a50 0x56205ab70e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0974b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56205a968800 con 0x56205ab70a50 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f07a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab70a50 0x56205ab70e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f07a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab70a50 0x56205ab70e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34692/0 (socket says 172.21.15.144:34692) 2024-09-13T19:34:30.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f07a5c640 1 -- 172.21.15.144:0/1371474699 learned_addr learned my addr 172.21.15.144:0/1371474699 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f07a5c640 1 -- 172.21.15.144:0/1371474699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205ab713b0 con 0x56205ab70a50 2024-09-13T19:34:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f07a5c640 1 --2- 172.21.15.144:0/1371474699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab70a50 0x56205ab70e70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x56205ab56dc0 tx=0x7f9ef800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9df1602640 1 -- 172.21.15.144:0/1371474699 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef8007d70 con 0x56205ab70a50 2024-09-13T19:34:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0974b980 1 -- 172.21.15.144:0/1371474699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56205ab71640 con 0x56205ab70a50 2024-09-13T19:34:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9f0974b980 1 -- 172.21.15.144:0/1371474699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56205ab742c0 con 0x56205ab70a50 2024-09-13T19:34:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9df1602640 1 -- 172.21.15.144:0/1371474699 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef801e020 con 0x56205ab70a50 2024-09-13T19:34:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9df1602640 1 -- 172.21.15.144:0/1371474699 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef8019550 con 0x56205ab70a50 2024-09-13T19:34:30.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.742+0000 7f9df1602640 1 -- 172.21.15.144:0/1371474699 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9ef8016040 con 0x56205ab70a50 2024-09-13T19:34:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9df1602640 1 --2- 172.21.15.144:0/1371474699 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9de0034650 0x7f9de0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9df1602640 1 -- 172.21.15.144:0/1371474699 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9ef801f030 con 0x56205ab70a50 2024-09-13T19:34:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0725b640 1 --2- 172.21.15.144:0/1371474699 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9de0034650 0x7f9de0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 Processor -- start 2024-09-13T19:34:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- start start 2024-09-13T19:34:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0725b640 1 --2- 172.21.15.144:0/1371474699 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9de0034650 0x7f9de0036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x56205ab5d9c0 tx=0x7f9f000aaf90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab7d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56205ab4f530 con 0x56205ab7d590 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f07a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab7d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f07a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab7d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34702/0 (socket says 172.21.15.144:34702) 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f07a5c640 1 -- 172.21.15.144:0/2080084034 learned_addr learned my addr 172.21.15.144:0/2080084034 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f07a5c640 1 -- 172.21.15.144:0/2080084034 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205ab7df40 con 0x56205ab7d590 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f07a5c640 1 --2- 172.21.15.144:0/2080084034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab7d970 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8049f90 tx=0x7f9ef80158c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4468d540eb6ef2e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9deaffd640 1 -- 172.21.15.144:0/2080084034 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef801d070 con 0x56205ab7d590 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9deaffd640 1 -- 172.21.15.144:0/2080084034 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef80224f0 con 0x56205ab7d590 2024-09-13T19:34:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9deaffd640 1 -- 172.21.15.144:0/2080084034 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef8014490 con 0x56205ab7d590 2024-09-13T19:34:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- 172.21.15.144:0/2080084034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 msgr2=0x56205ab7d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 --2- 172.21.15.144:0/2080084034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab7d970 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8049f90 tx=0x7f9ef80158c0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- 172.21.15.144:0/2080084034 shutdown_connections 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 --2- 172.21.15.144:0/2080084034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab7d970 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- 172.21.15.144:0/2080084034 >> 172.21.15.144:0/2080084034 conn(0x56205ab79970 msgr2=0x56205ab77a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- 172.21.15.144:0/2080084034 shutdown_connections 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- 172.21.15.144:0/2080084034 wait complete. 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 Processor -- start 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- start start 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab84940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f0974b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56205ab7e500 con 0x56205ab7d590 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f07a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab84940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f07a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab84940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34710/0 (socket says 172.21.15.144:34710) 2024-09-13T19:34:30.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.746+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 learned_addr learned my addr 172.21.15.144:0/412539786 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205ab84e80 con 0x56205ab7d590 2024-09-13T19:34:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f07a5c640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab84940 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8025040 tx=0x7f9ef8049f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9de97fa640 1 -- 172.21.15.144:0/412539786 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef8019900 con 0x56205ab7d590 2024-09-13T19:34:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56205ab85110 con 0x56205ab7d590 2024-09-13T19:34:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56205ab87df0 con 0x56205ab7d590 2024-09-13T19:34:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9de97fa640 1 -- 172.21.15.144:0/412539786 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef8019aa0 con 0x56205ab7d590 2024-09-13T19:34:30.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9de97fa640 1 -- 172.21.15.144:0/412539786 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef80186f0 con 0x56205ab7d590 2024-09-13T19:34:30.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9de97fa640 1 -- 172.21.15.144:0/412539786 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9ef8018890 con 0x56205ab7d590 2024-09-13T19:34:30.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9de97fa640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dd0034650 0x7f9dd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9de97fa640 1 -- 172.21.15.144:0/412539786 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9ef803a0c0 con 0x56205ab7d590 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0725b640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dd0034650 0x7f9dd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205ab8fd30 0x56205ab921f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab92940 con 0x56205ab8fd30 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f06a5a640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205ab8fd30 0x56205ab921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0725b640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dd0034650 0x7f9dd0036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b5fd0 tx=0x7f9f000da000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f06a5a640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205ab8fd30 0x56205ab921f0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ef000e5a0 con 0x56205ab8fd30 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 20 realm 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab8f200 con 0x56205ab8fd30 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ef000e5a0 con 0x56205ab8fd30 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab93440 con 0x56205ab8fd30 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ef000e5a0 con 0x56205ab8fd30 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.750+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab93990 con 0x56205ab8fd30 2024-09-13T19:34:30.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ef000e5a0 con 0x56205ab8fd30 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0974b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab94790 0x56205ab96b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab97100 con 0x56205ab94790 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f07a5c640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab94790 0x56205ab96b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f07a5c640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab94790 0x56205ab96b80 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0974b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0974b980 20 searching for the correct realm 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56205ab990e0 0x56205ab9b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0725b640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56205ab990e0 0x56205ab9b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0725b640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56205ab990e0 0x56205ab9b5a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0725b640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f9f000b7b60 0x7f9f000b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x7f9f000b7b60 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f06a5a640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f9f000b7b60 0x7f9f000b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f06a5a640 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f9f000b7b60 0x7f9f000b5470 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef000e5a0 con 0x7f9f000b7b60 2024-09-13T19:34:30.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.754+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab94790 2024-09-13T19:34:30.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ef000e5a0 con 0x56205ab8fd30 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab94790 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x7f9f000b7b60 2024-09-13T19:34:30.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab94790 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.758+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x7f9f000b7b60 2024-09-13T19:34:30.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab94790 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab94790 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x7f9f000b7b60 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.762+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab94790 2024-09-13T19:34:30.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab94790 2024-09-13T19:34:30.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x7f9f000b7b60 2024-09-13T19:34:30.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab990e0 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab94790 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x56205ab8fd30 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9bc70 con 0x7f9f000b7b60 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:30.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab97ac0 con 0x56205ab8fd30 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab97ef0 con 0x56205ab8fd30 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.766+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab97f00 con 0x56205ab8fd30 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 zone default found 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 4 Realm: () 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 zonegroup default 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab983a0 con 0x56205ab94790 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab976d0 con 0x56205ab990e0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9e080 con 0x56205ab990e0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 started sync module instance, tier type = 2024-09-13T19:34:30.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:30.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9d410 con 0x7f9f000b7b60 2024-09-13T19:34:30.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94696961071440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9d410 con 0x7f9f000b7b60 2024-09-13T19:34:30.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9eb60 con 0x56205ab8fd30 2024-09-13T19:34:30.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.770+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94696961071440] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.774+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.774+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94696961074768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9d410 con 0x56205ab8fd30 2024-09-13T19:34:30.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.774+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9f570 con 0x56205ab990e0 2024-09-13T19:34:30.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.774+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.774+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94696961077440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9fdc0 con 0x56205ab990e0 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.774+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba0780 con 0x7f9f000b7b60 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.774+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94696961074768] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94696961082064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba0ba0 con 0x7f9f000b7b60 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba13f0 con 0x56205ab8fd30 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94696961077440] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94696961082064] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94696961083120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba0fc0 con 0x56205ab8fd30 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba1c90 con 0x56205ab94790 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.778+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94696961083120] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.782+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.782+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94696961087456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba0fc0 con 0x56205ab94790 2024-09-13T19:34:30.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.782+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba24e0 con 0x56205ab94790 2024-09-13T19:34:30.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.782+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.782+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94696961089584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba2940 con 0x56205ab94790 2024-09-13T19:34:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.782+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba3440 con 0x56205ab94790 2024-09-13T19:34:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.782+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94696961087456] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94696961089584] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94696961093424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba2450 con 0x56205ab94790 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 20 add_watcher() i=0 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 20 add_watcher() i=1 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 20 add_watcher() i=2 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 20 add_watcher() i=3 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 20 add_watcher() i=4 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 20 add_watcher() i=5 2024-09-13T19:34:30.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 20 add_watcher() i=6 2024-09-13T19:34:30.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94696961093424] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 20 add_watcher() i=7 2024-09-13T19:34:30.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205aba6430 con 0x56205ab8fd30 2024-09-13T19:34:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.786+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94696961084176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba38b0 con 0x56205ab8fd30 2024-09-13T19:34:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94696961084176] v32'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9dbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 5 note: GC not initialized 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9dbcfe1640 20 reqs_thread_entry: start 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 20 Filter name: none 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9d367fc640 20 reqs_thread_entry: start 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205abc94f0 con 0x56205ab8fd30 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56205abcaa40 con 0x56205ab94790 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.790+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.794+0000 7f9dbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.794+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94696961084176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205abc8100 con 0x56205ab8fd30 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.794+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94696961084176] v32'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.794+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94696961071440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba0b10 con 0x7f9f000b7b60 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.794+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94696961071440] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.794+0000 7f9f0974b980 20 remove_watcher() i=0 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.794+0000 7f9f0974b980 2 removed watcher, disabling cache 2024-09-13T19:34:30.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.794+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94696961074768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba0b10 con 0x56205ab8fd30 2024-09-13T19:34:30.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94696961074768] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f0974b980 20 remove_watcher() i=1 2024-09-13T19:34:30.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94696961077440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9e650 con 0x56205ab990e0 2024-09-13T19:34:30.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f0725b640 1 -- 172.21.15.144:0/412539786 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94696961077440] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f000b2040 con 0x56205ab990e0 2024-09-13T19:34:30.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f0974b980 20 remove_watcher() i=2 2024-09-13T19:34:30.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94696961082064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba0b10 con 0x7f9f000b7b60 2024-09-13T19:34:30.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94696961082064] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x7f9f000b7b60 2024-09-13T19:34:30.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f0974b980 20 remove_watcher() i=3 2024-09-13T19:34:30.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.798+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94696961083120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9f0c0 con 0x56205ab8fd30 2024-09-13T19:34:30.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.802+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94696961083120] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef0029040 con 0x56205ab8fd30 2024-09-13T19:34:30.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.802+0000 7f9f0974b980 20 remove_watcher() i=4 2024-09-13T19:34:30.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.802+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94696961087456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9e650 con 0x56205ab94790 2024-09-13T19:34:30.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.806+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94696961087456] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.806+0000 7f9f0974b980 20 remove_watcher() i=5 2024-09-13T19:34:30.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.806+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94696961089584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205ab9f0c0 con 0x56205ab94790 2024-09-13T19:34:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.806+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94696961089584] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.806+0000 7f9f0974b980 20 remove_watcher() i=6 2024-09-13T19:34:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.806+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94696961093424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56205aba17e0 con 0x56205ab94790 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f07a5c640 1 -- 172.21.15.144:0/412539786 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94696961093424] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ef80083f0 con 0x56205ab94790 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 20 remove_watcher() i=7 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab94790 msgr2=0x56205ab96b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab94790 0x56205ab96b80 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205ab8fd30 msgr2=0x56205ab921f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205ab8fd30 0x56205ab921f0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f9f000b7b60 msgr2=0x7f9f000b5470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f9f000b7b60 0x7f9f000b5470 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56205ab990e0 msgr2=0x56205ab9b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56205ab990e0 0x56205ab9b5a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dd0034650 msgr2=0x7f9dd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dd0034650 0x7f9dd0036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b5fd0 tx=0x7f9f000da000 comp rx=0 tx=0).stop 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 msgr2=0x56205ab84940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f06a5a640 1 -- 172.21.15.144:0/412539786 reap_dead start 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab84940 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8025040 tx=0x7f9ef8049f20 comp rx=0 tx=0).stop 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 shutdown_connections 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/412539786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab7d590 0x56205ab84940 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 >> 172.21.15.144:0/412539786 conn(0x56205ab79970 msgr2=0x56205ab7ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 shutdown_connections 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/412539786 wait complete. 2024-09-13T19:34:30.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/1371474699 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9de0034650 msgr2=0x7f9de0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/1371474699 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9de0034650 0x7f9de0036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x56205ab5d9c0 tx=0x7f9f000aaf90 comp rx=0 tx=0).stop 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/1371474699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab70a50 msgr2=0x56205ab70e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/1371474699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab70a50 0x56205ab70e70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x56205ab56dc0 tx=0x7f9ef800af40 comp rx=0 tx=0).stop 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/1371474699 shutdown_connections 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/1371474699 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9de0034650 0x7f9de0036b10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/1371474699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205ab70a50 0x56205ab70e70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/1371474699 >> 172.21.15.144:0/1371474699 conn(0x56205ab65ba0 msgr2=0x56205ab68620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/1371474699 shutdown_connections 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/1371474699 wait complete. 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab5f850 msgr2=0x56205ab61c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab5f850 0x56205ab61c40 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205aa66cf0 msgr2=0x56205ab5cf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205aa66cf0 0x56205ab5cf70 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dec0346a0 msgr2=0x7f9dec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dec0346a0 0x7f9dec036b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0000f70 tx=0x7f9ef00012c0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 msgr2=0x56205ab55e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab55e70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9f000aa500 tx=0x7f9f00017d70 comp rx=0 tx=0).stop 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 shutdown_connections 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56205aa66cf0 0x56205ab5cf70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56205ab5f850 0x56205ab61c40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9dec0346a0 0x7f9dec036b60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 --2- 172.21.15.144:0/990082142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56205a9d62a0 0x56205ab55e70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 >> 172.21.15.144:0/990082142 conn(0x56205aa5c0a0 msgr2=0x56205ab49450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 shutdown_connections 2024-09-13T19:34:30.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.810+0000 7f9f0974b980 1 -- 172.21.15.144:0/990082142 wait complete. 2024-09-13T19:34:30.824 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-13T19:34:30.825 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-13T19:34:30.825 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T19:34:30.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T19:34:30.825 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-13T19:34:30.901 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:30.901 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:30.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d2fef980 1 Processor -- start 2024-09-13T19:34:30.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d2fef980 1 -- start start 2024-09-13T19:34:30.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d2fef980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563f007a6900 0x563f007a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d2fef980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563f0062bae0 con 0x563f007a2580 2024-09-13T19:34:30.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d2fef980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x563f0064fe30 con 0x563f007a6900 2024-09-13T19:34:30.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d02fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563f007a6900 0x563f007a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d0aff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x563f007a2580 0x563f007a2960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37832/0 (socket says 172.21.15.144:37832) 2024-09-13T19:34:30.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d0aff640 1 -- 172.21.15.144:0/3045170950 learned_addr learned my addr 172.21.15.144:0/3045170950 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:34:30.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d02fe640 1 -- 172.21.15.144:0/3045170950 >> v1:172.21.15.18:6789/0 conn(0x563f007a2580 legacy=0x563f007a2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.898+0000 7fe1d02fe640 1 -- 172.21.15.144:0/3045170950 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f007aa240 con 0x563f007a6900 2024-09-13T19:34:30.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.902+0000 7fe1d02fe640 1 --2- 172.21.15.144:0/3045170950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a6900 0x563f007a8cf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400a480 tx=0x7fe1c401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfee5f9515f9334 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.902+0000 7fe1cfafd640 1 -- 172.21.15.144:0/3045170950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c40b0070 con 0x563f007a6900 2024-09-13T19:34:30.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.902+0000 7fe1cfafd640 1 -- 172.21.15.144:0/3045170950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c40ab540 con 0x563f007a6900 2024-09-13T19:34:30.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.902+0000 7fe1cfafd640 1 -- 172.21.15.144:0/3045170950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c40ab840 con 0x563f007a6900 2024-09-13T19:34:30.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.906+0000 7fe1d2fef980 1 -- 172.21.15.144:0/3045170950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a6900 msgr2=0x563f007a8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.906+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/3045170950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a6900 0x563f007a8cf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400a480 tx=0x7fe1c401b280 comp rx=0 tx=0).stop 2024-09-13T19:34:30.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.906+0000 7fe1d2fef980 1 -- 172.21.15.144:0/3045170950 shutdown_connections 2024-09-13T19:34:30.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.906+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/3045170950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a6900 0x563f007a8cf0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.906+0000 7fe1d2fef980 1 -- 172.21.15.144:0/3045170950 >> 172.21.15.144:0/3045170950 conn(0x563f0079e0a0 msgr2=0x563f007a04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.906+0000 7fe1d2fef980 1 -- 172.21.15.144:0/3045170950 shutdown_connections 2024-09-13T19:34:30.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.906+0000 7fe1d2fef980 1 -- 172.21.15.144:0/3045170950 wait complete. 2024-09-13T19:34:30.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 Processor -- start 2024-09-13T19:34:30.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 -- start start 2024-09-13T19:34:30.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00717c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563f00651200 con 0x563f007a2580 2024-09-13T19:34:30.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d0aff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00717c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d0aff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00717c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34728/0 (socket says 172.21.15.144:34728) 2024-09-13T19:34:30.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d0aff640 1 -- 172.21.15.144:0/649602593 learned_addr learned my addr 172.21.15.144:0/649602593 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d0aff640 1 -- 172.21.15.144:0/649602593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f007181e0 con 0x563f007a2580 2024-09-13T19:34:30.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/649602593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00717c10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00015f0 tx=0x7fe1c0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7542deb79d4e0811 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe0bee0d640 1 -- 172.21.15.144:0/649602593 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c0004530 con 0x563f007a2580 2024-09-13T19:34:30.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe0bee0d640 1 -- 172.21.15.144:0/649602593 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c00046f0 con 0x563f007a2580 2024-09-13T19:34:30.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe0bee0d640 1 -- 172.21.15.144:0/649602593 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c0004a90 con 0x563f007a2580 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 -- 172.21.15.144:0/649602593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 msgr2=0x563f00717c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/649602593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00717c10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00015f0 tx=0x7fe1c0001ab0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 -- 172.21.15.144:0/649602593 shutdown_connections 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/649602593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00717c10 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 -- 172.21.15.144:0/649602593 >> 172.21.15.144:0/649602593 conn(0x563f0079e0a0 msgr2=0x563f008895a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 -- 172.21.15.144:0/649602593 shutdown_connections 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.918+0000 7fe1d2fef980 1 -- 172.21.15.144:0/649602593 wait complete. 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d2fef980 1 Processor -- start 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d2fef980 1 -- start start 2024-09-13T19:34:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d2fef980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00895da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d2fef980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563f007a9d40 con 0x563f007a2580 2024-09-13T19:34:30.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d0aff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00895da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d0aff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00895da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34740/0 (socket says 172.21.15.144:34740) 2024-09-13T19:34:30.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d0aff640 1 -- 172.21.15.144:0/2156115515 learned_addr learned my addr 172.21.15.144:0/2156115515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d0aff640 1 -- 172.21.15.144:0/2156115515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f008962e0 con 0x563f007a2580 2024-09-13T19:34:30.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00895da0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x563f0088fc70 tx=0x7fe1c0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe0bd60a640 1 -- 172.21.15.144:0/2156115515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c0013760 con 0x563f007a2580 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f00896570 con 0x563f007a2580 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f00899250 con 0x563f007a2580 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe0bd60a640 1 -- 172.21.15.144:0/2156115515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c0013900 con 0x563f007a2580 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe0bd60a640 1 -- 172.21.15.144:0/2156115515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c0013be0 con 0x563f007a2580 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe0bd60a640 1 -- 172.21.15.144:0/2156115515 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe1c0010070 con 0x563f007a2580 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe0bd60a640 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0b80346a0 0x7fe0b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe0bd60a640 1 -- 172.21.15.144:0/2156115515 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe1c0018070 con 0x563f007a2580 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d02fe640 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0b80346a0 0x7fe0b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f007a6900 0x563f0089cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f0089d420 con 0x563f007a6900 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d1300640 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f007a6900 0x563f0089cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d02fe640 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0b80346a0 0x7fe0b8036b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40ad000 tx=0x7fe1c40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.922+0000 7fe1d1300640 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f007a6900 0x563f0089cea0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d1300640 1 -- 172.21.15.144:0/2156115515 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f007a6900 2024-09-13T19:34:30.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f0089a470 con 0x563f007a6900 2024-09-13T19:34:30.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d1300640 1 -- 172.21.15.144:0/2156115515 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f007a6900 2024-09-13T19:34:30.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f0089f7a0 0x563f008a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008a2280 con 0x563f0089f7a0 2024-09-13T19:34:30.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f0089f7a0 0x563f008a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f0089f7a0 0x563f008a1b90 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d0aff640 1 -- 172.21.15.144:0/2156115515 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe1c001b030 con 0x563f0089f7a0 2024-09-13T19:34:30.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f0089e640 con 0x563f007a6900 2024-09-13T19:34:30.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d1300640 1 -- 172.21.15.144:0/2156115515 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f007a6900 2024-09-13T19:34:30.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f0089eb20 con 0x563f007a6900 2024-09-13T19:34:30.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d1300640 1 -- 172.21.15.144:0/2156115515 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f007a6900 2024-09-13T19:34:30.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 Processor -- start 2024-09-13T19:34:30.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 -- start start 2024-09-13T19:34:30.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f008b09a0 0x563f008b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.926+0000 7fe1d2fef980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563f006aa800 con 0x563f008b09a0 2024-09-13T19:34:30.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d1300640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f008b09a0 0x563f008b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d1300640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f008b09a0 0x563f008b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34742/0 (socket says 172.21.15.144:34742) 2024-09-13T19:34:30.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d1300640 1 -- 172.21.15.144:0/288770054 learned_addr learned my addr 172.21.15.144:0/288770054 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d1300640 1 -- 172.21.15.144:0/288770054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f008b1300 con 0x563f008b09a0 2024-09-13T19:34:30.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d1300640 1 --2- 172.21.15.144:0/288770054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f008b09a0 0x563f008b0dc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x563f008971d0 tx=0x7fe1c800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe0b67fc640 1 -- 172.21.15.144:0/288770054 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c8007d70 con 0x563f008b09a0 2024-09-13T19:34:30.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d2fef980 1 -- 172.21.15.144:0/288770054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f008b1590 con 0x563f008b09a0 2024-09-13T19:34:30.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d2fef980 1 -- 172.21.15.144:0/288770054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f008b4210 con 0x563f008b09a0 2024-09-13T19:34:30.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe0b67fc640 1 -- 172.21.15.144:0/288770054 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c801e020 con 0x563f008b09a0 2024-09-13T19:34:30.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe0b67fc640 1 -- 172.21.15.144:0/288770054 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c8019550 con 0x563f008b09a0 2024-09-13T19:34:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe0b67fc640 1 -- 172.21.15.144:0/288770054 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe1c8016040 con 0x563f008b09a0 2024-09-13T19:34:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe0b67fc640 1 --2- 172.21.15.144:0/288770054 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0a8034650 0x7fe0a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe0b67fc640 1 -- 172.21.15.144:0/288770054 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe1c801f030 con 0x563f008b09a0 2024-09-13T19:34:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/288770054 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0a8034650 0x7fe0a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d2fef980 1 Processor -- start 2024-09-13T19:34:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d2fef980 1 -- start start 2024-09-13T19:34:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/288770054 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0a8034650 0x7fe0a8036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x563f0089d8f0 tx=0x7fe1c0010770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d2fef980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f0088dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d2fef980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563f00718560 con 0x563f0088d830 2024-09-13T19:34:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d1300640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f0088dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d1300640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f0088dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34758/0 (socket says 172.21.15.144:34758) 2024-09-13T19:34:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.930+0000 7fe1d1300640 1 -- 172.21.15.144:0/2441461119 learned_addr learned my addr 172.21.15.144:0/2441461119 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d1300640 1 -- 172.21.15.144:0/2441461119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f0088e200 con 0x563f0088d830 2024-09-13T19:34:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d1300640 1 --2- 172.21.15.144:0/2441461119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f0088dc30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8049f90 tx=0x7fe1c8015710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f025f402d782d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe0a7fff640 1 -- 172.21.15.144:0/2441461119 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c801d070 con 0x563f0088d830 2024-09-13T19:34:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe0a7fff640 1 -- 172.21.15.144:0/2441461119 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c80224f0 con 0x563f0088d830 2024-09-13T19:34:30.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe0a7fff640 1 -- 172.21.15.144:0/2441461119 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c8014490 con 0x563f0088d830 2024-09-13T19:34:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2441461119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 msgr2=0x563f0088dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2441461119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f0088dc30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8049f90 tx=0x7fe1c8015710 comp rx=0 tx=0).stop 2024-09-13T19:34:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2441461119 shutdown_connections 2024-09-13T19:34:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2441461119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f0088dc30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2441461119 >> 172.21.15.144:0/2441461119 conn(0x563f008b98e0 msgr2=0x563f008b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:30.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2441461119 shutdown_connections 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2441461119 wait complete. 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 Processor -- start 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- start start 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f008c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563f0088e960 con 0x563f0088d830 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d1300640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f008c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d1300640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f008c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34760/0 (socket says 172.21.15.144:34760) 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 learned_addr learned my addr 172.21.15.144:0/1868669092 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f008c6fa0 con 0x563f0088d830 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d1300640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f008c6a60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8025040 tx=0x7fe1c8049f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe0a67fc640 1 -- 172.21.15.144:0/1868669092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c8017950 con 0x563f0088d830 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f008c7230 con 0x563f0088d830 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe0a67fc640 1 -- 172.21.15.144:0/1868669092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c80196f0 con 0x563f0088d830 2024-09-13T19:34:30.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f008c9f10 con 0x563f0088d830 2024-09-13T19:34:30.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.934+0000 7fe0a67fc640 1 -- 172.21.15.144:0/1868669092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c8017af0 con 0x563f0088d830 2024-09-13T19:34:30.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe0a67fc640 1 -- 172.21.15.144:0/1868669092 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe1c80198a0 con 0x563f0088d830 2024-09-13T19:34:30.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe0a67fc640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe09c034650 0x7fe09c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe0a67fc640 1 -- 172.21.15.144:0/1868669092 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe1c803a070 con 0x563f0088d830 2024-09-13T19:34:30.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f008d1ed0 0x563f008d4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe09c034650 0x7fe09c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008d4ac0 con 0x563f008d1ed0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d02fe640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f008d1ed0 0x563f008d4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe09c034650 0x7fe09c036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0029fd0 tx=0x7fe1c004d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d02fe640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f008d1ed0 0x563f008d4370 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 realm 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008d4ef0 con 0x563f008d1ed0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008d5790 con 0x563f008d1ed0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008d5b30 con 0x563f008d1ed0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f008d6890 0x563f008d8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008d91c0 con 0x563f008d6890 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d1300640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f008d6890 0x563f008d8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.938+0000 7fe1d1300640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f008d6890 0x563f008d8c80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d2fef980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:30.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d2fef980 20 searching for the correct realm 2024-09-13T19:34:30.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563f008db110 0x563f008dd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563f008db110 0x563f008dd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563f008db110 0x563f008dd5d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d0aff640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1c0041040 0x7fe1c00115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x7fe1c0041040 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1c0041040 0x7fe1c00115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1c0041040 0x7fe1c00115d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d6890 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.942+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d6890 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x7fe1c0041040 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d6890 2024-09-13T19:34:30.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x7fe1c0041040 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d6890 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.946+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d6890 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x7fe1c0041040 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d6890 2024-09-13T19:34:30.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d6890 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x7fe1c0041040 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008db110 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.950+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d6890 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x563f008d1ed0 2024-09-13T19:34:30.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563f008ddca0 con 0x7fe1c0041040 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008d9b80 con 0x563f008d1ed0 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008d9b80 con 0x563f008d1ed0 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008d9ff0 con 0x563f008d1ed0 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 zone default found 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 4 Realm: () 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 zonegroup default 2024-09-13T19:34:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008da010 con 0x563f008d6890 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008dfb00 con 0x563f008db110 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008dfea0 con 0x563f008db110 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 started sync module instance, tier type = 2024-09-13T19:34:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:30.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.954+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008defa0 con 0x7fe1c0041040 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.958+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.958+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94828592231632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008defa0 con 0x7fe1c0041040 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.958+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e0860 con 0x563f008d1ed0 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.958+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94828592231632] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.958+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.958+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94828592235712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008defa0 con 0x563f008d1ed0 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.958+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e1180 con 0x563f008db110 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94828592237648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e1a20 con 0x563f008db110 2024-09-13T19:34:30.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e2420 con 0x7fe1c0041040 2024-09-13T19:34:30.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94828592235712] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94828592229104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e2810 con 0x7fe1c0041040 2024-09-13T19:34:30.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e31d0 con 0x563f008d1ed0 2024-09-13T19:34:30.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94828592237648] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94828592229104] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94828592242480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e2d20 con 0x563f008d1ed0 2024-09-13T19:34:30.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.962+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e3570 con 0x563f008d6890 2024-09-13T19:34:30.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.966+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94828592242480] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.966+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.966+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94828592246048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e3140 con 0x563f008d6890 2024-09-13T19:34:30.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.966+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e4270 con 0x563f008d6890 2024-09-13T19:34:30.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.966+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94828592246048] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94828592249104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e41e0 con 0x563f008d6890 2024-09-13T19:34:30.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e4c30 con 0x563f008d6890 2024-09-13T19:34:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94828592249104] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94828592252704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e4e10 con 0x563f008d6890 2024-09-13T19:34:30.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 20 add_watcher() i=0 2024-09-13T19:34:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 20 add_watcher() i=1 2024-09-13T19:34:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 20 add_watcher() i=2 2024-09-13T19:34:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 20 add_watcher() i=3 2024-09-13T19:34:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 20 add_watcher() i=4 2024-09-13T19:34:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 20 add_watcher() i=5 2024-09-13T19:34:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.970+0000 7fe1d2fef980 20 add_watcher() i=6 2024-09-13T19:34:30.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94828592252704] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 20 add_watcher() i=7 2024-09-13T19:34:30.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:30.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f008e81e0 con 0x563f008d1ed0 2024-09-13T19:34:30.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94828592254208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e55d0 con 0x563f008d1ed0 2024-09-13T19:34:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94828592254208] v32'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe086fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 5 note: GC not initialized 2024-09-13T19:34:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe085fe3640 20 reqs_thread_entry: start 2024-09-13T19:34:30.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 20 Filter name: none 2024-09-13T19:34:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fdff77fe640 20 reqs_thread_entry: start 2024-09-13T19:34:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 20 rados->read ofs=0 len=0 2024-09-13T19:34:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f0090b280 con 0x563f008d1ed0 2024-09-13T19:34:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:34:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563f0090c7d0 con 0x563f008d6890 2024-09-13T19:34:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.974+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.978+0000 7fe086fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.978+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94828592254208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f009099e0 con 0x563f008d1ed0 2024-09-13T19:34:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.978+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94828592254208] v32'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.978+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94828592231632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e4d00 con 0x7fe1c0041040 2024-09-13T19:34:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.978+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94828592231632] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.978+0000 7fe1d2fef980 20 remove_watcher() i=0 2024-09-13T19:34:30.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.978+0000 7fe1d2fef980 2 removed watcher, disabling cache 2024-09-13T19:34:30.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.978+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94828592235712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e4d00 con 0x563f008d1ed0 2024-09-13T19:34:30.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94828592235712] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d2fef980 20 remove_watcher() i=1 2024-09-13T19:34:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94828592237648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e04c0 con 0x563f008db110 2024-09-13T19:34:30.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d0aff640 1 -- 172.21.15.144:0/1868669092 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94828592237648] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c003e070 con 0x563f008db110 2024-09-13T19:34:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d2fef980 20 remove_watcher() i=2 2024-09-13T19:34:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94828592229104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e4d00 con 0x7fe1c0041040 2024-09-13T19:34:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94828592229104] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x7fe1c0041040 2024-09-13T19:34:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d2fef980 20 remove_watcher() i=3 2024-09-13T19:34:30.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.982+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94828592242480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008deaf0 con 0x563f008d1ed0 2024-09-13T19:34:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.986+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94828592242480] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c40b3040 con 0x563f008d1ed0 2024-09-13T19:34:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.986+0000 7fe1d2fef980 20 remove_watcher() i=4 2024-09-13T19:34:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.986+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94828592246048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e4d00 con 0x563f008d6890 2024-09-13T19:34:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.986+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94828592246048] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.986+0000 7fe1d2fef980 20 remove_watcher() i=5 2024-09-13T19:34:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.986+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94828592249104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008e1f30 con 0x563f008d6890 2024-09-13T19:34:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.990+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94828592249104] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.990+0000 7fe1d2fef980 20 remove_watcher() i=6 2024-09-13T19:34:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.990+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94828592252704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563f008deaf0 con 0x563f008d6890 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d1300640 1 -- 172.21.15.144:0/1868669092 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94828592252704] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c80083f0 con 0x563f008d6890 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 20 remove_watcher() i=7 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f008d6890 msgr2=0x563f008d8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f008d6890 0x563f008d8c80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f008d1ed0 msgr2=0x563f008d4370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f008d1ed0 0x563f008d4370 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1c0041040 msgr2=0x7fe1c00115d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1c0041040 0x7fe1c00115d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563f008db110 msgr2=0x563f008dd5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563f008db110 0x563f008dd5d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe09c034650 msgr2=0x7fe09c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe09c034650 0x7fe09c036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0029fd0 tx=0x7fe1c004d040 comp rx=0 tx=0).stop 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 msgr2=0x563f008c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f008c6a60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8025040 tx=0x7fe1c8049f20 comp rx=0 tx=0).stop 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 shutdown_connections 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1c0041040 0x7fe1c00115d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563f008db110 0x563f008dd5d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f008d1ed0 0x563f008d4370 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d02fe640 1 -- 172.21.15.144:0/1868669092 reap_dead start 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f008d6890 0x563f008d8c80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe09c034650 0x7fe09c036b10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/1868669092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f0088d830 0x563f008c6a60 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 >> 172.21.15.144:0/1868669092 conn(0x563f008b98e0 msgr2=0x563f008b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 shutdown_connections 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/1868669092 wait complete. 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/288770054 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0a8034650 msgr2=0x7fe0a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/288770054 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0a8034650 0x7fe0a8036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x563f0089d8f0 tx=0x7fe1c0010770 comp rx=0 tx=0).stop 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/288770054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f008b09a0 msgr2=0x563f008b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/288770054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f008b09a0 0x563f008b0dc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x563f008971d0 tx=0x7fe1c800af40 comp rx=0 tx=0).stop 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/288770054 shutdown_connections 2024-09-13T19:34:31.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/288770054 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0a8034650 0x7fe0a8036b10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/288770054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f008b09a0 0x563f008b0dc0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/288770054 >> 172.21.15.144:0/288770054 conn(0x563f008a5af0 msgr2=0x563f008a8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/288770054 shutdown_connections 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/288770054 wait complete. 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f0089f7a0 msgr2=0x563f008a1b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f0089f7a0 0x563f008a1b90 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f007a6900 msgr2=0x563f0089cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f007a6900 0x563f0089cea0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0b80346a0 msgr2=0x7fe0b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0b80346a0 0x7fe0b8036b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40ad000 tx=0x7fe1c40a5040 comp rx=0 tx=0).stop 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 msgr2=0x563f00895da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00895da0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x563f0088fc70 tx=0x7fe1c0000f50 comp rx=0 tx=0).stop 2024-09-13T19:34:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 shutdown_connections 2024-09-13T19:34:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563f007a6900 0x563f0089cea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563f0089f7a0 0x563f008a1b90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe0b80346a0 0x7fe0b8036b60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 --2- 172.21.15.144:0/2156115515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563f007a2580 0x563f00895da0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 >> 172.21.15.144:0/2156115515 conn(0x563f0079e0a0 msgr2=0x563f00888120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 shutdown_connections 2024-09-13T19:34:31.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:30.994+0000 7fe1d2fef980 1 -- 172.21.15.144:0/2156115515 wait complete. 2024-09-13T19:34:31.009 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T19:34:31.009 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:34:31.010 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T19:34:31.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T19:34:31.010 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-13T19:34:31.089 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:31.089 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c3996b980 1 Processor -- start 2024-09-13T19:34:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c3996b980 1 -- start start 2024-09-13T19:34:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c3996b980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5649a4edac70 0x5649a4edd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c3996b980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649a4d5cae0 con 0x5649a4ed68f0 2024-09-13T19:34:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c3996b980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5649a4d80e30 con 0x5649a4edac70 2024-09-13T19:34:31.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c36c7a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5649a4edac70 0x5649a4edd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c3747b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5649a4ed68f0 0x5649a4ed6cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37836/0 (socket says 172.21.15.144:37836) 2024-09-13T19:34:31.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c36c7a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5649a4edac70 0x5649a4edd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34774/0 (socket says 172.21.15.144:34774) 2024-09-13T19:34:31.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c3747b640 1 -- 172.21.15.144:0/2739279517 learned_addr learned my addr 172.21.15.144:0/2739279517 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:34:31.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2739279517 >> v1:172.21.15.18:6789/0 conn(0x5649a4ed68f0 legacy=0x5649a4ed6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.086+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2739279517 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a4ede5b0 con 0x5649a4edac70 2024-09-13T19:34:31.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c36c7a640 1 --2- 172.21.15.144:0/2739279517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4edac70 0x5649a4edd060 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00a480 tx=0x7f4c2c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8a3b5a7c57ea5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c36479640 1 -- 172.21.15.144:0/2739279517 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c2c0b0070 con 0x5649a4edac70 2024-09-13T19:34:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c36479640 1 -- 172.21.15.144:0/2739279517 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c0ab540 con 0x5649a4edac70 2024-09-13T19:34:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c36479640 1 -- 172.21.15.144:0/2739279517 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c2c0ab840 con 0x5649a4edac70 2024-09-13T19:34:31.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c3996b980 1 -- 172.21.15.144:0/2739279517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4edac70 msgr2=0x5649a4edd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2739279517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4edac70 0x5649a4edd060 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00a480 tx=0x7f4c2c01b280 comp rx=0 tx=0).stop 2024-09-13T19:34:31.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c3996b980 1 -- 172.21.15.144:0/2739279517 shutdown_connections 2024-09-13T19:34:31.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2739279517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4edac70 0x5649a4edd060 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c3996b980 1 -- 172.21.15.144:0/2739279517 >> 172.21.15.144:0/2739279517 conn(0x5649a4e4a240 msgr2=0x5649a4e4a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c3996b980 1 -- 172.21.15.144:0/2739279517 shutdown_connections 2024-09-13T19:34:31.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.090+0000 7f4c3996b980 1 -- 172.21.15.144:0/2739279517 wait complete. 2024-09-13T19:34:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.102+0000 7f4c3996b980 1 Processor -- start 2024-09-13T19:34:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.102+0000 7f4c3996b980 1 -- start start 2024-09-13T19:34:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.102+0000 7f4c3996b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.102+0000 7f4c3996b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5649a4d82200 con 0x5649a4ed68f0 2024-09-13T19:34:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.102+0000 7f4c3747b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.102+0000 7f4c3747b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34782/0 (socket says 172.21.15.144:34782) 2024-09-13T19:34:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.102+0000 7f4c3747b640 1 -- 172.21.15.144:0/3154625091 learned_addr learned my addr 172.21.15.144:0/3154625091 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3747b640 1 -- 172.21.15.144:0/3154625091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a4fc2260 con 0x5649a4ed68f0 2024-09-13T19:34:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3747b640 1 --2- 172.21.15.144:0/3154625091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc1c90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4c28001d90 tx=0x7f4c28001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdcdc8b7cb4dabc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4b2560a640 1 -- 172.21.15.144:0/3154625091 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c28013030 con 0x5649a4ed68f0 2024-09-13T19:34:31.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4b2560a640 1 -- 172.21.15.144:0/3154625091 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2800e690 con 0x5649a4ed68f0 2024-09-13T19:34:31.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4b2560a640 1 -- 172.21.15.144:0/3154625091 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c2800ea10 con 0x5649a4ed68f0 2024-09-13T19:34:31.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- 172.21.15.144:0/3154625091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 msgr2=0x5649a4fc1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 --2- 172.21.15.144:0/3154625091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc1c90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4c28001d90 tx=0x7f4c28001e80 comp rx=0 tx=0).stop 2024-09-13T19:34:31.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- 172.21.15.144:0/3154625091 shutdown_connections 2024-09-13T19:34:31.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 --2- 172.21.15.144:0/3154625091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc1c90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- 172.21.15.144:0/3154625091 >> 172.21.15.144:0/3154625091 conn(0x5649a4e4a240 msgr2=0x5649a4fbd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- 172.21.15.144:0/3154625091 shutdown_connections 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- 172.21.15.144:0/3154625091 wait complete. 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 Processor -- start 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- start start 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5649a4ede0b0 con 0x5649a4ed68f0 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3747b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3747b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34788/0 (socket says 172.21.15.144:34788) 2024-09-13T19:34:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3747b640 1 -- 172.21.15.144:0/4247577650 learned_addr learned my addr 172.21.15.144:0/4247577650 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3747b640 1 -- 172.21.15.144:0/4247577650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a4fc9540 con 0x5649a4ed68f0 2024-09-13T19:34:31.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3747b640 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc9000 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x5649a4fc2e70 tx=0x7f4c28000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4b23e07640 1 -- 172.21.15.144:0/4247577650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c28027070 con 0x5649a4ed68f0 2024-09-13T19:34:31.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649a4fc97d0 con 0x5649a4ed68f0 2024-09-13T19:34:31.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a4fcc4b0 con 0x5649a4ed68f0 2024-09-13T19:34:31.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4b23e07640 1 -- 172.21.15.144:0/4247577650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c28019900 con 0x5649a4ed68f0 2024-09-13T19:34:31.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.106+0000 7f4b23e07640 1 -- 172.21.15.144:0/4247577650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c28019be0 con 0x5649a4ed68f0 2024-09-13T19:34:31.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4b23e07640 1 -- 172.21.15.144:0/4247577650 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c2802a070 con 0x5649a4ed68f0 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4b23e07640 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b1c0346a0 0x7f4b1c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4b23e07640 1 -- 172.21.15.144:0/4247577650 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4c2801f070 con 0x5649a4ed68f0 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c36c7a640 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b1c0346a0 0x7f4b1c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a4edac70 0x5649a4fcffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a4fd0620 con 0x5649a4edac70 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c37c7c640 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a4edac70 0x5649a4fcffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c36c7a640 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b1c0346a0 0x7f4b1c036b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0ad000 tx=0x7f4c2c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c37c7c640 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a4edac70 0x5649a4fcffb0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c37c7c640 1 -- 172.21.15.144:0/4247577650 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c3000a4d0 con 0x5649a4edac70 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a4fcd6d0 con 0x5649a4edac70 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c37c7c640 1 -- 172.21.15.144:0/4247577650 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c3000a4d0 con 0x5649a4edac70 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a4fd2970 0x5649a4fd4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a4fd5430 con 0x5649a4fd2970 2024-09-13T19:34:31.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c3747b640 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a4fd2970 0x5649a4fd4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.110+0000 7f4c3747b640 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a4fd2970 0x5649a4fd4d60 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3747b640 1 -- 172.21.15.144:0/4247577650 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c28029030 con 0x5649a4fd2970 2024-09-13T19:34:31.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a4fd1810 con 0x5649a4edac70 2024-09-13T19:34:31.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c37c7c640 1 -- 172.21.15.144:0/4247577650 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c3000a4d0 con 0x5649a4edac70 2024-09-13T19:34:31.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a4fd1cf0 con 0x5649a4edac70 2024-09-13T19:34:31.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c37c7c640 1 -- 172.21.15.144:0/4247577650 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c3000a4d0 con 0x5649a4edac70 2024-09-13T19:34:31.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3996b980 1 Processor -- start 2024-09-13T19:34:31.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3996b980 1 -- start start 2024-09-13T19:34:31.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3996b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4fe3b70 0x5649a4fe3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3996b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5649a4ddb800 con 0x5649a4fe3b70 2024-09-13T19:34:31.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c37c7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4fe3b70 0x5649a4fe3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c37c7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4fe3b70 0x5649a4fe3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34804/0 (socket says 172.21.15.144:34804) 2024-09-13T19:34:31.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c37c7c640 1 -- 172.21.15.144:0/1475293187 learned_addr learned my addr 172.21.15.144:0/1475293187 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c37c7c640 1 -- 172.21.15.144:0/1475293187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a4fe44d0 con 0x5649a4fe3b70 2024-09-13T19:34:31.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c37c7c640 1 --2- 172.21.15.144:0/1475293187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4fe3b70 0x5649a4fe3f90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x5649a4fc9f00 tx=0x7f4c30018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4b21602640 1 -- 172.21.15.144:0/1475293187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c30014450 con 0x5649a4fe3b70 2024-09-13T19:34:31.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3996b980 1 -- 172.21.15.144:0/1475293187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649a4fe4760 con 0x5649a4fe3b70 2024-09-13T19:34:31.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4c3996b980 1 -- 172.21.15.144:0/1475293187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a4fe73e0 con 0x5649a4fe3b70 2024-09-13T19:34:31.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4b21602640 1 -- 172.21.15.144:0/1475293187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c300145f0 con 0x5649a4fe3b70 2024-09-13T19:34:31.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.114+0000 7f4b21602640 1 -- 172.21.15.144:0/1475293187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c30028060 con 0x5649a4fe3b70 2024-09-13T19:34:31.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4b21602640 1 -- 172.21.15.144:0/1475293187 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c30011040 con 0x5649a4fe3b70 2024-09-13T19:34:31.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4b21602640 1 --2- 172.21.15.144:0/1475293187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b100346a0 0x7f4b10036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4b21602640 1 -- 172.21.15.144:0/1475293187 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4c3001e070 con 0x5649a4fe3b70 2024-09-13T19:34:31.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3747b640 1 --2- 172.21.15.144:0/1475293187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b100346a0 0x7f4b10036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 Processor -- start 2024-09-13T19:34:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 -- start start 2024-09-13T19:34:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3747b640 1 --2- 172.21.15.144:0/1475293187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b100346a0 0x7f4b10036b60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5649a4fd0ac0 tx=0x7f4c28017f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5649a4fc25e0 con 0x5649a4ff0680 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c37c7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c37c7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34806/0 (socket says 172.21.15.144:34806) 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c37c7c640 1 -- 172.21.15.144:0/1301450580 learned_addr learned my addr 172.21.15.144:0/1301450580 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c37c7c640 1 -- 172.21.15.144:0/1301450580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a4ff1030 con 0x5649a4ff0680 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c37c7c640 1 --2- 172.21.15.144:0/1301450580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff0a60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4c3004a1d0 tx=0x7f4c3004a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a49b531f12c0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4b1affd640 1 -- 172.21.15.144:0/1301450580 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c300168f0 con 0x5649a4ff0680 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4b1affd640 1 -- 172.21.15.144:0/1301450580 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3002b350 con 0x5649a4ff0680 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4b1affd640 1 -- 172.21.15.144:0/1301450580 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c30013cb0 con 0x5649a4ff0680 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 -- 172.21.15.144:0/1301450580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 msgr2=0x5649a4ff0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 --2- 172.21.15.144:0/1301450580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff0a60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4c3004a1d0 tx=0x7f4c3004a2c0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 -- 172.21.15.144:0/1301450580 shutdown_connections 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 --2- 172.21.15.144:0/1301450580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff0a60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 -- 172.21.15.144:0/1301450580 >> 172.21.15.144:0/1301450580 conn(0x5649a4fec9b0 msgr2=0x5649a4feaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 -- 172.21.15.144:0/1301450580 shutdown_connections 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 -- 172.21.15.144:0/1301450580 wait complete. 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.118+0000 7f4c3996b980 1 Processor -- start 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3996b980 1 -- start start 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3996b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3996b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5649a4ff1540 con 0x5649a4ff0680 2024-09-13T19:34:31.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c37c7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c37c7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34814/0 (socket says 172.21.15.144:34814) 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 learned_addr learned my addr 172.21.15.144:0/2015331604 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a4ff7e60 con 0x5649a4ff0680 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c37c7c640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff7920 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x5649a4fed090 tx=0x7f4c30049f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4b197fa640 1 -- 172.21.15.144:0/2015331604 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c30014e20 con 0x5649a4ff0680 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649a4ff80f0 con 0x5649a4ff0680 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4b197fa640 1 -- 172.21.15.144:0/2015331604 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c300225e0 con 0x5649a4ff0680 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a4ffadd0 con 0x5649a4ff0680 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4b197fa640 1 -- 172.21.15.144:0/2015331604 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c300228c0 con 0x5649a4ff0680 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4b197fa640 1 -- 172.21.15.144:0/2015331604 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c300133b0 con 0x5649a4ff0680 2024-09-13T19:34:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4b197fa640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b00034650 0x7f4b00036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4b197fa640 1 -- 172.21.15.144:0/2015331604 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4c30035070 con 0x5649a4ff0680 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3747b640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b00034650 0x7f4b00036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a5002f50 0x5649a50053f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a5005b40 con 0x5649a5002f50 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c36c7a640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a5002f50 0x5649a50053f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c3747b640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b00034650 0x7f4b00036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c2802af70 tx=0x7f4c28035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.122+0000 7f4c36c7a640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a5002f50 0x5649a50053f0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 realm 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a5005fc0 con 0x5649a5002f50 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a5006860 con 0x5649a5002f50 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a5006c00 con 0x5649a5002f50 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:31.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a5007960 0x5649a5009d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a500a290 con 0x5649a5007960 2024-09-13T19:34:31.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c37c7c640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a5007960 0x5649a5009d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c37c7c640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a5007960 0x5649a5009d50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:31.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 20 searching for the correct realm 2024-09-13T19:34:31.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5649a500c1e0 0x5649a500e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3747b640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5649a500c1e0 0x5649a500e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3747b640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5649a500c1e0 0x5649a500e6a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3747b640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4c2802c060 0x7f4c28016a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x7f4c2802c060 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.126+0000 7f4c36c7a640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4c2802c060 0x7f4c28016a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4c2802c060 0x7f4c28016a80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5007960 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5007960 2024-09-13T19:34:31.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x7f4c2802c060 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.130+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5007960 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x7f4c2802c060 2024-09-13T19:34:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5007960 2024-09-13T19:34:31.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.134+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5007960 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x7f4c2802c060 2024-09-13T19:34:31.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5007960 2024-09-13T19:34:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5007960 2024-09-13T19:34:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x7f4c2802c060 2024-09-13T19:34:31.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a500c1e0 2024-09-13T19:34:31.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.138+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5007960 2024-09-13T19:34:31.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x5649a5002f50 2024-09-13T19:34:31.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ed70 con 0x7f4c2802c060 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ac50 con 0x5649a5002f50 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ac50 con 0x5649a5002f50 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a500b0c0 con 0x5649a5002f50 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 zone default found 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 4 Realm: () 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:31.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 zonegroup default 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a500b100 con 0x5649a5007960 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a5010bd0 con 0x5649a500c1e0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a5010f70 con 0x5649a500c1e0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 started sync module instance, tier type = 2024-09-13T19:34:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:31.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.142+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5010070 con 0x7f4c2802c060 2024-09-13T19:34:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.146+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.146+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94874300908880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5010070 con 0x7f4c2802c060 2024-09-13T19:34:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.146+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5011970 con 0x5649a5002f50 2024-09-13T19:34:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.146+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94874300908880] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.146+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.146+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94874300912768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5010070 con 0x5649a5002f50 2024-09-13T19:34:31.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.146+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a50122a0 con 0x5649a500c1e0 2024-09-13T19:34:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94874300912768] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94874300906432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a500ffe0 con 0x5649a500c1e0 2024-09-13T19:34:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5013030 con 0x7f4c2802c060 2024-09-13T19:34:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94874300918592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a50138d0 con 0x7f4c2802c060 2024-09-13T19:34:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a50142d0 con 0x5649a5002f50 2024-09-13T19:34:31.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94874300918592] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.150+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94874300906432] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.154+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.154+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94874300917392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a50133a0 con 0x5649a5002f50 2024-09-13T19:34:31.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.154+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5014b70 con 0x5649a5007960 2024-09-13T19:34:31.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.154+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94874300917392] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.154+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.154+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94874300923360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a50133a0 con 0x5649a5007960 2024-09-13T19:34:31.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.154+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015020 con 0x5649a5007960 2024-09-13T19:34:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94874300923360] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94874300925632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5014f90 con 0x5649a5007960 2024-09-13T19:34:31.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a50159d0 con 0x5649a5007960 2024-09-13T19:34:31.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94874300929184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015e40 con 0x5649a5007960 2024-09-13T19:34:31.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 20 add_watcher() i=0 2024-09-13T19:34:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 20 add_watcher() i=1 2024-09-13T19:34:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 20 add_watcher() i=2 2024-09-13T19:34:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 20 add_watcher() i=3 2024-09-13T19:34:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 20 add_watcher() i=4 2024-09-13T19:34:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 20 add_watcher() i=5 2024-09-13T19:34:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94874300925632] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.158+0000 7f4c3996b980 20 add_watcher() i=6 2024-09-13T19:34:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94874300929184] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 20 add_watcher() i=7 2024-09-13T19:34:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015e40 con 0x5649a5002f50 2024-09-13T19:34:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94874300930448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015db0 con 0x5649a5002f50 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94874300930448] v32'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4aedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 5 note: GC not initialized 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4aecfe1640 20 reqs_thread_entry: start 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4c3996b980 20 Filter name: none 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.162+0000 7f4a667fc640 20 reqs_thread_entry: start 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c3996b980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a503bfb0 con 0x5649a5002f50 2024-09-13T19:34:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c3996b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:34:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649a503d500 con 0x5649a5007960 2024-09-13T19:34:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4aedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94874300930448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a503abc0 con 0x5649a5002f50 2024-09-13T19:34:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94874300930448] v32'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.166+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94874300908880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015990 con 0x7f4c2802c060 2024-09-13T19:34:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.170+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94874300908880] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.170+0000 7f4c3996b980 20 remove_watcher() i=0 2024-09-13T19:34:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.170+0000 7f4c3996b980 2 removed watcher, disabling cache 2024-09-13T19:34:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.170+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94874300912768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015990 con 0x5649a5002f50 2024-09-13T19:34:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.170+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94874300912768] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.170+0000 7f4c3996b980 20 remove_watcher() i=1 2024-09-13T19:34:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.170+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94874300906432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015990 con 0x5649a500c1e0 2024-09-13T19:34:31.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c3747b640 1 -- 172.21.15.144:0/2015331604 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94874300906432] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28029030 con 0x5649a500c1e0 2024-09-13T19:34:31.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c3996b980 20 remove_watcher() i=2 2024-09-13T19:34:31.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94874300918592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015990 con 0x7f4c2802c060 2024-09-13T19:34:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94874300918592] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x7f4c2802c060 2024-09-13T19:34:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c3996b980 20 remove_watcher() i=3 2024-09-13T19:34:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94874300917392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015990 con 0x5649a5002f50 2024-09-13T19:34:31.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94874300917392] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2c0b3040 con 0x5649a5002f50 2024-09-13T19:34:31.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c3996b980 20 remove_watcher() i=4 2024-09-13T19:34:31.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.174+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94874300923360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5012690 con 0x5649a5007960 2024-09-13T19:34:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.178+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94874300923360] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.178+0000 7f4c3996b980 20 remove_watcher() i=5 2024-09-13T19:34:31.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.178+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94874300925632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5015990 con 0x5649a5007960 2024-09-13T19:34:31.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.178+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94874300925632] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 20 remove_watcher() i=6 2024-09-13T19:34:31.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94874300929184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649a5013de0 con 0x5649a5007960 2024-09-13T19:34:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c37c7c640 1 -- 172.21.15.144:0/2015331604 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94874300929184] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3002a070 con 0x5649a5007960 2024-09-13T19:34:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 20 remove_watcher() i=7 2024-09-13T19:34:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a5007960 msgr2=0x5649a5009d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a5007960 0x5649a5009d50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a5002f50 msgr2=0x5649a50053f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a5002f50 0x5649a50053f0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4c2802c060 msgr2=0x7f4c28016a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f4c2802c060 0x7f4c28016a80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5649a500c1e0 msgr2=0x5649a500e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5649a500c1e0 0x5649a500e6a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b00034650 msgr2=0x7f4b00036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b00034650 0x7f4b00036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c2802af70 tx=0x7f4c28035000 comp rx=0 tx=0).stop 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c36c7a640 1 -- 172.21.15.144:0/2015331604 reap_dead start 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 msgr2=0x5649a4ff7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff7920 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x5649a4fed090 tx=0x7f4c30049f70 comp rx=0 tx=0).stop 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 shutdown_connections 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/2015331604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ff0680 0x5649a4ff7920 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 >> 172.21.15.144:0/2015331604 conn(0x5649a4fec9b0 msgr2=0x5649a4feaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 shutdown_connections 2024-09-13T19:34:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/2015331604 wait complete. 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/1475293187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b100346a0 msgr2=0x7f4b10036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/1475293187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b100346a0 0x7f4b10036b60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5649a4fd0ac0 tx=0x7f4c28017f60 comp rx=0 tx=0).stop 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/1475293187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4fe3b70 msgr2=0x5649a4fe3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/1475293187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4fe3b70 0x5649a4fe3f90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x5649a4fc9f00 tx=0x7f4c30018830 comp rx=0 tx=0).stop 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/1475293187 shutdown_connections 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/1475293187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b100346a0 0x7f4b10036b60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/1475293187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4fe3b70 0x5649a4fe3f90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/1475293187 >> 172.21.15.144:0/1475293187 conn(0x5649a4fd8cc0 msgr2=0x5649a4fdb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/1475293187 shutdown_connections 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/1475293187 wait complete. 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a4fd2970 msgr2=0x5649a4fd4d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a4fd2970 0x5649a4fd4d60 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a4edac70 msgr2=0x5649a4fcffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a4edac70 0x5649a4fcffb0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b1c0346a0 msgr2=0x7f4b1c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b1c0346a0 0x7f4b1c036b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0ad000 tx=0x7f4c2c0a5040 comp rx=0 tx=0).stop 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 msgr2=0x5649a4fc9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc9000 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x5649a4fc2e70 tx=0x7f4c28000bd0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 shutdown_connections 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5649a4edac70 0x5649a4fcffb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5649a4fd2970 0x5649a4fd4d60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4b1c0346a0 0x7f4b1c036b60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 --2- 172.21.15.144:0/4247577650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5649a4ed68f0 0x5649a4fc9000 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 >> 172.21.15.144:0/4247577650 conn(0x5649a4e4a240 msgr2=0x5649a4fbc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 shutdown_connections 2024-09-13T19:34:31.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.182+0000 7f4c3996b980 1 -- 172.21.15.144:0/4247577650 wait complete. 2024-09-13T19:34:31.198 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-13T19:34:31.198 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T19:34:31.199 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T19:34:31.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T19:34:31.199 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-13T19:34:31.282 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:31.282 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1739146980 1 Processor -- start 2024-09-13T19:34:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1739146980 1 -- start start 2024-09-13T19:34:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1739146980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55ea44922ad0 0x55ea44924ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1739146980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea447a6ae0 con 0x55ea44892b00 2024-09-13T19:34:31.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1739146980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55ea447cae30 con 0x55ea44922ad0 2024-09-13T19:34:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1736455640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55ea44922ad0 0x55ea44924ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1736455640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55ea44922ad0 0x55ea44924ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34820/0 (socket says 172.21.15.144:34820) 2024-09-13T19:34:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1736455640 1 -- 172.21.15.144:0/581546661 learned_addr learned my addr 172.21.15.144:0/581546661 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1736c56640 1 --1- 172.21.15.144:0/581546661 >> v1:172.21.15.18:6789/0 conn(0x55ea44892b00 0x55ea449213b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37838/0 (socket says 172.21.15.144:37838) 2024-09-13T19:34:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1736455640 1 -- 172.21.15.144:0/581546661 >> v1:172.21.15.18:6789/0 conn(0x55ea44892b00 legacy=0x55ea449213b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.278+0000 7f1736455640 1 -- 172.21.15.144:0/581546661 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea44926410 con 0x55ea44922ad0 2024-09-13T19:34:31.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1736455640 1 --2- 172.21.15.144:0/581546661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44922ad0 0x55ea44924ec0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f172c00a5c0 tx=0x7f172c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e175f41a8ac07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1735c54640 1 -- 172.21.15.144:0/581546661 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f172c0a6070 con 0x55ea44922ad0 2024-09-13T19:34:31.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1735c54640 1 -- 172.21.15.144:0/581546661 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c0af070 con 0x55ea44922ad0 2024-09-13T19:34:31.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1735c54640 1 -- 172.21.15.144:0/581546661 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f172c0aa5c0 con 0x55ea44922ad0 2024-09-13T19:34:31.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1739146980 1 -- 172.21.15.144:0/581546661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44922ad0 msgr2=0x55ea44924ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1739146980 1 --2- 172.21.15.144:0/581546661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44922ad0 0x55ea44924ec0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f172c00a5c0 tx=0x7f172c01b340 comp rx=0 tx=0).stop 2024-09-13T19:34:31.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1739146980 1 -- 172.21.15.144:0/581546661 shutdown_connections 2024-09-13T19:34:31.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1739146980 1 --2- 172.21.15.144:0/581546661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44922ad0 0x55ea44924ec0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1739146980 1 -- 172.21.15.144:0/581546661 >> 172.21.15.144:0/581546661 conn(0x55ea449190a0 msgr2=0x55ea4491b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1739146980 1 -- 172.21.15.144:0/581546661 shutdown_connections 2024-09-13T19:34:31.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.282+0000 7f1739146980 1 -- 172.21.15.144:0/581546661 wait complete. 2024-09-13T19:34:31.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 Processor -- start 2024-09-13T19:34:31.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- start start 2024-09-13T19:34:31.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a09b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea447cc200 con 0x55ea44892b00 2024-09-13T19:34:31.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1736c56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a09b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1736c56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a09b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34822/0 (socket says 172.21.15.144:34822) 2024-09-13T19:34:31.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1736c56640 1 -- 172.21.15.144:0/2863629889 learned_addr learned my addr 172.21.15.144:0/2863629889 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1736c56640 1 -- 172.21.15.144:0/2863629889 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea44a0a130 con 0x55ea44892b00 2024-09-13T19:34:31.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1736c56640 1 --2- 172.21.15.144:0/2863629889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a09b60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1728001e50 tx=0x7f1728001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25027a95777298fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1624e09640 1 -- 172.21.15.144:0/2863629889 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f172800e5d0 con 0x55ea44892b00 2024-09-13T19:34:31.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1624e09640 1 -- 172.21.15.144:0/2863629889 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172800e770 con 0x55ea44892b00 2024-09-13T19:34:31.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1624e09640 1 -- 172.21.15.144:0/2863629889 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f172800eab0 con 0x55ea44892b00 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- 172.21.15.144:0/2863629889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 msgr2=0x55ea44a09b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 --2- 172.21.15.144:0/2863629889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a09b60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1728001e50 tx=0x7f1728001e80 comp rx=0 tx=0).stop 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- 172.21.15.144:0/2863629889 shutdown_connections 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 --2- 172.21.15.144:0/2863629889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a09b60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- 172.21.15.144:0/2863629889 >> 172.21.15.144:0/2863629889 conn(0x55ea449190a0 msgr2=0x55ea44a05790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- 172.21.15.144:0/2863629889 shutdown_connections 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- 172.21.15.144:0/2863629889 wait complete. 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 Processor -- start 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- start start 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a10ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1739146980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea44925e50 con 0x55ea44892b00 2024-09-13T19:34:31.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.298+0000 7f1736c56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a10ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1736c56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a10ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34836/0 (socket says 172.21.15.144:34836) 2024-09-13T19:34:31.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1736c56640 1 -- 172.21.15.144:0/3989827846 learned_addr learned my addr 172.21.15.144:0/3989827846 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1736c56640 1 -- 172.21.15.144:0/3989827846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea44a11430 con 0x55ea44892b00 2024-09-13T19:34:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1736c56640 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a10ef0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x55ea44a0ad40 tx=0x7f1728000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1623606640 1 -- 172.21.15.144:0/3989827846 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1728001260 con 0x55ea44892b00 2024-09-13T19:34:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea44a116c0 con 0x55ea44892b00 2024-09-13T19:34:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1623606640 1 -- 172.21.15.144:0/3989827846 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172800fa40 con 0x55ea44892b00 2024-09-13T19:34:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1623606640 1 -- 172.21.15.144:0/3989827846 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f172802c060 con 0x55ea44892b00 2024-09-13T19:34:31.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea44a143a0 con 0x55ea44892b00 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1623606640 1 -- 172.21.15.144:0/3989827846 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1728017070 con 0x55ea44892b00 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1623606640 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f161c034650 0x7f161c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1623606640 1 -- 172.21.15.144:0/3989827846 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1728015020 con 0x55ea44892b00 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1736455640 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f161c034650 0x7f161c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44922ad0 0x55ea44a17ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a18550 con 0x55ea44922ad0 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1737457640 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44922ad0 0x55ea44a17ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1736455640 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f161c034650 0x7f161c036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f172c0ae000 tx=0x7f172c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1737457640 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44922ad0 0x55ea44a17ee0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1737457640 1 -- 172.21.15.144:0/3989827846 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f173000a4d0 con 0x55ea44922ad0 2024-09-13T19:34:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.302+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a155c0 con 0x55ea44922ad0 2024-09-13T19:34:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1737457640 1 -- 172.21.15.144:0/3989827846 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f173000a4d0 con 0x55ea44922ad0 2024-09-13T19:34:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a1a880 0x55ea44a1cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a1d340 con 0x55ea44a1a880 2024-09-13T19:34:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1736c56640 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a1a880 0x55ea44a1cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1736c56640 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a1a880 0x55ea44a1cc70 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1736c56640 1 -- 172.21.15.144:0/3989827846 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a1a880 2024-09-13T19:34:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a19720 con 0x55ea44922ad0 2024-09-13T19:34:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1737457640 1 -- 172.21.15.144:0/3989827846 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f173000a4d0 con 0x55ea44922ad0 2024-09-13T19:34:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a19c00 con 0x55ea44922ad0 2024-09-13T19:34:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1737457640 1 -- 172.21.15.144:0/3989827846 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f173000a4d0 con 0x55ea44922ad0 2024-09-13T19:34:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1739146980 1 Processor -- start 2024-09-13T19:34:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1739146980 1 -- start start 2024-09-13T19:34:31.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1739146980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a2ba20 0x55ea44a2be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1739146980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea44825800 con 0x55ea44a2ba20 2024-09-13T19:34:31.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1737457640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a2ba20 0x55ea44a2be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1737457640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a2ba20 0x55ea44a2be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34844/0 (socket says 172.21.15.144:34844) 2024-09-13T19:34:31.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1737457640 1 -- 172.21.15.144:0/3892806846 learned_addr learned my addr 172.21.15.144:0/3892806846 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.306+0000 7f1737457640 1 -- 172.21.15.144:0/3892806846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea44a2c380 con 0x55ea44a2ba20 2024-09-13T19:34:31.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1737457640 1 --2- 172.21.15.144:0/3892806846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a2ba20 0x55ea44a2be40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55ea44a18930 tx=0x7f1730018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1620e01640 1 -- 172.21.15.144:0/3892806846 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1730014450 con 0x55ea44a2ba20 2024-09-13T19:34:31.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1620e01640 1 -- 172.21.15.144:0/3892806846 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17300145f0 con 0x55ea44a2ba20 2024-09-13T19:34:31.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1620e01640 1 -- 172.21.15.144:0/3892806846 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1730014910 con 0x55ea44a2ba20 2024-09-13T19:34:31.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1739146980 1 -- 172.21.15.144:0/3892806846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea44a2c610 con 0x55ea44a2ba20 2024-09-13T19:34:31.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1739146980 1 -- 172.21.15.144:0/3892806846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea44a2f290 con 0x55ea44a2ba20 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1620e01640 1 -- 172.21.15.144:0/3892806846 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1730011040 con 0x55ea44a2ba20 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1620e01640 1 --2- 172.21.15.144:0/3892806846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16100346a0 0x7f1610036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1620e01640 1 -- 172.21.15.144:0/3892806846 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f173001e070 con 0x55ea44a2ba20 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1736c56640 1 --2- 172.21.15.144:0/3892806846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16100346a0 0x7f1610036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1739146980 1 Processor -- start 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1739146980 1 -- start start 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1736c56640 1 --2- 172.21.15.144:0/3892806846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16100346a0 0x7f1610036b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55ea44a189d0 tx=0x7f1728001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1739146980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1739146980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea44a0a4b0 con 0x55ea44a384c0 2024-09-13T19:34:31.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1737457640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1737457640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34856/0 (socket says 172.21.15.144:34856) 2024-09-13T19:34:31.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1737457640 1 -- 172.21.15.144:0/2129296001 learned_addr learned my addr 172.21.15.144:0/2129296001 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.310+0000 7f1737457640 1 -- 172.21.15.144:0/2129296001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea44a38e70 con 0x55ea44a384c0 2024-09-13T19:34:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1737457640 1 --2- 172.21.15.144:0/2129296001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a388a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f173004a130 tx=0x7f1730013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2654851e54ba1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f161a7fc640 1 -- 172.21.15.144:0/2129296001 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1730041070 con 0x55ea44a384c0 2024-09-13T19:34:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f161a7fc640 1 -- 172.21.15.144:0/2129296001 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173002bdd0 con 0x55ea44a384c0 2024-09-13T19:34:31.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f161a7fc640 1 -- 172.21.15.144:0/2129296001 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1730028070 con 0x55ea44a384c0 2024-09-13T19:34:31.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- 172.21.15.144:0/2129296001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 msgr2=0x55ea44a388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 --2- 172.21.15.144:0/2129296001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a388a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f173004a130 tx=0x7f1730013dd0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- 172.21.15.144:0/2129296001 shutdown_connections 2024-09-13T19:34:31.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 --2- 172.21.15.144:0/2129296001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a388a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- 172.21.15.144:0/2129296001 >> 172.21.15.144:0/2129296001 conn(0x55ea44a348a0 msgr2=0x55ea44a329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- 172.21.15.144:0/2129296001 shutdown_connections 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- 172.21.15.144:0/2129296001 wait complete. 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 Processor -- start 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- start start 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a3f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea44a39430 con 0x55ea44a384c0 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1737457640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a3f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1737457640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a3f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34872/0 (socket says 172.21.15.144:34872) 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 learned_addr learned my addr 172.21.15.144:0/1325823824 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea44a3fd90 con 0x55ea44a384c0 2024-09-13T19:34:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1737457640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a3f850 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f173003f040 tx=0x7f173004a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1618ff9640 1 -- 172.21.15.144:0/1325823824 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1730041030 con 0x55ea44a384c0 2024-09-13T19:34:31.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea44a40020 con 0x55ea44a384c0 2024-09-13T19:34:31.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea44a42d00 con 0x55ea44a384c0 2024-09-13T19:34:31.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1618ff9640 1 -- 172.21.15.144:0/1325823824 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173002b350 con 0x55ea44a384c0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.314+0000 7f1618ff9640 1 -- 172.21.15.144:0/1325823824 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f173002b630 con 0x55ea44a384c0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1618ff9640 1 -- 172.21.15.144:0/1325823824 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f173002b7d0 con 0x55ea44a384c0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1618ff9640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16000346a0 0x7f1600036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1618ff9640 1 -- 172.21.15.144:0/1325823824 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1730042070 con 0x55ea44a384c0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1736c56640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16000346a0 0x7f1600036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44a4ae80 0x55ea44a4d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a4da90 con 0x55ea44a4ae80 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1736455640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44a4ae80 0x55ea44a4d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1736c56640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16000346a0 0x7f1600036b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f172800ffd0 tx=0x7f172803a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1736455640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44a4ae80 0x55ea44a4d340 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 realm 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a4dec0 con 0x55ea44a4ae80 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a4e790 con 0x55ea44a4ae80 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a4eb30 con 0x55ea44a4ae80 2024-09-13T19:34:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:31.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a4f890 0x55ea44a51c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a522d0 con 0x55ea44a4f890 2024-09-13T19:34:31.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1737457640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a4f890 0x55ea44a51c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.318+0000 7f1737457640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a4f890 0x55ea44a51c80 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1739146980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1739146980 20 searching for the correct realm 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ea44a54220 0x55ea44a56630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736c56640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ea44a54220 0x55ea44a56630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736c56640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ea44a54220 0x55ea44a56630 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736c56640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1728057040 0x7f1728027890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x7f1728057040 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1728057040 0x7f1728027890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1728057040 0x7f1728027890 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4f890 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4f890 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.322+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x7f1728057040 2024-09-13T19:34:31.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4f890 2024-09-13T19:34:31.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x7f1728057040 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4f890 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.326+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4f890 2024-09-13T19:34:31.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x7f1728057040 2024-09-13T19:34:31.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4f890 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4f890 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x7f1728057040 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.330+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a54220 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4f890 2024-09-13T19:34:31.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x55ea44a4ae80 2024-09-13T19:34:31.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a56d00 con 0x7f1728057040 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a52c90 con 0x55ea44a4ae80 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a528d0 con 0x55ea44a4ae80 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a535b0 con 0x55ea44a4ae80 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 zone default found 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 4 Realm: () 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 zonegroup default 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a57180 con 0x55ea44a4f890 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a58f60 con 0x55ea44a54220 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a593b0 con 0x55ea44a54220 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 started sync module instance, tier type = 2024-09-13T19:34:31.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:31.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.334+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a583a0 con 0x7f1728057040 2024-09-13T19:34:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.338+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.338+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94464662407328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a583a0 con 0x7f1728057040 2024-09-13T19:34:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.338+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a59f60 con 0x55ea44a4ae80 2024-09-13T19:34:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.338+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94464662407328] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.338+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.338+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94464662411824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a583a0 con 0x55ea44a4ae80 2024-09-13T19:34:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.338+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5a970 con 0x55ea44a54220 2024-09-13T19:34:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94464662411824] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94464662404848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a58310 con 0x55ea44a54220 2024-09-13T19:34:31.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5b6c0 con 0x7f1728057040 2024-09-13T19:34:31.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94464662418208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5bf60 con 0x7f1728057040 2024-09-13T19:34:31.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5c920 con 0x55ea44a4ae80 2024-09-13T19:34:31.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94464662404848] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.342+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94464662418208] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.346+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.346+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94464662422640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5c890 con 0x55ea44a4ae80 2024-09-13T19:34:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.346+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5beb0 con 0x55ea44a4f890 2024-09-13T19:34:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.346+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94464662422640] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.346+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.346+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94464662419968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5d1c0 con 0x55ea44a4f890 2024-09-13T19:34:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.346+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5da10 con 0x55ea44a4f890 2024-09-13T19:34:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94464662419968] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94464662425328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5d8a0 con 0x55ea44a4f890 2024-09-13T19:34:31.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5e3c0 con 0x55ea44a4f890 2024-09-13T19:34:31.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94464662429328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5e830 con 0x55ea44a4f890 2024-09-13T19:34:31.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 20 add_watcher() i=0 2024-09-13T19:34:31.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 20 add_watcher() i=1 2024-09-13T19:34:31.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 20 add_watcher() i=2 2024-09-13T19:34:31.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 20 add_watcher() i=3 2024-09-13T19:34:31.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 20 add_watcher() i=4 2024-09-13T19:34:31.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 20 add_watcher() i=5 2024-09-13T19:34:31.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94464662425328] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.350+0000 7f1739146980 20 add_watcher() i=6 2024-09-13T19:34:31.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94464662429328] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 20 add_watcher() i=7 2024-09-13T19:34:31.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:31.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5e830 con 0x55ea44a4ae80 2024-09-13T19:34:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94464662430592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5e7a0 con 0x55ea44a4ae80 2024-09-13T19:34:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94464662430592] v32'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f15ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 5 note: GC not initialized 2024-09-13T19:34:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1567fff640 20 reqs_thread_entry: start 2024-09-13T19:34:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 20 Filter name: none 2024-09-13T19:34:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1565ffb640 20 reqs_thread_entry: start 2024-09-13T19:34:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:34:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a84f50 con 0x55ea44a4f890 2024-09-13T19:34:31.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.354+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T19:34:31.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:34:31.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-13T19:34:31.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a836f0 con 0x55ea44a4ae80 2024-09-13T19:34:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-13T19:34:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:34:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T19:34:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T19:34:31.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a83fc0 con 0x55ea44a4f890 2024-09-13T19:34:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T19:34:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:34:31.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T19:34:31.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.358+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94464662584080 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a88540 con 0x55ea44a4f890 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== watch-notify(notify (1) cookie 94464662429328 notify 137438953488 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55ea44a849a0 con 0x55ea44a4f890 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f161a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94464662429328 notifier 4720 bl.length()=556 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f161a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f161a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f161a7fc640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f15fc003eb0 con 0x55ea44a4f890 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(65 notify.7 [notify cookie 94464662584080 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== watch-notify(notify_complete (2) cookie 94464662584080 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea44a40020 con 0x55ea44a4f890 2024-09-13T19:34:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a83fc0 con 0x55ea44a4ae80 2024-09-13T19:34:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1739146980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:34:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1739146980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:34:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1739146980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:34:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94464662584080 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a88620 con 0x55ea44a4f890 2024-09-13T19:34:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== watch-notify(notify (1) cookie 94464662419968 notify 137438953489 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55ea44a40020 con 0x55ea44a4f890 2024-09-13T19:34:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1619ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94464662419968 notifier 4720 bl.length()=177 2024-09-13T19:34:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1619ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:34:31.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1619ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:34:31.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1619ffb640 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f156c003410 con 0x55ea44a4f890 2024-09-13T19:34:31.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(68 notify.5 [notify cookie 94464662584080 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.362+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== watch-notify(notify_complete (2) cookie 94464662584080 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea44a3fd90 con 0x55ea44a4f890 2024-09-13T19:34:31.369 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T19:34:31.362221Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:34:31.362203Z","tags":[],"group_ids":[]} 2024-09-13T19:34:31.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.366+0000 7f15ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:31.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.366+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94464662430592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a82cf0 con 0x55ea44a4ae80 2024-09-13T19:34:31.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.366+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94464662430592] v32'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.366+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94464662407328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a82cf0 con 0x7f1728057040 2024-09-13T19:34:31.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.366+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94464662407328] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.366+0000 7f1739146980 20 remove_watcher() i=0 2024-09-13T19:34:31.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.366+0000 7f1739146980 2 removed watcher, disabling cache 2024-09-13T19:34:31.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.366+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94464662411824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a588a0 con 0x55ea44a4ae80 2024-09-13T19:34:31.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94464662411824] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1739146980 20 remove_watcher() i=1 2024-09-13T19:34:31.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94464662404848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a82cf0 con 0x55ea44a54220 2024-09-13T19:34:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1736c56640 1 -- 172.21.15.144:0/1325823824 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94464662404848] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172802e070 con 0x55ea44a54220 2024-09-13T19:34:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1739146980 20 remove_watcher() i=2 2024-09-13T19:34:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94464662418208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a588a0 con 0x7f1728057040 2024-09-13T19:34:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94464662418208] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x7f1728057040 2024-09-13T19:34:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1739146980 20 remove_watcher() i=3 2024-09-13T19:34:31.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.370+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94464662422640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a57ef0 con 0x55ea44a4ae80 2024-09-13T19:34:31.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.374+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94464662422640] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f172c0aaa40 con 0x55ea44a4ae80 2024-09-13T19:34:31.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.374+0000 7f1739146980 20 remove_watcher() i=4 2024-09-13T19:34:31.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.374+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94464662419968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a82cf0 con 0x55ea44a4f890 2024-09-13T19:34:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.374+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94464662419968] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.374+0000 7f1739146980 20 remove_watcher() i=5 2024-09-13T19:34:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.374+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94464662425328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a5b320 con 0x55ea44a4f890 2024-09-13T19:34:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94464662425328] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 20 remove_watcher() i=6 2024-09-13T19:34:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94464662429328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea44a588a0 con 0x55ea44a4f890 2024-09-13T19:34:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1737457640 1 -- 172.21.15.144:0/1325823824 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94464662429328] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173002a070 con 0x55ea44a4f890 2024-09-13T19:34:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 20 remove_watcher() i=7 2024-09-13T19:34:31.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a4f890 msgr2=0x55ea44a51c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a4f890 0x55ea44a51c80 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44a4ae80 msgr2=0x55ea44a4d340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44a4ae80 0x55ea44a4d340 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1728057040 msgr2=0x7f1728027890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f1728057040 0x7f1728027890 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ea44a54220 msgr2=0x55ea44a56630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ea44a54220 0x55ea44a56630 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16000346a0 msgr2=0x7f1600036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16000346a0 0x7f1600036b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f172800ffd0 tx=0x7f172803a000 comp rx=0 tx=0).stop 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1736455640 1 -- 172.21.15.144:0/1325823824 reap_dead start 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 msgr2=0x55ea44a3f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a3f850 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f173003f040 tx=0x7f173004a090 comp rx=0 tx=0).stop 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 shutdown_connections 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 --2- 172.21.15.144:0/1325823824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a384c0 0x55ea44a3f850 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 >> 172.21.15.144:0/1325823824 conn(0x55ea44a348a0 msgr2=0x55ea44a39b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 shutdown_connections 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.378+0000 7f1739146980 1 -- 172.21.15.144:0/1325823824 wait complete. 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3892806846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16100346a0 msgr2=0x7f1610036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3892806846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16100346a0 0x7f1610036b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55ea44a189d0 tx=0x7f1728001400 comp rx=0 tx=0).stop 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3892806846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a2ba20 msgr2=0x55ea44a2be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3892806846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a2ba20 0x55ea44a2be40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55ea44a18930 tx=0x7f1730018830 comp rx=0 tx=0).stop 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3892806846 shutdown_connections 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3892806846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16100346a0 0x7f1610036b60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3892806846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44a2ba20 0x55ea44a2be40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3892806846 >> 172.21.15.144:0/3892806846 conn(0x55ea44a20b70 msgr2=0x55ea44a235f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3892806846 shutdown_connections 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3892806846 wait complete. 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a1a880 msgr2=0x55ea44a1cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a1a880 0x55ea44a1cc70 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44922ad0 msgr2=0x55ea44a17ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44922ad0 0x55ea44a17ee0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f161c034650 msgr2=0x7f161c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f161c034650 0x7f161c036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f172c0ae000 tx=0x7f172c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 msgr2=0x55ea44a10ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a10ef0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x55ea44a0ad40 tx=0x7f1728000bd0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 shutdown_connections 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ea44922ad0 0x55ea44a17ee0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ea44a1a880 0x55ea44a1cc70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f161c034650 0x7f161c036b10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 --2- 172.21.15.144:0/3989827846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea44892b00 0x55ea44a10ef0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 >> 172.21.15.144:0/3989827846 conn(0x55ea449190a0 msgr2=0x55ea44a04310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 shutdown_connections 2024-09-13T19:34:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.382+0000 7f1739146980 1 -- 172.21.15.144:0/3989827846 wait complete. 2024-09-13T19:34:31.395 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T19:34:31.362221Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:34:31.362203Z', 'tags': [], 'group_ids': []} 2024-09-13T19:34:31.422 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:34:31.427 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-13T19:34:31.427 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T19:34:31.427 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T19:34:31.427 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-13T19:34:31.469 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:31.469 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:31.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a9db4980 1 Processor -- start 2024-09-13T19:34:31.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a9db4980 1 -- start start 2024-09-13T19:34:31.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a9db4980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5626889eb2a0 0x562688a7b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a9db4980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626888feae0 con 0x562688a7bcf0 2024-09-13T19:34:31.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a9db4980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x562688922e30 con 0x5626889eb2a0 2024-09-13T19:34:31.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a78c4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5626889eb2a0 0x562688a7b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a78c4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5626889eb2a0 0x562688a7b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34878/0 (socket says 172.21.15.144:34878) 2024-09-13T19:34:31.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a70c3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x562688a7bcf0 0x562688a7e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37844/0 (socket says 172.21.15.144:37844) 2024-09-13T19:34:31.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a78c4640 1 -- 172.21.15.144:0/138138415 learned_addr learned my addr 172.21.15.144:0/138138415 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a78c4640 1 -- 172.21.15.144:0/138138415 >> v1:172.21.15.18:6789/0 conn(0x562688a7bcf0 legacy=0x562688a7e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.466+0000 7f52a78c4640 1 -- 172.21.15.144:0/138138415 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626889eb680 con 0x5626889eb2a0 2024-09-13T19:34:31.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a78c4640 1 --2- 172.21.15.144:0/138138415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626889eb2a0 0x562688a7b7b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f529800a5c0 tx=0x7f529801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d424e6a234bec6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a68c2640 1 -- 172.21.15.144:0/138138415 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52980a6070 con 0x5626889eb2a0 2024-09-13T19:34:31.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a68c2640 1 -- 172.21.15.144:0/138138415 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52980af070 con 0x5626889eb2a0 2024-09-13T19:34:31.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a68c2640 1 -- 172.21.15.144:0/138138415 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52980aa5c0 con 0x5626889eb2a0 2024-09-13T19:34:31.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a9db4980 1 -- 172.21.15.144:0/138138415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626889eb2a0 msgr2=0x562688a7b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a9db4980 1 --2- 172.21.15.144:0/138138415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626889eb2a0 0x562688a7b7b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f529800a5c0 tx=0x7f529801b340 comp rx=0 tx=0).stop 2024-09-13T19:34:31.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a9db4980 1 -- 172.21.15.144:0/138138415 shutdown_connections 2024-09-13T19:34:31.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a9db4980 1 --2- 172.21.15.144:0/138138415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626889eb2a0 0x562688a7b7b0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a9db4980 1 -- 172.21.15.144:0/138138415 >> 172.21.15.144:0/138138415 conn(0x562688a710a0 msgr2=0x562688a734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a9db4980 1 -- 172.21.15.144:0/138138415 shutdown_connections 2024-09-13T19:34:31.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.470+0000 7f52a9db4980 1 -- 172.21.15.144:0/138138415 wait complete. 2024-09-13T19:34:31.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a9db4980 1 Processor -- start 2024-09-13T19:34:31.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a9db4980 1 -- start start 2024-09-13T19:34:31.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a9db4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b63de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a9db4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562688924200 con 0x562688a7bcf0 2024-09-13T19:34:31.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a78c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b63de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a78c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b63de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34890/0 (socket says 172.21.15.144:34890) 2024-09-13T19:34:31.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a78c4640 1 -- 172.21.15.144:0/3904084245 learned_addr learned my addr 172.21.15.144:0/3904084245 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a78c4640 1 -- 172.21.15.144:0/3904084245 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562688b643b0 con 0x562688a7bcf0 2024-09-13T19:34:31.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f52a78c4640 1 --2- 172.21.15.144:0/3904084245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b63de0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f52980199f0 tx=0x7f5298003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b4041b1a2629e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f5195e0b640 1 -- 172.21.15.144:0/3904084245 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52980aa840 con 0x562688a7bcf0 2024-09-13T19:34:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f5195e0b640 1 -- 172.21.15.144:0/3904084245 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52980aa9e0 con 0x562688a7bcf0 2024-09-13T19:34:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.482+0000 7f5195e0b640 1 -- 172.21.15.144:0/3904084245 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52980aacc0 con 0x562688a7bcf0 2024-09-13T19:34:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- 172.21.15.144:0/3904084245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 msgr2=0x562688b63de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 --2- 172.21.15.144:0/3904084245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b63de0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f52980199f0 tx=0x7f5298003030 comp rx=0 tx=0).stop 2024-09-13T19:34:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- 172.21.15.144:0/3904084245 shutdown_connections 2024-09-13T19:34:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 --2- 172.21.15.144:0/3904084245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b63de0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- 172.21.15.144:0/3904084245 >> 172.21.15.144:0/3904084245 conn(0x562688a710a0 msgr2=0x562688b5f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- 172.21.15.144:0/3904084245 shutdown_connections 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- 172.21.15.144:0/3904084245 wait complete. 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 Processor -- start 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- start start 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b6afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562688a82230 con 0x562688a7bcf0 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a78c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b6afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a78c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b6afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34904/0 (socket says 172.21.15.144:34904) 2024-09-13T19:34:31.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a78c4640 1 -- 172.21.15.144:0/1567862544 learned_addr learned my addr 172.21.15.144:0/1567862544 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a78c4640 1 -- 172.21.15.144:0/1567862544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562688b6b4e0 con 0x562688a7bcf0 2024-09-13T19:34:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a78c4640 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b6afa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5298003070 tx=0x7f52980180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f518ffff640 1 -- 172.21.15.144:0/1567862544 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52980cb030 con 0x562688a7bcf0 2024-09-13T19:34:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562688b6b770 con 0x562688a7bcf0 2024-09-13T19:34:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562688b6e450 con 0x562688a7bcf0 2024-09-13T19:34:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f518ffff640 1 -- 172.21.15.144:0/1567862544 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5298000e50 con 0x562688a7bcf0 2024-09-13T19:34:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f518ffff640 1 -- 172.21.15.144:0/1567862544 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52980bd950 con 0x562688a7bcf0 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f518ffff640 1 -- 172.21.15.144:0/1567862544 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f52980ce070 con 0x562688a7bcf0 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f518ffff640 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f51900346a0 0x7f5190036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f518ffff640 1 -- 172.21.15.144:0/1567862544 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f52980cc070 con 0x562688a7bcf0 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a70c3640 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f51900346a0 0x7f5190036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688b6ff20 0x562688b72370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.486+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688b729e0 con 0x562688b6ff20 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a80c5640 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688b6ff20 0x562688b72370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a70c3640 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f51900346a0 0x7f5190036b60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f529c000f70 tx=0x7f529c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a80c5640 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688b6ff20 0x562688b72370 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a80c5640 1 -- 172.21.15.144:0/1567862544 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52a000a4d0 con 0x562688b6ff20 2024-09-13T19:34:31.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688b6f650 con 0x562688b6ff20 2024-09-13T19:34:31.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a80c5640 1 -- 172.21.15.144:0/1567862544 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52a000a4d0 con 0x562688b6ff20 2024-09-13T19:34:31.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688b74d10 0x562688b77100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688b777d0 con 0x562688b74d10 2024-09-13T19:34:31.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a78c4640 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688b74d10 0x562688b77100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a78c4640 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688b74d10 0x562688b77100 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a78c4640 1 -- 172.21.15.144:0/1567862544 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f52980c6960 con 0x562688b74d10 2024-09-13T19:34:31.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688b73bb0 con 0x562688b6ff20 2024-09-13T19:34:31.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a80c5640 1 -- 172.21.15.144:0/1567862544 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52a000a4d0 con 0x562688b6ff20 2024-09-13T19:34:31.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688b74090 con 0x562688b6ff20 2024-09-13T19:34:31.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.490+0000 7f52a80c5640 1 -- 172.21.15.144:0/1567862544 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f52a000a4d0 con 0x562688b6ff20 2024-09-13T19:34:31.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a9db4980 1 Processor -- start 2024-09-13T19:34:31.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a9db4980 1 -- start start 2024-09-13T19:34:31.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a9db4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b85eb0 0x562688b862d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a9db4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56268897d800 con 0x562688b85eb0 2024-09-13T19:34:31.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a80c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b85eb0 0x562688b862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a80c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b85eb0 0x562688b862d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34908/0 (socket says 172.21.15.144:34908) 2024-09-13T19:34:31.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a80c5640 1 -- 172.21.15.144:0/296717720 learned_addr learned my addr 172.21.15.144:0/296717720 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a80c5640 1 -- 172.21.15.144:0/296717720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562688b86810 con 0x562688b85eb0 2024-09-13T19:34:31.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a80c5640 1 --2- 172.21.15.144:0/296717720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b85eb0 0x562688b862d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x562688b72de0 tx=0x7f52a0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f518d7fa640 1 -- 172.21.15.144:0/296717720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a0014450 con 0x562688b85eb0 2024-09-13T19:34:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a9db4980 1 -- 172.21.15.144:0/296717720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562688b86aa0 con 0x562688b85eb0 2024-09-13T19:34:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f518d7fa640 1 -- 172.21.15.144:0/296717720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a00145f0 con 0x562688b85eb0 2024-09-13T19:34:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f518d7fa640 1 -- 172.21.15.144:0/296717720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a0014910 con 0x562688b85eb0 2024-09-13T19:34:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a9db4980 1 -- 172.21.15.144:0/296717720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562688b89720 con 0x562688b85eb0 2024-09-13T19:34:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f518d7fa640 1 -- 172.21.15.144:0/296717720 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f52a0011040 con 0x562688b85eb0 2024-09-13T19:34:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f518d7fa640 1 --2- 172.21.15.144:0/296717720 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5180034650 0x7f5180036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f518d7fa640 1 -- 172.21.15.144:0/296717720 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f52a001e070 con 0x562688b85eb0 2024-09-13T19:34:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.494+0000 7f52a78c4640 1 --2- 172.21.15.144:0/296717720 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5180034650 0x7f5180036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 Processor -- start 2024-09-13T19:34:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- start start 2024-09-13T19:34:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a78c4640 1 --2- 172.21.15.144:0/296717720 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5180034650 0x7f5180036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x562688b72e80 tx=0x7f52980e3980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b92e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562688b64670 con 0x562688b92a30 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b92e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b92e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34918/0 (socket says 172.21.15.144:34918) 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 -- 172.21.15.144:0/3958029570 learned_addr learned my addr 172.21.15.144:0/3958029570 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 -- 172.21.15.144:0/3958029570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562688b93400 con 0x562688b92a30 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 --2- 172.21.15.144:0/3958029570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b92e30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f52a00165b0 tx=0x7f52a0011500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b774cd5bcce7828 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f5186ffd640 1 -- 172.21.15.144:0/3958029570 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a0028070 con 0x562688b92a30 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f5186ffd640 1 -- 172.21.15.144:0/3958029570 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a003aa70 con 0x562688b92a30 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f5186ffd640 1 -- 172.21.15.144:0/3958029570 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a003ad50 con 0x562688b92a30 2024-09-13T19:34:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- 172.21.15.144:0/3958029570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 msgr2=0x562688b92e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 --2- 172.21.15.144:0/3958029570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b92e30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f52a00165b0 tx=0x7f52a0011500 comp rx=0 tx=0).stop 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- 172.21.15.144:0/3958029570 shutdown_connections 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 --2- 172.21.15.144:0/3958029570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b92e30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- 172.21.15.144:0/3958029570 >> 172.21.15.144:0/3958029570 conn(0x562688b8edb0 msgr2=0x562688b8ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- 172.21.15.144:0/3958029570 shutdown_connections 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- 172.21.15.144:0/3958029570 wait complete. 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 Processor -- start 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- start start 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b99cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a9db4980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562688b93940 con 0x562688b92a30 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b99cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b99cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34932/0 (socket says 172.21.15.144:34932) 2024-09-13T19:34:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 learned_addr learned my addr 172.21.15.144:0/1019834698 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562688b9a230 con 0x562688b92a30 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.498+0000 7f52a80c5640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b99cf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x562688b8da90 tx=0x7f52a004a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f51857fa640 1 -- 172.21.15.144:0/1019834698 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a00135c0 con 0x562688b92a30 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562688b9a4c0 con 0x562688b92a30 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562688b9d1a0 con 0x562688b92a30 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f51857fa640 1 -- 172.21.15.144:0/1019834698 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a0013760 con 0x562688b92a30 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f51857fa640 1 -- 172.21.15.144:0/1019834698 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a0013a40 con 0x562688b92a30 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f51857fa640 1 -- 172.21.15.144:0/1019834698 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f52a004b2d0 con 0x562688b92a30 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f51857fa640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5170034600 0x7f5170036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f51857fa640 1 -- 172.21.15.144:0/1019834698 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f52a0033030 con 0x562688b92a30 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a78c4640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5170034600 0x7f5170036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688ba53d0 0x562688ba7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688ba7fe0 con 0x562688ba53d0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a70c3640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688ba53d0 0x562688ba7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a78c4640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5170034600 0x7f5170036ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f52980bc540 tx=0x7f52980db000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a70c3640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688ba53d0 0x562688ba7890 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f529c00f620 con 0x562688ba53d0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 realm 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688ba4820 con 0x562688ba53d0 2024-09-13T19:34:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f529c00f620 con 0x562688ba53d0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688ba8ae0 con 0x562688ba53d0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f529c00f620 con 0x562688ba53d0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688ba93b0 con 0x562688ba53d0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f529c00f620 con 0x562688ba53d0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688ba9cf0 0x562688bac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bac890 con 0x562688ba9cf0 2024-09-13T19:34:31.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.502+0000 7f52a80c5640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688ba9cf0 0x562688bac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a80c5640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688ba9cf0 0x562688bac100 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a9db4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a9db4980 20 searching for the correct realm 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562688bae7e0 0x562688bb0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688bae7e0 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a78c4640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562688bae7e0 0x562688bb0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a78c4640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562688bae7e0 0x562688bb0c10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a78c4640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f52980d0030 0x7f52980e3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:31.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x7f52980d0030 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f52980d0030 0x7f52980e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f52980d0030 0x7f52980e3260 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c00f620 con 0x7f52980d0030 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688ba9cf0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688ba53d0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f529c00f620 con 0x562688ba53d0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688ba53d0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688ba53d0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.506+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688ba9cf0 2024-09-13T19:34:31.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x7f52980d0030 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688bae7e0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688ba53d0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688ba9cf0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688ba53d0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x7f52980d0030 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562688bb12e0 con 0x562688bae7e0 2024-09-13T19:34:31.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688bae7e0 2024-09-13T19:34:31.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba9cf0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688bae7e0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688bae7e0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.510+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba53d0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba53d0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba9cf0 2024-09-13T19:34:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688bae7e0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x7f52980d0030 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba53d0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba9cf0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688bae7e0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba9cf0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x7f52980d0030 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688bae7e0 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.514+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba9cf0 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x562688ba53d0 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f52980ff040 con 0x7f52980d0030 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:31.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bad250 con 0x562688ba53d0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688badaf0 con 0x562688ba53d0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bace90 con 0x562688ba53d0 2024-09-13T19:34:31.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 zone default found 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 4 Realm: () 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 zonegroup default 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bb1760 con 0x562688ba9cf0 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bb3a10 con 0x562688bae7e0 2024-09-13T19:34:31.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bb3db0 con 0x562688bae7e0 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 started sync module instance, tier type = 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb2ea0 con 0x7f52980d0030 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94723502715888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb2ea0 con 0x7f52980d0030 2024-09-13T19:34:31.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.518+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb47e0 con 0x562688ba53d0 2024-09-13T19:34:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.522+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94723502715888] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.522+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.522+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94723502720064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb2ea0 con 0x562688ba53d0 2024-09-13T19:34:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.522+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb51f0 con 0x562688bae7e0 2024-09-13T19:34:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.522+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94723502720064] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94723502713328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb2e10 con 0x562688bae7e0 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb5ef0 con 0x7f52980d0030 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94723502726000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb6790 con 0x7f52980d0030 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb7190 con 0x562688ba53d0 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94723502713328] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94723502726000] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94723502724496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb6270 con 0x562688ba53d0 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.526+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb7a30 con 0x562688ba9cf0 2024-09-13T19:34:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.530+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94723502724496] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.530+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.530+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94723502732672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb6270 con 0x562688ba9cf0 2024-09-13T19:34:31.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.530+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb8280 con 0x562688ba9cf0 2024-09-13T19:34:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.530+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.530+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94723502734800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb86a0 con 0x562688ba9cf0 2024-09-13T19:34:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.530+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb9180 con 0x562688ba9cf0 2024-09-13T19:34:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94723502732672] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94723502734800] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94723502730400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb86a0 con 0x562688ba9cf0 2024-09-13T19:34:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a9db4980 20 add_watcher() i=0 2024-09-13T19:34:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a9db4980 20 add_watcher() i=1 2024-09-13T19:34:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a9db4980 20 add_watcher() i=2 2024-09-13T19:34:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a9db4980 20 add_watcher() i=3 2024-09-13T19:34:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a9db4980 20 add_watcher() i=4 2024-09-13T19:34:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a9db4980 20 add_watcher() i=5 2024-09-13T19:34:31.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.534+0000 7f52a9db4980 20 add_watcher() i=6 2024-09-13T19:34:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94723502730400] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 20 add_watcher() i=7 2024-09-13T19:34:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bbc1b0 con 0x562688ba53d0 2024-09-13T19:34:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94723502736320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bb9630 con 0x562688ba53d0 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94723502736320] v32'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f515dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 5 note: GC not initialized 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f515cfe1640 20 reqs_thread_entry: start 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 20 Filter name: none 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f50d67fc640 20 reqs_thread_entry: start 2024-09-13T19:34:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:34:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.538+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bdf6f0 con 0x562688ba9cf0 2024-09-13T19:34:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:34:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-13T19:34:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:34:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:34:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be3850 con 0x7f52980d0030 2024-09-13T19:34:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v32'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:34:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:34:31.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:34:31.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94723502912016 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be44c0 con 0x562688ba9cf0 2024-09-13T19:34:31.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== watch-notify(notify (1) cookie 94723502732672 notify 137438953490 ret 0) ==== 424+0+0 (crc 0 0 0) 0x562688b9d1a0 con 0x562688ba9cf0 2024-09-13T19:34:31.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f5186ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94723502732672 notifier 4727 bl.length()=382 2024-09-13T19:34:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f5186ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:34:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f5186ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:34:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f5186ffd640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f516c003eb0 con 0x562688ba9cf0 2024-09-13T19:34:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(64 notify.5 [notify cookie 94723502912016 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== watch-notify(notify_complete (2) cookie 94723502912016 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562688b9a4c0 con 0x562688ba9cf0 2024-09-13T19:34:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be3210 con 0x562688ba53d0 2024-09-13T19:34:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 : miss 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 20 rados->read ofs=0 len=0 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 8.d 8:b65bc6ed:root::.bucket.meta.myfoo6%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be16b0 con 0x7f52980d0030 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 .bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 info.flags=0x17 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 to cache LRU end 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.542+0000 7f52a9db4980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 2024-09-13T19:34:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 8.d 8:b65bc6ed:root::.bucket.meta.myfoo6%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688beb5a0 con 0x7f52980d0030 2024-09-13T19:34:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(68 .bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 info.flags=0x17 2024-09-13T19:34:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 to cache LRU end 2024-09-13T19:34:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:34:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9, ofs0, ns] 2024-09-13T19:34:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94723502915312 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688bea270 con 0x7f52980d0030 2024-09-13T19:34:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== watch-notify(notify (1) cookie 94723502726000 notify 137438953509 ret 0) ==== 790+0+0 (crc 0 0 0) 0x562688be1aa0 con 0x7f52980d0030 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f51867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94723502726000 notifier 4727 bl.length()=748 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f51867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 info.flags=0x17 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f51867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 to cache LRU end 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f51867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(69 notify.3 [notify cookie 94723502915312 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f51867fc640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50dc003540 con 0x7f52980d0030 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== watch-notify(notify_complete (2) cookie 94723502915312 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562688be3330 con 0x7f52980d0030 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 20 handle_bi_update(): bucket=:myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]): orig_sources= new_sources= 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 20 handle_bi_update(): bucket=:myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]): potential sources added=[] removed=[] 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 20 handle_bi_update(): bucket=:myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]): orig_dests= new_dests= 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 20 handle_bi_update(): bucket=:myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]): potential dests added=[] removed=[] 2024-09-13T19:34:31.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be3ef0 con 0x562688ba53d0 2024-09-13T19:34:31.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.546+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(71 bud.buckets [call] v32'5 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be9dc0 con 0x562688ba53d0 2024-09-13T19:34:31.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(72 bud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688beadd0 con 0x562688ba53d0 2024-09-13T19:34:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v32'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T19:34:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:34:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T19:34:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94723502915312 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be48f0 con 0x7f52980d0030 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== watch-notify(notify (1) cookie 94723502726000 notify 137438953510 ret 0) ==== 358+0+0 (crc 0 0 0) 0x562688be8930 con 0x7f52980d0030 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f51867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94723502726000 notifier 4727 bl.length()=316 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f51867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f51867fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f51867fc640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50dc0035a0 con 0x7f52980d0030 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(74 notify.3 [notify cookie 94723502915312 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== watch-notify(notify_complete (2) cookie 94723502915312 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562688be3330 con 0x7f52980d0030 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 : hit (requested=0x17, cached=0x17) 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 2024-09-13T19:34:31.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.550+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:76 8.d 8:b65bc6ed:root::.bucket.meta.myfoo6%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x7f52980d0030 2024-09-13T19:34:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(76 .bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 info.flags=0x17 2024-09-13T19:34:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 to cache LRU end 2024-09-13T19:34:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:34:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9, ofs0, ns] 2024-09-13T19:34:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94723502915312 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x7f52980d0030 2024-09-13T19:34:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== watch-notify(notify (1) cookie 94723502726000 notify 137438953511 ret 0) ==== 790+0+0 (crc 0 0 0) 0x562688be3330 con 0x7f52980d0030 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f5186ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94723502726000 notifier 4727 bl.length()=748 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f5186ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 info.flags=0x17 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f5186ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 to cache LRU end 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f5186ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(77 notify.3 [notify cookie 94723502915312 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f5186ffd640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f516c003eb0 con 0x7f52980d0030 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== watch-notify(notify_complete (2) cookie 94723502915312 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f529c018040 con 0x7f52980d0030 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 20 handle_bi_update(): bucket=:myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]): orig_sources= new_sources= 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 20 handle_bi_update(): bucket=:myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]): potential sources added=[] removed=[] 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 20 handle_bi_update(): bucket=:myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]): orig_dests= new_dests= 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 20 handle_bi_update(): bucket=:myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]): potential dests added=[] removed=[] 2024-09-13T19:34:31.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:79 4.11 4:8ab76a2e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x562688ba9cf0 2024-09-13T19:34:31.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(79 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:80 4.18 4:1b22e554:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x7f52980d0030 2024-09-13T19:34:31.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== osd_op_reply(80 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 4.12 4:4996c341:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x562688ba53d0 2024-09-13T19:34:31.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(81 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.554+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:82 4.3e 4:7ca2fcd7:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x7f52980d0030 2024-09-13T19:34:31.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(82 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:83 4.26 4:6704a741:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x562688ba9cf0 2024-09-13T19:34:31.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(83 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:84 4.21 4:865a7eae:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x562688ba9cf0 2024-09-13T19:34:31.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(84 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 4.19 4:9b96777a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be7fc0 con 0x562688bae7e0 2024-09-13T19:34:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(85 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:86 4.2d 4:b49abd4e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be06a0 con 0x562688ba9cf0 2024-09-13T19:34:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(86 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.558+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:87 4.39 4:9c7ec48a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be06a0 con 0x562688ba9cf0 2024-09-13T19:34:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(87 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:88 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be06a0 con 0x7f52980d0030 2024-09-13T19:34:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== osd_op_reply(88 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [call out=378b] v0'0 uv3 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 10 cls_bucket_list_unordered: got thirteen 2024-09-13T19:34:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:89 4.35 4:ae52eb76:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be06a0 con 0x562688ba53d0 2024-09-13T19:34:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(89 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 get_obj_state: octx=0x7f529c00f5a0 obj=myfoo6:thirteen state=0x562688be1f18 s->prefetch_data=0 2024-09-13T19:34:31.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:90 3.1b 3:db2a3de6:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be06a0 con 0x562688bae7e0 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(90 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 10 manifest: total_size = 8 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 get_obj_state: setting s->obj_tag to c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.17232248948091281435 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 Read xattr rgw_rados: user.rgw.acl 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 Read xattr rgw_rados: user.rgw.etag 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 get_obj_state: octx=0x7f529c00f5a0 obj=myfoo6:thirteen state=0x562688be1f18 s->prefetch_data=0 2024-09-13T19:34:31.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 : hit (requested=0x17, cached=0x17) 2024-09-13T19:34:31.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 2024-09-13T19:34:31.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 2024-09-13T19:34:31.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:91 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688beee10 con 0x7f52980d0030 2024-09-13T19:34:31.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.562+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== osd_op_reply(91 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:92 3.1b 3:db2a3de6:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688beccf0 con 0x562688bae7e0 2024-09-13T19:34:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(92 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688beccf0 con 0x7f52980d0030 2024-09-13T19:34:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:1 objects processed in :myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9]). Next marker thirteen 2024-09-13T19:34:31.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688beccf0 con 0x7f52980d0030 2024-09-13T19:34:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v32'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a9db4980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:34:31.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a9db4980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:34:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a9db4980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:34:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94723502902128 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688beccf0 con 0x562688ba9cf0 2024-09-13T19:34:31.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(93 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f51867fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T19:34:31.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== watch-notify(notify (1) cookie 94723502732672 notify 137438953491 ret 0) ==== 598+0+0 (crc 0 0 0) 0x562688b9a4c0 con 0x562688ba9cf0 2024-09-13T19:34:31.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f5186ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94723502732672 notifier 4727 bl.length()=556 2024-09-13T19:34:31.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f5186ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:34:31.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f5186ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:34:31.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f5186ffd640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f516c003eb0 con 0x562688ba9cf0 2024-09-13T19:34:31.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(95 notify.5 [notify cookie 94723502902128 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.566+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== watch-notify(notify_complete (2) cookie 94723502902128 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562688b9a230 con 0x562688ba9cf0 2024-09-13T19:34:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be0040 con 0x562688ba53d0 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a9db4980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a9db4980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a9db4980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94723502902128 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688beccf0 con 0x562688ba9cf0 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== watch-notify(notify (1) cookie 94723502732672 notify 137438953492 ret 0) ==== 219+0+0 (crc 0 0 0) 0x562688b9a230 con 0x562688ba9cf0 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f51867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94723502732672 notifier 4727 bl.length()=177 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f51867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f51867fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f51867fc640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50dc0035a0 con 0x562688ba9cf0 2024-09-13T19:34:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(98 notify.5 [notify cookie 94723502902128 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== watch-notify(notify_complete (2) cookie 94723502902128 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562688b93400 con 0x562688ba9cf0 2024-09-13T19:34:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a9db4980 10 removing user index: bar 2024-09-13T19:34:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.570+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be0040 con 0x562688ba9cf0 2024-09-13T19:34:31.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(100 bar [delete] v32'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a9db4980 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-13T19:34:31.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a9db4980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T19:34:31.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94723502902128 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562688be1d30 con 0x562688ba9cf0 2024-09-13T19:34:31.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== watch-notify(notify (1) cookie 94723502730400 notify 137438953493 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562688b93400 con 0x562688ba9cf0 2024-09-13T19:34:31.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f5186ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94723502730400 notifier 4727 bl.length()=152 2024-09-13T19:34:31.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f5186ffd640 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f516c003eb0 con 0x562688ba9cf0 2024-09-13T19:34:31.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(101 notify.7 [notify cookie 94723502902128 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== watch-notify(notify_complete (2) cookie 94723502902128 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562688b89720 con 0x562688ba9cf0 2024-09-13T19:34:31.579 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T19:34:31.362221Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:34:31.362203Z","tags":[],"group_ids":[]} 2024-09-13T19:34:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f515dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.574+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94723502736320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bd0210 con 0x562688ba53d0 2024-09-13T19:34:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94723502736320] v32'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94723502715888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688bd0210 con 0x7f52980d0030 2024-09-13T19:34:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94723502715888] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a9db4980 20 remove_watcher() i=0 2024-09-13T19:34:31.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a9db4980 2 removed watcher, disabling cache 2024-09-13T19:34:31.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94723502720064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be2a60 con 0x562688ba53d0 2024-09-13T19:34:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94723502720064] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a9db4980 20 remove_watcher() i=1 2024-09-13T19:34:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.578+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94723502713328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be2a60 con 0x562688bae7e0 2024-09-13T19:34:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.582+0000 7f52a78c4640 1 -- 172.21.15.144:0/1019834698 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94723502713328] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52980c6960 con 0x562688bae7e0 2024-09-13T19:34:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.582+0000 7f52a9db4980 20 remove_watcher() i=2 2024-09-13T19:34:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.582+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94723502726000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be2a60 con 0x7f52980d0030 2024-09-13T19:34:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.582+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.2 v2:172.21.15.144:6816/2341760841 34 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94723502726000] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x7f52980d0030 2024-09-13T19:34:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.582+0000 7f52a9db4980 20 remove_watcher() i=3 2024-09-13T19:34:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.582+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94723502724496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be2a60 con 0x562688ba53d0 2024-09-13T19:34:31.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.586+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94723502724496] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f529c02b040 con 0x562688ba53d0 2024-09-13T19:34:31.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.586+0000 7f52a9db4980 20 remove_watcher() i=4 2024-09-13T19:34:31.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.586+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94723502732672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be2a60 con 0x562688ba9cf0 2024-09-13T19:34:31.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.586+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94723502732672] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.586+0000 7f52a9db4980 20 remove_watcher() i=5 2024-09-13T19:34:31.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.586+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94723502734800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be2a60 con 0x562688ba9cf0 2024-09-13T19:34:31.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 41 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94723502734800] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 20 remove_watcher() i=6 2024-09-13T19:34:31.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94723502730400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562688be2a60 con 0x562688ba9cf0 2024-09-13T19:34:31.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a80c5640 1 -- 172.21.15.144:0/1019834698 <== osd.0 v2:172.21.15.18:6800/2700511246 42 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94723502730400] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a004b040 con 0x562688ba9cf0 2024-09-13T19:34:31.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 20 remove_watcher() i=7 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688ba9cf0 msgr2=0x562688bac100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688ba9cf0 0x562688bac100 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688ba53d0 msgr2=0x562688ba7890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688ba53d0 0x562688ba7890 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f52980d0030 msgr2=0x7f52980e3260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f52980d0030 0x7f52980e3260 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562688bae7e0 msgr2=0x562688bb0c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.590+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x562688bae7e0 0x562688bb0c10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5170034600 msgr2=0x7f5170036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5170034600 0x7f5170036ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f52980bc540 tx=0x7f52980db000 comp rx=0 tx=0).stop 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 msgr2=0x562688b99cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1019834698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b92a30 0x562688b99cf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x562688b8da90 tx=0x7f52a004a0b0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 reap_dead start 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a70c3640 1 -- 172.21.15.144:0/1019834698 reap_dead start 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 shutdown_connections 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 >> 172.21.15.144:0/1019834698 conn(0x562688b8edb0 msgr2=0x562688b8ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 shutdown_connections 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1019834698 wait complete. 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/296717720 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5180034650 msgr2=0x7f5180036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/296717720 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5180034650 0x7f5180036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x562688b72e80 tx=0x7f52980e3980 comp rx=0 tx=0).stop 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/296717720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b85eb0 msgr2=0x562688b862d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/296717720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b85eb0 0x562688b862d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x562688b72de0 tx=0x7f52a0018830 comp rx=0 tx=0).stop 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/296717720 shutdown_connections 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/296717720 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5180034650 0x7f5180036b10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/296717720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688b85eb0 0x562688b862d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/296717720 >> 172.21.15.144:0/296717720 conn(0x562688b7b000 msgr2=0x562688b7da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/296717720 shutdown_connections 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/296717720 wait complete. 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688b74d10 msgr2=0x562688b77100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688b74d10 0x562688b77100 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688b6ff20 msgr2=0x562688b72370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688b6ff20 0x562688b72370 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f51900346a0 msgr2=0x7f5190036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f51900346a0 0x7f5190036b60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f529c000f70 tx=0x7f529c001380 comp rx=0 tx=0).stop 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 msgr2=0x562688b6afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b6afa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5298003070 tx=0x7f52980180e0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 shutdown_connections 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x562688b6ff20 0x562688b72370 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x562688b74d10 0x562688b77100 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f51900346a0 0x7f5190036b60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 --2- 172.21.15.144:0/1567862544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562688a7bcf0 0x562688b6afa0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 >> 172.21.15.144:0/1567862544 conn(0x562688a710a0 msgr2=0x562688b5e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 shutdown_connections 2024-09-13T19:34:31.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:31.594+0000 7f52a9db4980 1 -- 172.21.15.144:0/1567862544 wait complete. 2024-09-13T19:34:31.607 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T19:34:31.362221Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:34:31.362203Z', 'tags': [], 'group_ids': []} 2024-09-13T19:34:36.617 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:34:36.617 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:34:36.617 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T19:34:36.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T19:34:36.618 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-13T19:34:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aaebaa980 1 Processor -- start 2024-09-13T19:34:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aaebaa980 1 -- start start 2024-09-13T19:34:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aaebaa980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f21350c920 0x55f21350cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aaebaa980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f213392ae0 con 0x55f21350d270 2024-09-13T19:34:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aaebaa980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55f2133b6e30 con 0x55f21350c920 2024-09-13T19:34:36.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aac6ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f21350c920 0x55f21350cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aac6ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f21350c920 0x55f21350cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34934/0 (socket says 172.21.15.144:34934) 2024-09-13T19:34:36.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3648110812 learned_addr learned my addr 172.21.15.144:0/3648110812 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aabeb9640 1 --1- 172.21.15.144:0/3648110812 >> v1:172.21.15.18:6789/0 conn(0x55f21350d270 0x55f213511ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37850/0 (socket says 172.21.15.144:37850) 2024-09-13T19:34:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3648110812 >> v1:172.21.15.18:6789/0 conn(0x55f21350d270 legacy=0x55f213511ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.662+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3648110812 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2135144f0 con 0x55f21350c920 2024-09-13T19:34:36.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/3648110812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f21350cd00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00a5c0 tx=0x7f3a9c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb288ee85b15809 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aab6b8640 1 -- 172.21.15.144:0/3648110812 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9c0a6070 con 0x55f21350c920 2024-09-13T19:34:36.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aab6b8640 1 -- 172.21.15.144:0/3648110812 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9c0af070 con 0x55f21350c920 2024-09-13T19:34:36.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aab6b8640 1 -- 172.21.15.144:0/3648110812 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9c0aa5c0 con 0x55f21350c920 2024-09-13T19:34:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3648110812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 msgr2=0x55f21350cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3648110812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f21350cd00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00a5c0 tx=0x7f3a9c01b340 comp rx=0 tx=0).stop 2024-09-13T19:34:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3648110812 shutdown_connections 2024-09-13T19:34:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3648110812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f21350cd00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3648110812 >> 172.21.15.144:0/3648110812 conn(0x55f213480270 msgr2=0x55f213480680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3648110812 shutdown_connections 2024-09-13T19:34:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.666+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3648110812 wait complete. 2024-09-13T19:34:36.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aaebaa980 1 Processor -- start 2024-09-13T19:34:36.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aaebaa980 1 -- start start 2024-09-13T19:34:36.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aaebaa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aaebaa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f2133b8200 con 0x55f21350c920 2024-09-13T19:34:36.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aac6ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aac6ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34938/0 (socket says 172.21.15.144:34938) 2024-09-13T19:34:36.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aac6ba640 1 -- 172.21.15.144:0/1035136525 learned_addr learned my addr 172.21.15.144:0/1035136525 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aac6ba640 1 -- 172.21.15.144:0/1035136525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2135f82a0 con 0x55f21350c920 2024-09-13T19:34:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.682+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/1035136525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135f7cd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0199f0 tx=0x7f3a9c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3da0f793318970 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f399a60c640 1 -- 172.21.15.144:0/1035136525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9c0aaa00 con 0x55f21350c920 2024-09-13T19:34:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f399a60c640 1 -- 172.21.15.144:0/1035136525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9c0aaba0 con 0x55f21350c920 2024-09-13T19:34:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f399a60c640 1 -- 172.21.15.144:0/1035136525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9c0bd3f0 con 0x55f21350c920 2024-09-13T19:34:36.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1035136525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 msgr2=0x55f2135f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/1035136525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135f7cd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0199f0 tx=0x7f3a9c003030 comp rx=0 tx=0).stop 2024-09-13T19:34:36.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1035136525 shutdown_connections 2024-09-13T19:34:36.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/1035136525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135f7cd0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1035136525 >> 172.21.15.144:0/1035136525 conn(0x55f213480270 msgr2=0x55f2135f3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1035136525 shutdown_connections 2024-09-13T19:34:36.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1035136525 wait complete. 2024-09-13T19:34:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 Processor -- start 2024-09-13T19:34:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 -- start start 2024-09-13T19:34:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135fefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aaebaa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f213513f30 con 0x55f21350c920 2024-09-13T19:34:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aac6ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135fefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aac6ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135fefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34948/0 (socket says 172.21.15.144:34948) 2024-09-13T19:34:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aac6ba640 1 -- 172.21.15.144:0/331554799 learned_addr learned my addr 172.21.15.144:0/331554799 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aac6ba640 1 -- 172.21.15.144:0/331554799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2135ff520 con 0x55f21350c920 2024-09-13T19:34:36.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.686+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135fefe0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c018f70 tx=0x7f3a9c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3998e09640 1 -- 172.21.15.144:0/331554799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9c0c6750 con 0x55f21350c920 2024-09-13T19:34:36.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3998e09640 1 -- 172.21.15.144:0/331554799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9c0c68f0 con 0x55f21350c920 2024-09-13T19:34:36.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3998e09640 1 -- 172.21.15.144:0/331554799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9c0c6bd0 con 0x55f21350c920 2024-09-13T19:34:36.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2135ff7b0 con 0x55f21350c920 2024-09-13T19:34:36.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f213602490 con 0x55f21350c920 2024-09-13T19:34:36.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3998e09640 1 -- 172.21.15.144:0/331554799 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3a9c0ce020 con 0x55f21350c920 2024-09-13T19:34:36.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3998e09640 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39940346f0 0x7f3994036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3998e09640 1 -- 172.21.15.144:0/331554799 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3a9c0cc020 con 0x55f21350c920 2024-09-13T19:34:36.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aabeb9640 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39940346f0 0x7f3994036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f21350d270 0x55f213605f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2136065c0 con 0x55f21350d270 2024-09-13T19:34:36.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aacebb640 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f21350d270 0x55f213605f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aabeb9640 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39940346f0 0x7f3994036bb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a940016c0 tx=0x7f3a940066c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aacebb640 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f21350d270 0x55f213605f70 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aacebb640 1 -- 172.21.15.144:0/331554799 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3aa40083f0 con 0x55f21350d270 2024-09-13T19:34:36.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213603690 con 0x55f21350d270 2024-09-13T19:34:36.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aacebb640 1 -- 172.21.15.144:0/331554799 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3aa40083f0 con 0x55f21350d270 2024-09-13T19:34:36.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f2136088f0 0x55f21360ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.690+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f21360b3b0 con 0x55f2136088f0 2024-09-13T19:34:36.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f2136088f0 0x55f21360ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f2136088f0 0x55f21360ace0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aac6ba640 1 -- 172.21.15.144:0/331554799 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f2136088f0 2024-09-13T19:34:36.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213607790 con 0x55f21350d270 2024-09-13T19:34:36.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aacebb640 1 -- 172.21.15.144:0/331554799 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3aa40083f0 con 0x55f21350d270 2024-09-13T19:34:36.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213607c70 con 0x55f21350d270 2024-09-13T19:34:36.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aacebb640 1 -- 172.21.15.144:0/331554799 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3aa40083f0 con 0x55f21350d270 2024-09-13T19:34:36.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aaebaa980 1 Processor -- start 2024-09-13T19:34:36.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aaebaa980 1 -- start start 2024-09-13T19:34:36.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aaebaa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f213619af0 0x55f213619f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aaebaa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f213411800 con 0x55f213619af0 2024-09-13T19:34:36.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aacebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f213619af0 0x55f213619f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aacebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f213619af0 0x55f213619f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34952/0 (socket says 172.21.15.144:34952) 2024-09-13T19:34:36.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aacebb640 1 -- 172.21.15.144:0/2078977122 learned_addr learned my addr 172.21.15.144:0/2078977122 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.694+0000 7f3aacebb640 1 -- 172.21.15.144:0/2078977122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f21361a450 con 0x55f213619af0 2024-09-13T19:34:36.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aacebb640 1 --2- 172.21.15.144:0/2078977122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f213619af0 0x55f213619f10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55f2135ffee0 tx=0x7f3aa400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3991ffb640 1 -- 172.21.15.144:0/2078977122 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4007dd0 con 0x55f213619af0 2024-09-13T19:34:36.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3991ffb640 1 -- 172.21.15.144:0/2078977122 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa401e020 con 0x55f213619af0 2024-09-13T19:34:36.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3991ffb640 1 -- 172.21.15.144:0/2078977122 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4019590 con 0x55f213619af0 2024-09-13T19:34:36.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aaebaa980 1 -- 172.21.15.144:0/2078977122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f21361a6e0 con 0x55f213619af0 2024-09-13T19:34:36.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aaebaa980 1 -- 172.21.15.144:0/2078977122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f21361d360 con 0x55f213619af0 2024-09-13T19:34:36.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3991ffb640 1 -- 172.21.15.144:0/2078977122 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3aa4016040 con 0x55f213619af0 2024-09-13T19:34:36.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3991ffb640 1 --2- 172.21.15.144:0/2078977122 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39840346a0 0x7f3984036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3991ffb640 1 -- 172.21.15.144:0/2078977122 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3aa401f030 con 0x55f213619af0 2024-09-13T19:34:36.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/2078977122 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39840346a0 0x7f3984036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aaebaa980 1 Processor -- start 2024-09-13T19:34:36.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aaebaa980 1 -- start start 2024-09-13T19:34:36.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/2078977122 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39840346a0 0x7f3984036b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55f213606a60 tx=0x7f3a9c0dd040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aaebaa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f2136268d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aaebaa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f2135f8560 con 0x55f2136264d0 2024-09-13T19:34:36.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aacebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f2136268d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aacebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f2136268d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34958/0 (socket says 172.21.15.144:34958) 2024-09-13T19:34:36.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aacebb640 1 -- 172.21.15.144:0/1703500766 learned_addr learned my addr 172.21.15.144:0/1703500766 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aacebb640 1 -- 172.21.15.144:0/1703500766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f213626ea0 con 0x55f2136264d0 2024-09-13T19:34:36.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.698+0000 7f3aacebb640 1 --2- 172.21.15.144:0/1703500766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f2136268d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4023550 tx=0x7f3aa4023640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9061adf038407704 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f39837fe640 1 -- 172.21.15.144:0/1703500766 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa401d040 con 0x55f2136264d0 2024-09-13T19:34:36.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f39837fe640 1 -- 172.21.15.144:0/1703500766 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4015c90 con 0x55f2136264d0 2024-09-13T19:34:36.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f39837fe640 1 -- 172.21.15.144:0/1703500766 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa40433a0 con 0x55f2136264d0 2024-09-13T19:34:36.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1703500766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 msgr2=0x55f2136268d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/1703500766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f2136268d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4023550 tx=0x7f3aa4023640 comp rx=0 tx=0).stop 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1703500766 shutdown_connections 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/1703500766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f2136268d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1703500766 >> 172.21.15.144:0/1703500766 conn(0x55f213622900 msgr2=0x55f213620a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1703500766 shutdown_connections 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- 172.21.15.144:0/1703500766 wait complete. 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 Processor -- start 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- start start 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f21362d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f2136274f0 con 0x55f2136264d0 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aacebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f21362d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aacebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f21362d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34962/0 (socket says 172.21.15.144:34962) 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 learned_addr learned my addr 172.21.15.144:0/3477385849 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f21362de30 con 0x55f2136264d0 2024-09-13T19:34:36.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aacebb640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f21362d8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4023680 tx=0x7f3aa404a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3981ffb640 1 -- 172.21.15.144:0/3477385849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa401d040 con 0x55f2136264d0 2024-09-13T19:34:36.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3981ffb640 1 -- 172.21.15.144:0/3477385849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4015e40 con 0x55f2136264d0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f21362e0c0 con 0x55f2136264d0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3981ffb640 1 -- 172.21.15.144:0/3477385849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa40159c0 con 0x55f2136264d0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.702+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f213630da0 con 0x55f2136264d0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3981ffb640 1 -- 172.21.15.144:0/3477385849 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3aa402b790 con 0x55f2136264d0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3981ffb640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3974034650 0x7f3974036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3981ffb640 1 -- 172.21.15.144:0/3477385849 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3aa4035070 con 0x55f2136264d0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3974034650 0x7f3974036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f213638d90 0x55f21363b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f21363b9a0 con 0x55f213638d90 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aabeb9640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f213638d90 0x55f21363b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3974034650 0x7f3974036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55f21360b7b0 tx=0x7f3a9c0df050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aabeb9640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f213638d90 0x55f21363b250 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 realm 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2136381e0 con 0x55f213638d90 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f21363c470 con 0x55f213638d90 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f21363cd40 con 0x55f213638d90 2024-09-13T19:34:36.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:36.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f21363d630 0x55f21363fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2136401f0 con 0x55f21363d630 2024-09-13T19:34:36.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aacebb640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f21363d630 0x55f21363fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.706+0000 7f3aacebb640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f21363d630 0x55f21363fa60 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aaebaa980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aaebaa980 20 searching for the correct realm 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f213642140 0x55f213644570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f213642140 0x55f213644570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f213642140 0x55f213644570 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aac6ba640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3a9c0f9040 0x7f3a9c0ba890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x7f3a9c0f9040 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3a9c0f9040 0x7f3a9c0ba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3a9c0f9040 0x7f3a9c0ba890 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f21363d630 2024-09-13T19:34:36.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.710+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f21363d630 2024-09-13T19:34:36.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x7f3a9c0f9040 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f21363d630 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x7f3a9c0f9040 2024-09-13T19:34:36.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.714+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f21363d630 2024-09-13T19:34:36.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f21363d630 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x7f3a9c0f9040 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f21363d630 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.718+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f21363d630 2024-09-13T19:34:36.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x7f3a9c0f9040 2024-09-13T19:34:36.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213642140 2024-09-13T19:34:36.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f21363d630 2024-09-13T19:34:36.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x55f213638d90 2024-09-13T19:34:36.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f213644c40 con 0x7f3a9c0f9040 2024-09-13T19:34:36.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213640bb0 con 0x55f213638d90 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2136407f0 con 0x55f213638d90 2024-09-13T19:34:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213641550 con 0x55f213638d90 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 zone default found 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 4 Realm: () 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 zonegroup default 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.722+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213645170 con 0x55f21363d630 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213647440 con 0x55f213642140 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2136477e0 con 0x55f213642140 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 20 started sync module instance, tier type = 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2136468d0 con 0x7f3a9c0f9040 2024-09-13T19:34:36.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94498195795440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2136468d0 con 0x7f3a9c0f9040 2024-09-13T19:34:36.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213648250 con 0x55f213638d90 2024-09-13T19:34:36.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.726+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94498195795440] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.730+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.730+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94498195799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2136468d0 con 0x55f213638d90 2024-09-13T19:34:36.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.730+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213648c60 con 0x55f213642140 2024-09-13T19:34:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.730+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.730+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94498195802032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213649500 con 0x55f213642140 2024-09-13T19:34:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.730+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213649f00 con 0x7f3a9c0f9040 2024-09-13T19:34:36.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.730+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94498195799392] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94498195792928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364a2f0 con 0x7f3a9c0f9040 2024-09-13T19:34:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364acb0 con 0x55f213638d90 2024-09-13T19:34:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94498195802032] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94498195792928] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94498195806736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364a800 con 0x55f213638d90 2024-09-13T19:34:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364b050 con 0x55f21363d630 2024-09-13T19:34:36.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.734+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94498195806736] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.738+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.738+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94498195810304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364b0d0 con 0x55f21363d630 2024-09-13T19:34:36.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.738+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364b920 con 0x55f21363d630 2024-09-13T19:34:36.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.738+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.738+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94498195813040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364bd20 con 0x55f21363d630 2024-09-13T19:34:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.738+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364c840 con 0x55f21363d630 2024-09-13T19:34:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.738+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94498195810304] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94498195813040] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94498195817232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364b770 con 0x55f21363d630 2024-09-13T19:34:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 20 add_watcher() i=0 2024-09-13T19:34:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 20 add_watcher() i=1 2024-09-13T19:34:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 20 add_watcher() i=2 2024-09-13T19:34:36.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 20 add_watcher() i=3 2024-09-13T19:34:36.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 20 add_watcher() i=4 2024-09-13T19:34:36.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 20 add_watcher() i=5 2024-09-13T19:34:36.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 20 add_watcher() i=6 2024-09-13T19:34:36.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94498195817232] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 20 add_watcher() i=7 2024-09-13T19:34:36.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:36.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.742+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f21364f830 con 0x55f213638d90 2024-09-13T19:34:36.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94498195811360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f21364ccb0 con 0x55f213638d90 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94498195811360] v32'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f39627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 5 note: GC not initialized 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f39617e2640 20 reqs_thread_entry: start 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 20 Filter name: none 2024-09-13T19:34:36.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f38d2ffd640 20 reqs_thread_entry: start 2024-09-13T19:34:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:34:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213672e70 con 0x55f21363d630 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213671610 con 0x55f21363d630 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:34:36.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:34:36.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:34:36.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:34:36.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.746+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213671ee0 con 0x55f21363d630 2024-09-13T19:34:36.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aaebaa980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:34:36.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aaebaa980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:34:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aaebaa980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:34:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94498195970608 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213676460 con 0x55f21363d630 2024-09-13T19:34:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== watch-notify(notify (1) cookie 94498195810304 notify 137438953494 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55f2136728c0 con 0x55f21363d630 2024-09-13T19:34:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f39837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94498195810304 notifier 4734 bl.length()=556 2024-09-13T19:34:36.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f39837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:34:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f39837fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:34:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f39837fe640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3970003eb0 con 0x55f21363d630 2024-09-13T19:34:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(65 notify.5 [notify cookie 94498195970608 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== watch-notify(notify_complete (2) cookie 94498195970608 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f21362de30 con 0x55f21363d630 2024-09-13T19:34:36.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.750+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213671e40 con 0x55f21363d630 2024-09-13T19:34:36.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aaebaa980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:34:36.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aaebaa980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:34:36.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aaebaa980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:34:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94498195970448 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f213671e50 con 0x55f213642140 2024-09-13T19:34:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== watch-notify(notify (1) cookie 94498195802032 notify 137438953478 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f3a9c103040 con 0x55f213642140 2024-09-13T19:34:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3982ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94498195802032 notifier 4734 bl.length()=177 2024-09-13T19:34:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3982ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:34:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3982ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:34:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(68 notify.2 [notify cookie 94498195970448 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3982ffd640 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f38e0003410 con 0x55f213642140 2024-09-13T19:34:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== watch-notify(notify_complete (2) cookie 94498195970448 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f213602490 con 0x55f213642140 2024-09-13T19:34:36.760 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:34:36.753371Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:34:36.753359Z","tags":[],"group_ids":[]} 2024-09-13T19:34:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f39627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.754+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94498195811360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213670c10 con 0x55f213638d90 2024-09-13T19:34:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.758+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94498195811360] v32'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.758+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94498195795440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213670c10 con 0x7f3a9c0f9040 2024-09-13T19:34:36.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.758+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94498195795440] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.758+0000 7f3aaebaa980 20 remove_watcher() i=0 2024-09-13T19:34:36.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.758+0000 7f3aaebaa980 2 removed watcher, disabling cache 2024-09-13T19:34:36.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.758+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94498195799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213670c10 con 0x55f213638d90 2024-09-13T19:34:36.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94498195799392] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aaebaa980 20 remove_watcher() i=1 2024-09-13T19:34:36.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94498195802032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213647d60 con 0x55f213642140 2024-09-13T19:34:36.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aac6ba640 1 -- 172.21.15.144:0/3477385849 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94498195802032] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c0c6d70 con 0x55f213642140 2024-09-13T19:34:36.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aaebaa980 20 remove_watcher() i=2 2024-09-13T19:34:36.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94498195792928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213670c10 con 0x7f3a9c0f9040 2024-09-13T19:34:36.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94498195792928] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x7f3a9c0f9040 2024-09-13T19:34:36.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aaebaa980 20 remove_watcher() i=3 2024-09-13T19:34:36.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.762+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94498195806736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2136487b0 con 0x55f213638d90 2024-09-13T19:34:36.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.766+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94498195806736] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9400f070 con 0x55f213638d90 2024-09-13T19:34:36.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.766+0000 7f3aaebaa980 20 remove_watcher() i=4 2024-09-13T19:34:36.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.766+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94498195810304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213647d60 con 0x55f21363d630 2024-09-13T19:34:36.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.766+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94498195810304] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.766+0000 7f3aaebaa980 20 remove_watcher() i=5 2024-09-13T19:34:36.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.766+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94498195813040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213670c10 con 0x55f21363d630 2024-09-13T19:34:36.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.770+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94498195813040] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.770+0000 7f3aaebaa980 20 remove_watcher() i=6 2024-09-13T19:34:36.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.770+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94498195817232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f213649a10 con 0x55f21363d630 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.770+0000 7f3aacebb640 1 -- 172.21.15.144:0/3477385849 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94498195817232] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa402a070 con 0x55f21363d630 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.770+0000 7f3aaebaa980 20 remove_watcher() i=7 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f21363d630 msgr2=0x55f21363fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f21363d630 0x55f21363fa60 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f213638d90 msgr2=0x55f21363b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f213638d90 0x55f21363b250 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3a9c0f9040 msgr2=0x7f3a9c0ba890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f3a9c0f9040 0x7f3a9c0ba890 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f213642140 msgr2=0x55f213644570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f213642140 0x55f213644570 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3974034650 msgr2=0x7f3974036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f3974034650 0x7f3974036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55f21360b7b0 tx=0x7f3a9c0df050 comp rx=0 tx=0).stop 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 msgr2=0x55f21362d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f21362d8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4023680 tx=0x7f3aa404a260 comp rx=0 tx=0).stop 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aabeb9640 1 -- 172.21.15.144:0/3477385849 reap_dead start 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 shutdown_connections 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/3477385849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2136264d0 0x55f21362d8f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 >> 172.21.15.144:0/3477385849 conn(0x55f213622900 msgr2=0x55f2136209d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 shutdown_connections 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/3477385849 wait complete. 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/2078977122 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39840346a0 msgr2=0x7f3984036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/2078977122 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39840346a0 0x7f3984036b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55f213606a60 tx=0x7f3a9c0dd040 comp rx=0 tx=0).stop 2024-09-13T19:34:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/2078977122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f213619af0 msgr2=0x55f213619f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/2078977122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f213619af0 0x55f213619f10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55f2135ffee0 tx=0x7f3aa400af40 comp rx=0 tx=0).stop 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/2078977122 shutdown_connections 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/2078977122 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39840346a0 0x7f3984036b60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/2078977122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f213619af0 0x55f213619f10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/2078977122 >> 172.21.15.144:0/2078977122 conn(0x55f21360ec40 msgr2=0x55f2136116c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/2078977122 shutdown_connections 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/2078977122 wait complete. 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f2136088f0 msgr2=0x55f21360ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f2136088f0 0x55f21360ace0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f21350d270 msgr2=0x55f213605f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f21350d270 0x55f213605f70 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39940346f0 msgr2=0x7f3994036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39940346f0 0x7f3994036bb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a940016c0 tx=0x7f3a940066c0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 msgr2=0x55f2135fefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135fefe0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c018f70 tx=0x7f3a9c0180e0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 shutdown_connections 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f21350d270 0x55f213605f70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f2136088f0 0x55f21360ace0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f39940346f0 0x7f3994036bb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 --2- 172.21.15.144:0/331554799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f21350c920 0x55f2135fefe0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 >> 172.21.15.144:0/331554799 conn(0x55f213480270 msgr2=0x55f2135f2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 shutdown_connections 2024-09-13T19:34:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.774+0000 7f3aaebaa980 1 -- 172.21.15.144:0/331554799 wait complete. 2024-09-13T19:34:36.790 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:34:36.753371Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:34:36.753359Z', 'tags': [], 'group_ids': []} 2024-09-13T19:34:36.815 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:34:36.820 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-13T19:34:36.820 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T19:34:36.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T19:34:36.821 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-13T19:34:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ecbd26980 1 Processor -- start 2024-09-13T19:34:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ecbd26980 1 -- start start 2024-09-13T19:34:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ecbd26980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x564ba1a0f6a0 0x564ba1a0fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ecbd26980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ba1897ae0 con 0x564ba1a0fff0 2024-09-13T19:34:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ecbd26980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x564ba18bbe30 con 0x564ba1a0f6a0 2024-09-13T19:34:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ec9836640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x564ba1a0f6a0 0x564ba1a0fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ec9035640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x564ba1a0fff0 0x564ba1a14a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37864/0 (socket says 172.21.15.144:37864) 2024-09-13T19:34:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ec9035640 1 -- 172.21.15.144:0/3141550551 learned_addr learned my addr 172.21.15.144:0/3141550551 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:34:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ec9836640 1 -- 172.21.15.144:0/3141550551 >> v1:172.21.15.18:6789/0 conn(0x564ba1a0fff0 legacy=0x564ba1a14a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.862+0000 7f6ec9836640 1 -- 172.21.15.144:0/3141550551 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba1a17270 con 0x564ba1a0f6a0 2024-09-13T19:34:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3141550551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1a0fa80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400a420 tx=0x7f6ec401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484e408f71a968bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ec8834640 1 -- 172.21.15.144:0/3141550551 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec40af070 con 0x564ba1a0f6a0 2024-09-13T19:34:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ec8834640 1 -- 172.21.15.144:0/3141550551 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec40aa530 con 0x564ba1a0f6a0 2024-09-13T19:34:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ec8834640 1 -- 172.21.15.144:0/3141550551 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec40aa850 con 0x564ba1a0f6a0 2024-09-13T19:34:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3141550551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 msgr2=0x564ba1a0fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3141550551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1a0fa80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400a420 tx=0x7f6ec401afd0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3141550551 shutdown_connections 2024-09-13T19:34:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3141550551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1a0fa80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3141550551 >> 172.21.15.144:0/3141550551 conn(0x564ba1a0b1c0 msgr2=0x564ba1a0d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3141550551 shutdown_connections 2024-09-13T19:34:36.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.866+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3141550551 wait complete. 2024-09-13T19:34:36.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ecbd26980 1 Processor -- start 2024-09-13T19:34:36.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ecbd26980 1 -- start start 2024-09-13T19:34:36.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ecbd26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1986380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ecbd26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564ba18bd200 con 0x564ba1a0f6a0 2024-09-13T19:34:36.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ec9836640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1986380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ec9836640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1986380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34980/0 (socket says 172.21.15.144:34980) 2024-09-13T19:34:36.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ec9836640 1 -- 172.21.15.144:0/4275858797 learned_addr learned my addr 172.21.15.144:0/4275858797 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ec9836640 1 -- 172.21.15.144:0/4275858797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba1986950 con 0x564ba1a0f6a0 2024-09-13T19:34:36.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.882+0000 7f6ec9836640 1 --2- 172.21.15.144:0/4275858797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1986380 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40ad040 tx=0x7f6ec40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c560a3cb9a4e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6db7e07640 1 -- 172.21.15.144:0/4275858797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec40af050 con 0x564ba1a0f6a0 2024-09-13T19:34:36.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6db7e07640 1 -- 172.21.15.144:0/4275858797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec40b0040 con 0x564ba1a0f6a0 2024-09-13T19:34:36.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6db7e07640 1 -- 172.21.15.144:0/4275858797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec40aaca0 con 0x564ba1a0f6a0 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- 172.21.15.144:0/4275858797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 msgr2=0x564ba1986380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/4275858797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1986380 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40ad040 tx=0x7f6ec40033b0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- 172.21.15.144:0/4275858797 shutdown_connections 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/4275858797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1986380 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- 172.21.15.144:0/4275858797 >> 172.21.15.144:0/4275858797 conn(0x564ba1a0b1c0 msgr2=0x564ba1af66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- 172.21.15.144:0/4275858797 shutdown_connections 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- 172.21.15.144:0/4275858797 wait complete. 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 Processor -- start 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- start start 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1b03eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564ba1a16cb0 con 0x564ba1a0f6a0 2024-09-13T19:34:36.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ec9836640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1b03eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ec9836640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1b03eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34990/0 (socket says 172.21.15.144:34990) 2024-09-13T19:34:36.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ec9836640 1 -- 172.21.15.144:0/3393181755 learned_addr learned my addr 172.21.15.144:0/3393181755 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ec9836640 1 -- 172.21.15.144:0/3393181755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba1b043f0 con 0x564ba1a0f6a0 2024-09-13T19:34:36.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1b03eb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4019680 tx=0x7f6ec4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6db6604640 1 -- 172.21.15.144:0/3393181755 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec40c5070 con 0x564ba1a0f6a0 2024-09-13T19:34:36.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ba1b04680 con 0x564ba1a0f6a0 2024-09-13T19:34:36.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6db6604640 1 -- 172.21.15.144:0/3393181755 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec40b6d60 con 0x564ba1a0f6a0 2024-09-13T19:34:36.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6db6604640 1 -- 172.21.15.144:0/3393181755 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec40c15f0 con 0x564ba1a0f6a0 2024-09-13T19:34:36.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.886+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba1b07360 con 0x564ba1a0f6a0 2024-09-13T19:34:36.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6db6604640 1 -- 172.21.15.144:0/3393181755 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6ec40c8070 con 0x564ba1a0f6a0 2024-09-13T19:34:36.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6db6604640 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db0034650 0x7f6db0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6db6604640 1 -- 172.21.15.144:0/3393181755 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ec40bb070 con 0x564ba1a0f6a0 2024-09-13T19:34:36.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ec9035640 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db0034650 0x7f6db0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1a0fff0 0x564ba1b0ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b0b4b0 con 0x564ba1a0fff0 2024-09-13T19:34:36.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6eca037640 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1a0fff0 0x564ba1b0ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ec9035640 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db0034650 0x7f6db0036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f70 tx=0x7f6eb40012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6eca037640 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1a0fff0 0x564ba1b0ae40 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6eca037640 1 -- 172.21.15.144:0/3393181755 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ebc0083f0 con 0x564ba1a0fff0 2024-09-13T19:34:36.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b08580 con 0x564ba1a0fff0 2024-09-13T19:34:36.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6eca037640 1 -- 172.21.15.144:0/3393181755 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ebc0083f0 con 0x564ba1a0fff0 2024-09-13T19:34:36.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b0d830 0x564ba1b0fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b102f0 con 0x564ba1b0d830 2024-09-13T19:34:36.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b0d830 0x564ba1b0fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.890+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b0d830 0x564ba1b0fc20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ec9836640 1 -- 172.21.15.144:0/3393181755 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b0d830 2024-09-13T19:34:36.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b0c6d0 con 0x564ba1a0fff0 2024-09-13T19:34:36.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6eca037640 1 -- 172.21.15.144:0/3393181755 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ebc0083f0 con 0x564ba1a0fff0 2024-09-13T19:34:36.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b0cbb0 con 0x564ba1a0fff0 2024-09-13T19:34:36.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6eca037640 1 -- 172.21.15.144:0/3393181755 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ebc0083f0 con 0x564ba1a0fff0 2024-09-13T19:34:36.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ecbd26980 1 Processor -- start 2024-09-13T19:34:36.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ecbd26980 1 -- start start 2024-09-13T19:34:36.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ecbd26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b1ea30 0x564ba1b1ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ecbd26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564ba1916800 con 0x564ba1b1ea30 2024-09-13T19:34:36.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6eca037640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b1ea30 0x564ba1b1ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6eca037640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b1ea30 0x564ba1b1ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:34996/0 (socket says 172.21.15.144:34996) 2024-09-13T19:34:36.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6eca037640 1 -- 172.21.15.144:0/350894850 learned_addr learned my addr 172.21.15.144:0/350894850 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6eca037640 1 -- 172.21.15.144:0/350894850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba1b1f390 con 0x564ba1b1ea30 2024-09-13T19:34:36.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6eca037640 1 --2- 172.21.15.144:0/350894850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b1ea30 0x564ba1b1ee50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x564ba1b04db0 tx=0x7f6ebc00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6daf7fe640 1 -- 172.21.15.144:0/350894850 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc007d70 con 0x564ba1b1ea30 2024-09-13T19:34:36.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ecbd26980 1 -- 172.21.15.144:0/350894850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ba1b1f620 con 0x564ba1b1ea30 2024-09-13T19:34:36.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6daf7fe640 1 -- 172.21.15.144:0/350894850 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc01e020 con 0x564ba1b1ea30 2024-09-13T19:34:36.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6daf7fe640 1 -- 172.21.15.144:0/350894850 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc019590 con 0x564ba1b1ea30 2024-09-13T19:34:36.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.894+0000 7f6ecbd26980 1 -- 172.21.15.144:0/350894850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba1b222a0 con 0x564ba1b1ea30 2024-09-13T19:34:36.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6daf7fe640 1 -- 172.21.15.144:0/350894850 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6ebc016040 con 0x564ba1b1ea30 2024-09-13T19:34:36.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6daf7fe640 1 --2- 172.21.15.144:0/350894850 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6da4034650 0x7f6da4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6daf7fe640 1 -- 172.21.15.144:0/350894850 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ebc01f030 con 0x564ba1b1ea30 2024-09-13T19:34:36.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ec9836640 1 --2- 172.21.15.144:0/350894850 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6da4034650 0x7f6da4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 Processor -- start 2024-09-13T19:34:36.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 -- start start 2024-09-13T19:34:36.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ec9836640 1 --2- 172.21.15.144:0/350894850 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6da4034650 0x7f6da4036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x564ba1b0b980 tx=0x7f6ec40b4f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b2b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564ba1984ab0 con 0x564ba1b2b520 2024-09-13T19:34:36.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6eca037640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b2b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6eca037640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b2b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35004/0 (socket says 172.21.15.144:35004) 2024-09-13T19:34:36.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6eca037640 1 -- 172.21.15.144:0/170603654 learned_addr learned my addr 172.21.15.144:0/170603654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6eca037640 1 -- 172.21.15.144:0/170603654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba1b2bef0 con 0x564ba1b2b520 2024-09-13T19:34:36.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6eca037640 1 --2- 172.21.15.144:0/170603654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b2b920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc04a2a0 tx=0x7f6ebc023610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3a72f8c5bb180c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6dad7fa640 1 -- 172.21.15.144:0/170603654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc01d030 con 0x564ba1b2b520 2024-09-13T19:34:36.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6dad7fa640 1 -- 172.21.15.144:0/170603654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc043380 con 0x564ba1b2b520 2024-09-13T19:34:36.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6dad7fa640 1 -- 172.21.15.144:0/170603654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc043680 con 0x564ba1b2b520 2024-09-13T19:34:36.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 -- 172.21.15.144:0/170603654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 msgr2=0x564ba1b2b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/170603654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b2b920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc04a2a0 tx=0x7f6ebc023610 comp rx=0 tx=0).stop 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 -- 172.21.15.144:0/170603654 shutdown_connections 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/170603654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b2b920 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 -- 172.21.15.144:0/170603654 >> 172.21.15.144:0/170603654 conn(0x564ba1b27950 msgr2=0x564ba1b25a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 -- 172.21.15.144:0/170603654 shutdown_connections 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 -- 172.21.15.144:0/170603654 wait complete. 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 Processor -- start 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 -- start start 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.898+0000 7f6ecbd26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b32900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ecbd26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564ba1b2c540 con 0x564ba1b2b520 2024-09-13T19:34:36.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6eca037640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b32900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6eca037640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b32900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35020/0 (socket says 172.21.15.144:35020) 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 learned_addr learned my addr 172.21.15.144:0/3801401227 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba1b32e40 con 0x564ba1b2b520 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6eca037640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b32900 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc023650 tx=0x7f6ebc04a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6d9b7fe640 1 -- 172.21.15.144:0/3801401227 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc017770 con 0x564ba1b2b520 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ba1b330d0 con 0x564ba1b2b520 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6d9b7fe640 1 -- 172.21.15.144:0/3801401227 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc02b7d0 con 0x564ba1b2b520 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6d9b7fe640 1 -- 172.21.15.144:0/3801401227 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc02bab0 con 0x564ba1b2b520 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba1b35db0 con 0x564ba1b2b520 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6d9b7fe640 1 -- 172.21.15.144:0/3801401227 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6ebc037070 con 0x564ba1b2b520 2024-09-13T19:34:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6d9b7fe640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6d94034650 0x7f6d94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6d9b7fe640 1 -- 172.21.15.144:0/3801401227 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ebc056bf0 con 0x564ba1b2b520 2024-09-13T19:34:36.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6d94034650 0x7f6d94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1b3dda0 0x564ba1b40240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b40990 con 0x564ba1b3dda0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ec9035640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1b3dda0 0x564ba1b40240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6d94034650 0x7f6d94036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40ab200 tx=0x7f6ec40dd000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.902+0000 7f6ec9035640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1b3dda0 0x564ba1b40240 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 realm 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b3d270 con 0x564ba1b3dda0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b41490 con 0x564ba1b3dda0 2024-09-13T19:34:36.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b41d60 con 0x564ba1b3dda0 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b42780 0x564ba1b44b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b45260 con 0x564ba1b42780 2024-09-13T19:34:36.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6eca037640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b42780 0x564ba1b44b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6eca037640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b42780 0x564ba1b44b70 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 20 searching for the correct realm 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x564ba1b471b0 0x564ba1b495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x564ba1b471b0 0x564ba1b495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x564ba1b471b0 0x564ba1b495e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.906+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9836640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6ec40ca070 0x7f6ec40a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:36.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x7f6ec40ca070 2024-09-13T19:34:36.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6ec40ca070 0x7f6ec40a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:36.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6ec40ca070 0x7f6ec40a9730 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:36.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x7f6ec40ca070 2024-09-13T19:34:36.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b42780 2024-09-13T19:34:36.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b42780 2024-09-13T19:34:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x7f6ec40ca070 2024-09-13T19:34:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x7f6ec40ca070 2024-09-13T19:34:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.910+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b42780 2024-09-13T19:34:36.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x7f6ec40ca070 2024-09-13T19:34:36.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6eb400e5a0 con 0x7f6ec40ca070 2024-09-13T19:34:36.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b42780 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.914+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b42780 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x7f6ec40ca070 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x7f6ec40ca070 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b42780 2024-09-13T19:34:36.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b42780 2024-09-13T19:34:36.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x7f6ec40ca070 2024-09-13T19:34:36.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb400e5a0 con 0x7f6ec40ca070 2024-09-13T19:34:36.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.918+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b471b0 2024-09-13T19:34:36.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b42780 2024-09-13T19:34:36.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x564ba1b3dda0 2024-09-13T19:34:36.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6eb400e5a0 con 0x564ba1b3dda0 2024-09-13T19:34:36.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b49cb0 con 0x7f6ec40ca070 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb4038040 con 0x7f6ec40ca070 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b45c20 con 0x564ba1b3dda0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b464c0 con 0x564ba1b3dda0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b45860 con 0x564ba1b3dda0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 zone default found 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 4 Realm: () 2024-09-13T19:34:36.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 zonegroup default 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4a130 con 0x564ba1b42780 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4bee0 con 0x564ba1b471b0 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.922+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4c3b0 con 0x564ba1b471b0 2024-09-13T19:34:36.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ecbd26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:36.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ecbd26980 20 started sync module instance, tier type = 2024-09-13T19:34:36.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ecbd26980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:36.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4b350 con 0x7f6ec40ca070 2024-09-13T19:34:36.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x7f6ec40ca070 2024-09-13T19:34:36.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882835511408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4b350 con 0x7f6ec40ca070 2024-09-13T19:34:36.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4ce70 con 0x564ba1b3dda0 2024-09-13T19:34:36.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882835511408] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x7f6ec40ca070 2024-09-13T19:34:36.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882835515776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4b350 con 0x564ba1b3dda0 2024-09-13T19:34:36.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.926+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4d880 con 0x564ba1b471b0 2024-09-13T19:34:36.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.930+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.930+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882835518416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4e120 con 0x564ba1b471b0 2024-09-13T19:34:36.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.930+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4eb20 con 0x7f6ec40ca070 2024-09-13T19:34:36.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.930+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882835515776] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.930+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x7f6ec40ca070 2024-09-13T19:34:36.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.930+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882835508896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4ef10 con 0x7f6ec40ca070 2024-09-13T19:34:36.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.930+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4f8d0 con 0x564ba1b3dda0 2024-09-13T19:34:36.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.930+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882835518416] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.934+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882835508896] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x7f6ec40ca070 2024-09-13T19:34:36.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.934+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.934+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882835523120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4f420 con 0x564ba1b3dda0 2024-09-13T19:34:36.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.934+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4fc70 con 0x564ba1b42780 2024-09-13T19:34:36.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.934+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882835523120] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.934+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.934+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882835526688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4f840 con 0x564ba1b42780 2024-09-13T19:34:36.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.934+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b50970 con 0x564ba1b42780 2024-09-13T19:34:36.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.938+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882835526688] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.938+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.938+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882835529744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b508e0 con 0x564ba1b42780 2024-09-13T19:34:36.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.938+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b51320 con 0x564ba1b42780 2024-09-13T19:34:36.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882835529744] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882835533296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b51500 con 0x564ba1b42780 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 20 add_watcher() i=0 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 20 add_watcher() i=1 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 20 add_watcher() i=2 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 20 add_watcher() i=3 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 20 add_watcher() i=4 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 20 add_watcher() i=5 2024-09-13T19:34:36.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 20 add_watcher() i=6 2024-09-13T19:34:36.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882835533296] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 20 add_watcher() i=7 2024-09-13T19:34:36.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:36.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b548d0 con 0x564ba1b3dda0 2024-09-13T19:34:36.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.942+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882835534832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b51cf0 con 0x564ba1b3dda0 2024-09-13T19:34:36.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882835534832] v32'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6d7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:36.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:36.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:36.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 5 note: GC not initialized 2024-09-13T19:34:36.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6d7a7fc640 20 reqs_thread_entry: start 2024-09-13T19:34:36.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:36.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 20 Filter name: none 2024-09-13T19:34:36.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6cebfff640 20 reqs_thread_entry: start 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 20 rados->read ofs=0 len=0 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b77ec0 con 0x7f6ec40ca070 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6eb4038040 con 0x7f6ec40ca070 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:34:36.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.946+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b7c020 con 0x564ba1b42780 2024-09-13T19:34:36.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.950+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v32'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.953 INFO:teuthology.orchestra.run.smithi144.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-13T19:34:36.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.950+0000 7f6d7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:36.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.950+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882835534832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b75cf0 con 0x564ba1b3dda0 2024-09-13T19:34:36.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.950+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94882835534832] v32'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.950+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882835511408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b75cf0 con 0x7f6ec40ca070 2024-09-13T19:34:36.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.954+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94882835511408] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x7f6ec40ca070 2024-09-13T19:34:36.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.954+0000 7f6ecbd26980 20 remove_watcher() i=0 2024-09-13T19:34:36.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.954+0000 7f6ecbd26980 2 removed watcher, disabling cache 2024-09-13T19:34:36.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.954+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882835515776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b75cf0 con 0x564ba1b3dda0 2024-09-13T19:34:36.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.954+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94882835515776] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.954+0000 7f6ecbd26980 20 remove_watcher() i=1 2024-09-13T19:34:36.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.954+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882835518416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4c980 con 0x564ba1b471b0 2024-09-13T19:34:36.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.958+0000 7f6ec9836640 1 -- 172.21.15.144:0/3801401227 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94882835518416] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40d1070 con 0x564ba1b471b0 2024-09-13T19:34:36.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.958+0000 7f6ecbd26980 20 remove_watcher() i=2 2024-09-13T19:34:36.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.958+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882835508896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b75cf0 con 0x7f6ec40ca070 2024-09-13T19:34:36.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.958+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94882835508896] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x7f6ec40ca070 2024-09-13T19:34:36.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.958+0000 7f6ecbd26980 20 remove_watcher() i=3 2024-09-13T19:34:36.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.958+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882835523120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4d3d0 con 0x564ba1b3dda0 2024-09-13T19:34:36.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.962+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94882835523120] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb4038040 con 0x564ba1b3dda0 2024-09-13T19:34:36.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.962+0000 7f6ecbd26980 20 remove_watcher() i=4 2024-09-13T19:34:36.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.962+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882835526688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4c980 con 0x564ba1b42780 2024-09-13T19:34:36.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.962+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94882835526688] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.962+0000 7f6ecbd26980 20 remove_watcher() i=5 2024-09-13T19:34:36.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.962+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882835529744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b75cf0 con 0x564ba1b42780 2024-09-13T19:34:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.966+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94882835529744] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.966+0000 7f6ecbd26980 20 remove_watcher() i=6 2024-09-13T19:34:36.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.966+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882835533296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ba1b4e630 con 0x564ba1b42780 2024-09-13T19:34:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6eca037640 1 -- 172.21.15.144:0/3801401227 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94882835533296] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x564ba1b42780 2024-09-13T19:34:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 20 remove_watcher() i=7 2024-09-13T19:34:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b42780 msgr2=0x564ba1b44b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b42780 0x564ba1b44b70 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1b3dda0 msgr2=0x564ba1b40240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1b3dda0 0x564ba1b40240 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6ec40ca070 msgr2=0x7f6ec40a9730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6ec40ca070 0x7f6ec40a9730 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x564ba1b471b0 msgr2=0x564ba1b495e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x564ba1b471b0 0x564ba1b495e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6d94034650 msgr2=0x7f6d94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6d94034650 0x7f6d94036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40ab200 tx=0x7f6ec40dd000 comp rx=0 tx=0).stop 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 reap_dead start 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 msgr2=0x564ba1b32900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3801401227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b2b520 0x564ba1b32900 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc023650 tx=0x7f6ebc04a230 comp rx=0 tx=0).stop 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ec9035640 1 -- 172.21.15.144:0/3801401227 reap_dead start 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 shutdown_connections 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 >> 172.21.15.144:0/3801401227 conn(0x564ba1b27950 msgr2=0x564ba1b25a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 shutdown_connections 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3801401227 wait complete. 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/350894850 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6da4034650 msgr2=0x7f6da4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/350894850 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6da4034650 0x7f6da4036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x564ba1b0b980 tx=0x7f6ec40b4f60 comp rx=0 tx=0).stop 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/350894850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b1ea30 msgr2=0x564ba1b1ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/350894850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b1ea30 0x564ba1b1ee50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x564ba1b04db0 tx=0x7f6ebc00af40 comp rx=0 tx=0).stop 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/350894850 shutdown_connections 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/350894850 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6da4034650 0x7f6da4036b10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/350894850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1b1ea30 0x564ba1b1ee50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/350894850 >> 172.21.15.144:0/350894850 conn(0x564ba1b13b80 msgr2=0x564ba1b16600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/350894850 shutdown_connections 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/350894850 wait complete. 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b0d830 msgr2=0x564ba1b0fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b0d830 0x564ba1b0fc20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1a0fff0 msgr2=0x564ba1b0ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1a0fff0 0x564ba1b0ae40 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db0034650 msgr2=0x7f6db0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db0034650 0x7f6db0036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f70 tx=0x7f6eb40012c0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 msgr2=0x564ba1b03eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1b03eb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4019680 tx=0x7f6ec4019810 comp rx=0 tx=0).stop 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 shutdown_connections 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x564ba1a0fff0 0x564ba1b0ae40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x564ba1b0d830 0x564ba1b0fc20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db0034650 0x7f6db0036b10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 --2- 172.21.15.144:0/3393181755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ba1a0f6a0 0x564ba1b03eb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 >> 172.21.15.144:0/3393181755 conn(0x564ba1a0b1c0 msgr2=0x564ba1984fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 shutdown_connections 2024-09-13T19:34:36.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:36.970+0000 7f6ecbd26980 1 -- 172.21.15.144:0/3393181755 wait complete. 2024-09-13T19:34:36.985 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:34:36.991 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:34:36.991 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:34:36.995 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:34:36.995 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:34:36.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T19:34:36.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T19:34:36.996 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-13T19:34:37.070 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:37.070 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:37.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab5126980 1 Processor -- start 2024-09-13T19:34:37.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab5126980 1 -- start start 2024-09-13T19:34:37.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab5126980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559a9a714a00 0x559a9a714e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab5126980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559a9a622ae0 con 0x559a9a711690 2024-09-13T19:34:37.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab5126980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x559a9a646e30 con 0x559a9a714a00 2024-09-13T19:34:37.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab2435640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559a9a714a00 0x559a9a714e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab2435640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559a9a714a00 0x559a9a714e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35026/0 (socket says 172.21.15.144:35026) 2024-09-13T19:34:37.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab2435640 1 -- 172.21.15.144:0/2985910714 learned_addr learned my addr 172.21.15.144:0/2985910714 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab2c36640 1 --1- 172.21.15.144:0/2985910714 >> v1:172.21.15.18:6789/0 conn(0x559a9a711690 0x559a9a711a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37868/0 (socket says 172.21.15.144:37868) 2024-09-13T19:34:37.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab2435640 1 -- 172.21.15.144:0/2985910714 >> v1:172.21.15.18:6789/0 conn(0x559a9a711690 legacy=0x559a9a711a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.066+0000 7fcab2435640 1 -- 172.21.15.144:0/2985910714 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9a715350 con 0x559a9a714a00 2024-09-13T19:34:37.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab2435640 1 --2- 172.21.15.144:0/2985910714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a714a00 0x559a9a714e10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800a5c0 tx=0x7fcaa801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857464c6a3390950 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab1c34640 1 -- 172.21.15.144:0/2985910714 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa80b1070 con 0x559a9a714a00 2024-09-13T19:34:37.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab1c34640 1 -- 172.21.15.144:0/2985910714 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa80a8070 con 0x559a9a714a00 2024-09-13T19:34:37.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab1c34640 1 -- 172.21.15.144:0/2985910714 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa80ac5b0 con 0x559a9a714a00 2024-09-13T19:34:37.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab5126980 1 -- 172.21.15.144:0/2985910714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a714a00 msgr2=0x559a9a714e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab5126980 1 --2- 172.21.15.144:0/2985910714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a714a00 0x559a9a714e10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800a5c0 tx=0x7fcaa801b340 comp rx=0 tx=0).stop 2024-09-13T19:34:37.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab5126980 1 -- 172.21.15.144:0/2985910714 shutdown_connections 2024-09-13T19:34:37.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab5126980 1 --2- 172.21.15.144:0/2985910714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a714a00 0x559a9a714e10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab5126980 1 -- 172.21.15.144:0/2985910714 >> 172.21.15.144:0/2985910714 conn(0x559a9a710240 msgr2=0x559a9a710650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab5126980 1 -- 172.21.15.144:0/2985910714 shutdown_connections 2024-09-13T19:34:37.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.070+0000 7fcab5126980 1 -- 172.21.15.144:0/2985910714 wait complete. 2024-09-13T19:34:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab5126980 1 Processor -- start 2024-09-13T19:34:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab5126980 1 -- start start 2024-09-13T19:34:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab5126980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a88c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab5126980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a9a648200 con 0x559a9a711690 2024-09-13T19:34:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab2c36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a88c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab2c36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a88c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35032/0 (socket says 172.21.15.144:35032) 2024-09-13T19:34:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab2c36640 1 -- 172.21.15.144:0/4048399672 learned_addr learned my addr 172.21.15.144:0/4048399672 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab2c36640 1 -- 172.21.15.144:0/4048399672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9a88c950 con 0x559a9a711690 2024-09-13T19:34:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.086+0000 7fcab2c36640 1 --2- 172.21.15.144:0/4048399672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a88c380 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4001e50 tx=0x7fcaa4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e7632630a27886 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fc9a0e09640 1 -- 172.21.15.144:0/4048399672 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa400e5d0 con 0x559a9a711690 2024-09-13T19:34:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fc9a0e09640 1 -- 172.21.15.144:0/4048399672 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa400e770 con 0x559a9a711690 2024-09-13T19:34:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fc9a0e09640 1 -- 172.21.15.144:0/4048399672 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa400eab0 con 0x559a9a711690 2024-09-13T19:34:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- 172.21.15.144:0/4048399672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 msgr2=0x559a9a88c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 --2- 172.21.15.144:0/4048399672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a88c380 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4001e50 tx=0x7fcaa4001e80 comp rx=0 tx=0).stop 2024-09-13T19:34:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- 172.21.15.144:0/4048399672 shutdown_connections 2024-09-13T19:34:37.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 --2- 172.21.15.144:0/4048399672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a88c380 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- 172.21.15.144:0/4048399672 >> 172.21.15.144:0/4048399672 conn(0x559a9a710240 msgr2=0x559a9a887fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- 172.21.15.144:0/4048399672 shutdown_connections 2024-09-13T19:34:37.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- 172.21.15.144:0/4048399672 wait complete. 2024-09-13T19:34:37.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 Processor -- start 2024-09-13T19:34:37.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- start start 2024-09-13T19:34:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a8936d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a9a7aa930 con 0x559a9a711690 2024-09-13T19:34:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab2c36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a8936d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab2c36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a8936d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35048/0 (socket says 172.21.15.144:35048) 2024-09-13T19:34:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab2c36640 1 -- 172.21.15.144:0/577696456 learned_addr learned my addr 172.21.15.144:0/577696456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab2c36640 1 -- 172.21.15.144:0/577696456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9a893c10 con 0x559a9a711690 2024-09-13T19:34:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab2c36640 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a8936d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x559a9a88d560 tx=0x7fcaa4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fc99f606640 1 -- 172.21.15.144:0/577696456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa4001260 con 0x559a9a711690 2024-09-13T19:34:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a9a893ea0 con 0x559a9a711690 2024-09-13T19:34:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fc99f606640 1 -- 172.21.15.144:0/577696456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa400fa40 con 0x559a9a711690 2024-09-13T19:34:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fc99f606640 1 -- 172.21.15.144:0/577696456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaa400fd80 con 0x559a9a711690 2024-09-13T19:34:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.090+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9a896b80 con 0x559a9a711690 2024-09-13T19:34:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fc99f606640 1 -- 172.21.15.144:0/577696456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcaa4017070 con 0x559a9a711690 2024-09-13T19:34:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fc99f606640 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc998034650 0x7fc998036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fc99f606640 1 -- 172.21.15.144:0/577696456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fcaa4015020 con 0x559a9a711690 2024-09-13T19:34:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab2435640 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc998034650 0x7fc998036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a714a00 0x559a9a89a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a89ad10 con 0x559a9a714a00 2024-09-13T19:34:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab3437640 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a714a00 0x559a9a89a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab2435640 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc998034650 0x7fc998036b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80ae000 tx=0x7fcaa80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab3437640 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a714a00 0x559a9a89a6a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab3437640 1 -- 172.21.15.144:0/577696456 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcaac00a4d0 con 0x559a9a714a00 2024-09-13T19:34:37.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a897da0 con 0x559a9a714a00 2024-09-13T19:34:37.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab3437640 1 -- 172.21.15.144:0/577696456 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcaac00a4d0 con 0x559a9a714a00 2024-09-13T19:34:37.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a89d060 0x559a9a89f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a89fb20 con 0x559a9a89d060 2024-09-13T19:34:37.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab2c36640 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a89d060 0x559a9a89f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.094+0000 7fcab2c36640 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a89d060 0x559a9a89f450 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab2c36640 1 -- 172.21.15.144:0/577696456 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a89d060 2024-09-13T19:34:37.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a89bf00 con 0x559a9a714a00 2024-09-13T19:34:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab3437640 1 -- 172.21.15.144:0/577696456 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcaac00a4d0 con 0x559a9a714a00 2024-09-13T19:34:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a89c3f0 con 0x559a9a714a00 2024-09-13T19:34:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab3437640 1 -- 172.21.15.144:0/577696456 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcaac00a4d0 con 0x559a9a714a00 2024-09-13T19:34:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab5126980 1 Processor -- start 2024-09-13T19:34:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab5126980 1 -- start start 2024-09-13T19:34:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab5126980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8ae260 0x559a9a8ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab5126980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a9a6a1800 con 0x559a9a8ae260 2024-09-13T19:34:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab3437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8ae260 0x559a9a8ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab3437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8ae260 0x559a9a8ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35058/0 (socket says 172.21.15.144:35058) 2024-09-13T19:34:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab3437640 1 -- 172.21.15.144:0/977427815 learned_addr learned my addr 172.21.15.144:0/977427815 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab3437640 1 -- 172.21.15.144:0/977427815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9a8aebc0 con 0x559a9a8ae260 2024-09-13T19:34:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab3437640 1 --2- 172.21.15.144:0/977427815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8ae260 0x559a9a8ae680 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x559a9a894b00 tx=0x7fcaac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fc99ce01640 1 -- 172.21.15.144:0/977427815 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac014450 con 0x559a9a8ae260 2024-09-13T19:34:37.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab5126980 1 -- 172.21.15.144:0/977427815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a9a8aee50 con 0x559a9a8ae260 2024-09-13T19:34:37.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fc99ce01640 1 -- 172.21.15.144:0/977427815 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac0145f0 con 0x559a9a8ae260 2024-09-13T19:34:37.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fc99ce01640 1 -- 172.21.15.144:0/977427815 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac014910 con 0x559a9a8ae260 2024-09-13T19:34:37.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.098+0000 7fcab5126980 1 -- 172.21.15.144:0/977427815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9a8b1ad0 con 0x559a9a8ae260 2024-09-13T19:34:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fc99ce01640 1 -- 172.21.15.144:0/977427815 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcaac011040 con 0x559a9a8ae260 2024-09-13T19:34:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fc99ce01640 1 --2- 172.21.15.144:0/977427815 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc98c0346a0 0x7fc98c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fc99ce01640 1 -- 172.21.15.144:0/977427815 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fcaac01e070 con 0x559a9a8ae260 2024-09-13T19:34:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab2c36640 1 --2- 172.21.15.144:0/977427815 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc98c0346a0 0x7fc98c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab5126980 1 Processor -- start 2024-09-13T19:34:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab5126980 1 -- start start 2024-09-13T19:34:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab2c36640 1 --2- 172.21.15.144:0/977427815 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc98c0346a0 0x7fc98c036b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559a9a89b1b0 tx=0x7fcaa4048e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab5126980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab5126980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a9a88ccd0 con 0x559a9a8bad60 2024-09-13T19:34:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab3437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab3437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8bb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35070/0 (socket says 172.21.15.144:35070) 2024-09-13T19:34:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab3437640 1 -- 172.21.15.144:0/1163571933 learned_addr learned my addr 172.21.15.144:0/1163571933 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab3437640 1 -- 172.21.15.144:0/1163571933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9a8bb710 con 0x559a9a8bad60 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fcab3437640 1 --2- 172.21.15.144:0/1163571933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8bb140 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcaac018430 tx=0x7fcaac011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4896eb3c3638688 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fc9967fc640 1 -- 172.21.15.144:0/1163571933 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac03f020 con 0x559a9a8bad60 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fc9967fc640 1 -- 172.21.15.144:0/1163571933 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac03ac80 con 0x559a9a8bad60 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.102+0000 7fc9967fc640 1 -- 172.21.15.144:0/1163571933 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac0433b0 con 0x559a9a8bad60 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- 172.21.15.144:0/1163571933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 msgr2=0x559a9a8bb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 --2- 172.21.15.144:0/1163571933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8bb140 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcaac018430 tx=0x7fcaac011f90 comp rx=0 tx=0).stop 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- 172.21.15.144:0/1163571933 shutdown_connections 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 --2- 172.21.15.144:0/1163571933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8bb140 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- 172.21.15.144:0/1163571933 >> 172.21.15.144:0/1163571933 conn(0x559a9a8b7140 msgr2=0x559a9a8b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- 172.21.15.144:0/1163571933 shutdown_connections 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- 172.21.15.144:0/1163571933 wait complete. 2024-09-13T19:34:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 Processor -- start 2024-09-13T19:34:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- start start 2024-09-13T19:34:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a9a8bbd30 con 0x559a9a8bad60 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab3437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab3437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8c20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35082/0 (socket says 172.21.15.144:35082) 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 learned_addr learned my addr 172.21.15.144:0/1752360273 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9a8c2630 con 0x559a9a8bad60 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab3437640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8c20f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcaac02bfd0 tx=0x7fcaac04a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fc994ff9640 1 -- 172.21.15.144:0/1752360273 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac011c00 con 0x559a9a8bad60 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fc994ff9640 1 -- 172.21.15.144:0/1752360273 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac016940 con 0x559a9a8bad60 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a9a8c28c0 con 0x559a9a8bad60 2024-09-13T19:34:37.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fc994ff9640 1 -- 172.21.15.144:0/1752360273 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac03a070 con 0x559a9a8bad60 2024-09-13T19:34:37.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9a8c55a0 con 0x559a9a8bad60 2024-09-13T19:34:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fc994ff9640 1 -- 172.21.15.144:0/1752360273 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcaac042020 con 0x559a9a8bad60 2024-09-13T19:34:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fc994ff9640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc97c034650 0x7fc97c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.106+0000 7fc994ff9640 1 -- 172.21.15.144:0/1752360273 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fcaac034070 con 0x559a9a8bad60 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab2c36640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc97c034650 0x7fc97c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a8cd740 0x559a9a8cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d0350 con 0x559a9a8cd740 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab2435640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a8cd740 0x559a9a8cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab2c36640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc97c034650 0x7fc97c036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40178c0 tx=0x7fcaa4036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab2435640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a8cd740 0x559a9a8cfc00 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 realm 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d0780 con 0x559a9a8cd740 2024-09-13T19:34:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d1050 con 0x559a9a8cd740 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d13f0 con 0x559a9a8cd740 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a8d2150 0x559a9a8d4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d4b50 con 0x559a9a8d2150 2024-09-13T19:34:37.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab3437640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a8d2150 0x559a9a8d4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.110+0000 7fcab3437640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a8d2150 0x559a9a8d4540 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab5126980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab5126980 20 searching for the correct realm 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559a9a8d6a30 0x559a9a8d8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2c36640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559a9a8d6a30 0x559a9a8d8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2c36640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559a9a8d6a30 0x559a9a8d8e80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2c36640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcaa404bbd0 0x7fcaa4019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x7fcaa404bbd0 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcaa404bbd0 0x7fcaa4019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcaa404bbd0 0x7fcaa4019860 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d2150 2024-09-13T19:34:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.114+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d2150 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x7fcaa404bbd0 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d2150 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x7fcaa404bbd0 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.118+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d2150 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d2150 2024-09-13T19:34:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x7fcaa404bbd0 2024-09-13T19:34:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.122+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d2150 2024-09-13T19:34:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d2150 2024-09-13T19:34:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x7fcaa404bbd0 2024-09-13T19:34:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d6a30 2024-09-13T19:34:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8d2150 2024-09-13T19:34:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x559a9a8cd740 2024-09-13T19:34:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d9550 con 0x7fcaa404bbd0 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d54a0 con 0x559a9a8cd740 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.126+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d5890 con 0x559a9a8cd740 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d5890 con 0x559a9a8cd740 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 zone default found 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 4 Realm: () 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 zonegroup default 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8d5cb0 con 0x559a9a8d2150 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8db3b0 con 0x559a9a8d6a30 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8db870 con 0x559a9a8d6a30 2024-09-13T19:34:37.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 started sync module instance, tier type = 2024-09-13T19:34:37.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:37.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8da850 con 0x7fcaa404bbd0 2024-09-13T19:34:37.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94122506300752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8da850 con 0x7fcaa404bbd0 2024-09-13T19:34:37.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.130+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8dc330 con 0x559a9a8cd740 2024-09-13T19:34:37.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.134+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94122506300752] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.134+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.134+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94122506305088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8da850 con 0x559a9a8cd740 2024-09-13T19:34:37.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.134+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8dcd40 con 0x559a9a8d6a30 2024-09-13T19:34:37.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.134+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94122506307728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8dd590 con 0x559a9a8d6a30 2024-09-13T19:34:37.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ddf90 con 0x7fcaa404bbd0 2024-09-13T19:34:37.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94122506305088] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94122506298272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8de380 con 0x7fcaa404bbd0 2024-09-13T19:34:37.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ded40 con 0x559a9a8cd740 2024-09-13T19:34:37.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94122506307728] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94122506298272] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94122506312352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8de890 con 0x559a9a8cd740 2024-09-13T19:34:37.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.138+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8df0e0 con 0x559a9a8d2150 2024-09-13T19:34:37.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.142+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94122506312352] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.142+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.142+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94122506315920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8df160 con 0x559a9a8d2150 2024-09-13T19:34:37.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.142+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8df9b0 con 0x559a9a8d2150 2024-09-13T19:34:37.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94122506315920] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94122506318688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ded70 con 0x559a9a8d2150 2024-09-13T19:34:37.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8e03e0 con 0x559a9a8d2150 2024-09-13T19:34:37.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94122506318688] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94122506321616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8e03a0 con 0x559a9a8d2150 2024-09-13T19:34:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 20 add_watcher() i=0 2024-09-13T19:34:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 20 add_watcher() i=1 2024-09-13T19:34:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 20 add_watcher() i=2 2024-09-13T19:34:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 20 add_watcher() i=3 2024-09-13T19:34:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 20 add_watcher() i=4 2024-09-13T19:34:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 20 add_watcher() i=5 2024-09-13T19:34:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.146+0000 7fcab5126980 20 add_watcher() i=6 2024-09-13T19:34:37.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94122506321616] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab5126980 20 add_watcher() i=7 2024-09-13T19:34:37.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab5126980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:37.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8e3830 con 0x559a9a8cd740 2024-09-13T19:34:37.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94122506319872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8e0d50 con 0x559a9a8cd740 2024-09-13T19:34:37.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94122506319872] v32'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fc9697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:37.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab5126980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:37.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab5126980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:37.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.150+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8e34d0 con 0x559a9a8cd740 2024-09-13T19:34:37.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.154+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.154+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ec8a0 con 0x559a9a8d2150 2024-09-13T19:34:37.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.154+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.154+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ec8a0 con 0x559a9a8d6a30 2024-09-13T19:34:37.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.158+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.158+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ed0f0 con 0x559a9a8cd740 2024-09-13T19:34:37.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.158+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'219 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.158+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ebf10 con 0x7fcaa404bbd0 2024-09-13T19:34:37.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.158+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'68 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.158+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ebf10 con 0x559a9a8d6a30 2024-09-13T19:34:37.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.162+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.162+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edc50 con 0x559a9a8cd740 2024-09-13T19:34:37.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.162+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.162+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edc50 con 0x559a9a8d2150 2024-09-13T19:34:37.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.166+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.166+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edc50 con 0x7fcaa404bbd0 2024-09-13T19:34:37.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.166+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.166+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edce0 con 0x559a9a8d6a30 2024-09-13T19:34:37.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.170+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.170+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edd70 con 0x7fcaa404bbd0 2024-09-13T19:34:37.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.170+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'69 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.170+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edd70 con 0x559a9a8d2150 2024-09-13T19:34:37.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.174+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.174+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ede00 con 0x7fcaa404bbd0 2024-09-13T19:34:37.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.174+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.174+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ede00 con 0x559a9a8d2150 2024-09-13T19:34:37.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.178+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.178+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8cd740 2024-09-13T19:34:37.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.178+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'220 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.178+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d6a30 2024-09-13T19:34:37.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.178+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.178+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ede90 con 0x7fcaa404bbd0 2024-09-13T19:34:37.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.182+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'70 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.182+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d6a30 2024-09-13T19:34:37.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.182+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.182+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8cd740 2024-09-13T19:34:37.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.186+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.186+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8cd740 2024-09-13T19:34:37.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.186+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'221 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.186+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d6a30 2024-09-13T19:34:37.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.190+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.190+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.190+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.190+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d6a30 2024-09-13T19:34:37.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.190+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.190+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d6a30 2024-09-13T19:34:37.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.194+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.194+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d6a30 2024-09-13T19:34:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.194+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.194+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edef0 con 0x559a9a8d6a30 2024-09-13T19:34:37.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.194+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.194+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edef0 con 0x559a9a8d2150 2024-09-13T19:34:37.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.198+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.198+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ede90 con 0x559a9a8d6a30 2024-09-13T19:34:37.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.198+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.198+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d2150 2024-09-13T19:34:37.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.202+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.202+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d6a30 2024-09-13T19:34:37.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.202+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.202+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x559a9a8d2150 2024-09-13T19:34:37.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.206+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.206+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8edec0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fc8e3fff640 20 reqs_thread_entry: start 2024-09-13T19:34:37.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:37.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 20 Filter name: none 2024-09-13T19:34:37.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fc8e1ffb640 20 reqs_thread_entry: start 2024-09-13T19:34:37.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:34:37.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8eb2f0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a90bc70 con 0x559a9a8cd740 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 : miss 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:96 8.d 8:b65bc6ed:root::.bucket.meta.myfoo6%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a90b900 con 0x7fcaa404bbd0 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(96 .bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:34:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 info.flags=0x17 2024-09-13T19:34:37.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 to cache LRU end 2024-09-13T19:34:37.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:34:37.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:34:37.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 2024-09-13T19:34:37.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:97 4.11 4:8ab76a2e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988e30 con 0x559a9a8d2150 2024-09-13T19:34:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(97 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 4.18 4:1b22e554:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988e30 con 0x7fcaa404bbd0 2024-09-13T19:34:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(98 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.210+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 4.12 4:4996c341:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988e30 con 0x559a9a8cd740 2024-09-13T19:34:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(99 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:100 4.3e 4:7ca2fcd7:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988e30 con 0x7fcaa404bbd0 2024-09-13T19:34:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(100 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 4.26 4:6704a741:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988db0 con 0x559a9a8d2150 2024-09-13T19:34:37.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(101 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 4.21 4:865a7eae:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988df0 con 0x559a9a8d2150 2024-09-13T19:34:37.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(102 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:103 4.19 4:9b96777a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988df0 con 0x559a9a8d6a30 2024-09-13T19:34:37.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(103 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.214+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:104 4.2d 4:b49abd4e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988df0 con 0x559a9a8d2150 2024-09-13T19:34:37.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(104 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac04b040 con 0x559a9a8d2150 2024-09-13T19:34:37.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:105 4.39 4:9c7ec48a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988e30 con 0x559a9a8d2150 2024-09-13T19:34:37.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(105 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac06a060 con 0x559a9a8d2150 2024-09-13T19:34:37.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:106 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988e30 con 0x7fcaa404bbd0 2024-09-13T19:34:37.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(106 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [call out=345b] v0'0 uv5 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 10 cls_bucket_list_unordered: got thirteen 2024-09-13T19:34:37.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:107 4.35 4:ae52eb76:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a988e30 con 0x559a9a8cd740 2024-09-13T19:34:37.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(107 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 20 get_obj_state: octx=0x7fcaa80c7040 obj=myfoo6:thirteen state=0x559a9a986eb8 s->prefetch_data=0 2024-09-13T19:34:37.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:108 3.1b 3:db2a3de6:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a987ce0 con 0x559a9a8d6a30 2024-09-13T19:34:37.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(108 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 10 manifest: total_size = 8 2024-09-13T19:34:37.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 20 get_obj_state: setting s->obj_tag to _WL3ti4N83Ttx4ZY1N5mqXRPTdQKpZ8d 2024-09-13T19:34:37.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 20 get_obj_state: octx=0x7fcaa80c7040 obj=myfoo6:thirteen state=0x559a9a986eb8 s->prefetch_data=0 2024-09-13T19:34:37.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 20 prepare_atomic_modification: state is not atomic. state=0x559a9a986eb8 2024-09-13T19:34:37.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 2024-09-13T19:34:37.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.218+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:109 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9885a0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(109 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:110 3.1b 3:db2a3de6:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9885a0 con 0x559a9a8d6a30 2024-09-13T19:34:37.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(110 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9_thirteen [call] v32'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:111 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9104b0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 20 list_objects_ordered: starting attempt 1 2024-09-13T19:34:37.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:34:37.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:112 4.11 4:8ab76a2e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9104b0 con 0x559a9a8d2150 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:113 4.18 4:1b22e554:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a914780 con 0x7fcaa404bbd0 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:114 4.12 4:4996c341:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9104b0 con 0x559a9a8cd740 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:115 4.3e 4:7ca2fcd7:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9195b0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:116 4.26 4:6704a741:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a91bf10 con 0x559a9a8d2150 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:117 4.21 4:865a7eae:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a91e9e0 con 0x559a9a8d2150 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:118 4.19 4:9b96777a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9195b0 con 0x559a9a8d6a30 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:119 4.2d 4:b49abd4e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a91bf10 con 0x559a9a8d2150 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:120 4.39 4:9c7ec48a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a91bf10 con 0x559a9a8d2150 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:121 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a928570 con 0x7fcaa404bbd0 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:122 4.35 4:ae52eb76:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92af60 con 0x559a9a8cd740 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(114 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(115 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(118 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(113 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(122 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.222+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(116 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac06a060 con 0x559a9a8d2150 2024-09-13T19:34:37.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(119 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac06a060 con 0x559a9a8d2150 2024-09-13T19:34:37.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== osd_op_reply(112 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac06a060 con 0x559a9a8d2150 2024-09-13T19:34:37.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(117 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac06a060 con 0x559a9a8d2150 2024-09-13T19:34:37.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(120 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac06a060 con 0x559a9a8d2150 2024-09-13T19:34:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== osd_op_reply(111 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fc9967fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T19:34:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== osd_op_reply(121 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:34:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:34:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9])"; uploads.size()=0; is_truncated=0 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:123 4.11 4:8ab76a2e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a919610 con 0x559a9a8d2150 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:124 4.18 4:1b22e554:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92af60 con 0x7fcaa404bbd0 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:125 4.12 4:4996c341:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a929ed0 con 0x559a9a8cd740 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:126 4.3e 4:7ca2fcd7:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a919610 con 0x7fcaa404bbd0 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:127 4.26 4:6704a741:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92af60 con 0x559a9a8d2150 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:128 4.21 4:865a7eae:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a919610 con 0x559a9a8d2150 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:129 4.19 4:9b96777a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92a2b0 con 0x559a9a8d6a30 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:130 4.2d 4:b49abd4e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92ab80 con 0x559a9a8d2150 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:131 4.39 4:9c7ec48a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92af60 con 0x559a9a8d2150 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:132 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a929ed0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:133 4.35 4:ae52eb76:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92ab80 con 0x559a9a8cd740 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(125 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(133 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(124 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== osd_op_reply(126 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== osd_op_reply(132 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== osd_op_reply(123 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(127 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(129 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== osd_op_reply(131 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(128 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(130 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9289f0 con 0x559a9a8cd740 2024-09-13T19:34:37.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(134 bud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T19:34:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.226+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a91af00 con 0x559a9a8cd740 2024-09-13T19:34:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 37 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab5126980 20 rados_obj.operate() r=0 bl.length=166 2024-09-13T19:34:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab5126980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-13T19:34:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab5126980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:34:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92aa10 con 0x559a9a8cd740 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 38 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab5126980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab5126980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94122506623488 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92a2d0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== watch-notify(notify (1) cookie 94122506298272 notify 137438953513 ret 0) ==== 192+0+0 (crc 0 0 0) 0x559a9a90ae30 con 0x7fcaa404bbd0 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fc995ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94122506298272 notifier 4748 bl.length()=150 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fc995ffb640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc8e80032d0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(137 notify.3 [notify cookie 94122506623488 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 34 ==== watch-notify(notify_complete (2) cookie 94122506623488 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a9a8eb890 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.230+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:139 8.d 8:b65bc6ed:root::.bucket.meta.myfoo6%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92aa10 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 35 ==== osd_op_reply(139 .bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 from cache 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9, ofs0, ns] 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94122506500208 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a929eb0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 36 ==== watch-notify(notify (1) cookie 94122506298272 notify 137438953514 ret 0) ==== 249+0+0 (crc 0 0 0) 0x559a9a8eb890 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fc9967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94122506298272 notifier 4748 bl.length()=207 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 37 ==== osd_op_reply(140 notify.3 [notify cookie 94122506500208 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fc9967fc640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc978003d70 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 38 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 39 ==== watch-notify(notify_complete (2) cookie 94122506500208 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a9a8e3450 con 0x7fcaa404bbd0 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:142 4.11 4:8ab76a2e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a909e00 con 0x559a9a8d2150 2024-09-13T19:34:37.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:143 4.18 4:1b22e554:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a90a650 con 0x7fcaa404bbd0 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:144 4.12 4:4996c341:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a909e00 con 0x559a9a8cd740 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:145 4.3e 4:7ca2fcd7:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9292e0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:146 4.26 4:6704a741:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a90a650 con 0x559a9a8d2150 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:147 4.21 4:865a7eae:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a909e00 con 0x559a9a8d2150 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:148 4.19 4:9b96777a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9292e0 con 0x559a9a8d6a30 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:149 4.2d 4:b49abd4e:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a90a650 con 0x559a9a8d2150 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:150 4.39 4:9c7ec48a:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9292e0 con 0x559a9a8d2150 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:151 4.b 4:d0574010:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a909e00 con 0x7fcaa404bbd0 2024-09-13T19:34:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:152 4.35 4:ae52eb76:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a90a650 con 0x559a9a8cd740 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.234+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 39 ==== osd_op_reply(144 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.2 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 40 ==== osd_op_reply(145 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.3 [delete] v32'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 41 ==== osd_op_reply(143 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.1 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(142 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.0 [delete] v32'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(149 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.7 [delete] v32'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 41 ==== osd_op_reply(146 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.4 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 42 ==== osd_op_reply(147 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.5 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 42 ==== osd_op_reply(151 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.9 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 40 ==== osd_op_reply(152 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.10 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== osd_op_reply(148 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.6 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 43 ==== osd_op_reply(150 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9.8 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab5126980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 : miss 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab5126980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:153 6.14 6:2dfa0c8c:::pubsub..bucket.myfoo6%2fc35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9292e0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 43 ==== osd_op_reply(153 pubsub..bucket.myfoo6/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab5126980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab5126980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 info.flags=0x0 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab5126980 10 adding default.rgw.log++pubsub..bucket.myfoo6/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 to cache LRU end 2024-09-13T19:34:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:154 6.14 6:2dfa0c8c:::pubsub..bucket.myfoo6%2fc35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a90aa70 con 0x7fcaa404bbd0 2024-09-13T19:34:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 44 ==== osd_op_reply(154 pubsub..bucket.myfoo6/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.9 [delete] v32'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.238+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92a9a0 con 0x559a9a8cd740 2024-09-13T19:34:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 41 ==== osd_op_reply(155 bud.buckets [call] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab5126980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-13T19:34:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9097a0 con 0x559a9a8cd740 2024-09-13T19:34:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 42 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab5126980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:34:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94122506500208 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a929990 con 0x559a9a8d2150 2024-09-13T19:34:37.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 44 ==== watch-notify(notify (1) cookie 94122506315920 notify 137438953495 ret 0) ==== 212+0+0 (crc 0 0 0) 0x559a9a8ec540 con 0x559a9a8d2150 2024-09-13T19:34:37.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fc9967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94122506315920 notifier 4748 bl.length()=170 2024-09-13T19:34:37.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fc9967fc640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc978003d70 con 0x559a9a8d2150 2024-09-13T19:34:37.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 45 ==== osd_op_reply(157 notify.5 [notify cookie 94122506500208 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 46 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.242+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 47 ==== watch-notify(notify_complete (2) cookie 94122506500208 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a9a8c28c0 con 0x559a9a8d2150 2024-09-13T19:34:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab5126980 10 removing email index: 2024-09-13T19:34:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab5126980 10 removing user buckets index 2024-09-13T19:34:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a9097a0 con 0x559a9a8cd740 2024-09-13T19:34:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 43 ==== osd_op_reply(159 bud.buckets [delete] v32'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab5126980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-13T19:34:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94122506500208 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a929990 con 0x559a9a8d2150 2024-09-13T19:34:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 48 ==== watch-notify(notify (1) cookie 94122506318688 notify 137438953496 ret 0) ==== 202+0+0 (crc 0 0 0) 0x559a9a8c28c0 con 0x559a9a8d2150 2024-09-13T19:34:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fc995ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94122506318688 notifier 4748 bl.length()=160 2024-09-13T19:34:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fc995ffb640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc8e80032b0 con 0x559a9a8d2150 2024-09-13T19:34:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 49 ==== osd_op_reply(160 notify.6 [notify cookie 94122506500208 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 50 ==== watch-notify(notify_complete (2) cookie 94122506500208 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a9a8c2630 con 0x559a9a8d2150 2024-09-13T19:34:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 51 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab5126980 10 removing user index: bud 2024-09-13T19:34:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.246+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a92a9a0 con 0x7fcaa404bbd0 2024-09-13T19:34:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 45 ==== osd_op_reply(162 bud [call,call,delete] v32'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fcab5126980 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-13T19:34:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fcab5126980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:34:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94122506500208 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a9a928980 con 0x559a9a8d2150 2024-09-13T19:34:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 52 ==== watch-notify(notify (1) cookie 94122506315920 notify 137438953497 ret 0) ==== 194+0+0 (crc 0 0 0) 0x559a9a8c2630 con 0x559a9a8d2150 2024-09-13T19:34:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fc9967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94122506315920 notifier 4748 bl.length()=152 2024-09-13T19:34:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fc9967fc640 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc978003d70 con 0x559a9a8d2150 2024-09-13T19:34:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 53 ==== osd_op_reply(163 notify.5 [notify cookie 94122506500208 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 54 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.250+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 55 ==== watch-notify(notify_complete (2) cookie 94122506500208 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a9a8bb710 con 0x559a9a8d2150 2024-09-13T19:34:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.254+0000 7fc9697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.254+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94122506319872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x559a9a8cd740 2024-09-13T19:34:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.254+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 44 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94122506319872] v32'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.254+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94122506300752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x7fcaa404bbd0 2024-09-13T19:34:37.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.254+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 46 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94122506300752] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.254+0000 7fcab5126980 20 remove_watcher() i=0 2024-09-13T19:34:37.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.254+0000 7fcab5126980 2 removed watcher, disabling cache 2024-09-13T19:34:37.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.254+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94122506305088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x559a9a8cd740 2024-09-13T19:34:37.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.258+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 45 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94122506305088] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.258+0000 7fcab5126980 20 remove_watcher() i=1 2024-09-13T19:34:37.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.258+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94122506307728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x559a9a8d6a30 2024-09-13T19:34:37.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.258+0000 7fcab2c36640 1 -- 172.21.15.144:0/1752360273 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94122506307728] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa402e070 con 0x559a9a8d6a30 2024-09-13T19:34:37.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.258+0000 7fcab5126980 20 remove_watcher() i=2 2024-09-13T19:34:37.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.258+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94122506298272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x7fcaa404bbd0 2024-09-13T19:34:37.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.262+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.2 v2:172.21.15.144:6816/2341760841 47 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94122506298272] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x7fcaa404bbd0 2024-09-13T19:34:37.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.262+0000 7fcab5126980 20 remove_watcher() i=3 2024-09-13T19:34:37.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.262+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94122506312352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x559a9a8cd740 2024-09-13T19:34:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.262+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 <== osd.1 v2:172.21.15.144:6808/3556169889 46 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94122506312352] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa80b4040 con 0x559a9a8cd740 2024-09-13T19:34:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.262+0000 7fcab5126980 20 remove_watcher() i=4 2024-09-13T19:34:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.262+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94122506315920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x559a9a8d2150 2024-09-13T19:34:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.266+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 56 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94122506315920] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.266+0000 7fcab5126980 20 remove_watcher() i=5 2024-09-13T19:34:37.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.266+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94122506318688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x559a9a8d2150 2024-09-13T19:34:37.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.266+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 57 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94122506318688] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.266+0000 7fcab5126980 20 remove_watcher() i=6 2024-09-13T19:34:37.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.266+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94122506321616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a9a8ece70 con 0x559a9a8d2150 2024-09-13T19:34:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab3437640 1 -- 172.21.15.144:0/1752360273 <== osd.0 v2:172.21.15.18:6800/2700511246 58 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94122506321616] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac073040 con 0x559a9a8d2150 2024-09-13T19:34:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 20 remove_watcher() i=7 2024-09-13T19:34:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a8d2150 msgr2=0x559a9a8d4540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a8d2150 0x559a9a8d4540 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a8cd740 msgr2=0x559a9a8cfc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a8cd740 0x559a9a8cfc00 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcaa404bbd0 msgr2=0x7fcaa4019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcaa404bbd0 0x7fcaa4019860 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559a9a8d6a30 msgr2=0x559a9a8d8e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559a9a8d6a30 0x559a9a8d8e80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc97c034650 msgr2=0x7fc97c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc97c034650 0x7fc97c036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40178c0 tx=0x7fcaa4036000 comp rx=0 tx=0).stop 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 msgr2=0x559a9a8c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab2435640 1 -- 172.21.15.144:0/1752360273 reap_dead start 2024-09-13T19:34:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8c20f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcaac02bfd0 tx=0x7fcaac04a0b0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 shutdown_connections 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/1752360273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8bad60 0x559a9a8c20f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 >> 172.21.15.144:0/1752360273 conn(0x559a9a8b7140 msgr2=0x559a9a8b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 shutdown_connections 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/1752360273 wait complete. 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/977427815 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc98c0346a0 msgr2=0x7fc98c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/977427815 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc98c0346a0 0x7fc98c036b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559a9a89b1b0 tx=0x7fcaa4048e10 comp rx=0 tx=0).stop 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/977427815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8ae260 msgr2=0x559a9a8ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/977427815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8ae260 0x559a9a8ae680 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x559a9a894b00 tx=0x7fcaac018830 comp rx=0 tx=0).stop 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/977427815 shutdown_connections 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/977427815 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc98c0346a0 0x7fc98c036b60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/977427815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a8ae260 0x559a9a8ae680 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/977427815 >> 172.21.15.144:0/977427815 conn(0x559a9a8a33b0 msgr2=0x559a9a8a5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/977427815 shutdown_connections 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/977427815 wait complete. 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a89d060 msgr2=0x559a9a89f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a89d060 0x559a9a89f450 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a714a00 msgr2=0x559a9a89a6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a714a00 0x559a9a89a6a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc998034650 msgr2=0x7fc998036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc998034650 0x7fc998036b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80ae000 tx=0x7fcaa80a6000 comp rx=0 tx=0).stop 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 msgr2=0x559a9a8936d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a8936d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x559a9a88d560 tx=0x7fcaa4000bd0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 shutdown_connections 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559a9a714a00 0x559a9a89a6a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559a9a89d060 0x559a9a89f450 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc998034650 0x7fc998036b10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 --2- 172.21.15.144:0/577696456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a9a711690 0x559a9a8936d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 >> 172.21.15.144:0/577696456 conn(0x559a9a710240 msgr2=0x559a9a886b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 shutdown_connections 2024-09-13T19:34:37.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.270+0000 7fcab5126980 1 -- 172.21.15.144:0/577696456 wait complete. 2024-09-13T19:34:37.287 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T19:34:37.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T19:34:37.288 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-13T19:34:37.361 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:34:37.361 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:34:37.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b7b970980 1 Processor -- start 2024-09-13T19:34:37.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b7b970980 1 -- start start 2024-09-13T19:34:37.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b7b970980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560bb2f0de00 0x560bb2f101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b7b970980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560bb2d93ae0 con 0x560bb2f10760 2024-09-13T19:34:37.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b7b970980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x560bb2db7e30 con 0x560bb2f0de00 2024-09-13T19:34:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b79480640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560bb2f0de00 0x560bb2f101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b79480640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560bb2f0de00 0x560bb2f101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35090/0 (socket says 172.21.15.144:35090) 2024-09-13T19:34:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b78c7f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x560bb2f10760 0x560bb2f12b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:37872/0 (socket says 172.21.15.144:37872) 2024-09-13T19:34:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b79480640 1 -- 172.21.15.144:0/2885666330 learned_addr learned my addr 172.21.15.144:0/2885666330 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b79480640 1 -- 172.21.15.144:0/2885666330 >> v1:172.21.15.18:6789/0 conn(0x560bb2f10760 legacy=0x560bb2f12b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.358+0000 7f5b79480640 1 -- 172.21.15.144:0/2885666330 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb2f15400 con 0x560bb2f0de00 2024-09-13T19:34:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b79480640 1 --2- 172.21.15.144:0/2885666330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2f101f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00a5c0 tx=0x7f5b6c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d086b0a3336b690 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b6bfff640 1 -- 172.21.15.144:0/2885666330 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6c0a6070 con 0x560bb2f0de00 2024-09-13T19:34:37.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b6bfff640 1 -- 172.21.15.144:0/2885666330 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0af070 con 0x560bb2f0de00 2024-09-13T19:34:37.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b6bfff640 1 -- 172.21.15.144:0/2885666330 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6c0aa5c0 con 0x560bb2f0de00 2024-09-13T19:34:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b7b970980 1 -- 172.21.15.144:0/2885666330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 msgr2=0x560bb2f101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b7b970980 1 --2- 172.21.15.144:0/2885666330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2f101f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00a5c0 tx=0x7f5b6c01b340 comp rx=0 tx=0).stop 2024-09-13T19:34:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b7b970980 1 -- 172.21.15.144:0/2885666330 shutdown_connections 2024-09-13T19:34:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b7b970980 1 --2- 172.21.15.144:0/2885666330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2f101f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b7b970980 1 -- 172.21.15.144:0/2885666330 >> 172.21.15.144:0/2885666330 conn(0x560bb2e81290 msgr2=0x560bb2e816a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b7b970980 1 -- 172.21.15.144:0/2885666330 shutdown_connections 2024-09-13T19:34:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.362+0000 7f5b7b970980 1 -- 172.21.15.144:0/2885666330 wait complete. 2024-09-13T19:34:37.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b7b970980 1 Processor -- start 2024-09-13T19:34:37.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b7b970980 1 -- start start 2024-09-13T19:34:37.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b7b970980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2ff8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b7b970980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bb2db9200 con 0x560bb2f0de00 2024-09-13T19:34:37.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b79480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2ff8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b79480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2ff8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35100/0 (socket says 172.21.15.144:35100) 2024-09-13T19:34:37.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b79480640 1 -- 172.21.15.144:0/1011370004 learned_addr learned my addr 172.21.15.144:0/1011370004 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b79480640 1 -- 172.21.15.144:0/1011370004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb2ff9290 con 0x560bb2f0de00 2024-09-13T19:34:37.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.378+0000 7f5b79480640 1 --2- 172.21.15.144:0/1011370004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2ff8cc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0199f0 tx=0x7f5b6c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e661996e89bfb12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5a67606640 1 -- 172.21.15.144:0/1011370004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6c0aaa00 con 0x560bb2f0de00 2024-09-13T19:34:37.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5a67606640 1 -- 172.21.15.144:0/1011370004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0aaba0 con 0x560bb2f0de00 2024-09-13T19:34:37.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5a67606640 1 -- 172.21.15.144:0/1011370004 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6c0bd3f0 con 0x560bb2f0de00 2024-09-13T19:34:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- 172.21.15.144:0/1011370004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 msgr2=0x560bb2ff8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1011370004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2ff8cc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0199f0 tx=0x7f5b6c003030 comp rx=0 tx=0).stop 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- 172.21.15.144:0/1011370004 shutdown_connections 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1011370004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f0de00 0x560bb2ff8cc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- 172.21.15.144:0/1011370004 >> 172.21.15.144:0/1011370004 conn(0x560bb2e81290 msgr2=0x560bb2ff48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- 172.21.15.144:0/1011370004 shutdown_connections 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- 172.21.15.144:0/1011370004 wait complete. 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 Processor -- start 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- start start 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f10760 0x560bb3000020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bb2f14e40 con 0x560bb2f10760 2024-09-13T19:34:37.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b79480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f10760 0x560bb3000020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b79480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f10760 0x560bb3000020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35116/0 (socket says 172.21.15.144:35116) 2024-09-13T19:34:37.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b79480640 1 -- 172.21.15.144:0/948274647 learned_addr learned my addr 172.21.15.144:0/948274647 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b79480640 1 -- 172.21.15.144:0/948274647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb3000560 con 0x560bb2f10760 2024-09-13T19:34:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b79480640 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f10760 0x560bb3000020 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0199f0 tx=0x7f5b6c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5a65e03640 1 -- 172.21.15.144:0/948274647 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6c0c6690 con 0x560bb2f10760 2024-09-13T19:34:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5a65e03640 1 -- 172.21.15.144:0/948274647 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0c6830 con 0x560bb2f10760 2024-09-13T19:34:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bb30007f0 con 0x560bb2f10760 2024-09-13T19:34:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5a65e03640 1 -- 172.21.15.144:0/948274647 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6c0c6b10 con 0x560bb2f10760 2024-09-13T19:34:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.382+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb30034d0 con 0x560bb2f10760 2024-09-13T19:34:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5a65e03640 1 -- 172.21.15.144:0/948274647 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b6c0ce020 con 0x560bb2f10760 2024-09-13T19:34:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5a65e03640 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a60034650 0x7f5a60036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5a65e03640 1 -- 172.21.15.144:0/948274647 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5b6c0cc020 con 0x560bb2f10760 2024-09-13T19:34:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b78c7f640 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a60034650 0x7f5a60036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb3004fa0 0x560bb3007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30079e0 con 0x560bb3004fa0 2024-09-13T19:34:37.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b79c81640 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb3004fa0 0x560bb3007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b78c7f640 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a60034650 0x7f5a60036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b70000f70 tx=0x7f5b70001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b79c81640 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb3004fa0 0x560bb3007390 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b79c81640 1 -- 172.21.15.144:0/948274647 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7400a4d0 con 0x560bb3004fa0 2024-09-13T19:34:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30046f0 con 0x560bb3004fa0 2024-09-13T19:34:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b79c81640 1 -- 172.21.15.144:0/948274647 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b7400a4d0 con 0x560bb3004fa0 2024-09-13T19:34:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb3009d80 0x560bb300c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb300c840 con 0x560bb3009d80 2024-09-13T19:34:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b79480640 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb3009d80 0x560bb300c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b79480640 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb3009d80 0x560bb300c170 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.386+0000 7f5b79480640 1 -- 172.21.15.144:0/948274647 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3009d80 2024-09-13T19:34:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3008bf0 con 0x560bb3004fa0 2024-09-13T19:34:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b79c81640 1 -- 172.21.15.144:0/948274647 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b7400a4d0 con 0x560bb3004fa0 2024-09-13T19:34:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30090d0 con 0x560bb3004fa0 2024-09-13T19:34:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b79c81640 1 -- 172.21.15.144:0/948274647 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b7400a4d0 con 0x560bb3004fa0 2024-09-13T19:34:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b7b970980 1 Processor -- start 2024-09-13T19:34:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b7b970980 1 -- start start 2024-09-13T19:34:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b7b970980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb301af40 0x560bb301b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b7b970980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bb2e12800 con 0x560bb301af40 2024-09-13T19:34:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b79c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb301af40 0x560bb301b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b79c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb301af40 0x560bb301b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35122/0 (socket says 172.21.15.144:35122) 2024-09-13T19:34:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b79c81640 1 -- 172.21.15.144:0/3478414950 learned_addr learned my addr 172.21.15.144:0/3478414950 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b79c81640 1 -- 172.21.15.144:0/3478414950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb301b8a0 con 0x560bb301af40 2024-09-13T19:34:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b79c81640 1 --2- 172.21.15.144:0/3478414950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb301af40 0x560bb301b360 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x560bb3000f20 tx=0x7f5b74018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5a5effd640 1 -- 172.21.15.144:0/3478414950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b74014450 con 0x560bb301af40 2024-09-13T19:34:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b7b970980 1 -- 172.21.15.144:0/3478414950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bb301bb30 con 0x560bb301af40 2024-09-13T19:34:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5a5effd640 1 -- 172.21.15.144:0/3478414950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b740145f0 con 0x560bb301af40 2024-09-13T19:34:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5a5effd640 1 -- 172.21.15.144:0/3478414950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b74014910 con 0x560bb301af40 2024-09-13T19:34:37.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.390+0000 7f5b7b970980 1 -- 172.21.15.144:0/3478414950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb301e7b0 con 0x560bb301af40 2024-09-13T19:34:37.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5a5effd640 1 -- 172.21.15.144:0/3478414950 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b74011040 con 0x560bb301af40 2024-09-13T19:34:37.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5a5effd640 1 --2- 172.21.15.144:0/3478414950 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a500346a0 0x7f5a50036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5a5effd640 1 -- 172.21.15.144:0/3478414950 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5b7401e070 con 0x560bb301af40 2024-09-13T19:34:37.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b79480640 1 --2- 172.21.15.144:0/3478414950 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a500346a0 0x7f5a50036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 Processor -- start 2024-09-13T19:34:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 -- start start 2024-09-13T19:34:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b79480640 1 --2- 172.21.15.144:0/3478414950 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a500346a0 0x7f5a50036b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0e3920 tx=0x7f5b6c0de040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb3027e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bb2ff9550 con 0x560bb3027a80 2024-09-13T19:34:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b79c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb3027e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b79c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb3027e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35136/0 (socket says 172.21.15.144:35136) 2024-09-13T19:34:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b79c81640 1 -- 172.21.15.144:0/4151268940 learned_addr learned my addr 172.21.15.144:0/4151268940 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b79c81640 1 -- 172.21.15.144:0/4151268940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb3028450 con 0x560bb3027a80 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b79c81640 1 --2- 172.21.15.144:0/4151268940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb3027e80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5b74049f80 tx=0x7f5b74013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304bfc2cd802a0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5a5cff9640 1 -- 172.21.15.144:0/4151268940 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b74028070 con 0x560bb3027a80 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5a5cff9640 1 -- 172.21.15.144:0/4151268940 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b74013e00 con 0x560bb3027a80 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5a5cff9640 1 -- 172.21.15.144:0/4151268940 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b74016930 con 0x560bb3027a80 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 -- 172.21.15.144:0/4151268940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 msgr2=0x560bb3027e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 --2- 172.21.15.144:0/4151268940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb3027e80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5b74049f80 tx=0x7f5b74013b70 comp rx=0 tx=0).stop 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 -- 172.21.15.144:0/4151268940 shutdown_connections 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 --2- 172.21.15.144:0/4151268940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb3027e80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 -- 172.21.15.144:0/4151268940 >> 172.21.15.144:0/4151268940 conn(0x560bb3023db0 msgr2=0x560bb3021eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 -- 172.21.15.144:0/4151268940 shutdown_connections 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 -- 172.21.15.144:0/4151268940 wait complete. 2024-09-13T19:34:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 Processor -- start 2024-09-13T19:34:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 -- start start 2024-09-13T19:34:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.394+0000 7f5b7b970980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb302edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b7b970980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bb3028a00 con 0x560bb3027a80 2024-09-13T19:34:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b79c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb302edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b79c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb302edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:35140/0 (socket says 172.21.15.144:35140) 2024-09-13T19:34:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 learned_addr learned my addr 172.21.15.144:0/1417592814 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:34:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb302f300 con 0x560bb3027a80 2024-09-13T19:34:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b79c81640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb302edc0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5b74011e10 tx=0x7f5b74049f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5a4effd640 1 -- 172.21.15.144:0/1417592814 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7402b350 con 0x560bb3027a80 2024-09-13T19:34:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bb302f590 con 0x560bb3027a80 2024-09-13T19:34:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5a4effd640 1 -- 172.21.15.144:0/1417592814 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7402b4f0 con 0x560bb3027a80 2024-09-13T19:34:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5a4effd640 1 -- 172.21.15.144:0/1417592814 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7402b810 con 0x560bb3027a80 2024-09-13T19:34:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb3032270 con 0x560bb3027a80 2024-09-13T19:34:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5a4effd640 1 -- 172.21.15.144:0/1417592814 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b7404b430 con 0x560bb3027a80 2024-09-13T19:34:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5a4effd640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a44034650 0x7f5a44036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5a4effd640 1 -- 172.21.15.144:0/1417592814 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5b74034030 con 0x560bb3027a80 2024-09-13T19:34:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b79480640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a44034650 0x7f5a44036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb303a420 0x560bb303c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb303d030 con 0x560bb303a420 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b78c7f640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb303a420 0x560bb303c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b79480640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a44034650 0x7f5a44036b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0c6fd0 tx=0x7f5b6c0ea000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.398+0000 7f5b78c7f640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb303a420 0x560bb303c8e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7000f620 con 0x560bb303a420 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 realm 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3039870 con 0x560bb303a420 2024-09-13T19:34:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7000f620 con 0x560bb303a420 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb303db30 con 0x560bb303a420 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7000f620 con 0x560bb303a420 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb303e400 con 0x560bb303a420 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b7000f620 con 0x560bb303a420 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb303ed40 0x560bb3041150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30418e0 con 0x560bb303ed40 2024-09-13T19:34:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b79c81640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb303ed40 0x560bb3041150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b79c81640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb303ed40 0x560bb3041150 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 20 searching for the correct realm 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560bb3043830 0x560bb3045c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb3043830 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b79480640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560bb3043830 0x560bb3045c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b79480640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560bb3043830 0x560bb3045c80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b79480640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560bb2f0de00 0x7f5b6c0e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb2f0de00 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.402+0000 7f5b78c7f640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560bb2f0de00 0x7f5b6c0e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560bb2f0de00 0x7f5b6c0e3990 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7000f620 con 0x560bb2f0de00 2024-09-13T19:34:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb303ed40 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb303a420 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5b7000f620 con 0x560bb303a420 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb303a420 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb303a420 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb303ed40 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb2f0de00 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb3043830 2024-09-13T19:34:37.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb303a420 2024-09-13T19:34:37.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.406+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb303ed40 2024-09-13T19:34:37.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb303a420 2024-09-13T19:34:37.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb2f0de00 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046350 con 0x560bb3043830 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb3043830 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303ed40 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb3043830 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb3043830 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303a420 2024-09-13T19:34:37.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303a420 2024-09-13T19:34:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303ed40 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb3043830 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.410+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb2f0de00 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303a420 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303ed40 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb3043830 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303ed40 2024-09-13T19:34:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb2f0de00 2024-09-13T19:34:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb3043830 2024-09-13T19:34:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303ed40 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb303a420 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.414+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5b6c105040 con 0x560bb2f0de00 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:34:37.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30422a0 con 0x560bb303a420 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3041ee0 con 0x560bb303a420 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3042c40 con 0x560bb303a420 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:34:37.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 zone default found 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 4 Realm: () 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 zonegroup default 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3046830 con 0x560bb303ed40 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3048b00 con 0x560bb3043830 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3048ea0 con 0x560bb3043830 2024-09-13T19:34:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 started sync module instance, tier type = 2024-09-13T19:34:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:34:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3047f90 con 0x560bb2f0de00 2024-09-13T19:34:37.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94608248046768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3047f90 con 0x560bb2f0de00 2024-09-13T19:34:37.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.418+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3049900 con 0x560bb303a420 2024-09-13T19:34:37.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.422+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94608248046768] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.422+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.422+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94608248044528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3049900 con 0x560bb303a420 2024-09-13T19:34:37.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.422+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304a2c0 con 0x560bb3043830 2024-09-13T19:34:37.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.422+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94608248044528] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.422+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.422+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94608248050768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3049870 con 0x560bb3043830 2024-09-13T19:34:37.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.422+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304afc0 con 0x560bb2f0de00 2024-09-13T19:34:37.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.426+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.426+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94608248056592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304af30 con 0x560bb2f0de00 2024-09-13T19:34:37.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.426+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304bec0 con 0x560bb303a420 2024-09-13T19:34:37.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.426+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94608248050768] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.426+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94608248056592] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.426+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.426+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94608248055392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304b9d0 con 0x560bb303a420 2024-09-13T19:34:37.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.426+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304c760 con 0x560bb303ed40 2024-09-13T19:34:37.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.430+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.430+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94608248062640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304b9d0 con 0x560bb303ed40 2024-09-13T19:34:37.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.430+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304d4e0 con 0x560bb303ed40 2024-09-13T19:34:37.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.430+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94608248055392] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.430+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.430+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94608248065968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304d4a0 con 0x560bb303ed40 2024-09-13T19:34:37.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.430+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304df20 con 0x560bb303ed40 2024-09-13T19:34:37.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.430+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94608248062640] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94608248065968] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94608248058688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304cb00 con 0x560bb303ed40 2024-09-13T19:34:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 20 add_watcher() i=0 2024-09-13T19:34:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 20 add_watcher() i=1 2024-09-13T19:34:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 20 add_watcher() i=2 2024-09-13T19:34:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 20 add_watcher() i=3 2024-09-13T19:34:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 20 add_watcher() i=4 2024-09-13T19:34:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 20 add_watcher() i=5 2024-09-13T19:34:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 20 add_watcher() i=6 2024-09-13T19:34:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94608248058688] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 20 add_watcher() i=7 2024-09-13T19:34:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 2 all 8 watchers are set, enabling cache 2024-09-13T19:34:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.434+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3050f10 con 0x560bb303a420 2024-09-13T19:34:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94608248068624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb304e390 con 0x560bb303a420 2024-09-13T19:34:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94608248068624] v32'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5a2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5b7b970980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:34:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5b7b970980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:34:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3059740 con 0x560bb303a420 2024-09-13T19:34:37.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.437+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3059d70 con 0x560bb303ed40 2024-09-13T19:34:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.441+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.441+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3059d70 con 0x560bb3043830 2024-09-13T19:34:37.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.441+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.441+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305a190 con 0x560bb303a420 2024-09-13T19:34:37.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.445+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'224 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.445+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305a570 con 0x560bb2f0de00 2024-09-13T19:34:37.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.445+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'71 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.445+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aa20 con 0x560bb3043830 2024-09-13T19:34:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.449+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.449+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aa20 con 0x560bb303a420 2024-09-13T19:34:37.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.449+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.449+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aa20 con 0x560bb303ed40 2024-09-13T19:34:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.453+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.453+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aa20 con 0x560bb2f0de00 2024-09-13T19:34:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.453+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.453+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305ab10 con 0x560bb3043830 2024-09-13T19:34:37.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.453+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.453+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aad0 con 0x560bb2f0de00 2024-09-13T19:34:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.457+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'72 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.457+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aad0 con 0x560bb303ed40 2024-09-13T19:34:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.457+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.457+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aad0 con 0x560bb2f0de00 2024-09-13T19:34:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.461+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.461+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aad0 con 0x560bb303ed40 2024-09-13T19:34:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.461+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.461+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305aad0 con 0x560bb303a420 2024-09-13T19:34:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.461+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.461+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.465+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.465+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb2f0de00 2024-09-13T19:34:37.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.465+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'73 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.465+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.465+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.465+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb303a420 2024-09-13T19:34:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.469+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.469+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb303a420 2024-09-13T19:34:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.469+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.469+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.473+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.473+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb2f0de00 2024-09-13T19:34:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.473+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.473+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.473+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.473+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.473+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.473+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.477+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.477+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.477+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.477+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb303ed40 2024-09-13T19:34:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.477+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.477+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.481+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.481+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb303ed40 2024-09-13T19:34:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.481+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.481+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb3043830 2024-09-13T19:34:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.485+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.485+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb303ed40 2024-09-13T19:34:37.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.485+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.485+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb305b1c0 con 0x560bb2f0de00 2024-09-13T19:34:37.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5a2e7e4640 20 reqs_thread_entry: start 2024-09-13T19:34:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 20 init_complete bucket index max shards: 11 2024-09-13T19:34:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 20 Filter name: none 2024-09-13T19:34:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f599ffff640 20 reqs_thread_entry: start 2024-09-13T19:34:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:34:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3057a20 con 0x560bb303ed40 2024-09-13T19:34:37.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:34:37.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:34:37.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:34:37.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:34:37.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.489+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3078e70 con 0x560bb303ed40 2024-09-13T19:34:37.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 : miss 2024-09-13T19:34:37.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:96 8.f 8:f52daaed:root::.bucket.meta.myfoo7%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3078b10 con 0x560bb3043830 2024-09-13T19:34:37.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv9 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 20 rados_obj.operate() r=0 bl.length=382 2024-09-13T19:34:37.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 info.flags=0x17 2024-09-13T19:34:37.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 to cache LRU end 2024-09-13T19:34:37.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:34:37.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:34:37.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 2024-09-13T19:34:37.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:97 4.17 4:e82a3863:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6000 con 0x560bb303ed40 2024-09-13T19:34:37.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(97 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:98 4.11 4:88cac148:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6000 con 0x560bb303ed40 2024-09-13T19:34:37.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(98 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:99 4.22 4:4630c739:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6000 con 0x560bb303a420 2024-09-13T19:34:37.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(99 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.493+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 4.2d 4:b45fd74f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6000 con 0x560bb303ed40 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(100 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74052070 con 0x560bb303ed40 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:101 4.29 4:9481f3b6:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6000 con 0x560bb3043830 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(101 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.4 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:102 4.3f 4:ff0d5f71:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6040 con 0x560bb2f0de00 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(102 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5 [call out=378b] v0'0 uv3 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b7b970980 10 cls_bucket_list_unordered: got fourteen 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:103 4.3b 4:df4c75f0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6040 con 0x560bb3043830 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(103 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:104 4.7 4:e3cfcffd:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6040 con 0x560bb303ed40 2024-09-13T19:34:37.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(104 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74070060 con 0x560bb303ed40 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:105 4.24 4:27bc4e3f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6040 con 0x560bb303ed40 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(105 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74070060 con 0x560bb303ed40 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:106 4.12 4:4b1e8905:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6000 con 0x560bb303a420 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(106 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.497+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:107 4.2f 4:f60aa1b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f6040 con 0x560bb303a420 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(107 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 20 get_obj_state: octx=0x7f5b7000f5a0 obj=myfoo7:fourteen state=0x560bb30f4088 s->prefetch_data=0 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:108 3.16 3:6b457b84:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f4eb0 con 0x560bb2f0de00 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(108 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 10 manifest: total_size = 8 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 20 get_obj_state: setting s->obj_tag to c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.12269095542940243646 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 20 get_obj_state: octx=0x7f5b7000f5a0 obj=myfoo7:fourteen state=0x560bb30f4088 s->prefetch_data=0 2024-09-13T19:34:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 20 prepare_atomic_modification: state is not atomic. state=0x560bb30f4088 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:109 4.3f 4:ff0d5f71:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f5770 con 0x560bb2f0de00 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(109 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:110 3.16 3:6b457b84:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb30f5770 con 0x560bb2f0de00 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(110 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10_fourteen [call] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:111 4.3f 4:ff0d5f71:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb307d6c0 con 0x560bb2f0de00 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 20 list_objects_ordered: starting attempt 1 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:34:37.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:112 4.17 4:e82a3863:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb307d6c0 con 0x560bb303ed40 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:113 4.11 4:88cac148:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3081950 con 0x560bb303ed40 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:114 4.22 4:4630c739:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb30842b0 con 0x560bb303a420 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:115 4.2d 4:b45fd74f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3086d80 con 0x560bb303ed40 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:116 4.29 4:9481f3b6:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb307d6c0 con 0x560bb3043830 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:117 4.3f 4:ff0d5f71:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308c050 con 0x560bb2f0de00 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:118 4.3b 4:df4c75f0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308e940 con 0x560bb3043830 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:119 4.7 4:e3cfcffd:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3086d80 con 0x560bb303ed40 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(116 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.4 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(114 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:120 4.24 4:27bc4e3f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308c050 con 0x560bb303ed40 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:121 4.12 4:4b1e8905:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3086d80 con 0x560bb303a420 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:122 4.2f 4:f60aa1b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3083e80 con 0x560bb303a420 2024-09-13T19:34:37.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(118 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(121 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(122 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== osd_op_reply(112 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74070060 con 0x560bb303ed40 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(113 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74070060 con 0x560bb303ed40 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.501+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(115 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74070060 con 0x560bb303ed40 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== osd_op_reply(119 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74070060 con 0x560bb303ed40 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(120 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74070060 con 0x560bb303ed40 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(111 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5a4ffff640 20 handle_completion(): completion ok for obj=fourteen 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(117 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:34:37.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10])"; uploads.size()=0; is_truncated=0 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:123 4.17 4:e82a3863:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308aea0 con 0x560bb303ed40 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:124 4.11 4:88cac148:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308a5b0 con 0x560bb303ed40 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:125 4.22 4:4630c739:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3083e00 con 0x560bb303a420 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:126 4.2d 4:b45fd74f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308bba0 con 0x560bb303ed40 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:127 4.29 4:9481f3b6:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3086c70 con 0x560bb3043830 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:128 4.3f 4:ff0d5f71:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308aea0 con 0x560bb2f0de00 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:129 4.3b 4:df4c75f0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308a5b0 con 0x560bb3043830 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:130 4.7 4:e3cfcffd:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb3083e00 con 0x560bb303ed40 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:131 4.24 4:27bc4e3f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308bba0 con 0x560bb303ed40 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:132 4.12 4:4b1e8905:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308a5b0 con 0x560bb303a420 2024-09-13T19:34:37.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== osd_op_reply(127 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.4 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(125 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:133 4.2f 4:f60aa1b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308a5b0 con 0x560bb303a420 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(128 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(129 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(132 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 37 ==== osd_op_reply(133 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== osd_op_reply(123 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(124 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(126 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(130 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(131 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 41 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-13T19:34:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.505+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb2f0de00 2024-09-13T19:34:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv45 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b7b970980 20 rados_obj.operate() r=0 bl.length=168 2024-09-13T19:34:37.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b7b970980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-13T19:34:37.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b7b970980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-13T19:34:37.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb2f0de00 2024-09-13T19:34:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'46 uv46 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b7b970980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-13T19:34:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b7b970980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-13T19:34:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94608248320336 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb2f0de00 2024-09-13T19:34:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== watch-notify(notify (1) cookie 94608248056592 notify 137438953515 ret 0) ==== 192+0+0 (crc 0 0 0) 0x560bb305a190 con 0x560bb2f0de00 2024-09-13T19:34:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5a5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94608248056592 notifier 4755 bl.length()=150 2024-09-13T19:34:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5a5cff9640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5a3c003d70 con 0x560bb2f0de00 2024-09-13T19:34:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(137 notify.3 [notify cookie 94608248320336 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== watch-notify(notify_complete (2) cookie 94608248320336 notify 137438953515 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560bb3059f40 con 0x560bb2f0de00 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.509+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:139 8.f 8:f52daaed:root::.bucket.meta.myfoo7%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb3043830 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 33 ==== osd_op_reply(139 .bucket.meta.myfoo7:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 [call,call,delete] v32'10 uv10 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 from cache 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10, ofs0, ns] 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94608248244864 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb3043830 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 34 ==== watch-notify(notify (1) cookie 94608248050768 notify 137438953480 ret 0) ==== 250+0+0 (crc 0 0 0) 0x560bb3078010 con 0x560bb3043830 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5a4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94608248050768 notifier 4755 bl.length()=208 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5a4ffff640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f59ac003330 con 0x560bb3043830 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 35 ==== osd_op_reply(140 notify.2 [notify cookie 94608248244864 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 36 ==== watch-notify(notify_complete (2) cookie 94608248244864 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5b6c0ff040 con 0x560bb3043830 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 37 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:142 4.17 4:e82a3863:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:143 4.11 4:88cac148:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308b600 con 0x560bb303ed40 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:144 4.22 4:4630c739:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3077000 con 0x560bb303a420 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:145 4.2d 4:b45fd74f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308b600 con 0x560bb303ed40 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:146 4.29 4:9481f3b6:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb3043830 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:147 4.3f 4:ff0d5f71:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308b600 con 0x560bb2f0de00 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:148 4.3b 4:df4c75f0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3077000 con 0x560bb3043830 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:149 4.7 4:e3cfcffd:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3081dc0 con 0x560bb303ed40 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:150 4.24 4:27bc4e3f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308b600 con 0x560bb303ed40 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:151 4.12 4:4b1e8905:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303a420 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:152 4.2f 4:f60aa1b0:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb3081dc0 con 0x560bb303a420 2024-09-13T19:34:37.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 38 ==== osd_op_reply(146 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.4 [delete] v32'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 38 ==== osd_op_reply(144 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.2 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 39 ==== osd_op_reply(151 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.9 [delete] v32'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== osd_op_reply(147 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.5 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.513+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 42 ==== osd_op_reply(145 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.3 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 40 ==== osd_op_reply(152 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.10 [delete] v32'8 uv8 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 43 ==== osd_op_reply(143 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.1 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 44 ==== osd_op_reply(150 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.8 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 45 ==== osd_op_reply(149 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.7 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 46 ==== osd_op_reply(142 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.0 [delete] v32'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 39 ==== osd_op_reply(148 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10.6 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b7b970980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 : miss 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b7b970980 20 rados->read ofs=0 len=0 2024-09-13T19:34:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:153 6.1d 6:bf77d7f5:::pubsub..bucket.myfoo7%2fc35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 47 ==== osd_op_reply(153 pubsub..bucket.myfoo7/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b7b970980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b7b970980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 info.flags=0x0 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b7b970980 10 adding default.rgw.log++pubsub..bucket.myfoo7/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 to cache LRU end 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:154 6.1d 6:bf77d7f5:::pubsub..bucket.myfoo7%2fc35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 48 ==== osd_op_reply(154 pubsub..bucket.myfoo7/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.10 [delete] v32'49 uv36 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.517+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 49 ==== osd_op_reply(155 fud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b7b970980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:34:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 50 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b7b970980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:34:37.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94608248244864 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb3043830 2024-09-13T19:34:37.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 40 ==== watch-notify(notify (1) cookie 94608248050768 notify 137438953481 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f5b6c0ff040 con 0x560bb3043830 2024-09-13T19:34:37.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5a4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94608248050768 notifier 4755 bl.length()=170 2024-09-13T19:34:37.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5a4ffff640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f59ac003310 con 0x560bb3043830 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 41 ==== osd_op_reply(157 notify.2 [notify cookie 94608248244864 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 42 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 43 ==== watch-notify(notify_complete (2) cookie 94608248244864 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560bb30034d0 con 0x560bb3043830 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b7b970980 10 removing email index: 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b7b970980 10 removing user buckets index 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.521+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 51 ==== osd_op_reply(159 fud.buckets [delete] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b7b970980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94608248244864 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 52 ==== watch-notify(notify (1) cookie 94608248065968 notify 137438953498 ret 0) ==== 202+0+0 (crc 0 0 0) 0x560bb30590a0 con 0x560bb303ed40 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5a5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94608248065968 notifier 4755 bl.length()=160 2024-09-13T19:34:37.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5a5cff9640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5a3c003d70 con 0x560bb303ed40 2024-09-13T19:34:37.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 53 ==== osd_op_reply(160 notify.6 [notify cookie 94608248244864 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 54 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 55 ==== watch-notify(notify_complete (2) cookie 94608248244864 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560bb302f590 con 0x560bb303ed40 2024-09-13T19:34:37.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b7b970980 10 removing user index: fud 2024-09-13T19:34:37.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.525+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 56 ==== osd_op_reply(162 fud [call,call,delete] v32'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5b7b970980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5b7b970980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94608248244864 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 57 ==== watch-notify(notify (1) cookie 94608248062640 notify 137438953499 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560bb302f590 con 0x560bb303ed40 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5a4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94608248062640 notifier 4755 bl.length()=152 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5a4ffff640 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f59ac0032f0 con 0x560bb303ed40 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 58 ==== osd_op_reply(163 notify.5 [notify cookie 94608248244864 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 59 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.529+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 60 ==== watch-notify(notify_complete (2) cookie 94608248244864 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560bb302f300 con 0x560bb303ed40 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.533+0000 7f5a2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:34:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.533+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94608248068624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303a420 2024-09-13T19:34:37.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.533+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 41 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94608248068624] v32'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.533+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94608248046768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb2f0de00 2024-09-13T19:34:37.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.533+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94608248046768] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.533+0000 7f5b7b970980 20 remove_watcher() i=0 2024-09-13T19:34:37.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.533+0000 7f5b7b970980 2 removed watcher, disabling cache 2024-09-13T19:34:37.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.533+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94608248044528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303a420 2024-09-13T19:34:37.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.537+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 42 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94608248044528] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.537+0000 7f5b7b970980 20 remove_watcher() i=1 2024-09-13T19:34:37.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.537+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94608248050768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb3043830 2024-09-13T19:34:37.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.537+0000 7f5b79480640 1 -- 172.21.15.144:0/1417592814 <== osd.3 v2:172.21.15.144:6800/1157716661 44 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94608248050768] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6c0c6d40 con 0x560bb3043830 2024-09-13T19:34:37.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.537+0000 7f5b7b970980 20 remove_watcher() i=2 2024-09-13T19:34:37.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.537+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94608248056592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb2f0de00 2024-09-13T19:34:37.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.541+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94608248056592] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb2f0de00 2024-09-13T19:34:37.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.541+0000 7f5b7b970980 20 remove_watcher() i=3 2024-09-13T19:34:37.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.541+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94608248055392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303a420 2024-09-13T19:34:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.541+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 <== osd.1 v2:172.21.15.144:6808/3556169889 43 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94608248055392] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7002b040 con 0x560bb303a420 2024-09-13T19:34:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.541+0000 7f5b7b970980 20 remove_watcher() i=4 2024-09-13T19:34:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.541+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94608248062640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.545+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 61 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94608248062640] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.545+0000 7f5b7b970980 20 remove_watcher() i=5 2024-09-13T19:34:37.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.545+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94608248065968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.545+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 62 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94608248065968] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.545+0000 7f5b7b970980 20 remove_watcher() i=6 2024-09-13T19:34:37.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.545+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94608248058688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560bb308ab60 con 0x560bb303ed40 2024-09-13T19:34:37.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b79c81640 1 -- 172.21.15.144:0/1417592814 <== osd.0 v2:172.21.15.18:6800/2700511246 63 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94608248058688] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b74078040 con 0x560bb303ed40 2024-09-13T19:34:37.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 20 remove_watcher() i=7 2024-09-13T19:34:37.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb303ed40 msgr2=0x560bb3041150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb303ed40 0x560bb3041150 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb303a420 msgr2=0x560bb303c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb303a420 0x560bb303c8e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560bb2f0de00 msgr2=0x7f5b6c0e3990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x560bb2f0de00 0x7f5b6c0e3990 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560bb3043830 msgr2=0x560bb3045c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560bb3043830 0x560bb3045c80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a44034650 msgr2=0x7f5a44036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a44034650 0x7f5a44036b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0c6fd0 tx=0x7f5b6c0ea000 comp rx=0 tx=0).stop 2024-09-13T19:34:37.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 msgr2=0x560bb302edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/1417592814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb3027a80 0x560bb302edc0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5b74011e10 tx=0x7f5b74049f10 comp rx=0 tx=0).stop 2024-09-13T19:34:37.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 reap_dead start 2024-09-13T19:34:37.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b78c7f640 1 -- 172.21.15.144:0/1417592814 reap_dead start 2024-09-13T19:34:37.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 shutdown_connections 2024-09-13T19:34:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 >> 172.21.15.144:0/1417592814 conn(0x560bb3023db0 msgr2=0x560bb30290b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 shutdown_connections 2024-09-13T19:34:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/1417592814 wait complete. 2024-09-13T19:34:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/3478414950 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a500346a0 msgr2=0x7f5a50036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/3478414950 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a500346a0 0x7f5a50036b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0e3920 tx=0x7f5b6c0de040 comp rx=0 tx=0).stop 2024-09-13T19:34:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/3478414950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb301af40 msgr2=0x560bb301b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/3478414950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb301af40 0x560bb301b360 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x560bb3000f20 tx=0x7f5b74018830 comp rx=0 tx=0).stop 2024-09-13T19:34:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/3478414950 shutdown_connections 2024-09-13T19:34:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/3478414950 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a500346a0 0x7f5a50036b60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/3478414950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb301af40 0x560bb301b360 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/3478414950 >> 172.21.15.144:0/3478414950 conn(0x560bb3010090 msgr2=0x560bb3012b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/3478414950 shutdown_connections 2024-09-13T19:34:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/3478414950 wait complete. 2024-09-13T19:34:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb3009d80 msgr2=0x560bb300c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb3009d80 0x560bb300c170 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb3004fa0 msgr2=0x560bb3007390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb3004fa0 0x560bb3007390 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a60034650 msgr2=0x7f5a60036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a60034650 0x7f5a60036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b70000f70 tx=0x7f5b70001380 comp rx=0 tx=0).stop 2024-09-13T19:34:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f10760 msgr2=0x560bb3000020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:34:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f10760 0x560bb3000020 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0199f0 tx=0x7f5b6c0180e0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 shutdown_connections 2024-09-13T19:34:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560bb3004fa0 0x560bb3007390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560bb3009d80 0x560bb300c170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a60034650 0x7f5a60036b10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 --2- 172.21.15.144:0/948274647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bb2f10760 0x560bb3000020 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:34:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 >> 172.21.15.144:0/948274647 conn(0x560bb2e81290 msgr2=0x560bb2ff3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:34:37.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 shutdown_connections 2024-09-13T19:34:37.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:34:37.549+0000 7f5b7b970980 1 -- 172.21.15.144:0/948274647 wait complete. 2024-09-13T19:35:17.568 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-13T19:35:17.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-13T19:35:17.569 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-13T19:35:17.608 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:17.608 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:17.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.604+0000 7fdcef316980 1 Processor -- start 2024-09-13T19:35:17.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.604+0000 7fdcef316980 1 -- start start 2024-09-13T19:35:17.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcef316980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55fe0ca19a50 0x55fe0ca1be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcef316980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe0c89dae0 con 0x55fe0c989b00 2024-09-13T19:35:17.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcef316980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55fe0c8c1e30 con 0x55fe0ca19a50 2024-09-13T19:35:17.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcec625640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55fe0ca19a50 0x55fe0ca1be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcec625640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55fe0ca19a50 0x55fe0ca1be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58980/0 (socket says 172.21.15.144:58980) 2024-09-13T19:35:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcec625640 1 -- 172.21.15.144:0/1752364401 learned_addr learned my addr 172.21.15.144:0/1752364401 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcec625640 1 -- 172.21.15.144:0/1752364401 >> v1:172.21.15.18:6789/0 conn(0x55fe0c989b00 legacy=0x55fe0ca18330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcec625640 1 -- 172.21.15.144:0/1752364401 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0ca1d390 con 0x55fe0ca19a50 2024-09-13T19:35:17.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcec625640 1 --2- 172.21.15.144:0/1752364401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0ca19a50 0x55fe0ca1be40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fdce000a5c0 tx=0x7fdce001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb69230ff958200d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcebe24640 1 -- 172.21.15.144:0/1752364401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce00a6070 con 0x55fe0ca19a50 2024-09-13T19:35:17.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcebe24640 1 -- 172.21.15.144:0/1752364401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce00af070 con 0x55fe0ca19a50 2024-09-13T19:35:17.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.608+0000 7fdcebe24640 1 -- 172.21.15.144:0/1752364401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce00aa5c0 con 0x55fe0ca19a50 2024-09-13T19:35:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.612+0000 7fdcef316980 1 -- 172.21.15.144:0/1752364401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0ca19a50 msgr2=0x55fe0ca1be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.612+0000 7fdcef316980 1 --2- 172.21.15.144:0/1752364401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0ca19a50 0x55fe0ca1be40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fdce000a5c0 tx=0x7fdce001b340 comp rx=0 tx=0).stop 2024-09-13T19:35:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.612+0000 7fdcef316980 1 -- 172.21.15.144:0/1752364401 shutdown_connections 2024-09-13T19:35:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.612+0000 7fdcef316980 1 --2- 172.21.15.144:0/1752364401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0ca19a50 0x55fe0ca1be40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.612+0000 7fdcef316980 1 -- 172.21.15.144:0/1752364401 >> 172.21.15.144:0/1752364401 conn(0x55fe0ca10060 msgr2=0x55fe0ca12480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.612+0000 7fdcef316980 1 -- 172.21.15.144:0/1752364401 shutdown_connections 2024-09-13T19:35:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.612+0000 7fdcef316980 1 -- 172.21.15.144:0/1752364401 wait complete. 2024-09-13T19:35:17.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.624+0000 7fdcef316980 1 Processor -- start 2024-09-13T19:35:17.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- start start 2024-09-13T19:35:17.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb00a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fe0c8c3200 con 0x55fe0c989b00 2024-09-13T19:35:17.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcece26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb00a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcece26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb00a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58986/0 (socket says 172.21.15.144:58986) 2024-09-13T19:35:17.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcece26640 1 -- 172.21.15.144:0/1143595899 learned_addr learned my addr 172.21.15.144:0/1143595899 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcece26640 1 -- 172.21.15.144:0/1143595899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0cb01020 con 0x55fe0c989b00 2024-09-13T19:35:17.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcece26640 1 --2- 172.21.15.144:0/1143595899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb00a50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00b1f0 tx=0x7fdcdc00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72438fd71a245699 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdbdae0d640 1 -- 172.21.15.144:0/1143595899 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc00a040 con 0x55fe0c989b00 2024-09-13T19:35:17.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdbdae0d640 1 -- 172.21.15.144:0/1143595899 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc00f750 con 0x55fe0c989b00 2024-09-13T19:35:17.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdbdae0d640 1 -- 172.21.15.144:0/1143595899 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc00fa70 con 0x55fe0c989b00 2024-09-13T19:35:17.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- 172.21.15.144:0/1143595899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 msgr2=0x55fe0cb00a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 --2- 172.21.15.144:0/1143595899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb00a50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00b1f0 tx=0x7fdcdc00b6b0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- 172.21.15.144:0/1143595899 shutdown_connections 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 --2- 172.21.15.144:0/1143595899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb00a50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- 172.21.15.144:0/1143595899 >> 172.21.15.144:0/1143595899 conn(0x55fe0ca10060 msgr2=0x55fe0cafc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- 172.21.15.144:0/1143595899 shutdown_connections 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- 172.21.15.144:0/1143595899 wait complete. 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 Processor -- start 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- start start 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb07e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcef316980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fe0ca1ce30 con 0x55fe0c989b00 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcece26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb07e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcece26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb07e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:58990/0 (socket says 172.21.15.144:58990) 2024-09-13T19:35:17.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.628+0000 7fdcece26640 1 -- 172.21.15.144:0/788931320 learned_addr learned my addr 172.21.15.144:0/788931320 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcece26640 1 -- 172.21.15.144:0/788931320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0cb08360 con 0x55fe0c989b00 2024-09-13T19:35:17.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcece26640 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb07e20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00b6f0 tx=0x7fdcdc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdbd960a640 1 -- 172.21.15.144:0/788931320 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc001300 con 0x55fe0c989b00 2024-09-13T19:35:17.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe0cb085f0 con 0x55fe0c989b00 2024-09-13T19:35:17.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdbd960a640 1 -- 172.21.15.144:0/788931320 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc01c9c0 con 0x55fe0c989b00 2024-09-13T19:35:17.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdbd960a640 1 -- 172.21.15.144:0/788931320 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc01cca0 con 0x55fe0c989b00 2024-09-13T19:35:17.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe0cb0b2d0 con 0x55fe0c989b00 2024-09-13T19:35:17.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdbd960a640 1 -- 172.21.15.144:0/788931320 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdcdc017050 con 0x55fe0c989b00 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdbd960a640 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbd4034650 0x7fdbd4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdbd960a640 1 -- 172.21.15.144:0/788931320 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdcdc015020 con 0x55fe0c989b00 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcec625640 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbd4034650 0x7fdbd4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0ca19a50 0x55fe0cb0ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb0f460 con 0x55fe0ca19a50 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdced627640 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0ca19a50 0x55fe0cb0ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcec625640 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbd4034650 0x7fdbd4036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdce00ae000 tx=0x7fdce00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdced627640 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0ca19a50 0x55fe0cb0ef20 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdced627640 1 -- 172.21.15.144:0/788931320 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce400a4d0 con 0x55fe0ca19a50 2024-09-13T19:35:17.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb0c4f0 con 0x55fe0ca19a50 2024-09-13T19:35:17.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdced627640 1 -- 172.21.15.144:0/788931320 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdce400a4d0 con 0x55fe0ca19a50 2024-09-13T19:35:17.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.632+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb11790 0x55fe0cb13b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb14270 con 0x55fe0cb11790 2024-09-13T19:35:17.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcece26640 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb11790 0x55fe0cb13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcece26640 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb11790 0x55fe0cb13b80 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcece26640 1 -- 172.21.15.144:0/788931320 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb11790 2024-09-13T19:35:17.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb10630 con 0x55fe0ca19a50 2024-09-13T19:35:17.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdced627640 1 -- 172.21.15.144:0/788931320 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdce400a4d0 con 0x55fe0ca19a50 2024-09-13T19:35:17.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb10b10 con 0x55fe0ca19a50 2024-09-13T19:35:17.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdced627640 1 -- 172.21.15.144:0/788931320 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdce400a4d0 con 0x55fe0ca19a50 2024-09-13T19:35:17.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcef316980 1 Processor -- start 2024-09-13T19:35:17.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcef316980 1 -- start start 2024-09-13T19:35:17.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcef316980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb22990 0x55fe0cb22db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdcef316980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fe0c91c800 con 0x55fe0cb22990 2024-09-13T19:35:17.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdced627640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb22990 0x55fe0cb22db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdced627640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb22990 0x55fe0cb22db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59004/0 (socket says 172.21.15.144:59004) 2024-09-13T19:35:17.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.636+0000 7fdced627640 1 -- 172.21.15.144:0/1152476476 learned_addr learned my addr 172.21.15.144:0/1152476476 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdced627640 1 -- 172.21.15.144:0/1152476476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0cb232f0 con 0x55fe0cb22990 2024-09-13T19:35:17.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdced627640 1 --2- 172.21.15.144:0/1152476476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb22990 0x55fe0cb22db0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x55fe0cb09250 tx=0x7fdce4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdbd27fc640 1 -- 172.21.15.144:0/1152476476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce4014450 con 0x55fe0cb22990 2024-09-13T19:35:17.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdcef316980 1 -- 172.21.15.144:0/1152476476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe0cb23580 con 0x55fe0cb22990 2024-09-13T19:35:17.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdbd27fc640 1 -- 172.21.15.144:0/1152476476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce4014610 con 0x55fe0cb22990 2024-09-13T19:35:17.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdbd27fc640 1 -- 172.21.15.144:0/1152476476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce4014930 con 0x55fe0cb22990 2024-09-13T19:35:17.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdcef316980 1 -- 172.21.15.144:0/1152476476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe0cb26200 con 0x55fe0cb22990 2024-09-13T19:35:17.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdbd27fc640 1 -- 172.21.15.144:0/1152476476 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdce4011040 con 0x55fe0cb22990 2024-09-13T19:35:17.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdbd27fc640 1 --2- 172.21.15.144:0/1152476476 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbc4034650 0x7fdbc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdbd27fc640 1 -- 172.21.15.144:0/1152476476 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdce401e070 con 0x55fe0cb22990 2024-09-13T19:35:17.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdcece26640 1 --2- 172.21.15.144:0/1152476476 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbc4034650 0x7fdbc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdcef316980 1 Processor -- start 2024-09-13T19:35:17.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdcef316980 1 -- start start 2024-09-13T19:35:17.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdcece26640 1 --2- 172.21.15.144:0/1152476476 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbc4034650 0x7fdbc4036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55fe0cb0f8e0 tx=0x7fdcdc0014a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdcef316980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb2f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdcef316980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fe0cb013a0 con 0x55fe0cb2f460 2024-09-13T19:35:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdced627640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb2f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdced627640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb2f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59008/0 (socket says 172.21.15.144:59008) 2024-09-13T19:35:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdced627640 1 -- 172.21.15.144:0/2988657228 learned_addr learned my addr 172.21.15.144:0/2988657228 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.640+0000 7fdced627640 1 -- 172.21.15.144:0/2988657228 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0cb2fe30 con 0x55fe0cb2f460 2024-09-13T19:35:17.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdced627640 1 --2- 172.21.15.144:0/2988657228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb2f860 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdce404a1c0 tx=0x7fdce404a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c296f27d7e63a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdbc3fff640 1 -- 172.21.15.144:0/2988657228 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce4043350 con 0x55fe0cb2f460 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdbc3fff640 1 -- 172.21.15.144:0/2988657228 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce4023420 con 0x55fe0cb2f460 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdbc3fff640 1 -- 172.21.15.144:0/2988657228 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce4014b20 con 0x55fe0cb2f460 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- 172.21.15.144:0/2988657228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 msgr2=0x55fe0cb2f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 --2- 172.21.15.144:0/2988657228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb2f860 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdce404a1c0 tx=0x7fdce404a2b0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- 172.21.15.144:0/2988657228 shutdown_connections 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 --2- 172.21.15.144:0/2988657228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb2f860 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- 172.21.15.144:0/2988657228 >> 172.21.15.144:0/2988657228 conn(0x55fe0cb2b890 msgr2=0x55fe0cb29990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- 172.21.15.144:0/2988657228 shutdown_connections 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- 172.21.15.144:0/2988657228 wait complete. 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 Processor -- start 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- start start 2024-09-13T19:35:17.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb36840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fe0cb30480 con 0x55fe0cb2f460 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdced627640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb36840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdced627640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb36840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59010/0 (socket says 172.21.15.144:59010) 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 learned_addr learned my addr 172.21.15.144:0/819901389 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0cb36d80 con 0x55fe0cb2f460 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdced627640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb36840 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdce403d010 tx=0x7fdce4049f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdbc27fc640 1 -- 172.21.15.144:0/819901389 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce40239d0 con 0x55fe0cb2f460 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe0cb37010 con 0x55fe0cb2f460 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe0cb39cf0 con 0x55fe0cb2f460 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdbc27fc640 1 -- 172.21.15.144:0/819901389 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce4023b70 con 0x55fe0cb2f460 2024-09-13T19:35:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.644+0000 7fdbc27fc640 1 -- 172.21.15.144:0/819901389 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce4043350 con 0x55fe0cb2f460 2024-09-13T19:35:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdbc27fc640 1 -- 172.21.15.144:0/819901389 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdce404bd10 con 0x55fe0cb2f460 2024-09-13T19:35:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdbc27fc640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbb8034650 0x7fdbb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdbc27fc640 1 -- 172.21.15.144:0/819901389 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdce400e040 con 0x55fe0cb2f460 2024-09-13T19:35:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0cb41f30 0x55fe0cb443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcece26640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbb8034650 0x7fdbb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb44b40 con 0x55fe0cb41f30 2024-09-13T19:35:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcec625640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0cb41f30 0x55fe0cb443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcece26640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbb8034650 0x7fdbb8036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0184b0 tx=0x7fdcdc039000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcec625640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0cb41f30 0x55fe0cb443f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 realm 2024-09-13T19:35:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb44f70 con 0x55fe0cb41f30 2024-09-13T19:35:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb45810 con 0x55fe0cb41f30 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb45bb0 con 0x55fe0cb41f30 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb46960 0x55fe0cb48d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb493a0 con 0x55fe0cb46960 2024-09-13T19:35:17.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.648+0000 7fdced627640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb46960 0x55fe0cb48d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdced627640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb46960 0x55fe0cb48d50 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcef316980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcef316980 20 searching for the correct realm 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fe0cb4b2f0 0x55fe0cb4d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcece26640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fe0cb4b2f0 0x55fe0cb4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcece26640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fe0cb4b2f0 0x55fe0cb4d700 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcece26640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdcdc00e7a0 0x7fdcdc0488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcec625640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdcdc00e7a0 0x7fdcdc0488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcec625640 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdcdc00e7a0 0x7fdcdc0488b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x55fe0cb46960 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x55fe0cb41f30 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.652+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x55fe0cb41f30 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x55fe0cb41f30 2024-09-13T19:35:17.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x55fe0cb46960 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4dd80 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb41f30 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb46960 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb41f30 2024-09-13T19:35:17.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.656+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb46960 2024-09-13T19:35:17.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb41f30 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb41f30 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb46960 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb41f30 2024-09-13T19:35:17.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.660+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb46960 2024-09-13T19:35:17.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb46960 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb46960 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x55fe0cb41f30 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdcdc056040 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb49d60 con 0x55fe0cb41f30 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb499a0 con 0x55fe0cb41f30 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4a680 con 0x55fe0cb41f30 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 zone default found 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 4 Realm: () 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:17.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 zonegroup default 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.664+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4e200 con 0x55fe0cb46960 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb50010 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb50450 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 20 started sync module instance, tier type = 2024-09-13T19:35:17.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:17.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4f420 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94549623240992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4f420 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb50fc0 con 0x55fe0cb41f30 2024-09-13T19:35:17.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.668+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94549623240992] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.672+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.672+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94549623245472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4f420 con 0x55fe0cb41f30 2024-09-13T19:35:17.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.672+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb519d0 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.672+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94549623245472] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.672+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.672+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94549623238512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb4f390 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.672+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb526d0 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.676+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.676+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94549623251792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb52f70 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.676+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb53970 con 0x55fe0cb41f30 2024-09-13T19:35:17.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.676+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94549623238512] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.676+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94549623251792] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.676+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.676+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94549623250288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb52a50 con 0x55fe0cb41f30 2024-09-13T19:35:17.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.676+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb54210 con 0x55fe0cb46960 2024-09-13T19:35:17.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.680+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.680+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94549623258464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb52a50 con 0x55fe0cb46960 2024-09-13T19:35:17.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.680+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb54f90 con 0x55fe0cb46960 2024-09-13T19:35:17.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.680+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94549623250288] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.680+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.680+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94549623261792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb54f50 con 0x55fe0cb46960 2024-09-13T19:35:17.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.680+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb559d0 con 0x55fe0cb46960 2024-09-13T19:35:17.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.680+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94549623258464] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94549623261792] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94549623256192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb545b0 con 0x55fe0cb46960 2024-09-13T19:35:17.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdcef316980 20 add_watcher() i=0 2024-09-13T19:35:17.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdcef316980 20 add_watcher() i=1 2024-09-13T19:35:17.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdcef316980 20 add_watcher() i=2 2024-09-13T19:35:17.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdcef316980 20 add_watcher() i=3 2024-09-13T19:35:17.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdcef316980 20 add_watcher() i=4 2024-09-13T19:35:17.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdcef316980 20 add_watcher() i=5 2024-09-13T19:35:17.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.684+0000 7fdcef316980 20 add_watcher() i=6 2024-09-13T19:35:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94549623256192] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 20 add_watcher() i=7 2024-09-13T19:35:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb589c0 con 0x55fe0cb41f30 2024-09-13T19:35:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94549623264448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb55e40 con 0x55fe0cb41f30 2024-09-13T19:35:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94549623264448] v32'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdba2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 5 note: GC not initialized 2024-09-13T19:35:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdba1fe3640 20 reqs_thread_entry: start 2024-09-13T19:35:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 20 Filter name: none 2024-09-13T19:35:17.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdb137fe640 20 reqs_thread_entry: start 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7be40 con 0x55fe0cb41f30 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.688+0000 7fdcef316980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:17.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.692+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7e8d0 con 0x55fe0cb46960 2024-09-13T19:35:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.692+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.692+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7e8d0 con 0x55fe0cb46960 2024-09-13T19:35:17.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.696+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.696+0000 7fdba2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:17.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.696+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94549623264448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb5b1e0 con 0x55fe0cb41f30 2024-09-13T19:35:17.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.696+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94549623264448] v32'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.696+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94549623240992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb554c0 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.700+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94549623240992] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.700+0000 7fdcef316980 20 remove_watcher() i=0 2024-09-13T19:35:17.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.700+0000 7fdcef316980 2 removed watcher, disabling cache 2024-09-13T19:35:17.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.700+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94549623245472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7b9e0 con 0x55fe0cb41f30 2024-09-13T19:35:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.700+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94549623245472] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.700+0000 7fdcef316980 20 remove_watcher() i=1 2024-09-13T19:35:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.700+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94549623238512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7b9e0 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.704+0000 7fdcece26640 1 -- 172.21.15.144:0/819901389 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94549623238512] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc02e070 con 0x55fe0cb4b2f0 2024-09-13T19:35:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.704+0000 7fdcef316980 20 remove_watcher() i=2 2024-09-13T19:35:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.704+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94549623251792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7b9e0 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.704+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94549623251792] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x7fdcdc00e7a0 2024-09-13T19:35:17.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.704+0000 7fdcef316980 20 remove_watcher() i=3 2024-09-13T19:35:17.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.704+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94549623250288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7b9e0 con 0x55fe0cb41f30 2024-09-13T19:35:17.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.708+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94549623250288] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce00aaa30 con 0x55fe0cb41f30 2024-09-13T19:35:17.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.708+0000 7fdcef316980 20 remove_watcher() i=4 2024-09-13T19:35:17.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.708+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94549623258464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7b9e0 con 0x55fe0cb46960 2024-09-13T19:35:17.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.708+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94549623258464] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.708+0000 7fdcef316980 20 remove_watcher() i=5 2024-09-13T19:35:17.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.708+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94549623261792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7b9e0 con 0x55fe0cb46960 2024-09-13T19:35:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94549623261792] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 20 remove_watcher() i=6 2024-09-13T19:35:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94549623256192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe0cb7b9e0 con 0x55fe0cb46960 2024-09-13T19:35:17.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdced627640 1 -- 172.21.15.144:0/819901389 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94549623256192] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce405e040 con 0x55fe0cb46960 2024-09-13T19:35:17.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 20 remove_watcher() i=7 2024-09-13T19:35:17.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb46960 msgr2=0x55fe0cb48d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb46960 0x55fe0cb48d50 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0cb41f30 msgr2=0x55fe0cb443f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0cb41f30 0x55fe0cb443f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdcdc00e7a0 msgr2=0x7fdcdc0488b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdcdc00e7a0 0x7fdcdc0488b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fe0cb4b2f0 msgr2=0x55fe0cb4d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fe0cb4b2f0 0x55fe0cb4d700 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbb8034650 msgr2=0x7fdbb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbb8034650 0x7fdbb8036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0184b0 tx=0x7fdcdc039000 comp rx=0 tx=0).stop 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 msgr2=0x55fe0cb36840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 --2- 172.21.15.144:0/819901389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb2f460 0x55fe0cb36840 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdce403d010 tx=0x7fdce4049f60 comp rx=0 tx=0).stop 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 reap_dead start 2024-09-13T19:35:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcec625640 1 -- 172.21.15.144:0/819901389 reap_dead start 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 shutdown_connections 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 >> 172.21.15.144:0/819901389 conn(0x55fe0cb2b890 msgr2=0x55fe0cb29960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 shutdown_connections 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.712+0000 7fdcef316980 1 -- 172.21.15.144:0/819901389 wait complete. 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/1152476476 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbc4034650 msgr2=0x7fdbc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/1152476476 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbc4034650 0x7fdbc4036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55fe0cb0f8e0 tx=0x7fdcdc0014a0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/1152476476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb22990 msgr2=0x55fe0cb22db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/1152476476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb22990 0x55fe0cb22db0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x55fe0cb09250 tx=0x7fdce4018830 comp rx=0 tx=0).stop 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/1152476476 shutdown_connections 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/1152476476 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbc4034650 0x7fdbc4036b10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/1152476476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0cb22990 0x55fe0cb22db0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/1152476476 >> 172.21.15.144:0/1152476476 conn(0x55fe0cb17ae0 msgr2=0x55fe0cb1a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/1152476476 shutdown_connections 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/1152476476 wait complete. 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb11790 msgr2=0x55fe0cb13b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb11790 0x55fe0cb13b80 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0ca19a50 msgr2=0x55fe0cb0ef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0ca19a50 0x55fe0cb0ef20 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbd4034650 msgr2=0x7fdbd4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbd4034650 0x7fdbd4036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdce00ae000 tx=0x7fdce00a6000 comp rx=0 tx=0).stop 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 msgr2=0x55fe0cb07e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb07e20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00b6f0 tx=0x7fdcdc000ee0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 shutdown_connections 2024-09-13T19:35:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fe0ca19a50 0x55fe0cb0ef20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fe0cb11790 0x55fe0cb13b80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdbd4034650 0x7fdbd4036b10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 --2- 172.21.15.144:0/788931320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe0c989b00 0x55fe0cb07e20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 >> 172.21.15.144:0/788931320 conn(0x55fe0ca10060 msgr2=0x55fe0cafb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 shutdown_connections 2024-09-13T19:35:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.716+0000 7fdcef316980 1 -- 172.21.15.144:0/788931320 wait complete. 2024-09-13T19:35:17.730 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T19:35:17.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T19:35:17.730 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T19:35:17.813 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:17.813 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:17.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a4318980 1 Processor -- start 2024-09-13T19:35:17.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a4318980 1 -- start start 2024-09-13T19:35:17.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a4318980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5589693bba50 0x5589693bde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a4318980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55896923fae0 con 0x55896932bb00 2024-09-13T19:35:17.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a4318980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x558969263e30 con 0x5589693bba50 2024-09-13T19:35:17.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a1627640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5589693bba50 0x5589693bde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a1627640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5589693bba50 0x5589693bde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59012/0 (socket says 172.21.15.144:59012) 2024-09-13T19:35:17.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a1627640 1 -- 172.21.15.144:0/902787649 learned_addr learned my addr 172.21.15.144:0/902787649 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a1627640 1 -- 172.21.15.144:0/902787649 >> v1:172.21.15.18:6789/0 conn(0x55896932bb00 legacy=0x5589693ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.812+0000 7fe1a1627640 1 -- 172.21.15.144:0/902787649 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589693bf390 con 0x5589693bba50 2024-09-13T19:35:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a1627640 1 --2- 172.21.15.144:0/902787649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589693bba50 0x5589693bde40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00a5c0 tx=0x7fe18c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c497fbca99cb03e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a0e26640 1 -- 172.21.15.144:0/902787649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c0a6070 con 0x5589693bba50 2024-09-13T19:35:17.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a0e26640 1 -- 172.21.15.144:0/902787649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c0af070 con 0x5589693bba50 2024-09-13T19:35:17.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a0e26640 1 -- 172.21.15.144:0/902787649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c0aa5c0 con 0x5589693bba50 2024-09-13T19:35:17.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a4318980 1 -- 172.21.15.144:0/902787649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589693bba50 msgr2=0x5589693bde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a4318980 1 --2- 172.21.15.144:0/902787649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589693bba50 0x5589693bde40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00a5c0 tx=0x7fe18c01b340 comp rx=0 tx=0).stop 2024-09-13T19:35:17.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a4318980 1 -- 172.21.15.144:0/902787649 shutdown_connections 2024-09-13T19:35:17.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a4318980 1 --2- 172.21.15.144:0/902787649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589693bba50 0x5589693bde40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a4318980 1 -- 172.21.15.144:0/902787649 >> 172.21.15.144:0/902787649 conn(0x5589693b2060 msgr2=0x5589693b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a4318980 1 -- 172.21.15.144:0/902787649 shutdown_connections 2024-09-13T19:35:17.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.816+0000 7fe1a4318980 1 -- 172.21.15.144:0/902787649 wait complete. 2024-09-13T19:35:17.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a4318980 1 Processor -- start 2024-09-13T19:35:17.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a4318980 1 -- start start 2024-09-13T19:35:17.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a4318980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a4318980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558969265200 con 0x55896932bb00 2024-09-13T19:35:17.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a1e28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a1e28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59024/0 (socket says 172.21.15.144:59024) 2024-09-13T19:35:17.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1375970622 learned_addr learned my addr 172.21.15.144:0/1375970622 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1375970622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589694a3180 con 0x55896932bb00 2024-09-13T19:35:17.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/1375970622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a2bb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe1940016c0 tx=0x7fe194001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ecc1c1c7b62d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe08fe07640 1 -- 172.21.15.144:0/1375970622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe194016070 con 0x55896932bb00 2024-09-13T19:35:17.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe08fe07640 1 -- 172.21.15.144:0/1375970622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19400f640 con 0x55896932bb00 2024-09-13T19:35:17.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.832+0000 7fe08fe07640 1 -- 172.21.15.144:0/1375970622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19400f9a0 con 0x55896932bb00 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- 172.21.15.144:0/1375970622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 msgr2=0x5589694a2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1375970622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a2bb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe1940016c0 tx=0x7fe194001b80 comp rx=0 tx=0).stop 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- 172.21.15.144:0/1375970622 shutdown_connections 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1375970622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a2bb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- 172.21.15.144:0/1375970622 >> 172.21.15.144:0/1375970622 conn(0x5589693b2060 msgr2=0x55896949e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- 172.21.15.144:0/1375970622 shutdown_connections 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- 172.21.15.144:0/1375970622 wait complete. 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 Processor -- start 2024-09-13T19:35:17.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- start start 2024-09-13T19:35:17.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589693bee30 con 0x55896932bb00 2024-09-13T19:35:17.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a1e28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a1e28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59026/0 (socket says 172.21.15.144:59026) 2024-09-13T19:35:17.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a1e28640 1 -- 172.21.15.144:0/2423926047 learned_addr learned my addr 172.21.15.144:0/2423926047 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a1e28640 1 -- 172.21.15.144:0/2423926047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589694aa530 con 0x55896932bb00 2024-09-13T19:35:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a9ff0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe19400f610 tx=0x7fe194001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe08e604640 1 -- 172.21.15.144:0/2423926047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe194016040 con 0x55896932bb00 2024-09-13T19:35:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe08e604640 1 -- 172.21.15.144:0/2423926047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe194006030 con 0x55896932bb00 2024-09-13T19:35:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589694aa7c0 con 0x55896932bb00 2024-09-13T19:35:17.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe08e604640 1 -- 172.21.15.144:0/2423926047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1940117c0 con 0x55896932bb00 2024-09-13T19:35:17.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.836+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589694ad4a0 con 0x55896932bb00 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe08e604640 1 -- 172.21.15.144:0/2423926047 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe194011a70 con 0x55896932bb00 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe08e604640 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe088034650 0x7fe088036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe08e604640 1 -- 172.21.15.144:0/2423926047 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe194049c10 con 0x55896932bb00 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a1627640 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe088034650 0x7fe088036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694aef70 0x5589694b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694b1a10 con 0x5589694aef70 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a2629640 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694aef70 0x5589694b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a1627640 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe088034650 0x7fe088036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0ae000 tx=0x7fe18c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a2629640 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694aef70 0x5589694b13a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a2629640 1 -- 172.21.15.144:0/2423926047 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe19c0083f0 con 0x5589694aef70 2024-09-13T19:35:17.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694ae6c0 con 0x5589694aef70 2024-09-13T19:35:17.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a2629640 1 -- 172.21.15.144:0/2423926047 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe19c0083f0 con 0x5589694aef70 2024-09-13T19:35:17.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694b3d40 0x5589694b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694b6800 con 0x5589694b3d40 2024-09-13T19:35:17.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694b3d40 0x5589694b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694b3d40 0x5589694b6130 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a1e28640 1 -- 172.21.15.144:0/2423926047 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe194023020 con 0x5589694b3d40 2024-09-13T19:35:17.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.840+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694b2be0 con 0x5589694aef70 2024-09-13T19:35:17.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a2629640 1 -- 172.21.15.144:0/2423926047 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe19c0083f0 con 0x5589694aef70 2024-09-13T19:35:17.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694b30c0 con 0x5589694aef70 2024-09-13T19:35:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a2629640 1 -- 172.21.15.144:0/2423926047 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe19c0083f0 con 0x5589694aef70 2024-09-13T19:35:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a4318980 1 Processor -- start 2024-09-13T19:35:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a4318980 1 -- start start 2024-09-13T19:35:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a4318980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694c4f40 0x5589694c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a4318980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589692be800 con 0x5589694c4f40 2024-09-13T19:35:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a2629640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694c4f40 0x5589694c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a2629640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694c4f40 0x5589694c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59030/0 (socket says 172.21.15.144:59030) 2024-09-13T19:35:17.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a2629640 1 -- 172.21.15.144:0/829548080 learned_addr learned my addr 172.21.15.144:0/829548080 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a2629640 1 -- 172.21.15.144:0/829548080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589694c58a0 con 0x5589694c4f40 2024-09-13T19:35:17.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a2629640 1 --2- 172.21.15.144:0/829548080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694c4f40 0x5589694c5360 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5589694ab240 tx=0x7fe19c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe0877fe640 1 -- 172.21.15.144:0/829548080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19c007dd0 con 0x5589694c4f40 2024-09-13T19:35:17.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a4318980 1 -- 172.21.15.144:0/829548080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589694c5b30 con 0x5589694c4f40 2024-09-13T19:35:17.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe0877fe640 1 -- 172.21.15.144:0/829548080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c01e020 con 0x5589694c4f40 2024-09-13T19:35:17.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe0877fe640 1 -- 172.21.15.144:0/829548080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19c019590 con 0x5589694c4f40 2024-09-13T19:35:17.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.844+0000 7fe1a4318980 1 -- 172.21.15.144:0/829548080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589694c87b0 con 0x5589694c4f40 2024-09-13T19:35:17.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe0877fe640 1 -- 172.21.15.144:0/829548080 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe19c016040 con 0x5589694c4f40 2024-09-13T19:35:17.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe0877fe640 1 --2- 172.21.15.144:0/829548080 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe07c034650 0x7fe07c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe0877fe640 1 -- 172.21.15.144:0/829548080 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe19c01f030 con 0x5589694c4f40 2024-09-13T19:35:17.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/829548080 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe07c034650 0x7fe07c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 Processor -- start 2024-09-13T19:35:17.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- start start 2024-09-13T19:35:17.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/829548080 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe07c034650 0x7fe07c036b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5589694b1e90 tx=0x7fe194047f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589694a3500 con 0x5589694d1a10 2024-09-13T19:35:17.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a2629640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a2629640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59040/0 (socket says 172.21.15.144:59040) 2024-09-13T19:35:17.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a2629640 1 -- 172.21.15.144:0/1473596173 learned_addr learned my addr 172.21.15.144:0/1473596173 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a2629640 1 -- 172.21.15.144:0/1473596173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589694d23e0 con 0x5589694d1a10 2024-09-13T19:35:17.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a2629640 1 --2- 172.21.15.144:0/1473596173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d1e10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe19c04a350 tx=0x7fe19c019d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0ac98a364340a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe0857fa640 1 -- 172.21.15.144:0/1473596173 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19c046070 con 0x5589694d1a10 2024-09-13T19:35:17.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe0857fa640 1 -- 172.21.15.144:0/1473596173 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c03be00 con 0x5589694d1a10 2024-09-13T19:35:17.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe0857fa640 1 -- 172.21.15.144:0/1473596173 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19c01d040 con 0x5589694d1a10 2024-09-13T19:35:17.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- 172.21.15.144:0/1473596173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 msgr2=0x5589694d1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1473596173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d1e10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe19c04a350 tx=0x7fe19c019d10 comp rx=0 tx=0).stop 2024-09-13T19:35:17.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- 172.21.15.144:0/1473596173 shutdown_connections 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1473596173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d1e10 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- 172.21.15.144:0/1473596173 >> 172.21.15.144:0/1473596173 conn(0x5589694cdda0 msgr2=0x5589694cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- 172.21.15.144:0/1473596173 shutdown_connections 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- 172.21.15.144:0/1473596173 wait complete. 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 Processor -- start 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- start start 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.848+0000 7fe1a4318980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589694d29c0 con 0x5589694d1a10 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a2629640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a2629640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59052/0 (socket says 172.21.15.144:59052) 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 learned_addr learned my addr 172.21.15.144:0/1184124612 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:17.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589694d92a0 con 0x5589694d1a10 2024-09-13T19:35:17.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a2629640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d8d60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe19c019f60 tx=0x7fe19c04a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe0737fe640 1 -- 172.21.15.144:0/1184124612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19c01d040 con 0x5589694d1a10 2024-09-13T19:35:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589694d9530 con 0x5589694d1a10 2024-09-13T19:35:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe0737fe640 1 -- 172.21.15.144:0/1184124612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c0223c0 con 0x5589694d1a10 2024-09-13T19:35:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe0737fe640 1 -- 172.21.15.144:0/1184124612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19c0226a0 con 0x5589694d1a10 2024-09-13T19:35:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589694d9530 con 0x5589694d1a10 2024-09-13T19:35:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe0737fe640 1 -- 172.21.15.144:0/1184124612 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe19c035070 con 0x5589694d1a10 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe0737fe640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe06c034650 0x7fe06c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe0737fe640 1 -- 172.21.15.144:0/1184124612 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe19c032030 con 0x5589694d1a10 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694e3ff0 0x5589694e6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694e6be0 con 0x5589694e3ff0 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a1627640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694e3ff0 0x5589694e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.852+0000 7fe1a1627640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694e3ff0 0x5589694e6490 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 realm 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694e7010 con 0x5589694e3ff0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694e78b0 con 0x5589694e3ff0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694e7c50 con 0x5589694e3ff0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:17.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694e89b0 0x5589694eada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694eb2e0 con 0x5589694e89b0 2024-09-13T19:35:17.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a2629640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694e89b0 0x5589694eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a2629640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694e89b0 0x5589694eada0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 20 searching for the correct realm 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589694ed230 0x5589694ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589694ed230 0x5589694ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589694ed230 0x5589694ef6f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19403a030 con 0x5589694ed230 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1940410c0 0x7fe19400e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x7fe1940410c0 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.856+0000 7fe1a1627640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1940410c0 0x7fe19400e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1940410c0 0x7fe19400e260 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e89b0 2024-09-13T19:35:17.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e89b0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x7fe1940410c0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19403a030 con 0x5589694ed230 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.860+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e89b0 2024-09-13T19:35:17.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x7fe1940410c0 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19403a030 con 0x5589694ed230 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e89b0 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.864+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e89b0 2024-09-13T19:35:17.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x7fe1940410c0 2024-09-13T19:35:17.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e89b0 2024-09-13T19:35:17.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e89b0 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x7fe1940410c0 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694ed230 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.868+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e89b0 2024-09-13T19:35:17.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x5589694e3ff0 2024-09-13T19:35:17.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589694efdc0 con 0x7fe1940410c0 2024-09-13T19:35:17.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:17.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694ebc30 con 0x5589694e3ff0 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694ec080 con 0x5589694e3ff0 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694ec090 con 0x5589694e3ff0 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 zone default found 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 4 Realm: () 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 zonegroup default 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694eb7c0 con 0x5589694e89b0 2024-09-13T19:35:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694f20d0 con 0x5589694ed230 2024-09-13T19:35:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694f2470 con 0x5589694ed230 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 started sync module instance, tier type = 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.872+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f1510 con 0x7fe1940410c0 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.876+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.876+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94048665672240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f1510 con 0x7fe1940410c0 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.876+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f2e30 con 0x5589694e3ff0 2024-09-13T19:35:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.876+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94048665672240] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.876+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.876+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94048665676432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f1510 con 0x5589694e3ff0 2024-09-13T19:35:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.876+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f3840 con 0x5589694ed230 2024-09-13T19:35:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.880+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94048665676432] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.880+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.880+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94048665669728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f1480 con 0x5589694ed230 2024-09-13T19:35:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.880+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f4540 con 0x7fe1940410c0 2024-09-13T19:35:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.880+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.880+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94048665682336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f4b90 con 0x7fe1940410c0 2024-09-13T19:35:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.880+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f5690 con 0x5589694e3ff0 2024-09-13T19:35:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94048665669728] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94048665682336] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94048665686400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f5650 con 0x5589694e3ff0 2024-09-13T19:35:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f5ab0 con 0x5589694e89b0 2024-09-13T19:35:17.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94048665686400] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94048665683456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f5e50 con 0x5589694e89b0 2024-09-13T19:35:17.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.884+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f6810 con 0x5589694e89b0 2024-09-13T19:35:17.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.888+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe06c034650 0x7fe06c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:17.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.888+0000 7fe1a1e28640 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe06c034650 0x7fe06c036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5589694ec6b0 tx=0x7fe19405d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:17.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.888+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.888+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94048665690976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f6c30 con 0x5589694e89b0 2024-09-13T19:35:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.888+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f7660 con 0x5589694e89b0 2024-09-13T19:35:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.888+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94048665683456] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94048665690976] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94048665694576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f67c0 con 0x5589694e89b0 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 20 add_watcher() i=0 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 20 add_watcher() i=1 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 20 add_watcher() i=2 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 20 add_watcher() i=3 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 20 add_watcher() i=4 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 20 add_watcher() i=5 2024-09-13T19:35:17.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 20 add_watcher() i=6 2024-09-13T19:35:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94048665694576] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 20 add_watcher() i=7 2024-09-13T19:35:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589694fa760 con 0x5589694e3ff0 2024-09-13T19:35:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.892+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94048665680864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f7be0 con 0x5589694e3ff0 2024-09-13T19:35:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94048665680864] v32'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe0537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 5 note: GC not initialized 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe0527fc640 20 reqs_thread_entry: start 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 20 Filter name: none 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 20 rados->read ofs=0 len=0 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fdfc3fff640 20 reqs_thread_entry: start 2024-09-13T19:35:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55896951d6b0 con 0x5589694e3ff0 2024-09-13T19:35:17.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:35:17.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55896951ec00 con 0x5589694e89b0 2024-09-13T19:35:17.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe0537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:17.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.896+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94048665680864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694fc650 con 0x5589694e3ff0 2024-09-13T19:35:17.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.900+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94048665680864] v32'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.900+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94048665672240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f3be0 con 0x7fe1940410c0 2024-09-13T19:35:17.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.900+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94048665672240] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.900+0000 7fe1a4318980 20 remove_watcher() i=0 2024-09-13T19:35:17.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.900+0000 7fe1a4318980 2 removed watcher, disabling cache 2024-09-13T19:35:17.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.900+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94048665676432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f3be0 con 0x5589694e3ff0 2024-09-13T19:35:17.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.904+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94048665676432] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.904+0000 7fe1a4318980 20 remove_watcher() i=1 2024-09-13T19:35:17.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.904+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94048665669728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f3be0 con 0x5589694ed230 2024-09-13T19:35:17.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.904+0000 7fe1a1e28640 1 -- 172.21.15.144:0/1184124612 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94048665669728] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe194056040 con 0x5589694ed230 2024-09-13T19:35:17.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.904+0000 7fe1a4318980 20 remove_watcher() i=2 2024-09-13T19:35:17.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.904+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94048665682336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f1060 con 0x7fe1940410c0 2024-09-13T19:35:17.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.908+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94048665682336] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x7fe1940410c0 2024-09-13T19:35:17.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.908+0000 7fe1a4318980 20 remove_watcher() i=3 2024-09-13T19:35:17.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.908+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94048665686400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f41a0 con 0x5589694e3ff0 2024-09-13T19:35:17.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.908+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94048665686400] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c0aa9e0 con 0x5589694e3ff0 2024-09-13T19:35:17.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.908+0000 7fe1a4318980 20 remove_watcher() i=4 2024-09-13T19:35:17.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.908+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94048665683456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f1060 con 0x5589694e89b0 2024-09-13T19:35:17.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.912+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94048665683456] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.912+0000 7fe1a4318980 20 remove_watcher() i=5 2024-09-13T19:35:17.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.912+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94048665690976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f1060 con 0x5589694e89b0 2024-09-13T19:35:17.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.912+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94048665690976] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.912+0000 7fe1a4318980 20 remove_watcher() i=6 2024-09-13T19:35:17.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.912+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94048665694576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589694f6360 con 0x5589694e89b0 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a2629640 1 -- 172.21.15.144:0/1184124612 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94048665694576] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe19c05e040 con 0x5589694e89b0 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 20 remove_watcher() i=7 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694e89b0 msgr2=0x5589694eada0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694e89b0 0x5589694eada0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694e3ff0 msgr2=0x5589694e6490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694e3ff0 0x5589694e6490 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1940410c0 msgr2=0x7fe19400e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fe1940410c0 0x7fe19400e260 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589694ed230 msgr2=0x5589694ef6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5589694ed230 0x5589694ef6f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe06c034650 msgr2=0x7fe06c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe06c034650 0x7fe06c036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5589694ec6b0 tx=0x7fe19405d040 comp rx=0 tx=0).stop 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 msgr2=0x5589694d8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a1627640 1 -- 172.21.15.144:0/1184124612 reap_dead start 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d8d60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe19c019f60 tx=0x7fe19c04a2b0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 shutdown_connections 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/1184124612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694d1a10 0x5589694d8d60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 >> 172.21.15.144:0/1184124612 conn(0x5589694cdda0 msgr2=0x5589694cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 shutdown_connections 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/1184124612 wait complete. 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/829548080 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe07c034650 msgr2=0x7fe07c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/829548080 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe07c034650 0x7fe07c036b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5589694b1e90 tx=0x7fe194047f80 comp rx=0 tx=0).stop 2024-09-13T19:35:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/829548080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694c4f40 msgr2=0x5589694c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/829548080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694c4f40 0x5589694c5360 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5589694ab240 tx=0x7fe19c00af40 comp rx=0 tx=0).stop 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/829548080 shutdown_connections 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/829548080 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe07c034650 0x7fe07c036b10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/829548080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589694c4f40 0x5589694c5360 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/829548080 >> 172.21.15.144:0/829548080 conn(0x5589694ba090 msgr2=0x5589694bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/829548080 shutdown_connections 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/829548080 wait complete. 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694b3d40 msgr2=0x5589694b6130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694b3d40 0x5589694b6130 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694aef70 msgr2=0x5589694b13a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694aef70 0x5589694b13a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe088034650 msgr2=0x7fe088036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe088034650 0x7fe088036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0ae000 tx=0x7fe18c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:35:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 msgr2=0x5589694a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a9ff0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe19400f610 tx=0x7fe194001260 comp rx=0 tx=0).stop 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 shutdown_connections 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5589694aef70 0x5589694b13a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5589694b3d40 0x5589694b6130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fe088034650 0x7fe088036b10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 --2- 172.21.15.144:0/2423926047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896932bb00 0x5589694a9ff0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 >> 172.21.15.144:0/2423926047 conn(0x5589693b2060 msgr2=0x55896949d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 shutdown_connections 2024-09-13T19:35:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:17.916+0000 7fe1a4318980 1 -- 172.21.15.144:0/2423926047 wait complete. 2024-09-13T19:35:17.931 INFO:teuthology.orchestra.run.smithi144.stdout:{"entries":[],"summary":[]} 2024-09-13T19:35:17.931 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T19:35:17.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T19:35:17.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T19:35:17.932 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-13T19:35:18.015 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:18.016 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.012+0000 7fb15e3f6980 1 Processor -- start 2024-09-13T19:35:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.012+0000 7fb15e3f6980 1 -- start start 2024-09-13T19:35:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.012+0000 7fb15e3f6980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x555b5fd373c0 0x555b5fd35b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.012+0000 7fb15e3f6980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b5fc48ae0 con 0x555b5fd377d0 2024-09-13T19:35:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.012+0000 7fb15e3f6980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x555b5fc6ce30 con 0x555b5fd373c0 2024-09-13T19:35:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.012+0000 7fb15bf06640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x555b5fd373c0 0x555b5fd35b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.012+0000 7fb15bf06640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x555b5fd373c0 0x555b5fd35b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59060/0 (socket says 172.21.15.144:59060) 2024-09-13T19:35:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.012+0000 7fb15bf06640 1 -- 172.21.15.144:0/2418750912 learned_addr learned my addr 172.21.15.144:0/2418750912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15bf06640 1 -- 172.21.15.144:0/2418750912 >> v1:172.21.15.18:6789/0 conn(0x555b5fd377d0 legacy=0x555b5fd360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15bf06640 1 -- 172.21.15.144:0/2418750912 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5fd368f0 con 0x555b5fd373c0 2024-09-13T19:35:18.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15bf06640 1 --2- 172.21.15.144:0/2418750912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5fd35b80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00a4e0 tx=0x7fb14c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcc5fc4f217473a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15af04640 1 -- 172.21.15.144:0/2418750912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c0aa540 con 0x555b5fd373c0 2024-09-13T19:35:18.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15af04640 1 -- 172.21.15.144:0/2418750912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c0aa6e0 con 0x555b5fd373c0 2024-09-13T19:35:18.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15af04640 1 -- 172.21.15.144:0/2418750912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c0aaa40 con 0x555b5fd373c0 2024-09-13T19:35:18.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2418750912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 msgr2=0x555b5fd35b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2418750912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5fd35b80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00a4e0 tx=0x7fb14c01b090 comp rx=0 tx=0).stop 2024-09-13T19:35:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2418750912 shutdown_connections 2024-09-13T19:35:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2418750912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5fd35b80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2418750912 >> 172.21.15.144:0/2418750912 conn(0x555b5fdbc1c0 msgr2=0x555b5fdbe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2418750912 shutdown_connections 2024-09-13T19:35:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.016+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2418750912 wait complete. 2024-09-13T19:35:18.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.032+0000 7fb15e3f6980 1 Processor -- start 2024-09-13T19:35:18.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.032+0000 7fb15e3f6980 1 -- start start 2024-09-13T19:35:18.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.032+0000 7fb15e3f6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feadb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.032+0000 7fb15e3f6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555b5fc6e200 con 0x555b5fd373c0 2024-09-13T19:35:18.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.032+0000 7fb15bf06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feadb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.032+0000 7fb15bf06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feadb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59062/0 (socket says 172.21.15.144:59062) 2024-09-13T19:35:18.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.032+0000 7fb15bf06640 1 -- 172.21.15.144:0/223395416 learned_addr learned my addr 172.21.15.144:0/223395416 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15bf06640 1 -- 172.21.15.144:0/223395416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5feae130 con 0x555b5fd373c0 2024-09-13T19:35:18.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15bf06640 1 --2- 172.21.15.144:0/223395416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feadb60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb14c017ca0 tx=0x7fb14c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d73286530f766c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb049e0b640 1 -- 172.21.15.144:0/223395416 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c0b9070 con 0x555b5fd373c0 2024-09-13T19:35:18.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb049e0b640 1 -- 172.21.15.144:0/223395416 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c0aab30 con 0x555b5fd373c0 2024-09-13T19:35:18.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb049e0b640 1 -- 172.21.15.144:0/223395416 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c0aae10 con 0x555b5fd373c0 2024-09-13T19:35:18.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 -- 172.21.15.144:0/223395416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 msgr2=0x555b5feadb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/223395416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feadb60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb14c017ca0 tx=0x7fb14c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 -- 172.21.15.144:0/223395416 shutdown_connections 2024-09-13T19:35:18.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/223395416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feadb60 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 -- 172.21.15.144:0/223395416 >> 172.21.15.144:0/223395416 conn(0x555b5fdbc1c0 msgr2=0x555b5fea9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 -- 172.21.15.144:0/223395416 shutdown_connections 2024-09-13T19:35:18.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 -- 172.21.15.144:0/223395416 wait complete. 2024-09-13T19:35:18.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 Processor -- start 2024-09-13T19:35:18.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 -- start start 2024-09-13T19:35:18.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feb4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15e3f6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555b5fdcc210 con 0x555b5fd373c0 2024-09-13T19:35:18.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15bf06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feb4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15bf06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feb4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59072/0 (socket says 172.21.15.144:59072) 2024-09-13T19:35:18.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15bf06640 1 -- 172.21.15.144:0/2135320791 learned_addr learned my addr 172.21.15.144:0/2135320791 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15bf06640 1 -- 172.21.15.144:0/2135320791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5feb52d0 con 0x555b5fd373c0 2024-09-13T19:35:18.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.036+0000 7fb15bf06640 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feb4d90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb14c017ca0 tx=0x7fb14c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb043fff640 1 -- 172.21.15.144:0/2135320791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c0b9070 con 0x555b5fd373c0 2024-09-13T19:35:18.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb043fff640 1 -- 172.21.15.144:0/2135320791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c0b5e10 con 0x555b5fd373c0 2024-09-13T19:35:18.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b5feb5560 con 0x555b5fd373c0 2024-09-13T19:35:18.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb043fff640 1 -- 172.21.15.144:0/2135320791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c0bd610 con 0x555b5fd373c0 2024-09-13T19:35:18.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5feb8240 con 0x555b5fd373c0 2024-09-13T19:35:18.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb043fff640 1 -- 172.21.15.144:0/2135320791 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb14c0b3040 con 0x555b5fd373c0 2024-09-13T19:35:18.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb043fff640 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb044034650 0x7fb044036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb043fff640 1 -- 172.21.15.144:0/2135320791 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb14c0c4070 con 0x555b5fd373c0 2024-09-13T19:35:18.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15b705640 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb044034650 0x7fb044036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5fd377d0 0x555b5febbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5febc3c0 con 0x555b5fd377d0 2024-09-13T19:35:18.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15c707640 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5fd377d0 0x555b5febbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15b705640 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb044034650 0x7fb044036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb144000f70 tx=0x7fb144001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15c707640 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5fd377d0 0x555b5febbd80 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15c707640 1 -- 172.21.15.144:0/2135320791 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1540083f0 con 0x555b5fd377d0 2024-09-13T19:35:18.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5feb9460 con 0x555b5fd377d0 2024-09-13T19:35:18.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15c707640 1 -- 172.21.15.144:0/2135320791 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1540083f0 con 0x555b5fd377d0 2024-09-13T19:35:18.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5febe710 0x555b5fec0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fec11d0 con 0x555b5febe710 2024-09-13T19:35:18.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.040+0000 7fb15bf06640 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5febe710 0x555b5fec0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15bf06640 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5febe710 0x555b5fec0b00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15bf06640 1 -- 172.21.15.144:0/2135320791 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb14c0d03f0 con 0x555b5febe710 2024-09-13T19:35:18.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5febd5b0 con 0x555b5fd377d0 2024-09-13T19:35:18.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15c707640 1 -- 172.21.15.144:0/2135320791 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1540083f0 con 0x555b5fd377d0 2024-09-13T19:35:18.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5febda90 con 0x555b5fd377d0 2024-09-13T19:35:18.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15c707640 1 -- 172.21.15.144:0/2135320791 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1540083f0 con 0x555b5fd377d0 2024-09-13T19:35:18.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15e3f6980 1 Processor -- start 2024-09-13T19:35:18.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15e3f6980 1 -- start start 2024-09-13T19:35:18.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15e3f6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fecf8b0 0x555b5fecfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15e3f6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555b5fcc7800 con 0x555b5fecf8b0 2024-09-13T19:35:18.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15c707640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fecf8b0 0x555b5fecfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15c707640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fecf8b0 0x555b5fecfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59078/0 (socket says 172.21.15.144:59078) 2024-09-13T19:35:18.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15c707640 1 -- 172.21.15.144:0/2113276290 learned_addr learned my addr 172.21.15.144:0/2113276290 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.044+0000 7fb15c707640 1 -- 172.21.15.144:0/2113276290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5fed0210 con 0x555b5fecf8b0 2024-09-13T19:35:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15c707640 1 --2- 172.21.15.144:0/2113276290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fecf8b0 0x555b5fecfcd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x555b5febc7c0 tx=0x7fb15400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb0417fa640 1 -- 172.21.15.144:0/2113276290 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154007e00 con 0x555b5fecf8b0 2024-09-13T19:35:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb0417fa640 1 -- 172.21.15.144:0/2113276290 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15401e020 con 0x555b5fecf8b0 2024-09-13T19:35:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2113276290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b5fed04a0 con 0x555b5fecf8b0 2024-09-13T19:35:18.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb0417fa640 1 -- 172.21.15.144:0/2113276290 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154019590 con 0x555b5fecf8b0 2024-09-13T19:35:18.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2113276290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5fed3120 con 0x555b5fecf8b0 2024-09-13T19:35:18.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb0417fa640 1 -- 172.21.15.144:0/2113276290 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb154016040 con 0x555b5fecf8b0 2024-09-13T19:35:18.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb0417fa640 1 --2- 172.21.15.144:0/2113276290 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb034034650 0x7fb034036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb0417fa640 1 -- 172.21.15.144:0/2113276290 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb15401f030 con 0x555b5fecf8b0 2024-09-13T19:35:18.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15bf06640 1 --2- 172.21.15.144:0/2113276290 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb034034650 0x7fb034036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15e3f6980 1 Processor -- start 2024-09-13T19:35:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15e3f6980 1 -- start start 2024-09-13T19:35:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15bf06640 1 --2- 172.21.15.144:0/2113276290 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb034034650 0x7fb034036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x555b5febc860 tx=0x7fb14c0a4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15e3f6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fedc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15e3f6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555b5feae3f0 con 0x555b5fedc3d0 2024-09-13T19:35:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15c707640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fedc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15c707640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fedc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59090/0 (socket says 172.21.15.144:59090) 2024-09-13T19:35:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15c707640 1 -- 172.21.15.144:0/889272915 learned_addr learned my addr 172.21.15.144:0/889272915 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15c707640 1 -- 172.21.15.144:0/889272915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5fedcda0 con 0x555b5fedc3d0 2024-09-13T19:35:18.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.048+0000 7fb15c707640 1 --2- 172.21.15.144:0/889272915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fedc7d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb15404a360 tx=0x7fb154017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a9262fc9720b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb03affd640 1 -- 172.21.15.144:0/889272915 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb15401d070 con 0x555b5fedc3d0 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb03affd640 1 -- 172.21.15.144:0/889272915 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1540153e0 con 0x555b5fedc3d0 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb03affd640 1 -- 172.21.15.144:0/889272915 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb15402b350 con 0x555b5fedc3d0 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- 172.21.15.144:0/889272915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 msgr2=0x555b5fedc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/889272915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fedc7d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb15404a360 tx=0x7fb154017fa0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- 172.21.15.144:0/889272915 shutdown_connections 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/889272915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fedc7d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- 172.21.15.144:0/889272915 >> 172.21.15.144:0/889272915 conn(0x555b5fed87b0 msgr2=0x555b5fed68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- 172.21.15.144:0/889272915 shutdown_connections 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- 172.21.15.144:0/889272915 wait complete. 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 Processor -- start 2024-09-13T19:35:18.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- start start 2024-09-13T19:35:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fee36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555b5fedd340 con 0x555b5fedc3d0 2024-09-13T19:35:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15c707640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fee36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15c707640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fee36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59106/0 (socket says 172.21.15.144:59106) 2024-09-13T19:35:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 learned_addr learned my addr 172.21.15.144:0/1656301438 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5fee3c10 con 0x555b5fedc3d0 2024-09-13T19:35:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15c707640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fee36d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb154017fe0 tx=0x7fb15404a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb0397fa640 1 -- 172.21.15.144:0/1656301438 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154015590 con 0x555b5fedc3d0 2024-09-13T19:35:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b5fee3ea0 con 0x555b5fedc3d0 2024-09-13T19:35:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5fee6b80 con 0x555b5fedc3d0 2024-09-13T19:35:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb0397fa640 1 -- 172.21.15.144:0/1656301438 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb154022a60 con 0x555b5fedc3d0 2024-09-13T19:35:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.052+0000 7fb0397fa640 1 -- 172.21.15.144:0/1656301438 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154022d40 con 0x555b5fedc3d0 2024-09-13T19:35:18.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb0397fa640 1 -- 172.21.15.144:0/1656301438 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb154037070 con 0x555b5fedc3d0 2024-09-13T19:35:18.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb0397fa640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb0240346a0 0x7fb024036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb0397fa640 1 -- 172.21.15.144:0/1656301438 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb154047070 con 0x555b5fedc3d0 2024-09-13T19:35:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15bf06640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb0240346a0 0x7fb024036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5feeeb60 0x555b5fef1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fef1770 con 0x555b5feeeb60 2024-09-13T19:35:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15b705640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5feeeb60 0x555b5fef1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15bf06640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb0240346a0 0x7fb024036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb14c019740 tx=0x7fb14c0e0000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15b705640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5feeeb60 0x555b5fef1020 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14400d040 con 0x555b5feeeb60 2024-09-13T19:35:18.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 realm 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5feedfb0 con 0x555b5feeeb60 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14400d040 con 0x555b5feeeb60 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fef2270 con 0x555b5feeeb60 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14400d040 con 0x555b5feeeb60 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fef2b40 con 0x555b5feeeb60 2024-09-13T19:35:18.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb14400d040 con 0x555b5feeeb60 2024-09-13T19:35:18.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:18.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5fef3560 0x555b5fef5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fef60c0 con 0x555b5fef3560 2024-09-13T19:35:18.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.056+0000 7fb15c707640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5fef3560 0x555b5fef5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15c707640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5fef3560 0x555b5fef5950 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15e3f6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15e3f6980 20 searching for the correct realm 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x555b5fef8010 0x555b5fefa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5fef8010 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15bf06640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x555b5fef8010 0x555b5fefa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15bf06640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x555b5fef8010 0x555b5fefa420 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15bf06640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb14c0c7410 0x7fb14c0a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x7fb14c0c7410 2024-09-13T19:35:18.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15b705640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb14c0c7410 0x7fb14c0a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15b705640 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb14c0c7410 0x7fb14c0a9700 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14400d040 con 0x7fb14c0c7410 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5fef3560 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5feeeb60 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb14400d040 con 0x555b5feeeb60 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.060+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5feeeb60 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5feeeb60 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5fef3560 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x7fb14c0c7410 2024-09-13T19:35:18.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5fef8010 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5feeeb60 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5fef3560 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5feeeb60 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x7fb14c0c7410 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaaf0 con 0x555b5fef8010 2024-09-13T19:35:18.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef8010 2024-09-13T19:35:18.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.064+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef3560 2024-09-13T19:35:18.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef8010 2024-09-13T19:35:18.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef8010 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5feeeb60 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5feeeb60 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef3560 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef8010 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x7fb14c0c7410 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5feeeb60 2024-09-13T19:35:18.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.068+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef3560 2024-09-13T19:35:18.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef8010 2024-09-13T19:35:18.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef3560 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x7fb14c0c7410 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef8010 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5fef3560 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x555b5feeeb60 2024-09-13T19:35:18.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb14c0fe040 con 0x7fb14c0c7410 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fef6a80 con 0x555b5feeeb60 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fef7320 con 0x555b5feeeb60 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.072+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fef66c0 con 0x555b5feeeb60 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 zone default found 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 4 Realm: () 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:18.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 zonegroup default 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefaf70 con 0x555b5fef3560 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefcd20 con 0x555b5fef8010 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefd1b0 con 0x555b5fef8010 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 started sync module instance, tier type = 2024-09-13T19:35:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:18.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefc190 con 0x7fb14c0c7410 2024-09-13T19:35:18.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93850939934352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefc190 con 0x7fb14c0c7410 2024-09-13T19:35:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.076+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefdcd0 con 0x555b5feeeb60 2024-09-13T19:35:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.080+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93850939934352] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.080+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.080+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93850939938752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefc190 con 0x555b5feeeb60 2024-09-13T19:35:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.080+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefe6e0 con 0x555b5fef8010 2024-09-13T19:35:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.080+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93850939938752] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.080+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.080+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93850939931872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefc100 con 0x555b5fef8010 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.080+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5feff420 con 0x7fb14c0c7410 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.084+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.084+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93850939944752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5feffcc0 con 0x7fb14c0c7410 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.084+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff006c0 con 0x555b5feeeb60 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.084+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93850939944752] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.084+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93850939931872] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.084+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.084+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93850939943552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5feff790 con 0x555b5feeeb60 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.084+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff00f60 con 0x555b5fef3560 2024-09-13T19:35:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.088+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93850939943552] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.088+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.088+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93850939949520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5feff790 con 0x555b5fef3560 2024-09-13T19:35:18.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.088+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01410 con 0x555b5fef3560 2024-09-13T19:35:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93850939949520] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93850939951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01380 con 0x555b5fef3560 2024-09-13T19:35:18.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01df0 con 0x555b5fef3560 2024-09-13T19:35:18.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93850939951792] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93850939955392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01fd0 con 0x555b5fef3560 2024-09-13T19:35:18.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 20 add_watcher() i=0 2024-09-13T19:35:18.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 20 add_watcher() i=1 2024-09-13T19:35:18.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 20 add_watcher() i=2 2024-09-13T19:35:18.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 20 add_watcher() i=3 2024-09-13T19:35:18.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 20 add_watcher() i=4 2024-09-13T19:35:18.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 20 add_watcher() i=5 2024-09-13T19:35:18.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.092+0000 7fb15e3f6980 20 add_watcher() i=6 2024-09-13T19:35:18.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93850939955392] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15e3f6980 20 add_watcher() i=7 2024-09-13T19:35:18.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15e3f6980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:18.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff053a0 con 0x555b5feeeb60 2024-09-13T19:35:18.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93850939956928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff02790 con 0x555b5feeeb60 2024-09-13T19:35:18.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93850939956928] v32'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:18.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15e3f6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:18.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.096+0000 7fb15e3f6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:18.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.100+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0db90 con 0x555b5feeeb60 2024-09-13T19:35:18.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.100+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.100+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0e1e0 con 0x555b5fef3560 2024-09-13T19:35:18.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.104+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.104+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0e1e0 con 0x555b5fef8010 2024-09-13T19:35:18.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.104+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.104+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0e620 con 0x555b5feeeb60 2024-09-13T19:35:18.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.104+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'233 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.104+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0ead0 con 0x7fb14c0c7410 2024-09-13T19:35:18.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.108+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'74 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.108+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b9e0 con 0x555b5fef8010 2024-09-13T19:35:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.108+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.108+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b9e0 con 0x555b5feeeb60 2024-09-13T19:35:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.108+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.108+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b9e0 con 0x555b5fef3560 2024-09-13T19:35:18.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.112+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.112+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b9e0 con 0x7fb14c0c7410 2024-09-13T19:35:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.116+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.116+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b9e0 con 0x555b5fef8010 2024-09-13T19:35:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.116+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.116+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x7fb14c0c7410 2024-09-13T19:35:18.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.116+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'75 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.116+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef3560 2024-09-13T19:35:18.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.120+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.120+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x7fb14c0c7410 2024-09-13T19:35:18.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.120+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.120+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef3560 2024-09-13T19:35:18.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.124+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.124+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5feeeb60 2024-09-13T19:35:18.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.124+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'234 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.124+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef8010 2024-09-13T19:35:18.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.128+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.128+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b8a0 con 0x7fb14c0c7410 2024-09-13T19:35:18.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.128+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'76 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.128+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b8a0 con 0x555b5fef8010 2024-09-13T19:35:18.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.132+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.132+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b8a0 con 0x555b5feeeb60 2024-09-13T19:35:18.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.132+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.132+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b8a0 con 0x555b5feeeb60 2024-09-13T19:35:18.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.136+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'235 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.136+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b8a0 con 0x555b5fef8010 2024-09-13T19:35:18.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.136+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.136+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x7fb14c0c7410 2024-09-13T19:35:18.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.140+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.140+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef8010 2024-09-13T19:35:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.140+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.140+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef8010 2024-09-13T19:35:18.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.144+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.144+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef8010 2024-09-13T19:35:18.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.144+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.144+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef8010 2024-09-13T19:35:18.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.144+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.144+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef3560 2024-09-13T19:35:18.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.148+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.148+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef8010 2024-09-13T19:35:18.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.152+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.152+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef3560 2024-09-13T19:35:18.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.152+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.152+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef8010 2024-09-13T19:35:18.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.156+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.156+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x555b5fef3560 2024-09-13T19:35:18.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.156+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.156+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b810 con 0x7fb14c0c7410 2024-09-13T19:35:18.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb010fe1640 20 reqs_thread_entry: start 2024-09-13T19:35:18.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:18.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 20 Filter name: none 2024-09-13T19:35:18.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7faf8a7fc640 20 reqs_thread_entry: start 2024-09-13T19:35:18.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:35:18.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b840 con 0x555b5feeeb60 2024-09-13T19:35:18.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:35:18.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:35:18.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff0b2b0 con 0x7fb14c0c7410 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv44 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 : miss 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.160+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:96 8.9 8:94f192d3:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff2cbe0 con 0x7fb14c0c7410 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(96 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv40 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 info.flags=0x17 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 to cache LRU end 2024-09-13T19:35:18.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:18.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:35:18.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 2024-09-13T19:35:18.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:97 4.10 4:0a9b0abd:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5fef8010 2024-09-13T19:35:18.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(97 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:98 4.12 4:4b983460:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5feeeb60 2024-09-13T19:35:18.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(98 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:99 4.33 4:cc8105b6:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5fef3560 2024-09-13T19:35:18.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(99 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 4.17 4:e8dee6eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5fef3560 2024-09-13T19:35:18.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(100 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:101 4.35 4:ac99e5be:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5feeeb60 2024-09-13T19:35:18.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(101 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4 [call out=425b] v0'0 uv10 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T19:35:18.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.164+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:102 4.29 4:94e56179:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5fef8010 2024-09-13T19:35:18.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(102 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 4.33 4:cd86163d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5fef3560 2024-09-13T19:35:18.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(103 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:104 4.2b 4:d60abeba:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5feeeb60 2024-09-13T19:35:18.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(104 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:105 4.3e 4:7e78dc3c:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x7fb14c0c7410 2024-09-13T19:35:18.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(105 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14402a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:106 4.20 4:0553e41f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5feeeb60 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(106 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:107 4.35 4:ae409bd4:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa3f0 con 0x555b5feeeb60 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(107 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 20 get_obj_state: octx=0x555b5fedc7b0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x555b5ffa87e8 s->prefetch_data=0 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:108 3.37 3:ef004581:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa9870 con 0x555b5feeeb60 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(108 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 10 manifest: total_size = 6 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 20 get_obj_state: setting s->obj_tag to c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.1809721373883749646 2024-09-13T19:35:18.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 20 get_obj_state: octx=0x555b5fedc7b0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x555b5ffa87e8 s->prefetch_data=0 2024-09-13T19:35:18.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 20 prepare_atomic_modification: state is not atomic. state=0x555b5ffa87e8 2024-09-13T19:35:18.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 20 bucket index object: :.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4 2024-09-13T19:35:18.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.168+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:109 4.35 4:ac99e5be:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x555b5feeeb60 2024-09-13T19:35:18.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(109 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:110 3.37 3:ef004581:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x555b5feeeb60 2024-09-13T19:35:18.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 37 ==== osd_op_reply(110 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb14402a040 con 0x555b5feeeb60 2024-09-13T19:35:18.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:111 4.35 4:ac99e5be:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff31ea0 con 0x555b5feeeb60 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 20 list_objects_ordered: starting attempt 1 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:112 4.10 4:0a9b0abd:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff337e0 con 0x555b5fef8010 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:113 4.12 4:4b983460:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff360e0 con 0x555b5feeeb60 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:114 4.33 4:cc8105b6:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff38a40 con 0x555b5fef3560 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:115 4.17 4:e8dee6eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff337e0 con 0x555b5fef3560 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:116 4.35 4:ac99e5be:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff3d9f0 con 0x555b5feeeb60 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:117 4.29 4:94e56179:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff337e0 con 0x555b5fef8010 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:118 4.33 4:cd86163d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff42830 con 0x555b5fef3560 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:119 4.2b 4:d60abeba:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff45330 con 0x555b5feeeb60 2024-09-13T19:35:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:120 4.3e 4:7e78dc3c:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff45330 con 0x7fb14c0c7410 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:121 4.20 4:0553e41f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff4a2e0 con 0x555b5feeeb60 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:122 4.35 4:ae409bd4:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff4d160 con 0x555b5feeeb60 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.172+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 38 ==== osd_op_reply(113 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb144050040 con 0x555b5feeeb60 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 39 ==== osd_op_reply(119 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb144050040 con 0x555b5feeeb60 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(112 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(114 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(117 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(115 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 40 ==== osd_op_reply(121 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb144050040 con 0x555b5feeeb60 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(120 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb144050040 con 0x7fb14c0c7410 2024-09-13T19:35:18.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 41 ==== osd_op_reply(122 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb144050040 con 0x555b5feeeb60 2024-09-13T19:35:18.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(118 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 42 ==== osd_op_reply(111 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4 [stat,call,call] v32'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb144050040 con 0x555b5feeeb60 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb03affd640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 43 ==== osd_op_reply(116 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb144050040 con 0x555b5feeeb60 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7])"; uploads.size()=0; is_truncated=0 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:123 4.10 4:0a9b0abd:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff340c0 con 0x555b5fef8010 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:124 4.12 4:4b983460:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff35960 con 0x555b5feeeb60 2024-09-13T19:35:18.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:125 4.33 4:cc8105b6:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff43d60 con 0x555b5fef3560 2024-09-13T19:35:18.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:126 4.17 4:e8dee6eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff37950 con 0x555b5fef3560 2024-09-13T19:35:18.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:127 4.35 4:ac99e5be:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff4ccd0 con 0x555b5feeeb60 2024-09-13T19:35:18.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:128 4.29 4:94e56179:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff4a240 con 0x555b5fef8010 2024-09-13T19:35:18.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:129 4.33 4:cd86163d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff340c0 con 0x555b5fef3560 2024-09-13T19:35:18.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:130 4.2b 4:d60abeba:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff35960 con 0x555b5feeeb60 2024-09-13T19:35:18.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:131 4.3e 4:7e78dc3c:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff4a240 con 0x7fb14c0c7410 2024-09-13T19:35:18.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:132 4.20 4:0553e41f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff340c0 con 0x555b5feeeb60 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:133 4.35 4:ae409bd4:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff43d60 con 0x555b5feeeb60 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 44 ==== osd_op_reply(124 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(123 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== osd_op_reply(128 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 45 ==== osd_op_reply(127 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 46 ==== osd_op_reply(130 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 47 ==== osd_op_reply(132 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 48 ==== osd_op_reply(133 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(131 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(126 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== osd_op_reply(125 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(129 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.176+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff44630 con 0x7fb14c0c7410 2024-09-13T19:35:18.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(134 foo.buckets [call] v32'47 uv47 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15e3f6980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:35:18.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa85a0 con 0x7fb14c0c7410 2024-09-13T19:35:18.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv41 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15e3f6980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:35:18.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15e3f6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:35:18.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15e3f6980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:35:18.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.180+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff43d60 con 0x7fb14c0c7410 2024-09-13T19:35:18.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(136 myfoo [call,call,delete] v32'48 uv48 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15e3f6980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15e3f6980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93850940639632 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa85a0 con 0x555b5fef3560 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== watch-notify(notify (1) cookie 93850939951792 notify 137438953500 ret 0) ==== 191+0+0 (crc 0 0 0) 0x555b5fee3ea0 con 0x555b5fef3560 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb03affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 93850939951792 notifier 4776 bl.length()=149 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb03affd640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb020003d70 con 0x555b5fef3560 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== osd_op_reply(137 notify.6 [notify cookie 93850940639632 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== watch-notify(notify_complete (2) cookie 93850940639632 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b5fee3c10 con 0x555b5fef3560 2024-09-13T19:35:18.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.184+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:139 8.9 8:94f192d3:root::.bucket.meta.myfoo%3ac35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa80f0 con 0x7fb14c0c7410 2024-09-13T19:35:18.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== osd_op_reply(139 .bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 [call,call,delete] v32'49 uv49 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 from cache 2024-09-13T19:35:18.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7, ofs0, ns] 2024-09-13T19:35:18.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93850940638432 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa80f0 con 0x7fb14c0c7410 2024-09-13T19:35:18.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== watch-notify(notify (1) cookie 93850939934352 notify 137438953516 ret 0) ==== 248+0+0 (crc 0 0 0) 0x555b5ff2c170 con 0x7fb14c0c7410 2024-09-13T19:35:18.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb03a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953516 cookie 93850939934352 notifier 4776 bl.length()=206 2024-09-13T19:35:18.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb03a7fc640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faf900032d0 con 0x7fb14c0c7410 2024-09-13T19:35:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(140 notify.0 [notify cookie 93850940638432 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== watch-notify(notify_complete (2) cookie 93850940638432 notify 137438953516 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b5ff0d550 con 0x7fb14c0c7410 2024-09-13T19:35:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:142 4.10 4:0a9b0abd:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa80f0 con 0x555b5fef8010 2024-09-13T19:35:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:143 4.12 4:4b983460:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa84e0 con 0x555b5feeeb60 2024-09-13T19:35:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:144 4.33 4:cc8105b6:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff33130 con 0x555b5fef3560 2024-09-13T19:35:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:145 4.17 4:e8dee6eb:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa80f0 con 0x555b5fef3560 2024-09-13T19:35:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:146 4.35 4:ac99e5be:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa84e0 con 0x555b5feeeb60 2024-09-13T19:35:18.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:147 4.29 4:94e56179:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff33130 con 0x555b5fef8010 2024-09-13T19:35:18.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:148 4.33 4:cd86163d:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa84e0 con 0x555b5fef3560 2024-09-13T19:35:18.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:149 4.2b 4:d60abeba:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffa80f0 con 0x555b5feeeb60 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:150 4.3e 4:7e78dc3c:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff372a0 con 0x7fb14c0c7410 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:151 4.20 4:0553e41f:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff33130 con 0x555b5feeeb60 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:152 4.35 4:ae409bd4:::.dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff34290 con 0x555b5feeeb60 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.188+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 49 ==== osd_op_reply(143 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.1 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(147 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.5 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(144 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.2 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(145 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.3 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 50 ==== osd_op_reply(149 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 51 ==== osd_op_reply(146 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.4 [delete] v32'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 33 ==== osd_op_reply(142 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.0 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== osd_op_reply(150 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.8 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(148 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.6 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 52 ==== osd_op_reply(151 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.9 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 53 ==== osd_op_reply(152 .dir.c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7.10 [delete] v32'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15e3f6980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 : miss 2024-09-13T19:35:18.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15e3f6980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:153 6.8 6:123c85b8:::pubsub..bucket.myfoo%2fc35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x555b5fef8010 2024-09-13T19:35:18.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 34 ==== osd_op_reply(153 pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15e3f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15e3f6980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 info.flags=0x0 2024-09-13T19:35:18.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15e3f6980 10 adding default.rgw.log++pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 to cache LRU end 2024-09-13T19:35:18.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:154 6.8 6:123c85b8:::pubsub..bucket.myfoo%2fc35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x555b5fef8010 2024-09-13T19:35:18.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 35 ==== osd_op_reply(154 pubsub..bucket.myfoo/c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.7 [delete] v32'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.192+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x7fb14c0c7410 2024-09-13T19:35:18.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.196+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(155 foo.buckets [call] v32'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.196+0000 7fb15e3f6980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-13T19:35:18.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.196+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x555b5fef3560 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.196+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15e3f6980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 93850940646128 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff35ea0 con 0x7fb14c0c7410 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== watch-notify(notify (1) cookie 93850939944752 notify 137438953517 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555b5ff0d550 con 0x7fb14c0c7410 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb03a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953517 cookie 93850939944752 notifier 4776 bl.length()=170 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 34 ==== osd_op_reply(157 notify.3 [notify cookie 93850940646128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb03a7fc640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faf900032b0 con 0x7fb14c0c7410 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 35 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 36 ==== watch-notify(notify_complete (2) cookie 93850940646128 notify 137438953517 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b5ff0e3b0 con 0x7fb14c0c7410 2024-09-13T19:35:18.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15e3f6980 10 removing email index: foo@foo.com 2024-09-13T19:35:18.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x555b5feeeb60 2024-09-13T19:35:18.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 54 ==== osd_op_reply(159 foo@foo.com [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15e3f6980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T19:35:18.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 93850940646128 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff37760 con 0x7fb14c0c7410 2024-09-13T19:35:18.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 37 ==== watch-notify(notify (1) cookie 93850939944752 notify 137438953518 ret 0) ==== 204+0+0 (crc 0 0 0) 0x555b5ff0e3b0 con 0x7fb14c0c7410 2024-09-13T19:35:18.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 38 ==== osd_op_reply(160 notify.3 [notify cookie 93850940646128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb03a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953518 cookie 93850939944752 notifier 4776 bl.length()=162 2024-09-13T19:35:18.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.200+0000 7fb03a7fc640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faf900032b0 con 0x7fb14c0c7410 2024-09-13T19:35:18.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 39 ==== watch-notify(notify_complete (2) cookie 93850940646128 notify 137438953518 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b5ff0e1e0 con 0x7fb14c0c7410 2024-09-13T19:35:18.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 40 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15e3f6980 10 removing user buckets index 2024-09-13T19:35:18.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x7fb14c0c7410 2024-09-13T19:35:18.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 41 ==== osd_op_reply(162 foo.buckets [delete] v32'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15e3f6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-13T19:35:18.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93850940646128 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff37760 con 0x555b5fef3560 2024-09-13T19:35:18.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 41 ==== watch-notify(notify (1) cookie 93850939949520 notify 137438953501 ret 0) ==== 202+0+0 (crc 0 0 0) 0x555b5fee3c10 con 0x555b5fef3560 2024-09-13T19:35:18.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb03a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 93850939949520 notifier 4776 bl.length()=160 2024-09-13T19:35:18.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb03a7fc640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faf900032b0 con 0x555b5fef3560 2024-09-13T19:35:18.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 42 ==== osd_op_reply(163 notify.5 [notify cookie 93850940646128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.204+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 43 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 44 ==== watch-notify(notify_complete (2) cookie 93850940646128 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b5fedcda0 con 0x555b5fef3560 2024-09-13T19:35:18.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15e3f6980 10 removing user index: foo 2024-09-13T19:35:18.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2f0 con 0x555b5feeeb60 2024-09-13T19:35:18.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 55 ==== osd_op_reply(165 foo [call,call,delete] v32'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15e3f6980 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-13T19:35:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15e3f6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:35:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 93850940646128 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff37760 con 0x555b5feeeb60 2024-09-13T19:35:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 56 ==== watch-notify(notify (1) cookie 93850939943552 notify 137438953490 ret 0) ==== 194+0+0 (crc 0 0 0) 0x555b5ff0e1e0 con 0x555b5feeeb60 2024-09-13T19:35:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb03affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 93850939943552 notifier 4776 bl.length()=152 2024-09-13T19:35:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 57 ==== osd_op_reply(166 notify.4 [notify cookie 93850940646128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb03affd640 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb020003d70 con 0x555b5feeeb60 2024-09-13T19:35:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 58 ==== watch-notify(notify_complete (2) cookie 93850940646128 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b5ff0df30 con 0x555b5feeeb60 2024-09-13T19:35:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 59 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.208+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93850939956928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ffaa2b0 con 0x555b5feeeb60 2024-09-13T19:35:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.212+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 60 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 93850939956928] v32'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.212+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93850939934352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01ec0 con 0x7fb14c0c7410 2024-09-13T19:35:18.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.212+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 42 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 93850939934352] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.212+0000 7fb15e3f6980 20 remove_watcher() i=0 2024-09-13T19:35:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.212+0000 7fb15e3f6980 2 removed watcher, disabling cache 2024-09-13T19:35:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.212+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93850939938752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff33860 con 0x555b5feeeb60 2024-09-13T19:35:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.216+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 61 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 93850939938752] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.216+0000 7fb15e3f6980 20 remove_watcher() i=1 2024-09-13T19:35:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.216+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93850939931872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01ec0 con 0x555b5fef8010 2024-09-13T19:35:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.216+0000 7fb15bf06640 1 -- 172.21.15.144:0/1656301438 <== osd.3 v2:172.21.15.144:6800/1157716661 36 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 93850939931872] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14c0ef070 con 0x555b5fef8010 2024-09-13T19:35:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.216+0000 7fb15e3f6980 20 remove_watcher() i=2 2024-09-13T19:35:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.216+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93850939944752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01ec0 con 0x7fb14c0c7410 2024-09-13T19:35:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.220+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.2 v2:172.21.15.144:6816/2341760841 43 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 93850939944752] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x7fb14c0c7410 2024-09-13T19:35:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.220+0000 7fb15e3f6980 20 remove_watcher() i=3 2024-09-13T19:35:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.220+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93850939943552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01ec0 con 0x555b5feeeb60 2024-09-13T19:35:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.220+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 <== osd.1 v2:172.21.15.144:6808/3556169889 62 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 93850939943552] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14405a040 con 0x555b5feeeb60 2024-09-13T19:35:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.220+0000 7fb15e3f6980 20 remove_watcher() i=4 2024-09-13T19:35:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.220+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93850939949520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefea80 con 0x555b5fef3560 2024-09-13T19:35:18.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.224+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 45 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 93850939949520] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.224+0000 7fb15e3f6980 20 remove_watcher() i=5 2024-09-13T19:35:18.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.224+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93850939951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5ff01ec0 con 0x555b5fef3560 2024-09-13T19:35:18.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.224+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 46 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 93850939951792] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.224+0000 7fb15e3f6980 20 remove_watcher() i=6 2024-09-13T19:35:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.224+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93850939955392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b5fefea80 con 0x555b5fef3560 2024-09-13T19:35:18.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15c707640 1 -- 172.21.15.144:0/1656301438 <== osd.0 v2:172.21.15.18:6800/2700511246 47 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 93850939955392] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb154036030 con 0x555b5fef3560 2024-09-13T19:35:18.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 20 remove_watcher() i=7 2024-09-13T19:35:18.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5fef3560 msgr2=0x555b5fef5950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5fef3560 0x555b5fef5950 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5feeeb60 msgr2=0x555b5fef1020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5feeeb60 0x555b5fef1020 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb14c0c7410 msgr2=0x7fb14c0a9700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb14c0c7410 0x7fb14c0a9700 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x555b5fef8010 msgr2=0x555b5fefa420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x555b5fef8010 0x555b5fefa420 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb0240346a0 msgr2=0x7fb024036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb0240346a0 0x7fb024036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb14c019740 tx=0x7fb14c0e0000 comp rx=0 tx=0).stop 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 msgr2=0x555b5fee36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fee36d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb154017fe0 tx=0x7fb15404a2f0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15b705640 1 -- 172.21.15.144:0/1656301438 reap_dead start 2024-09-13T19:35:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 shutdown_connections 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/1656301438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fedc3d0 0x555b5fee36d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 >> 172.21.15.144:0/1656301438 conn(0x555b5fed87b0 msgr2=0x555b5fed6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 shutdown_connections 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/1656301438 wait complete. 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2113276290 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb034034650 msgr2=0x7fb034036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2113276290 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb034034650 0x7fb034036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x555b5febc860 tx=0x7fb14c0a4000 comp rx=0 tx=0).stop 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2113276290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fecf8b0 msgr2=0x555b5fecfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2113276290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fecf8b0 0x555b5fecfcd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x555b5febc7c0 tx=0x7fb15400af40 comp rx=0 tx=0).stop 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2113276290 shutdown_connections 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2113276290 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb034034650 0x7fb034036b10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2113276290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fecf8b0 0x555b5fecfcd0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2113276290 >> 172.21.15.144:0/2113276290 conn(0x555b5fec4a00 msgr2=0x555b5fec7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2113276290 shutdown_connections 2024-09-13T19:35:18.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2113276290 wait complete. 2024-09-13T19:35:18.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5febe710 msgr2=0x555b5fec0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5febe710 0x555b5fec0b00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5fd377d0 msgr2=0x555b5febbd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5fd377d0 0x555b5febbd80 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb044034650 msgr2=0x7fb044036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb044034650 0x7fb044036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb144000f70 tx=0x7fb144001420 comp rx=0 tx=0).stop 2024-09-13T19:35:18.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 msgr2=0x555b5feb4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.228+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feb4d90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb14c017ca0 tx=0x7fb14c017e30 comp rx=0 tx=0).stop 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.232+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 shutdown_connections 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.232+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x555b5fd377d0 0x555b5febbd80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.232+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x555b5febe710 0x555b5fec0b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.232+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb044034650 0x7fb044036b10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.232+0000 7fb15e3f6980 1 --2- 172.21.15.144:0/2135320791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b5fd373c0 0x555b5feb4d90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.232+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 >> 172.21.15.144:0/2135320791 conn(0x555b5fdbc1c0 msgr2=0x555b5fea8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.232+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 shutdown_connections 2024-09-13T19:35:18.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.232+0000 7fb15e3f6980 1 -- 172.21.15.144:0/2135320791 wait complete. 2024-09-13T19:35:18.245 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:35:18.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:35:18.246 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:35:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b52b9c980 1 Processor -- start 2024-09-13T19:35:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b52b9c980 1 -- start start 2024-09-13T19:35:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b52b9c980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556b863f0b00 0x556b8647f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b52b9c980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b86304ae0 con 0x556b8647f870 2024-09-13T19:35:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b52b9c980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x556b86328e30 con 0x556b863f0b00 2024-09-13T19:35:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b506ac640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556b863f0b00 0x556b8647f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b506ac640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556b863f0b00 0x556b8647f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59110/0 (socket says 172.21.15.144:59110) 2024-09-13T19:35:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b4feab640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x556b8647f870 0x556b86481c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:33010/0 (socket says 172.21.15.144:33010) 2024-09-13T19:35:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b506ac640 1 -- 172.21.15.144:0/2035871016 learned_addr learned my addr 172.21.15.144:0/2035871016 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b506ac640 1 -- 172.21.15.144:0/2035871016 >> v1:172.21.15.18:6789/0 conn(0x556b8647f870 legacy=0x556b86481c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.324+0000 7f6b506ac640 1 -- 172.21.15.144:0/2035871016 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b86484390 con 0x556b863f0b00 2024-09-13T19:35:18.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b506ac640 1 --2- 172.21.15.144:0/2035871016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8647f330 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000a5c0 tx=0x7f6b4001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c60c4325871f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b4f6aa640 1 -- 172.21.15.144:0/2035871016 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b400a6070 con 0x556b863f0b00 2024-09-13T19:35:18.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b4f6aa640 1 -- 172.21.15.144:0/2035871016 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b400af070 con 0x556b863f0b00 2024-09-13T19:35:18.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b4f6aa640 1 -- 172.21.15.144:0/2035871016 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b400aa5c0 con 0x556b863f0b00 2024-09-13T19:35:18.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b52b9c980 1 -- 172.21.15.144:0/2035871016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 msgr2=0x556b8647f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/2035871016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8647f330 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000a5c0 tx=0x7f6b4001b340 comp rx=0 tx=0).stop 2024-09-13T19:35:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b52b9c980 1 -- 172.21.15.144:0/2035871016 shutdown_connections 2024-09-13T19:35:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/2035871016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8647f330 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b52b9c980 1 -- 172.21.15.144:0/2035871016 >> 172.21.15.144:0/2035871016 conn(0x556b86477060 msgr2=0x556b86479480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b52b9c980 1 -- 172.21.15.144:0/2035871016 shutdown_connections 2024-09-13T19:35:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.328+0000 7f6b52b9c980 1 -- 172.21.15.144:0/2035871016 wait complete. 2024-09-13T19:35:18.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b52b9c980 1 Processor -- start 2024-09-13T19:35:18.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b52b9c980 1 -- start start 2024-09-13T19:35:18.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b52b9c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b86567a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b52b9c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556b8632a200 con 0x556b863f0b00 2024-09-13T19:35:18.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b506ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b86567a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b506ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b86567a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59114/0 (socket says 172.21.15.144:59114) 2024-09-13T19:35:18.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b506ac640 1 -- 172.21.15.144:0/3035973099 learned_addr learned my addr 172.21.15.144:0/3035973099 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b506ac640 1 -- 172.21.15.144:0/3035973099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b86568020 con 0x556b863f0b00 2024-09-13T19:35:18.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6b506ac640 1 --2- 172.21.15.144:0/3035973099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b86567a50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6b400199f0 tx=0x7f6b40003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35693dffcb26a616 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6a3e60c640 1 -- 172.21.15.144:0/3035973099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b400aaa00 con 0x556b863f0b00 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6a3e60c640 1 -- 172.21.15.144:0/3035973099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b400aaba0 con 0x556b863f0b00 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.344+0000 7f6a3e60c640 1 -- 172.21.15.144:0/3035973099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b400bd3f0 con 0x556b863f0b00 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3035973099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 msgr2=0x556b86567a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/3035973099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b86567a50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6b400199f0 tx=0x7f6b40003030 comp rx=0 tx=0).stop 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3035973099 shutdown_connections 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/3035973099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b86567a50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3035973099 >> 172.21.15.144:0/3035973099 conn(0x556b86477060 msgr2=0x556b86563680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3035973099 shutdown_connections 2024-09-13T19:35:18.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3035973099 wait complete. 2024-09-13T19:35:18.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 Processor -- start 2024-09-13T19:35:18.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- start start 2024-09-13T19:35:18.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8656ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556b86483e30 con 0x556b863f0b00 2024-09-13T19:35:18.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b506ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8656ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b506ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8656ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59122/0 (socket says 172.21.15.144:59122) 2024-09-13T19:35:18.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b506ac640 1 -- 172.21.15.144:0/143610832 learned_addr learned my addr 172.21.15.144:0/143610832 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b506ac640 1 -- 172.21.15.144:0/143610832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8656f200 con 0x556b863f0b00 2024-09-13T19:35:18.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b506ac640 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8656ecc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6b400199f0 tx=0x7f6b400180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6a3ce09640 1 -- 172.21.15.144:0/143610832 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b400bd7c0 con 0x556b863f0b00 2024-09-13T19:35:18.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b8656f490 con 0x556b863f0b00 2024-09-13T19:35:18.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6a3ce09640 1 -- 172.21.15.144:0/143610832 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b400bd960 con 0x556b863f0b00 2024-09-13T19:35:18.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6a3ce09640 1 -- 172.21.15.144:0/143610832 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b400bdc40 con 0x556b863f0b00 2024-09-13T19:35:18.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.348+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b8656f8c0 con 0x556b863f0b00 2024-09-13T19:35:18.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6a3ce09640 1 -- 172.21.15.144:0/143610832 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b400ce020 con 0x556b863f0b00 2024-09-13T19:35:18.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6a3ce09640 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a380346a0 0x7f6a38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6a3ce09640 1 -- 172.21.15.144:0/143610832 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6b400cc020 con 0x556b863f0b00 2024-09-13T19:35:18.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b4feab640 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a380346a0 0x7f6a38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b8647f870 0x556b86575cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865762f0 con 0x556b8647f870 2024-09-13T19:35:18.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b50ead640 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b8647f870 0x556b86575cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b4feab640 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a380346a0 0x7f6a38036b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6b44000f70 tx=0x7f6b44001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b50ead640 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b8647f870 0x556b86575cb0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b50ead640 1 -- 172.21.15.144:0/143610832 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4800a4d0 con 0x556b8647f870 2024-09-13T19:35:18.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b86573200 con 0x556b8647f870 2024-09-13T19:35:18.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b50ead640 1 -- 172.21.15.144:0/143610832 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b4800a4d0 con 0x556b8647f870 2024-09-13T19:35:18.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b86578620 0x556b8657aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b8657b0e0 con 0x556b86578620 2024-09-13T19:35:18.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b506ac640 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b86578620 0x556b8657aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.352+0000 7f6b506ac640 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b86578620 0x556b8657aa10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b506ac640 1 -- 172.21.15.144:0/143610832 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b400e5050 con 0x556b86578620 2024-09-13T19:35:18.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865774c0 con 0x556b8647f870 2024-09-13T19:35:18.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b50ead640 1 -- 172.21.15.144:0/143610832 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b4800a4d0 con 0x556b8647f870 2024-09-13T19:35:18.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b86577980 con 0x556b8647f870 2024-09-13T19:35:18.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b50ead640 1 -- 172.21.15.144:0/143610832 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b4800a4d0 con 0x556b8647f870 2024-09-13T19:35:18.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b52b9c980 1 Processor -- start 2024-09-13T19:35:18.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b52b9c980 1 -- start start 2024-09-13T19:35:18.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b52b9c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b8647cc90 0x556b8647b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b52b9c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556b86383800 con 0x556b8647cc90 2024-09-13T19:35:18.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b50ead640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b8647cc90 0x556b8647b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b50ead640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b8647cc90 0x556b8647b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59136/0 (socket says 172.21.15.144:59136) 2024-09-13T19:35:18.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b50ead640 1 -- 172.21.15.144:0/3018464958 learned_addr learned my addr 172.21.15.144:0/3018464958 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b50ead640 1 -- 172.21.15.144:0/3018464958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8647d0b0 con 0x556b8647cc90 2024-09-13T19:35:18.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b50ead640 1 --2- 172.21.15.144:0/3018464958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b8647cc90 0x556b8647b310 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x556b865766f0 tx=0x7f6b48018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6a35ffb640 1 -- 172.21.15.144:0/3018464958 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b48014450 con 0x556b8647cc90 2024-09-13T19:35:18.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6a35ffb640 1 -- 172.21.15.144:0/3018464958 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b480145f0 con 0x556b8647cc90 2024-09-13T19:35:18.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6a35ffb640 1 -- 172.21.15.144:0/3018464958 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b48014910 con 0x556b8647cc90 2024-09-13T19:35:18.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3018464958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b8647b8b0 con 0x556b8647cc90 2024-09-13T19:35:18.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.356+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3018464958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b8647bcc0 con 0x556b8647cc90 2024-09-13T19:35:18.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6a35ffb640 1 -- 172.21.15.144:0/3018464958 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b48011040 con 0x556b8647cc90 2024-09-13T19:35:18.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6a35ffb640 1 --2- 172.21.15.144:0/3018464958 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a28034650 0x7f6a28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6a35ffb640 1 -- 172.21.15.144:0/3018464958 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6b4801e070 con 0x556b8647cc90 2024-09-13T19:35:18.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b506ac640 1 --2- 172.21.15.144:0/3018464958 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a28034650 0x7f6a28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 Processor -- start 2024-09-13T19:35:18.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 -- start start 2024-09-13T19:35:18.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b506ac640 1 --2- 172.21.15.144:0/3018464958 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a28034650 0x7f6a28036b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x556b86576790 tx=0x7f6b400d04b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b865988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556b865682e0 con 0x556b865984b0 2024-09-13T19:35:18.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b50ead640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b865988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b50ead640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b865988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59146/0 (socket says 172.21.15.144:59146) 2024-09-13T19:35:18.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b50ead640 1 -- 172.21.15.144:0/1840804668 learned_addr learned my addr 172.21.15.144:0/1840804668 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b50ead640 1 -- 172.21.15.144:0/1840804668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b86598e80 con 0x556b865984b0 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b50ead640 1 --2- 172.21.15.144:0/1840804668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b865988b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6b4804a160 tx=0x7f6b48016a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fad1fc91f543c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6a277fe640 1 -- 172.21.15.144:0/1840804668 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b4803f070 con 0x556b865984b0 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6a277fe640 1 -- 172.21.15.144:0/1840804668 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b480433b0 con 0x556b865984b0 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6a277fe640 1 -- 172.21.15.144:0/1840804668 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b48022a50 con 0x556b865984b0 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1840804668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 msgr2=0x556b865988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1840804668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b865988b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6b4804a160 tx=0x7f6b48016a90 comp rx=0 tx=0).stop 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1840804668 shutdown_connections 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1840804668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b865988b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1840804668 >> 172.21.15.144:0/1840804668 conn(0x556b86594890 msgr2=0x556b86592990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1840804668 shutdown_connections 2024-09-13T19:35:18.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.360+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1840804668 wait complete. 2024-09-13T19:35:18.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b52b9c980 1 Processor -- start 2024-09-13T19:35:18.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b52b9c980 1 -- start start 2024-09-13T19:35:18.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b52b9c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b8659f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b52b9c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556b86599480 con 0x556b865984b0 2024-09-13T19:35:18.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b50ead640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b8659f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b50ead640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b8659f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59162/0 (socket says 172.21.15.144:59162) 2024-09-13T19:35:18.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 learned_addr learned my addr 172.21.15.144:0/1088035164 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8659fd80 con 0x556b865984b0 2024-09-13T19:35:18.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b50ead640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b8659f840 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6b4803bdb0 tx=0x7f6b4804a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6a25ffb640 1 -- 172.21.15.144:0/1088035164 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b4804b2e0 con 0x556b865984b0 2024-09-13T19:35:18.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6a25ffb640 1 -- 172.21.15.144:0/1088035164 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4804b480 con 0x556b865984b0 2024-09-13T19:35:18.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b865a0010 con 0x556b865984b0 2024-09-13T19:35:18.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6a25ffb640 1 -- 172.21.15.144:0/1088035164 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b4804b780 con 0x556b865984b0 2024-09-13T19:35:18.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b865a2cf0 con 0x556b865984b0 2024-09-13T19:35:18.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6a25ffb640 1 -- 172.21.15.144:0/1088035164 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b48042070 con 0x556b865984b0 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.364+0000 7f6a25ffb640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a180346a0 0x7f6a18036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6a25ffb640 1 -- 172.21.15.144:0/1088035164 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6b48034030 con 0x556b865984b0 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b506ac640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a180346a0 0x7f6a18036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b865aacd0 0x556b865ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865ad890 con 0x556b865aacd0 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b4feab640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b865aacd0 0x556b865ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b506ac640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a180346a0 0x7f6a18036b60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b400cf6f0 tx=0x7f6b400dd000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b4feab640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b865aacd0 0x556b865ad140 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4400f620 con 0x556b865aacd0 2024-09-13T19:35:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 realm 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865aa230 con 0x556b865aacd0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4400f620 con 0x556b865aacd0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865ae390 con 0x556b865aacd0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4400f620 con 0x556b865aacd0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865ae8c0 con 0x556b865aacd0 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b4400f620 con 0x556b865aacd0 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b865af6c0 0x556b865b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865b2030 con 0x556b865af6c0 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b50ead640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b865af6c0 0x556b865b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b50ead640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b865af6c0 0x556b865b1ab0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 20 searching for the correct realm 2024-09-13T19:35:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556b865b4010 0x556b865b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.368+0000 7f6b506ac640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556b865b4010 0x556b865b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b506ac640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556b865b4010 0x556b865b64d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b506ac640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6b40009040 0x7f6b400c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x7f6b40009040 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6b40009040 0x7f6b400c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6b40009040 0x7f6b400c6480 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400f620 con 0x7f6b40009040 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865af6c0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6b4400f620 con 0x556b865aacd0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865af6c0 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x7f6b40009040 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.372+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865af6c0 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x7f6b40009040 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865af6c0 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.376+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865af6c0 2024-09-13T19:35:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x7f6b40009040 2024-09-13T19:35:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865af6c0 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865af6c0 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x7f6b40009040 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865b4010 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.380+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865af6c0 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x556b865aacd0 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b865b6ba0 con 0x7f6b40009040 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865b29f0 con 0x556b865aacd0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865b2e70 con 0x556b865aacd0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865b32d0 con 0x556b865aacd0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 zone default found 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 4 Realm: () 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 zonegroup default 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865b7020 con 0x556b865af6c0 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865b2630 con 0x556b865b4010 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865b93e0 con 0x556b865b4010 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 started sync module instance, tier type = 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.384+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865b8240 con 0x7f6b40009040 2024-09-13T19:35:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.388+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.388+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920304007008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865b9840 con 0x7f6b40009040 2024-09-13T19:35:18.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.388+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865ba090 con 0x556b865aacd0 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.388+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920304007008] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.388+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.388+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920304011328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865ba110 con 0x556b865aacd0 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.388+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865ba960 con 0x556b865b4010 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920304011328] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920304012656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bad00 con 0x556b865b4010 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bb6c0 con 0x7f6b40009040 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920304018208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bbd70 con 0x7f6b40009040 2024-09-13T19:35:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bc890 con 0x556b865aacd0 2024-09-13T19:35:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920304012656] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920304018208] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920304022368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bc850 con 0x556b865aacd0 2024-09-13T19:35:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.392+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bcc80 con 0x556b865af6c0 2024-09-13T19:35:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.396+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920304022368] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.396+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.396+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920304019392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bd020 con 0x556b865af6c0 2024-09-13T19:35:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.396+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bd9e0 con 0x556b865af6c0 2024-09-13T19:35:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920304026928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bde00 con 0x556b865af6c0 2024-09-13T19:35:18.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865be8f0 con 0x556b865af6c0 2024-09-13T19:35:18.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920304019392] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920304026928] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920304030656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bd950 con 0x556b865af6c0 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 20 add_watcher() i=0 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 20 add_watcher() i=1 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 20 add_watcher() i=2 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 20 add_watcher() i=3 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 20 add_watcher() i=4 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 20 add_watcher() i=5 2024-09-13T19:35:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.400+0000 7f6b52b9c980 20 add_watcher() i=6 2024-09-13T19:35:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920304030656] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 20 add_watcher() i=7 2024-09-13T19:35:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865c19f0 con 0x556b865aacd0 2024-09-13T19:35:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920304013776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bee70 con 0x556b865aacd0 2024-09-13T19:35:18.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920304013776] v32'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6a067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 5 note: GC not initialized 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6a057e2640 20 reqs_thread_entry: start 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 20 Filter name: none 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6976ffd640 20 reqs_thread_entry: start 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b865e4a20 con 0x556b865aacd0 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.404+0000 7f6b52b9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:could not fetch user info: no user info saved 2024-09-13T19:35:18.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.408+0000 7f6a067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:18.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.408+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920304013776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865e49e0 con 0x556b865aacd0 2024-09-13T19:35:18.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.408+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93920304013776] v32'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.408+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920304007008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865e49e0 con 0x7f6b40009040 2024-09-13T19:35:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.408+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93920304007008] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.408+0000 7f6b52b9c980 20 remove_watcher() i=0 2024-09-13T19:35:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.408+0000 7f6b52b9c980 2 removed watcher, disabling cache 2024-09-13T19:35:18.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.408+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920304011328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865e49e0 con 0x556b865aacd0 2024-09-13T19:35:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93920304011328] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b52b9c980 20 remove_watcher() i=1 2024-09-13T19:35:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920304012656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865e49e0 con 0x556b865b4010 2024-09-13T19:35:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b506ac640 1 -- 172.21.15.144:0/1088035164 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93920304012656] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b400e5050 con 0x556b865b4010 2024-09-13T19:35:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b52b9c980 20 remove_watcher() i=2 2024-09-13T19:35:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920304018208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865e28b0 con 0x7f6b40009040 2024-09-13T19:35:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93920304018208] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x7f6b40009040 2024-09-13T19:35:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b52b9c980 20 remove_watcher() i=3 2024-09-13T19:35:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.412+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920304022368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865b8760 con 0x556b865aacd0 2024-09-13T19:35:18.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.416+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93920304022368] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4402b040 con 0x556b865aacd0 2024-09-13T19:35:18.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.416+0000 7f6b52b9c980 20 remove_watcher() i=4 2024-09-13T19:35:18.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.416+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920304019392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865b9840 con 0x556b865af6c0 2024-09-13T19:35:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.416+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93920304019392] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.416+0000 7f6b52b9c980 20 remove_watcher() i=5 2024-09-13T19:35:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.416+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920304026928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bb320 con 0x556b865af6c0 2024-09-13T19:35:18.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93920304026928] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 20 remove_watcher() i=6 2024-09-13T19:35:18.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920304030656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b865bc360 con 0x556b865af6c0 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b50ead640 1 -- 172.21.15.144:0/1088035164 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93920304030656] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b48041030 con 0x556b865af6c0 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 20 remove_watcher() i=7 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b865af6c0 msgr2=0x556b865b1ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b865af6c0 0x556b865b1ab0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b865aacd0 msgr2=0x556b865ad140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b865aacd0 0x556b865ad140 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6b40009040 msgr2=0x7f6b400c6480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6b40009040 0x7f6b400c6480 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556b865b4010 msgr2=0x556b865b64d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.420+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556b865b4010 0x556b865b64d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a180346a0 msgr2=0x7f6a18036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a180346a0 0x7f6a18036b60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b400cf6f0 tx=0x7f6b400dd000 comp rx=0 tx=0).stop 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b4feab640 1 -- 172.21.15.144:0/1088035164 reap_dead start 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 msgr2=0x556b8659f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b8659f840 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6b4803bdb0 tx=0x7f6b4804a0c0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 shutdown_connections 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/1088035164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b865984b0 0x556b8659f840 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 >> 172.21.15.144:0/1088035164 conn(0x556b86594890 msgr2=0x556b86592960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 shutdown_connections 2024-09-13T19:35:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/1088035164 wait complete. 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3018464958 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a28034650 msgr2=0x7f6a28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/3018464958 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a28034650 0x7f6a28036b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x556b86576790 tx=0x7f6b400d04b0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3018464958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b8647cc90 msgr2=0x556b8647b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/3018464958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b8647cc90 0x556b8647b310 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x556b865766f0 tx=0x7f6b48018830 comp rx=0 tx=0).stop 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3018464958 shutdown_connections 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/3018464958 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a28034650 0x7f6a28036b10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/3018464958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b8647cc90 0x556b8647b310 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3018464958 >> 172.21.15.144:0/3018464958 conn(0x556b8657e8f0 msgr2=0x556b86581370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3018464958 shutdown_connections 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/3018464958 wait complete. 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b86578620 msgr2=0x556b8657aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b86578620 0x556b8657aa10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b8647f870 msgr2=0x556b86575cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b8647f870 0x556b86575cb0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a380346a0 msgr2=0x7f6a38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a380346a0 0x7f6a38036b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6b44000f70 tx=0x7f6b44001380 comp rx=0 tx=0).stop 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 msgr2=0x556b8656ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8656ecc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6b400199f0 tx=0x7f6b400180e0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 shutdown_connections 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556b8647f870 0x556b86575cb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556b86578620 0x556b8657aa10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a380346a0 0x7f6a38036b60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 --2- 172.21.15.144:0/143610832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b863f0b00 0x556b8656ecc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 >> 172.21.15.144:0/143610832 conn(0x556b86477060 msgr2=0x556b86562200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 shutdown_connections 2024-09-13T19:35:18.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.424+0000 7f6b52b9c980 1 -- 172.21.15.144:0/143610832 wait complete. 2024-09-13T19:35:18.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T19:35:18.437 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-13T19:35:18.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-13T19:35:18.437 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-13T19:35:18.510 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:18.510 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:18.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc721c8e980 1 Processor -- start 2024-09-13T19:35:18.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc721c8e980 1 -- start start 2024-09-13T19:35:18.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc721c8e980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56480ec32590 0x56480ec32970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc721c8e980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56480eabbae0 con 0x56480ec32ee0 2024-09-13T19:35:18.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc721c8e980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56480eadfe30 con 0x56480ec32590 2024-09-13T19:35:18.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc71f79e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56480ec32590 0x56480ec32970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc71f79e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56480ec32590 0x56480ec32970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59166/0 (socket says 172.21.15.144:59166) 2024-09-13T19:35:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc71ef9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x56480ec32ee0 0x56480ec37910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:33020/0 (socket says 172.21.15.144:33020) 2024-09-13T19:35:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc71f79e640 1 -- 172.21.15.144:0/1838712168 learned_addr learned my addr 172.21.15.144:0/1838712168 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc71f79e640 1 -- 172.21.15.144:0/1838712168 >> v1:172.21.15.18:6789/0 conn(0x56480ec32ee0 legacy=0x56480ec37910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.508+0000 7fc71f79e640 1 -- 172.21.15.144:0/1838712168 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480ec3a160 con 0x56480ec32590 2024-09-13T19:35:18.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc71f79e640 1 --2- 172.21.15.144:0/1838712168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ec32970 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc71800a4e0 tx=0x7fc71801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ec07679606cdb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc71e79c640 1 -- 172.21.15.144:0/1838712168 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7180aa540 con 0x56480ec32590 2024-09-13T19:35:18.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc71e79c640 1 -- 172.21.15.144:0/1838712168 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7180aa6e0 con 0x56480ec32590 2024-09-13T19:35:18.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc71e79c640 1 -- 172.21.15.144:0/1838712168 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7180aaa40 con 0x56480ec32590 2024-09-13T19:35:18.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc721c8e980 1 -- 172.21.15.144:0/1838712168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 msgr2=0x56480ec32970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc721c8e980 1 --2- 172.21.15.144:0/1838712168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ec32970 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc71800a4e0 tx=0x7fc71801b090 comp rx=0 tx=0).stop 2024-09-13T19:35:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc721c8e980 1 -- 172.21.15.144:0/1838712168 shutdown_connections 2024-09-13T19:35:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc721c8e980 1 --2- 172.21.15.144:0/1838712168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ec32970 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc721c8e980 1 -- 172.21.15.144:0/1838712168 >> 172.21.15.144:0/1838712168 conn(0x56480ec2e0b0 msgr2=0x56480ec304d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc721c8e980 1 -- 172.21.15.144:0/1838712168 shutdown_connections 2024-09-13T19:35:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.512+0000 7fc721c8e980 1 -- 172.21.15.144:0/1838712168 wait complete. 2024-09-13T19:35:18.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 Processor -- start 2024-09-13T19:35:18.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 -- start start 2024-09-13T19:35:18.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480eba7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56480eae1200 con 0x56480ec32590 2024-09-13T19:35:18.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc71f79e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480eba7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc71f79e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480eba7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59170/0 (socket says 172.21.15.144:59170) 2024-09-13T19:35:18.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc71f79e640 1 -- 172.21.15.144:0/1174874469 learned_addr learned my addr 172.21.15.144:0/1174874469 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc71f79e640 1 -- 172.21.15.144:0/1174874469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480eba8320 con 0x56480ec32590 2024-09-13T19:35:18.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc71f79e640 1 --2- 172.21.15.144:0/1174874469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480eba7d50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc718017ca0 tx=0x7fc7180033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b0a46eb7346636 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc60c618640 1 -- 172.21.15.144:0/1174874469 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7180b9030 con 0x56480ec32590 2024-09-13T19:35:18.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc60c618640 1 -- 172.21.15.144:0/1174874469 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7180aaac0 con 0x56480ec32590 2024-09-13T19:35:18.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc60c618640 1 -- 172.21.15.144:0/1174874469 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7180aada0 con 0x56480ec32590 2024-09-13T19:35:18.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 -- 172.21.15.144:0/1174874469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 msgr2=0x56480eba7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 --2- 172.21.15.144:0/1174874469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480eba7d50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc718017ca0 tx=0x7fc7180033b0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 -- 172.21.15.144:0/1174874469 shutdown_connections 2024-09-13T19:35:18.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 --2- 172.21.15.144:0/1174874469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480eba7d50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 -- 172.21.15.144:0/1174874469 >> 172.21.15.144:0/1174874469 conn(0x56480ec2e0b0 msgr2=0x56480ed195e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 -- 172.21.15.144:0/1174874469 shutdown_connections 2024-09-13T19:35:18.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 -- 172.21.15.144:0/1174874469 wait complete. 2024-09-13T19:35:18.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 Processor -- start 2024-09-13T19:35:18.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.528+0000 7fc721c8e980 1 -- start start 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc721c8e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ed25d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc721c8e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56480ec39ba0 con 0x56480ec32590 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71f79e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ed25d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71f79e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ed25d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59172/0 (socket says 172.21.15.144:59172) 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71f79e640 1 -- 172.21.15.144:0/2429685247 learned_addr learned my addr 172.21.15.144:0/2429685247 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71f79e640 1 -- 172.21.15.144:0/2429685247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480ed26240 con 0x56480ec32590 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71f79e640 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ed25d00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc718005cc0 tx=0x7fc718017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc60ae15640 1 -- 172.21.15.144:0/2429685247 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7180b9030 con 0x56480ec32590 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56480ed264d0 con 0x56480ec32590 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc60ae15640 1 -- 172.21.15.144:0/2429685247 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7180c3070 con 0x56480ec32590 2024-09-13T19:35:18.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc60ae15640 1 -- 172.21.15.144:0/2429685247 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7180bf750 con 0x56480ec32590 2024-09-13T19:35:18.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56480ed291b0 con 0x56480ec32590 2024-09-13T19:35:18.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc721c8e980 1 Processor -- start 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc721c8e980 1 -- start start 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc721c8e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed1d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc721c8e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56480eb3a800 con 0x56480ed1f340 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc60ae15640 1 -- 172.21.15.144:0/2429685247 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc7180c5030 con 0x56480ec32590 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71ff9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed1d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71ff9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed1d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59176/0 (socket says 172.21.15.144:59176) 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71ff9f640 1 -- 172.21.15.144:0/1246174769 learned_addr learned my addr 172.21.15.144:0/1246174769 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc60ae15640 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc604034650 0x7fc604036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc60ae15640 1 -- 172.21.15.144:0/2429685247 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc7180ba070 con 0x56480ec32590 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71f79e640 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc604034650 0x7fc604036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71ff9f640 1 -- 172.21.15.144:0/1246174769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480ed1de00 con 0x56480ed1f340 2024-09-13T19:35:18.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71f79e640 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc604034650 0x7fc604036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc7180a3cb0 tx=0x7fc7180a3c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.532+0000 7fc71ff9f640 1 --2- 172.21.15.144:0/1246174769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed1d8c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc70800a440 tx=0x7fc70800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0edbe8bed3dcd35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc608e11640 1 -- 172.21.15.144:0/1246174769 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc708008850 con 0x56480ed1f340 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc608e11640 1 -- 172.21.15.144:0/1246174769 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc708008a10 con 0x56480ed1f340 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc608e11640 1 -- 172.21.15.144:0/1246174769 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc708008d30 con 0x56480ed1f340 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- 172.21.15.144:0/1246174769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 msgr2=0x56480ed1d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 --2- 172.21.15.144:0/1246174769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed1d8c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc70800a440 tx=0x7fc70800a900 comp rx=0 tx=0).stop 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- 172.21.15.144:0/1246174769 shutdown_connections 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 --2- 172.21.15.144:0/1246174769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed1d8c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- 172.21.15.144:0/1246174769 >> 172.21.15.144:0/1246174769 conn(0x56480ec32ee0 msgr2=0x56480ed2e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- 172.21.15.144:0/1246174769 shutdown_connections 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- 172.21.15.144:0/1246174769 wait complete. 2024-09-13T19:35:18.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 Processor -- start 2024-09-13T19:35:18.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- start start 2024-09-13T19:35:18.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed3c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56480ed1e0c0 con 0x56480ed1f340 2024-09-13T19:35:18.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc71ff9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed3c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc71ff9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed3c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59182/0 (socket says 172.21.15.144:59182) 2024-09-13T19:35:18.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc71ff9f640 1 -- 172.21.15.144:0/2808767252 learned_addr learned my addr 172.21.15.144:0/2808767252 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc71ff9f640 1 -- 172.21.15.144:0/2808767252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480ed3c570 con 0x56480ed1f340 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc71ff9f640 1 --2- 172.21.15.144:0/2808767252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed3c030 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc708010000 tx=0x7fc708003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc602ffd640 1 -- 172.21.15.144:0/2808767252 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc708013a70 con 0x56480ed1f340 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- 172.21.15.144:0/2808767252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56480ed3c800 con 0x56480ed1f340 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc602ffd640 1 -- 172.21.15.144:0/2808767252 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc708023070 con 0x56480ed1f340 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc602ffd640 1 -- 172.21.15.144:0/2808767252 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc708013d40 con 0x56480ed1f340 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.536+0000 7fc721c8e980 1 -- 172.21.15.144:0/2808767252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56480ed3f4e0 con 0x56480ed1f340 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc721c8e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc721c8e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc602ffd640 1 -- 172.21.15.144:0/2808767252 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc708028460 con 0x56480ed1f340 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc602ffd640 1 --2- 172.21.15.144:0/2808767252 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc5f8034650 0x7fc5f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc721c8e980 1 Processor -- start 2024-09-13T19:35:18.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc602ffd640 1 -- 172.21.15.144:0/2808767252 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc708049ee0 con 0x56480ed1f340 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc71ff9f640 1 --2- 172.21.15.144:0/2808767252 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc5f8034650 0x7fc5f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc721c8e980 1 -- start start 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc721c8e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed55920 0x56480ed55d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc721c8e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56480eba85e0 con 0x56480ed55920 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc71ff9f640 1 --2- 172.21.15.144:0/2808767252 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc5f8034650 0x7fc5f8036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc708027fd0 tx=0x7fc708013ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc71f79e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed55920 0x56480ed55d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc71f79e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed55920 0x56480ed55d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59186/0 (socket says 172.21.15.144:59186) 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc71f79e640 1 -- 172.21.15.144:0/3548586758 learned_addr learned my addr 172.21.15.144:0/3548586758 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc71f79e640 1 -- 172.21.15.144:0/3548586758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480ed56310 con 0x56480ed55920 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc71f79e640 1 --2- 172.21.15.144:0/3548586758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed55920 0x56480ed55d40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc7180bf010 tx=0x7fc7180b4bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc5e2fe5640 1 -- 172.21.15.144:0/3548586758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7180b43a0 con 0x56480ed55920 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc721c8e980 1 -- 172.21.15.144:0/3548586758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56480ed58e70 con 0x56480ed55920 2024-09-13T19:35:18.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc721c8e980 1 -- 172.21.15.144:0/3548586758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56480ed59270 con 0x56480ed55920 2024-09-13T19:35:18.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc5e2fe5640 1 -- 172.21.15.144:0/3548586758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7180b45e0 con 0x56480ed55920 2024-09-13T19:35:18.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc5e2fe5640 1 -- 172.21.15.144:0/3548586758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc718005050 con 0x56480ed55920 2024-09-13T19:35:18.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc5e2fe5640 1 -- 172.21.15.144:0/3548586758 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc7180b3040 con 0x56480ed55920 2024-09-13T19:35:18.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc5e2fe5640 1 --2- 172.21.15.144:0/3548586758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc560034650 0x7fc560036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.540+0000 7fc5e2fe5640 1 -- 172.21.15.144:0/3548586758 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc7180d30e0 con 0x56480ed55920 2024-09-13T19:35:18.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc71ef9d640 1 --2- 172.21.15.144:0/3548586758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc560034650 0x7fc560036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc5e0fe1640 20 reqs_thread_entry: start 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56480ed5b430 0x56480ed5d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56480ed5df30 con 0x56480ed5b430 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc71ef9d640 1 --2- 172.21.15.144:0/3548586758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc560034650 0x7fc560036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc710000f70 tx=0x7fc710001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc71ff9f640 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56480ed5b430 0x56480ed5d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc71ff9f640 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56480ed5b430 0x56480ed5d860 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc71ff9f640 1 -- 172.21.15.144:0/2429685247 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc70801e7a0 con 0x56480ed5b430 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56480ed5fd00 0x56480ed620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:2 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56480ed62740 con 0x56480ed5fd00 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc71f79e640 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56480ed5fd00 0x56480ed620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc71f79e640 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56480ed5fd00 0x56480ed620f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.544+0000 7fc71f79e640 1 -- 172.21.15.144:0/2429685247 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(2 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7180ce070 con 0x56480ed5fd00 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2808767252 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc5f8034650 msgr2=0x7fc5f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2808767252 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc5f8034650 0x7fc5f8036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc708027fd0 tx=0x7fc708013ee0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2808767252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 msgr2=0x56480ed3c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2808767252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed3c030 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc708010000 tx=0x7fc708003000 comp rx=0 tx=0).stop 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2808767252 shutdown_connections 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2808767252 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc5f8034650 0x7fc5f8036b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2808767252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed1f340 0x56480ed3c030 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2808767252 >> 172.21.15.144:0/2808767252 conn(0x56480ec32ee0 msgr2=0x56480ed31200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2808767252 shutdown_connections 2024-09-13T19:35:18.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2808767252 wait complete. 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/3548586758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc560034650 msgr2=0x7fc560036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/3548586758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc560034650 0x7fc560036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc710000f70 tx=0x7fc710001300 comp rx=0 tx=0).stop 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/3548586758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed55920 msgr2=0x56480ed55d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/3548586758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed55920 0x56480ed55d40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc7180bf010 tx=0x7fc7180b4bd0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/3548586758 shutdown_connections 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/3548586758 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc560034650 0x7fc560036b10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/3548586758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ed55920 0x56480ed55d40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/3548586758 >> 172.21.15.144:0/3548586758 conn(0x56480ed4a8f0 msgr2=0x56480ed4d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/3548586758 shutdown_connections 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/3548586758 wait complete. 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56480ed5fd00 msgr2=0x56480ed620f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56480ed5fd00 0x56480ed620f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56480ed5b430 msgr2=0x56480ed5d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56480ed5b430 0x56480ed5d860 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc604034650 msgr2=0x7fc604036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc604034650 0x7fc604036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc7180a3cb0 tx=0x7fc7180a3c40 comp rx=0 tx=0).stop 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 msgr2=0x56480ed25d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ed25d00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc718005cc0 tx=0x7fc718017e30 comp rx=0 tx=0).stop 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 shutdown_connections 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56480ed5b430 0x56480ed5d860 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56480ed5fd00 0x56480ed620f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc604034650 0x7fc604036b10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 --2- 172.21.15.144:0/2429685247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56480ec32590 0x56480ed25d00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 >> 172.21.15.144:0/2429685247 conn(0x56480ec2e0b0 msgr2=0x56480ed18160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 shutdown_connections 2024-09-13T19:35:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.548+0000 7fc721c8e980 1 -- 172.21.15.144:0/2429685247 wait complete. 2024-09-13T19:35:18.560 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:35:18.560 DEBUG:tasks.util.rgw: json result: {'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:35:18.561 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-13T19:35:18.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-13T19:35:18.561 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-13T19:35:18.633 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:18.634 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:18.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f962b568980 1 Processor -- start 2024-09-13T19:35:18.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f962b568980 1 -- start start 2024-09-13T19:35:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f962b568980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55bb9b0499c0 0x55bb9b04bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f962b568980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb9aecdae0 con 0x55bb9b045640 2024-09-13T19:35:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f962b568980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55bb9aef1e30 con 0x55bb9b0499c0 2024-09-13T19:35:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f9628877640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55bb9b0499c0 0x55bb9b04bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f9629078640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55bb9b045640 0x55bb9b045a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:33032/0 (socket says 172.21.15.144:33032) 2024-09-13T19:35:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f9629078640 1 -- 172.21.15.144:0/2593647586 learned_addr learned my addr 172.21.15.144:0/2593647586 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f9628877640 1 -- 172.21.15.144:0/2593647586 >> v1:172.21.15.18:6789/0 conn(0x55bb9b045640 legacy=0x55bb9b045a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.632+0000 7f9628877640 1 -- 172.21.15.144:0/2593647586 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9b04d300 con 0x55bb9b0499c0 2024-09-13T19:35:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f9628877640 1 --2- 172.21.15.144:0/2593647586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b04bdb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f962000a480 tx=0x7f962001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa8d2142a4fb727 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f961bfff640 1 -- 172.21.15.144:0/2593647586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96200b0070 con 0x55bb9b0499c0 2024-09-13T19:35:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f961bfff640 1 -- 172.21.15.144:0/2593647586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96200ab540 con 0x55bb9b0499c0 2024-09-13T19:35:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f961bfff640 1 -- 172.21.15.144:0/2593647586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96200ab840 con 0x55bb9b0499c0 2024-09-13T19:35:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f962b568980 1 -- 172.21.15.144:0/2593647586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 msgr2=0x55bb9b04bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f962b568980 1 --2- 172.21.15.144:0/2593647586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b04bdb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f962000a480 tx=0x7f962001b280 comp rx=0 tx=0).stop 2024-09-13T19:35:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f962b568980 1 -- 172.21.15.144:0/2593647586 shutdown_connections 2024-09-13T19:35:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f962b568980 1 --2- 172.21.15.144:0/2593647586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b04bdb0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f962b568980 1 -- 172.21.15.144:0/2593647586 >> 172.21.15.144:0/2593647586 conn(0x55bb9b041160 msgr2=0x55bb9b043580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f962b568980 1 -- 172.21.15.144:0/2593647586 shutdown_connections 2024-09-13T19:35:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.636+0000 7f962b568980 1 -- 172.21.15.144:0/2593647586 wait complete. 2024-09-13T19:35:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.648+0000 7f962b568980 1 Processor -- start 2024-09-13T19:35:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.648+0000 7f962b568980 1 -- start start 2024-09-13T19:35:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.648+0000 7f962b568980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b045640 0x55bb9b130a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.648+0000 7f962b568980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bb9aef3200 con 0x55bb9b045640 2024-09-13T19:35:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b045640 0x55bb9b130a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b045640 0x55bb9b130a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59204/0 (socket says 172.21.15.144:59204) 2024-09-13T19:35:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 -- 172.21.15.144:0/296061873 learned_addr learned my addr 172.21.15.144:0/296061873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 -- 172.21.15.144:0/296061873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9b131040 con 0x55bb9b045640 2024-09-13T19:35:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 --2- 172.21.15.144:0/296061873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b045640 0x55bb9b130a70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f961c001e20 tx=0x7f961c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5665fb4ca9146a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9517606640 1 -- 172.21.15.144:0/296061873 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f961c012020 con 0x55bb9b045640 2024-09-13T19:35:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9517606640 1 -- 172.21.15.144:0/296061873 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961c00e7c0 con 0x55bb9b045640 2024-09-13T19:35:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9517606640 1 -- 172.21.15.144:0/296061873 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f961c00eb00 con 0x55bb9b045640 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 -- 172.21.15.144:0/296061873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b045640 msgr2=0x55bb9b130a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 --2- 172.21.15.144:0/296061873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b045640 0x55bb9b130a70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f961c001e20 tx=0x7f961c00b790 comp rx=0 tx=0).stop 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 -- 172.21.15.144:0/296061873 shutdown_connections 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 --2- 172.21.15.144:0/296061873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b045640 0x55bb9b130a70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 -- 172.21.15.144:0/296061873 >> 172.21.15.144:0/296061873 conn(0x55bb9b041160 msgr2=0x55bb9b12c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 -- 172.21.15.144:0/296061873 shutdown_connections 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 -- 172.21.15.144:0/296061873 wait complete. 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 Processor -- start 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 -- start start 2024-09-13T19:35:18.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f962b568980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bb9b04ce00 con 0x55bb9b0499c0 2024-09-13T19:35:18.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59216/0 (socket says 172.21.15.144:59216) 2024-09-13T19:35:18.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 learned_addr learned my addr 172.21.15.144:0/3015492415 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9b138580 con 0x55bb9b0499c0 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.652+0000 7f9629078640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b138040 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f961c001e20 tx=0x7f961c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9515e03640 1 -- 172.21.15.144:0/3015492415 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f961c012030 con 0x55bb9b0499c0 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb9b138810 con 0x55bb9b0499c0 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9515e03640 1 -- 172.21.15.144:0/3015492415 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961c001480 con 0x55bb9b0499c0 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9b13b4f0 con 0x55bb9b0499c0 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9515e03640 1 -- 172.21.15.144:0/3015492415 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f961c01a880 con 0x55bb9b0499c0 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 Processor -- start 2024-09-13T19:35:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- start start 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9b1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bb9af4c800 con 0x55bb9b1451f0 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9515e03640 1 -- 172.21.15.144:0/3015492415 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f961c015020 con 0x55bb9b0499c0 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9629879640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9b1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9629879640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9b1455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59222/0 (socket says 172.21.15.144:59222) 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9629879640 1 -- 172.21.15.144:0/1076093980 learned_addr learned my addr 172.21.15.144:0/1076093980 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9515e03640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9510034650 0x7f9510036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9515e03640 1 -- 172.21.15.144:0/3015492415 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f961c020030 con 0x55bb9b0499c0 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9629078640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9510034650 0x7f9510036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9629879640 1 -- 172.21.15.144:0/1076093980 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9b145b30 con 0x55bb9b1451f0 2024-09-13T19:35:18.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9629078640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9510034650 0x7f9510036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f961c01aeb0 tx=0x7f961c01ad00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f9629879640 1 --2- 172.21.15.144:0/1076093980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9b1455f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f962400a430 tx=0x7f962400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75c18582116dab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f950f7fe640 1 -- 172.21.15.144:0/1076093980 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962400f6e0 con 0x55bb9b1451f0 2024-09-13T19:35:18.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f950f7fe640 1 -- 172.21.15.144:0/1076093980 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9624015070 con 0x55bb9b1451f0 2024-09-13T19:35:18.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f950f7fe640 1 -- 172.21.15.144:0/1076093980 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962400fa10 con 0x55bb9b1451f0 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- 172.21.15.144:0/1076093980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 msgr2=0x55bb9b1455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 --2- 172.21.15.144:0/1076093980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9b1455f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f962400a430 tx=0x7f962400a8f0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- 172.21.15.144:0/1076093980 shutdown_connections 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 --2- 172.21.15.144:0/1076093980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9b1455f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- 172.21.15.144:0/1076093980 >> 172.21.15.144:0/1076093980 conn(0x55bb9b1406f0 msgr2=0x55bb9b143540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- 172.21.15.144:0/1076093980 shutdown_connections 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.656+0000 7f962b568980 1 -- 172.21.15.144:0/1076093980 wait complete. 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 1 Processor -- start 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 1 -- start start 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9afbbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bb9b146510 con 0x55bb9b1451f0 2024-09-13T19:35:18.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f9629879640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9afbbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f9629879640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9afbbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59226/0 (socket says 172.21.15.144:59226) 2024-09-13T19:35:18.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f9629879640 1 -- 172.21.15.144:0/340112241 learned_addr learned my addr 172.21.15.144:0/340112241 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f9629879640 1 -- 172.21.15.144:0/340112241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9afbc1c0 con 0x55bb9b1451f0 2024-09-13T19:35:18.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f9629879640 1 --2- 172.21.15.144:0/340112241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9afbbc80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55bb9b145fa0 tx=0x7f9624003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f950dffb640 1 -- 172.21.15.144:0/340112241 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f962400fe00 con 0x55bb9b1451f0 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 1 -- 172.21.15.144:0/340112241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb9afba440 con 0x55bb9b1451f0 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f950dffb640 1 -- 172.21.15.144:0/340112241 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9624010a20 con 0x55bb9b1451f0 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f950dffb640 1 -- 172.21.15.144:0/340112241 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9624010dc0 con 0x55bb9b1451f0 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 1 -- 172.21.15.144:0/340112241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9afba910 con 0x55bb9b1451f0 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f950dffb640 1 -- 172.21.15.144:0/340112241 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f962401a480 con 0x55bb9b1451f0 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f950dffb640 1 --2- 172.21.15.144:0/340112241 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9500034650 0x7f9500036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 1 Processor -- start 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f950dffb640 1 -- 172.21.15.144:0/340112241 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f962404a460 con 0x55bb9b1451f0 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f9629879640 1 --2- 172.21.15.144:0/340112241 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9500034650 0x7f9500036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.660+0000 7f962b568980 1 -- start start 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f962b568980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b16c380 0x55bb9b16c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f962b568980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bb9b1313c0 con 0x55bb9b16c380 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9629879640 1 --2- 172.21.15.144:0/340112241 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9500034650 0x7f9500036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9624019e70 tx=0x7f962402e4b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9629078640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b16c380 0x55bb9b16c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9629078640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b16c380 0x55bb9b16c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59238/0 (socket says 172.21.15.144:59238) 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9629078640 1 -- 172.21.15.144:0/4004638858 learned_addr learned my addr 172.21.15.144:0/4004638858 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9629078640 1 -- 172.21.15.144:0/4004638858 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9b16cd70 con 0x55bb9b16c380 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9629078640 1 --2- 172.21.15.144:0/4004638858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b16c380 0x55bb9b16c7a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f961c0485d0 tx=0x7f961c016980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f94edfe3640 1 -- 172.21.15.144:0/4004638858 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f961c035040 con 0x55bb9b16c380 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f962b568980 1 -- 172.21.15.144:0/4004638858 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb9b16f940 con 0x55bb9b16c380 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f94edfe3640 1 -- 172.21.15.144:0/4004638858 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961c040040 con 0x55bb9b16c380 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f962b568980 1 -- 172.21.15.144:0/4004638858 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9b16fcf0 con 0x55bb9b16c380 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f94edfe3640 1 -- 172.21.15.144:0/4004638858 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f961c0195d0 con 0x55bb9b16c380 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f94edfe3640 1 -- 172.21.15.144:0/4004638858 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f961c009070 con 0x55bb9b16c380 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f94edfe3640 1 --2- 172.21.15.144:0/4004638858 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f946c0347a0 0x7f946c036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f94edfe3640 1 -- 172.21.15.144:0/4004638858 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f961c005050 con 0x55bb9b16c380 2024-09-13T19:35:18.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9628877640 1 --2- 172.21.15.144:0/4004638858 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f946c0347a0 0x7f946c036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f94677fe640 20 reqs_thread_entry: start 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55bb9b171e60 0x55bb9b1742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b174970 con 0x55bb9b171e60 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9628877640 1 --2- 172.21.15.144:0/4004638858 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f946c0347a0 0x7f946c036c60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f96200ad000 tx=0x7f96200a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.664+0000 7f9629879640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55bb9b171e60 0x55bb9b1742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9629879640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55bb9b171e60 0x55bb9b1742f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b175200 con 0x55bb9b171e60 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55bb9b176b10 0x55bb9b178f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b179670 con 0x55bb9b176b10 2024-09-13T19:35:18.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9629078640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55bb9b176b10 0x55bb9b178f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9629078640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55bb9b176b10 0x55bb9b178f80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b180190 con 0x55bb9b171e60 2024-09-13T19:35:18.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.674 INFO:teuthology.orchestra.run.smithi144.stderr:NOTICE: set zone's realm_id= 2024-09-13T19:35:18.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55bb9b1841f0 0x55bb9b180610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9628877640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55bb9b1841f0 0x55bb9b180610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.668+0000 7f9628877640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55bb9b1841f0 0x55bb9b180610 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9628877640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96200ab030 0x7f96200b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x7f96200ab030 2024-09-13T19:35:18.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96200ab030 0x7f96200b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96200ab030 0x7f96200b7930 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x7f96200ab030 2024-09-13T19:35:18.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b176b10 2024-09-13T19:35:18.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b176b10 2024-09-13T19:35:18.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x7f96200ab030 2024-09-13T19:35:18.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x7f96200ab030 2024-09-13T19:35:18.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.672+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b176b10 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x7f96200ab030 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f962400e070 con 0x7f96200ab030 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b176b10 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b176b10 2024-09-13T19:35:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.676+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x7f96200ab030 2024-09-13T19:35:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x7f96200ab030 2024-09-13T19:35:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b176b10 2024-09-13T19:35:18.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b176b10 2024-09-13T19:35:18.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x7f96200ab030 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x7f96200ab030 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b1841f0 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96200b3040 con 0x55bb9b1841f0 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9628877640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b176b10 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.680+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x55bb9b171e60 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.684+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.684+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17fa20 con 0x7f96200ab030 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.684+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f962400e070 con 0x7f96200ab030 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.684+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b1817c0 con 0x55bb9b171e60 2024-09-13T19:35:18.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.684+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.684+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:38 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b182040 con 0x55bb9b176b10 2024-09-13T19:35:18.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.684+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(38 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.684+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:39 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b182440 con 0x55bb9b176b10 2024-09-13T19:35:18.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.688+0000 7f9629078640 1 -- 172.21.15.144:0/3015492415 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(39 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [create,call,writefull 0~1155] v32'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f961c008030 con 0x55bb9b176b10 2024-09-13T19:35:18.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.688+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b17ece0 con 0x55bb9b171e60 2024-09-13T19:35:18.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.688+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.688+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb9b184c40 con 0x55bb9b171e60 2024-09-13T19:35:18.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.688+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f962400e070 con 0x55bb9b171e60 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/340112241 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9500034650 msgr2=0x7f9500036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/340112241 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9500034650 0x7f9500036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9624019e70 tx=0x7f962402e4b0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/340112241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 msgr2=0x55bb9afbbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/340112241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9afbbc80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55bb9b145fa0 tx=0x7f9624003380 comp rx=0 tx=0).stop 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/340112241 shutdown_connections 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/340112241 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9500034650 0x7f9500036b10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/340112241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b1451f0 0x55bb9afbbc80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/340112241 >> 172.21.15.144:0/340112241 conn(0x55bb9b1406f0 msgr2=0x55bb9b13ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/340112241 shutdown_connections 2024-09-13T19:35:18.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/340112241 wait complete. 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/4004638858 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f946c0347a0 msgr2=0x7f946c036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/4004638858 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f946c0347a0 0x7f946c036c60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f96200ad000 tx=0x7f96200a5040 comp rx=0 tx=0).stop 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/4004638858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b16c380 msgr2=0x55bb9b16c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/4004638858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b16c380 0x55bb9b16c7a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f961c0485d0 tx=0x7f961c016980 comp rx=0 tx=0).stop 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/4004638858 shutdown_connections 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/4004638858 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f946c0347a0 0x7f946c036c60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/4004638858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b16c380 0x55bb9b16c7a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/4004638858 >> 172.21.15.144:0/4004638858 conn(0x55bb9b161350 msgr2=0x55bb9b163c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/4004638858 shutdown_connections 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/4004638858 wait complete. 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55bb9b176b10 msgr2=0x55bb9b178f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55bb9b176b10 0x55bb9b178f80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55bb9b171e60 msgr2=0x55bb9b1742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55bb9b171e60 0x55bb9b1742f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96200ab030 msgr2=0x7f96200b7930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f96200ab030 0x7f96200b7930 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55bb9b1841f0 msgr2=0x55bb9b180610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55bb9b1841f0 0x55bb9b180610 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9510034650 msgr2=0x7f9510036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9510034650 0x7f9510036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f961c01aeb0 tx=0x7f961c01ad00 comp rx=0 tx=0).stop 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 msgr2=0x55bb9b138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f9629879640 1 -- 172.21.15.144:0/3015492415 reap_dead start 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b138040 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f961c001e20 tx=0x7f961c000ee0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 shutdown_connections 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 --2- 172.21.15.144:0/3015492415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9b0499c0 0x55bb9b138040 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 >> 172.21.15.144:0/3015492415 conn(0x55bb9b041160 msgr2=0x55bb9b12b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 shutdown_connections 2024-09-13T19:35:18.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.692+0000 7f962b568980 1 -- 172.21.15.144:0/3015492415 wait complete. 2024-09-13T19:35:18.705 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T19:35:18.705 DEBUG:tasks.util.rgw: json result: {'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T19:35:18.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-13T19:35:18.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-13T19:35:18.705 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-13T19:35:18.771 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:18.771 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4919a26980 1 Processor -- start 2024-09-13T19:35:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4919a26980 1 -- start start 2024-09-13T19:35:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4919a26980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5646a3beaab0 0x5646a3c7b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4919a26980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646a3afeae0 con 0x5646a3c7bca0 2024-09-13T19:35:18.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4919a26980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5646a3b22e30 con 0x5646a3beaab0 2024-09-13T19:35:18.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4917536640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5646a3beaab0 0x5646a3c7b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4916d35640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5646a3c7bca0 0x5646a3c7e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:33040/0 (socket says 172.21.15.144:33040) 2024-09-13T19:35:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4916d35640 1 -- 172.21.15.144:0/1912825558 learned_addr learned my addr 172.21.15.144:0/1912825558 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4917536640 1 -- 172.21.15.144:0/1912825558 >> v1:172.21.15.18:6789/0 conn(0x5646a3c7bca0 legacy=0x5646a3c7e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.768+0000 7f4917536640 1 -- 172.21.15.144:0/1912825558 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a3beae90 con 0x5646a3beaab0 2024-09-13T19:35:18.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4917536640 1 --2- 172.21.15.144:0/1912825558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3c7b760 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f491000a420 tx=0x7f491001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e55424905abe26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4916534640 1 -- 172.21.15.144:0/1912825558 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49100af070 con 0x5646a3beaab0 2024-09-13T19:35:18.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4916534640 1 -- 172.21.15.144:0/1912825558 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49100aa530 con 0x5646a3beaab0 2024-09-13T19:35:18.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4916534640 1 -- 172.21.15.144:0/1912825558 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49100aa850 con 0x5646a3beaab0 2024-09-13T19:35:18.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4919a26980 1 -- 172.21.15.144:0/1912825558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 msgr2=0x5646a3c7b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4919a26980 1 --2- 172.21.15.144:0/1912825558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3c7b760 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f491000a420 tx=0x7f491001afd0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4919a26980 1 -- 172.21.15.144:0/1912825558 shutdown_connections 2024-09-13T19:35:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4919a26980 1 --2- 172.21.15.144:0/1912825558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3c7b760 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4919a26980 1 -- 172.21.15.144:0/1912825558 >> 172.21.15.144:0/1912825558 conn(0x5646a3c71050 msgr2=0x5646a3c73470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4919a26980 1 -- 172.21.15.144:0/1912825558 shutdown_connections 2024-09-13T19:35:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.772+0000 7f4919a26980 1 -- 172.21.15.144:0/1912825558 wait complete. 2024-09-13T19:35:18.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 Processor -- start 2024-09-13T19:35:18.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- start start 2024-09-13T19:35:18.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d63c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646a3b24200 con 0x5646a3beaab0 2024-09-13T19:35:18.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4917536640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d63c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4917536640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d63c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59258/0 (socket says 172.21.15.144:59258) 2024-09-13T19:35:18.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4917536640 1 -- 172.21.15.144:0/3744837131 learned_addr learned my addr 172.21.15.144:0/3744837131 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4917536640 1 -- 172.21.15.144:0/3744837131 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a3d64250 con 0x5646a3beaab0 2024-09-13T19:35:18.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4917536640 1 --2- 172.21.15.144:0/3744837131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d63c80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f49100ad040 tx=0x7f49100033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326fd8a750330df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f480560a640 1 -- 172.21.15.144:0/3744837131 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49100af040 con 0x5646a3beaab0 2024-09-13T19:35:18.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f480560a640 1 -- 172.21.15.144:0/3744837131 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49100aab50 con 0x5646a3beaab0 2024-09-13T19:35:18.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f480560a640 1 -- 172.21.15.144:0/3744837131 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49100aae50 con 0x5646a3beaab0 2024-09-13T19:35:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- 172.21.15.144:0/3744837131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 msgr2=0x5646a3d63c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 --2- 172.21.15.144:0/3744837131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d63c80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f49100ad040 tx=0x7f49100033b0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- 172.21.15.144:0/3744837131 shutdown_connections 2024-09-13T19:35:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 --2- 172.21.15.144:0/3744837131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d63c80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- 172.21.15.144:0/3744837131 >> 172.21.15.144:0/3744837131 conn(0x5646a3c71050 msgr2=0x5646a3d5f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- 172.21.15.144:0/3744837131 shutdown_connections 2024-09-13T19:35:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- 172.21.15.144:0/3744837131 wait complete. 2024-09-13T19:35:18.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 Processor -- start 2024-09-13T19:35:18.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- start start 2024-09-13T19:35:18.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d6ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.788+0000 7f4919a26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646a3c82240 con 0x5646a3beaab0 2024-09-13T19:35:18.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917536640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d6ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917536640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d6ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59266/0 (socket says 172.21.15.144:59266) 2024-09-13T19:35:18.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917536640 1 -- 172.21.15.144:0/770311711 learned_addr learned my addr 172.21.15.144:0/770311711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917536640 1 -- 172.21.15.144:0/770311711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a3d6b3c0 con 0x5646a3beaab0 2024-09-13T19:35:18.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917536640 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d6ae80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4910018c00 tx=0x7f4910017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4803e07640 1 -- 172.21.15.144:0/770311711 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49100c5070 con 0x5646a3beaab0 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4803e07640 1 -- 172.21.15.144:0/770311711 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49100b58b0 con 0x5646a3beaab0 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4803e07640 1 -- 172.21.15.144:0/770311711 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49100b5b90 con 0x5646a3beaab0 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646a3d6b650 con 0x5646a3beaab0 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646a3d6e330 con 0x5646a3beaab0 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4919a26980 1 Processor -- start 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4919a26980 1 -- start start 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4919a26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d78040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4919a26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646a3b7d800 con 0x5646a3d77c40 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4803e07640 1 -- 172.21.15.144:0/770311711 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f49100c8070 con 0x5646a3beaab0 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917d37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d78040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917d37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d78040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59280/0 (socket says 172.21.15.144:59280) 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917d37640 1 -- 172.21.15.144:0/2469985901 learned_addr learned my addr 172.21.15.144:0/2469985901 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4803e07640 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47fc034650 0x7f47fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4803e07640 1 -- 172.21.15.144:0/770311711 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f49100bb070 con 0x5646a3beaab0 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917536640 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47fc034650 0x7f47fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917d37640 1 -- 172.21.15.144:0/2469985901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a3d78580 con 0x5646a3d77c40 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917536640 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47fc034650 0x7f47fc036b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49100b6590 tx=0x7f49100b6420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4917d37640 1 --2- 172.21.15.144:0/2469985901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d78040 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f490800a440 tx=0x7f490800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37f0c34e5fc7239 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4801e03640 1 -- 172.21.15.144:0/2469985901 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4908008850 con 0x5646a3d77c40 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4801e03640 1 -- 172.21.15.144:0/2469985901 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4908008a10 con 0x5646a3d77c40 2024-09-13T19:35:18.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.792+0000 7f4801e03640 1 -- 172.21.15.144:0/2469985901 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4908008d30 con 0x5646a3d77c40 2024-09-13T19:35:18.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- 172.21.15.144:0/2469985901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 msgr2=0x5646a3d78040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 --2- 172.21.15.144:0/2469985901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d78040 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f490800a440 tx=0x7f490800a900 comp rx=0 tx=0).stop 2024-09-13T19:35:18.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- 172.21.15.144:0/2469985901 shutdown_connections 2024-09-13T19:35:18.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 --2- 172.21.15.144:0/2469985901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d78040 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- 172.21.15.144:0/2469985901 >> 172.21.15.144:0/2469985901 conn(0x5646a3c7bca0 msgr2=0x5646a3d73550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- 172.21.15.144:0/2469985901 shutdown_connections 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- 172.21.15.144:0/2469985901 wait complete. 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 Processor -- start 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- start start 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d7ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646a3d78810 con 0x5646a3d77c40 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4917d37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d7ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4917d37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d7ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59286/0 (socket says 172.21.15.144:59286) 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4917d37640 1 -- 172.21.15.144:0/2642770483 learned_addr learned my addr 172.21.15.144:0/2642770483 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4917d37640 1 -- 172.21.15.144:0/2642770483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a3d7f480 con 0x5646a3d77c40 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4917d37640 1 --2- 172.21.15.144:0/2642770483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d7ef40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x5646a3d789f0 tx=0x7f4908003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f47f3fff640 1 -- 172.21.15.144:0/2642770483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4908013a70 con 0x5646a3d77c40 2024-09-13T19:35:18.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f47f3fff640 1 -- 172.21.15.144:0/2642770483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4908023070 con 0x5646a3d77c40 2024-09-13T19:35:18.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f47f3fff640 1 -- 172.21.15.144:0/2642770483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4908013d40 con 0x5646a3d77c40 2024-09-13T19:35:18.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- 172.21.15.144:0/2642770483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646a3d7f710 con 0x5646a3d77c40 2024-09-13T19:35:18.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.796+0000 7f4919a26980 1 -- 172.21.15.144:0/2642770483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646a3d823f0 con 0x5646a3d77c40 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4919a26980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4919a26980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f47f3fff640 1 -- 172.21.15.144:0/2642770483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4908028460 con 0x5646a3d77c40 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4919a26980 1 Processor -- start 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f47f3fff640 1 --2- 172.21.15.144:0/2642770483 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47f8034650 0x7f47f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4919a26980 1 -- start start 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f47f3fff640 1 -- 172.21.15.144:0/2642770483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4908049ee0 con 0x5646a3d77c40 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4917d37640 1 --2- 172.21.15.144:0/2642770483 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47f8034650 0x7f47f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4919a26980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d98860 0x5646a3d98c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4919a26980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5646a3d64510 con 0x5646a3d98860 2024-09-13T19:35:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4917d37640 1 --2- 172.21.15.144:0/2642770483 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47f8034650 0x7f47f8036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4908013fd0 tx=0x7f4908013ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4917536640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d98860 0x5646a3d98c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4917536640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d98860 0x5646a3d98c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59290/0 (socket says 172.21.15.144:59290) 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4917536640 1 -- 172.21.15.144:0/1538165394 learned_addr learned my addr 172.21.15.144:0/1538165394 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4917536640 1 -- 172.21.15.144:0/1538165394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a3d99250 con 0x5646a3d98860 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4917536640 1 --2- 172.21.15.144:0/1538165394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d98860 0x5646a3d98c80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f49100aa000 tx=0x7f49100e3530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f475ffff640 1 -- 172.21.15.144:0/1538165394 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49100e30f0 con 0x5646a3d98860 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4919a26980 1 -- 172.21.15.144:0/1538165394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646a3d9bdb0 con 0x5646a3d98860 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f475ffff640 1 -- 172.21.15.144:0/1538165394 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49100e3290 con 0x5646a3d98860 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f475ffff640 1 -- 172.21.15.144:0/1538165394 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49100c15b0 con 0x5646a3d98860 2024-09-13T19:35:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4919a26980 1 -- 172.21.15.144:0/1538165394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646a3d9c1b0 con 0x5646a3d98860 2024-09-13T19:35:18.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f475ffff640 1 -- 172.21.15.144:0/1538165394 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f49100de040 con 0x5646a3d98860 2024-09-13T19:35:18.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f475ffff640 1 --2- 172.21.15.144:0/1538165394 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4754034650 0x7f4754036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f475ffff640 1 -- 172.21.15.144:0/1538165394 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f49100f3ba0 con 0x5646a3d98860 2024-09-13T19:35:18.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f4916d35640 1 --2- 172.21.15.144:0/1538165394 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4754034650 0x7f4754036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.800+0000 7f475dffb640 20 reqs_thread_entry: start 2024-09-13T19:35:18.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4916d35640 1 --2- 172.21.15.144:0/1538165394 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4754034650 0x7f4754036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5646a3d740f0 tx=0x7f490c001280 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646a3d9e370 0x5646a3da07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646a3da0e20 con 0x5646a3d9e370 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4917d37640 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646a3d9e370 0x5646a3da07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4917d37640 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646a3d9e370 0x5646a3da07a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4917d37640 1 -- 172.21.15.144:0/770311711 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f490801e7a0 con 0x5646a3d9e370 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646a3da16d0 con 0x5646a3d9e370 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4917d37640 1 -- 172.21.15.144:0/770311711 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f490801e7a0 con 0x5646a3d9e370 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646a3da2f90 0x5646a3da5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646a3da5b10 con 0x5646a3da2f90 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4917536640 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646a3da2f90 0x5646a3da5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4917536640 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646a3da2f90 0x5646a3da5420 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.804+0000 7f4917536640 1 -- 172.21.15.144:0/770311711 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f49100fb040 con 0x5646a3da2f90 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/2642770483 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47f8034650 msgr2=0x7f47f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/2642770483 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47f8034650 0x7f47f8036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4908013fd0 tx=0x7f4908013ee0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/2642770483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 msgr2=0x5646a3d7ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/2642770483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d7ef40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x5646a3d789f0 tx=0x7f4908003000 comp rx=0 tx=0).stop 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/2642770483 shutdown_connections 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/2642770483 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47f8034650 0x7f47f8036b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/2642770483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d77c40 0x5646a3d7ef40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/2642770483 >> 172.21.15.144:0/2642770483 conn(0x5646a3c7bca0 msgr2=0x5646a3d730c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/2642770483 shutdown_connections 2024-09-13T19:35:18.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/2642770483 wait complete. 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/1538165394 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4754034650 msgr2=0x7f4754036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/1538165394 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4754034650 0x7f4754036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5646a3d740f0 tx=0x7f490c001280 comp rx=0 tx=0).stop 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/1538165394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d98860 msgr2=0x5646a3d98c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/1538165394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d98860 0x5646a3d98c80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f49100aa000 tx=0x7f49100e3530 comp rx=0 tx=0).stop 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/1538165394 shutdown_connections 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/1538165394 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4754034650 0x7f4754036b10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/1538165394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3d98860 0x5646a3d98c80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/1538165394 >> 172.21.15.144:0/1538165394 conn(0x5646a3d8d830 msgr2=0x5646a3d90120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/1538165394 shutdown_connections 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/1538165394 wait complete. 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646a3da2f90 msgr2=0x5646a3da5420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646a3da2f90 0x5646a3da5420 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646a3d9e370 msgr2=0x5646a3da07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646a3d9e370 0x5646a3da07a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47fc034650 msgr2=0x7f47fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47fc034650 0x7f47fc036b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49100b6590 tx=0x7f49100b6420 comp rx=0 tx=0).stop 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 msgr2=0x5646a3d6ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d6ae80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4910018c00 tx=0x7f4910017d70 comp rx=0 tx=0).stop 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 shutdown_connections 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5646a3d9e370 0x5646a3da07a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5646a3da2f90 0x5646a3da5420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f47fc034650 0x7f47fc036b10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 --2- 172.21.15.144:0/770311711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646a3beaab0 0x5646a3d6ae80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 >> 172.21.15.144:0/770311711 conn(0x5646a3c71050 msgr2=0x5646a3d5e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 shutdown_connections 2024-09-13T19:35:18.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.808+0000 7f4919a26980 1 -- 172.21.15.144:0/770311711 wait complete. 2024-09-13T19:35:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T19:35:18.820 DEBUG:tasks.util.rgw: json result: {'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T19:35:18.820 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:35:18.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:35:18.821 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T19:35:18.893 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:18.893 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:18.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b51670980 1 Processor -- start 2024-09-13T19:35:18.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b51670980 1 -- start start 2024-09-13T19:35:18.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b51670980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55559b2c8c80 0x55559b2c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b51670980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55559b1daae0 con 0x55559b2c9090 2024-09-13T19:35:18.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b51670980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55559b1fee30 con 0x55559b2c8c80 2024-09-13T19:35:18.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b4f180640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55559b2c8c80 0x55559b2c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b4f180640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55559b2c8c80 0x55559b2c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59302/0 (socket says 172.21.15.144:59302) 2024-09-13T19:35:18.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b4e97f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55559b2c9090 0x55559b2c7980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:33052/0 (socket says 172.21.15.144:33052) 2024-09-13T19:35:18.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b4f180640 1 -- 172.21.15.144:0/2000652883 learned_addr learned my addr 172.21.15.144:0/2000652883 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b4f180640 1 -- 172.21.15.144:0/2000652883 >> v1:172.21.15.18:6789/0 conn(0x55559b2c9090 legacy=0x55559b2c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b4f180640 1 -- 172.21.15.144:0/2000652883 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559b2c81b0 con 0x55559b2c8c80 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.892+0000 7f5b4f180640 1 --2- 172.21.15.144:0/2000652883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b2c7440 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000a5c0 tx=0x7f5b4001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c020325203177b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b4e17e640 1 -- 172.21.15.144:0/2000652883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b400a6070 con 0x55559b2c8c80 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b4e17e640 1 -- 172.21.15.144:0/2000652883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b400af070 con 0x55559b2c8c80 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b4e17e640 1 -- 172.21.15.144:0/2000652883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b400aa5c0 con 0x55559b2c8c80 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b51670980 1 -- 172.21.15.144:0/2000652883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 msgr2=0x55559b2c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b51670980 1 --2- 172.21.15.144:0/2000652883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b2c7440 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000a5c0 tx=0x7f5b4001b340 comp rx=0 tx=0).stop 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b51670980 1 -- 172.21.15.144:0/2000652883 shutdown_connections 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b51670980 1 --2- 172.21.15.144:0/2000652883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b2c7440 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b51670980 1 -- 172.21.15.144:0/2000652883 >> 172.21.15.144:0/2000652883 conn(0x55559b34e160 msgr2=0x55559b350580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b51670980 1 -- 172.21.15.144:0/2000652883 shutdown_connections 2024-09-13T19:35:18.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.896+0000 7f5b51670980 1 -- 172.21.15.144:0/2000652883 wait complete. 2024-09-13T19:35:18.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b51670980 1 Processor -- start 2024-09-13T19:35:18.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b51670980 1 -- start start 2024-09-13T19:35:18.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b51670980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b43fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b51670980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55559b200200 con 0x55559b2c8c80 2024-09-13T19:35:18.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b4f180640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b43fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b4f180640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b43fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59318/0 (socket says 172.21.15.144:59318) 2024-09-13T19:35:18.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b4f180640 1 -- 172.21.15.144:0/4118887312 learned_addr learned my addr 172.21.15.144:0/4118887312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b4f180640 1 -- 172.21.15.144:0/4118887312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559b4401c0 con 0x55559b2c8c80 2024-09-13T19:35:18.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5b4f180640 1 --2- 172.21.15.144:0/4118887312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b43fbf0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5b40017f50 tx=0x7f5b40003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d946c25103e70dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5a3d60a640 1 -- 172.21.15.144:0/4118887312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b400aa8f0 con 0x55559b2c8c80 2024-09-13T19:35:18.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5a3d60a640 1 -- 172.21.15.144:0/4118887312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b400aaa90 con 0x55559b2c8c80 2024-09-13T19:35:18.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.908+0000 7f5a3d60a640 1 -- 172.21.15.144:0/4118887312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b400aad70 con 0x55559b2c8c80 2024-09-13T19:35:18.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- 172.21.15.144:0/4118887312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 msgr2=0x55559b43fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 --2- 172.21.15.144:0/4118887312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b43fbf0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5b40017f50 tx=0x7f5b40003030 comp rx=0 tx=0).stop 2024-09-13T19:35:18.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- 172.21.15.144:0/4118887312 shutdown_connections 2024-09-13T19:35:18.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 --2- 172.21.15.144:0/4118887312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b43fbf0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- 172.21.15.144:0/4118887312 >> 172.21.15.144:0/4118887312 conn(0x55559b34e160 msgr2=0x55559b43b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- 172.21.15.144:0/4118887312 shutdown_connections 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- 172.21.15.144:0/4118887312 wait complete. 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 Processor -- start 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- start start 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b446f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55559b35e1b0 con 0x55559b2c8c80 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b4f180640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b446f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b4f180640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b446f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59328/0 (socket says 172.21.15.144:59328) 2024-09-13T19:35:18.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b4f180640 1 -- 172.21.15.144:0/1061810550 learned_addr learned my addr 172.21.15.144:0/1061810550 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b4f180640 1 -- 172.21.15.144:0/1061810550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559b447480 con 0x55559b2c8c80 2024-09-13T19:35:18.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b4f180640 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b446f40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5b40096f40 tx=0x7f5b400180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5a3be07640 1 -- 172.21.15.144:0/1061810550 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b400c6690 con 0x55559b2c8c80 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55559b447710 con 0x55559b2c8c80 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5a3be07640 1 -- 172.21.15.144:0/1061810550 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b400cd070 con 0x55559b2c8c80 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55559b44a3f0 con 0x55559b2c8c80 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5a3be07640 1 -- 172.21.15.144:0/1061810550 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b400c6830 con 0x55559b2c8c80 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 Processor -- start 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- start start 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b454190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b51670980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55559b259800 con 0x55559b453d90 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.912+0000 7f5b4f981640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b454190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5a3be07640 1 -- 172.21.15.144:0/1061810550 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b400c69d0 con 0x55559b2c8c80 2024-09-13T19:35:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b454190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59338/0 (socket says 172.21.15.144:59338) 2024-09-13T19:35:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 -- 172.21.15.144:0/2500446054 learned_addr learned my addr 172.21.15.144:0/2500446054 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5a3be07640 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a34034650 0x7f5a34036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5a3be07640 1 -- 172.21.15.144:0/1061810550 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5b400e5870 con 0x55559b2c8c80 2024-09-13T19:35:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f180640 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a34034650 0x7f5a34036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 -- 172.21.15.144:0/2500446054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559b4546d0 con 0x55559b453d90 2024-09-13T19:35:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f180640 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a34034650 0x7f5a34036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5b400d1580 tx=0x7f5b400d1410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 --2- 172.21.15.144:0/2500446054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b454190 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800a430 tx=0x7f5b4800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a6369e4602b267 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5a39e03640 1 -- 172.21.15.144:0/2500446054 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4800f6e0 con 0x55559b453d90 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5a39e03640 1 -- 172.21.15.144:0/2500446054 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b48015070 con 0x55559b453d90 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5a39e03640 1 -- 172.21.15.144:0/2500446054 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4800fa10 con 0x55559b453d90 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 -- 172.21.15.144:0/2500446054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 msgr2=0x55559b454190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 --2- 172.21.15.144:0/2500446054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b454190 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800a430 tx=0x7f5b4800a8f0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 -- 172.21.15.144:0/2500446054 shutdown_connections 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 --2- 172.21.15.144:0/2500446054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b454190 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 -- 172.21.15.144:0/2500446054 >> 172.21.15.144:0/2500446054 conn(0x55559b2c9090 msgr2=0x55559b44f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 -- 172.21.15.144:0/2500446054 shutdown_connections 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 -- 172.21.15.144:0/2500446054 wait complete. 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 Processor -- start 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 -- start start 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b45b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55559b4550b0 con 0x55559b453d90 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b45b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b45b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59344/0 (socket says 172.21.15.144:59344) 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 -- 172.21.15.144:0/2141370804 learned_addr learned my addr 172.21.15.144:0/2141370804 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 -- 172.21.15.144:0/2141370804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559b45b710 con 0x55559b453d90 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b4f981640 1 --2- 172.21.15.144:0/2141370804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b45b1d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x55559b454b40 tx=0x7f5b48003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5a2bfff640 1 -- 172.21.15.144:0/2141370804 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4800fe00 con 0x55559b453d90 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.916+0000 7f5b51670980 1 -- 172.21.15.144:0/2141370804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55559b45b9a0 con 0x55559b453d90 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 1 -- 172.21.15.144:0/2141370804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55559b45e680 con 0x55559b453d90 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5a2bfff640 1 -- 172.21.15.144:0/2141370804 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b48010a20 con 0x55559b453d90 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5a2bfff640 1 -- 172.21.15.144:0/2141370804 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b48010d80 con 0x55559b453d90 2024-09-13T19:35:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5a2bfff640 1 -- 172.21.15.144:0/2141370804 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b4801a480 con 0x55559b453d90 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5a2bfff640 1 --2- 172.21.15.144:0/2141370804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a30034650 0x7f5a30036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5a2bfff640 1 -- 172.21.15.144:0/2141370804 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5b4804a440 con 0x55559b453d90 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b4e97f640 1 --2- 172.21.15.144:0/2141370804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a30034650 0x7f5a30036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 1 Processor -- start 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 1 -- start start 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b474970 0x55559b474d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b4e97f640 1 --2- 172.21.15.144:0/2141370804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a30034650 0x7f5a30036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5b44000f70 tx=0x7f5b44001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55559b440480 con 0x55559b474970 2024-09-13T19:35:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b4f180640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b474970 0x55559b474d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b4f180640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b474970 0x55559b474d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59360/0 (socket says 172.21.15.144:59360) 2024-09-13T19:35:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b4f180640 1 -- 172.21.15.144:0/3831640622 learned_addr learned my addr 172.21.15.144:0/3831640622 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b4f180640 1 -- 172.21.15.144:0/3831640622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559b475360 con 0x55559b474970 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b4f180640 1 --2- 172.21.15.144:0/3831640622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b474970 0x55559b474d90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5b400bde90 tx=0x7f5b400e3d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5a14fe1640 1 -- 172.21.15.144:0/3831640622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b400f5070 con 0x55559b474970 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 1 -- 172.21.15.144:0/3831640622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55559b477fe0 con 0x55559b474970 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5a14fe1640 1 -- 172.21.15.144:0/3831640622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b400bc3a0 con 0x55559b474970 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5a14fe1640 1 -- 172.21.15.144:0/3831640622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b400c56d0 con 0x55559b474970 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.920+0000 7f5b51670980 1 -- 172.21.15.144:0/3831640622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55559b478390 con 0x55559b474970 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5a14fe1640 1 -- 172.21.15.144:0/3831640622 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b400f8070 con 0x55559b474970 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5a14fe1640 1 --2- 172.21.15.144:0/3831640622 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5988034600 0x7f5988036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5a14fe1640 1 -- 172.21.15.144:0/3831640622 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5b400ec030 con 0x55559b474970 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b4e97f640 1 --2- 172.21.15.144:0/3831640622 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5988034600 0x7f5988036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5a0dffb640 20 reqs_thread_entry: start 2024-09-13T19:35:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55559b47a5b0 0x55559b47c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55559b47d070 con 0x55559b47a5b0 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b4e97f640 1 --2- 172.21.15.144:0/3831640622 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5988034600 0x7f5988036ac0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5b44001ee0 tx=0x7f5b4400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b4f981640 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55559b47a5b0 0x55559b47c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b4f981640 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55559b47a5b0 0x55559b47c9a0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b4f981640 1 -- 172.21.15.144:0/1061810550 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b4800e070 con 0x55559b47a5b0 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55559b47ee90 0x55559b481280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:2 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55559b4818d0 con 0x55559b47ee90 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b4f180640 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55559b47ee90 0x55559b481280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.924+0000 7f5b4f180640 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55559b47ee90 0x55559b481280 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.928+0000 7f5b4f180640 1 -- 172.21.15.144:0/1061810550 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(2 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f5b400f7030 con 0x55559b47ee90 2024-09-13T19:35:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.928+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55559b486700 con 0x55559b47ee90 2024-09-13T19:35:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.928+0000 7f5b4f180640 1 -- 172.21.15.144:0/1061810550 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [stat,call,call,writefull 0~993] v32'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f5b400f7030 con 0x55559b47ee90 2024-09-13T19:35:18.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.928+0000 7f5b51670980 1 -- 172.21.15.144:0/2141370804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a30034650 msgr2=0x7f5a30036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.928+0000 7f5b51670980 1 --2- 172.21.15.144:0/2141370804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a30034650 0x7f5a30036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5b44000f70 tx=0x7f5b44001300 comp rx=0 tx=0).stop 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.928+0000 7f5b51670980 1 -- 172.21.15.144:0/2141370804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 msgr2=0x55559b45b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.928+0000 7f5b51670980 1 --2- 172.21.15.144:0/2141370804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b45b1d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x55559b454b40 tx=0x7f5b48003380 comp rx=0 tx=0).stop 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/2141370804 shutdown_connections 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/2141370804 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a30034650 0x7f5a30036b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/2141370804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b453d90 0x55559b45b1d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/2141370804 >> 172.21.15.144:0/2141370804 conn(0x55559b2c9090 msgr2=0x55559b44f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/2141370804 shutdown_connections 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/2141370804 wait complete. 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/3831640622 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5988034600 msgr2=0x7f5988036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/3831640622 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5988034600 0x7f5988036ac0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5b44001ee0 tx=0x7f5b4400f000 comp rx=0 tx=0).stop 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/3831640622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b474970 msgr2=0x55559b474d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/3831640622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b474970 0x55559b474d90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5b400bde90 tx=0x7f5b400e3d90 comp rx=0 tx=0).stop 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/3831640622 shutdown_connections 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/3831640622 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5988034600 0x7f5988036ac0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/3831640622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b474970 0x55559b474d90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/3831640622 >> 172.21.15.144:0/3831640622 conn(0x55559b469980 msgr2=0x55559b46c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/3831640622 shutdown_connections 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/3831640622 wait complete. 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55559b47ee90 msgr2=0x55559b481280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55559b47ee90 0x55559b481280 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55559b47a5b0 msgr2=0x55559b47c9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55559b47a5b0 0x55559b47c9a0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a34034650 msgr2=0x7f5a34036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a34034650 0x7f5a34036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5b400d1580 tx=0x7f5b400d1410 comp rx=0 tx=0).stop 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 msgr2=0x55559b446f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b446f40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5b40096f40 tx=0x7f5b400180e0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 shutdown_connections 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55559b47a5b0 0x55559b47c9a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55559b47ee90 0x55559b481280 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f5a34034650 0x7f5a34036b10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 --2- 172.21.15.144:0/1061810550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55559b2c8c80 0x55559b446f40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 >> 172.21.15.144:0/1061810550 conn(0x55559b34e160 msgr2=0x55559b43a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 shutdown_connections 2024-09-13T19:35:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:18.932+0000 7f5b51670980 1 -- 172.21.15.144:0/1061810550 wait complete. 2024-09-13T19:35:18.944 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:35:18.944 DEBUG:tasks.util.rgw: json result: {'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:35:18.944 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-13T19:35:18.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-13T19:35:18.945 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-13T19:35:19.017 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:19.018 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:19.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855e012980 1 Processor -- start 2024-09-13T19:35:19.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855e012980 1 -- start start 2024-09-13T19:35:19.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855e012980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55d0442db9c0 0x55d0442dddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855e012980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d04415fae0 con 0x55d0442d7640 2024-09-13T19:35:19.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855e012980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55d044183e30 con 0x55d0442db9c0 2024-09-13T19:35:19.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855b321640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55d0442db9c0 0x55d0442dddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855b321640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55d0442db9c0 0x55d0442dddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59376/0 (socket says 172.21.15.144:59376) 2024-09-13T19:35:19.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855b321640 1 -- 172.21.15.144:0/1314881916 learned_addr learned my addr 172.21.15.144:0/1314881916 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855bb22640 1 --1- 172.21.15.144:0/1314881916 >> v1:172.21.15.18:6789/0 conn(0x55d0442d7640 0x55d0442d7a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:33064/0 (socket says 172.21.15.144:33064) 2024-09-13T19:35:19.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855b321640 1 -- 172.21.15.144:0/1314881916 >> v1:172.21.15.18:6789/0 conn(0x55d0442d7640 legacy=0x55d0442d7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.016+0000 7f855b321640 1 -- 172.21.15.144:0/1314881916 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0442df300 con 0x55d0442db9c0 2024-09-13T19:35:19.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855b321640 1 --2- 172.21.15.144:0/1314881916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442db9c0 0x55d0442dddb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f855000a5c0 tx=0x7f855001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193f48d92e92b6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855ab20640 1 -- 172.21.15.144:0/1314881916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85500a6070 con 0x55d0442db9c0 2024-09-13T19:35:19.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855ab20640 1 -- 172.21.15.144:0/1314881916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85500af070 con 0x55d0442db9c0 2024-09-13T19:35:19.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855ab20640 1 -- 172.21.15.144:0/1314881916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85500aa5c0 con 0x55d0442db9c0 2024-09-13T19:35:19.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855e012980 1 -- 172.21.15.144:0/1314881916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442db9c0 msgr2=0x55d0442dddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855e012980 1 --2- 172.21.15.144:0/1314881916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442db9c0 0x55d0442dddb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f855000a5c0 tx=0x7f855001b340 comp rx=0 tx=0).stop 2024-09-13T19:35:19.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855e012980 1 -- 172.21.15.144:0/1314881916 shutdown_connections 2024-09-13T19:35:19.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855e012980 1 --2- 172.21.15.144:0/1314881916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442db9c0 0x55d0442dddb0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855e012980 1 -- 172.21.15.144:0/1314881916 >> 172.21.15.144:0/1314881916 conn(0x55d0442d3160 msgr2=0x55d0442d5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855e012980 1 -- 172.21.15.144:0/1314881916 shutdown_connections 2024-09-13T19:35:19.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.020+0000 7f855e012980 1 -- 172.21.15.144:0/1314881916 wait complete. 2024-09-13T19:35:19.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.032+0000 7f855e012980 1 Processor -- start 2024-09-13T19:35:19.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.032+0000 7f855e012980 1 -- start start 2024-09-13T19:35:19.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.032+0000 7f855e012980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.032+0000 7f855e012980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d044185200 con 0x55d0442d7640 2024-09-13T19:35:19.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.032+0000 7f855bb22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.032+0000 7f855bb22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59392/0 (socket says 172.21.15.144:59392) 2024-09-13T19:35:19.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.032+0000 7f855bb22640 1 -- 172.21.15.144:0/2741030899 learned_addr learned my addr 172.21.15.144:0/2741030899 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855bb22640 1 -- 172.21.15.144:0/2741030899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0443c2fe0 con 0x55d0442d7640 2024-09-13T19:35:19.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855bb22640 1 --2- 172.21.15.144:0/2741030899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c2a10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8554001690 tx=0x7f8554001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ce39b54d24f34b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f8449e0b640 1 -- 172.21.15.144:0/2741030899 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8554003460 con 0x55d0442d7640 2024-09-13T19:35:19.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f8449e0b640 1 -- 172.21.15.144:0/2741030899 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8554003600 con 0x55d0442d7640 2024-09-13T19:35:19.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f8449e0b640 1 -- 172.21.15.144:0/2741030899 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8554003920 con 0x55d0442d7640 2024-09-13T19:35:19.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 -- 172.21.15.144:0/2741030899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 msgr2=0x55d0443c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 --2- 172.21.15.144:0/2741030899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c2a10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8554001690 tx=0x7f8554001b50 comp rx=0 tx=0).stop 2024-09-13T19:35:19.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 -- 172.21.15.144:0/2741030899 shutdown_connections 2024-09-13T19:35:19.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 --2- 172.21.15.144:0/2741030899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c2a10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 -- 172.21.15.144:0/2741030899 >> 172.21.15.144:0/2741030899 conn(0x55d0442d3160 msgr2=0x55d0443be640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 -- 172.21.15.144:0/2741030899 shutdown_connections 2024-09-13T19:35:19.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 -- 172.21.15.144:0/2741030899 wait complete. 2024-09-13T19:35:19.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 Processor -- start 2024-09-13T19:35:19.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 -- start start 2024-09-13T19:35:19.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855e012980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d0442dee00 con 0x55d0442d7640 2024-09-13T19:35:19.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855bb22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855bb22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59394/0 (socket says 172.21.15.144:59394) 2024-09-13T19:35:19.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855bb22640 1 -- 172.21.15.144:0/14950935 learned_addr learned my addr 172.21.15.144:0/14950935 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855bb22640 1 -- 172.21.15.144:0/14950935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0443ca280 con 0x55d0442d7640 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.036+0000 7f855bb22640 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c9d40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8554000f90 tx=0x7f8554001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8443fff640 1 -- 172.21.15.144:0/14950935 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8554022020 con 0x55d0442d7640 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0443ca510 con 0x55d0442d7640 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8443fff640 1 -- 172.21.15.144:0/14950935 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8554006840 con 0x55d0442d7640 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8443fff640 1 -- 172.21.15.144:0/14950935 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f855401e800 con 0x55d0442d7640 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0443cd1f0 con 0x55d0442d7640 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 Processor -- start 2024-09-13T19:35:19.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- start start 2024-09-13T19:35:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443d6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d0441de800 con 0x55d0443d6af0 2024-09-13T19:35:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8443fff640 1 -- 172.21.15.144:0/14950935 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8554025020 con 0x55d0442d7640 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855c323640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443d6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855c323640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443d6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59402/0 (socket says 172.21.15.144:59402) 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855c323640 1 -- 172.21.15.144:0/1444918754 learned_addr learned my addr 172.21.15.144:0/1444918754 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8443fff640 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8444034600 0x7f8444036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8443fff640 1 -- 172.21.15.144:0/14950935 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8554049b20 con 0x55d0442d7640 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855bb22640 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8444034600 0x7f8444036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855c323640 1 -- 172.21.15.144:0/1444918754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0443d7430 con 0x55d0443d6af0 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855bb22640 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8444034600 0x7f8444036ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8554011ff0 tx=0x7f855401de90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855c323640 1 --2- 172.21.15.144:0/1444918754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443d6ef0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f854c00a440 tx=0x7f854c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b714d8d898cfa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8441ffb640 1 -- 172.21.15.144:0/1444918754 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c008850 con 0x55d0443d6af0 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8441ffb640 1 -- 172.21.15.144:0/1444918754 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c008a10 con 0x55d0443d6af0 2024-09-13T19:35:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f8441ffb640 1 -- 172.21.15.144:0/1444918754 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c008d30 con 0x55d0443d6af0 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- 172.21.15.144:0/1444918754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 msgr2=0x55d0443d6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 --2- 172.21.15.144:0/1444918754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443d6ef0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f854c00a440 tx=0x7f854c00a900 comp rx=0 tx=0).stop 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- 172.21.15.144:0/1444918754 shutdown_connections 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 --2- 172.21.15.144:0/1444918754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443d6ef0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- 172.21.15.144:0/1444918754 >> 172.21.15.144:0/1444918754 conn(0x55d0442db9c0 msgr2=0x55d0443d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- 172.21.15.144:0/1444918754 shutdown_connections 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- 172.21.15.144:0/1444918754 wait complete. 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 Processor -- start 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- start start 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443dde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.040+0000 7f855e012980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d0443d7e10 con 0x55d0443d6af0 2024-09-13T19:35:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855c323640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855c323640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443dde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59406/0 (socket says 172.21.15.144:59406) 2024-09-13T19:35:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855c323640 1 -- 172.21.15.144:0/1849773825 learned_addr learned my addr 172.21.15.144:0/1849773825 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855c323640 1 -- 172.21.15.144:0/1849773825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0443de370 con 0x55d0443d6af0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855c323640 1 --2- 172.21.15.144:0/1849773825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443dde30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55d0443d78a0 tx=0x7f854c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f843bfff640 1 -- 172.21.15.144:0/1849773825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c013a70 con 0x55d0443d6af0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855e012980 1 -- 172.21.15.144:0/1849773825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0443de600 con 0x55d0443d6af0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f843bfff640 1 -- 172.21.15.144:0/1849773825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c023070 con 0x55d0443d6af0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f843bfff640 1 -- 172.21.15.144:0/1849773825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c013d40 con 0x55d0443d6af0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855e012980 1 -- 172.21.15.144:0/1849773825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0443e12e0 con 0x55d0443d6af0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855e012980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855e012980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f843bfff640 1 -- 172.21.15.144:0/1849773825 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f854c028460 con 0x55d0443d6af0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f843bfff640 1 --2- 172.21.15.144:0/1849773825 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f84340346a0 0x7f8434036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f843bfff640 1 -- 172.21.15.144:0/1849773825 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f854c049fe0 con 0x55d0443d6af0 2024-09-13T19:35:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855e012980 1 Processor -- start 2024-09-13T19:35:19.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855c323640 1 --2- 172.21.15.144:0/1849773825 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f84340346a0 0x7f8434036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855e012980 1 -- start start 2024-09-13T19:35:19.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855e012980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443f7750 0x55d0443f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855e012980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d0443c3300 con 0x55d0443f7750 2024-09-13T19:35:19.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855c323640 1 --2- 172.21.15.144:0/1849773825 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f84340346a0 0x7f8434036b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f854c028e20 tx=0x7f854c028db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855bb22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443f7750 0x55d0443f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855bb22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443f7750 0x55d0443f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59408/0 (socket says 172.21.15.144:59408) 2024-09-13T19:35:19.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.044+0000 7f855bb22640 1 -- 172.21.15.144:0/1536321538 learned_addr learned my addr 172.21.15.144:0/1536321538 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855bb22640 1 -- 172.21.15.144:0/1536321538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0443f8140 con 0x55d0443f7750 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855bb22640 1 --2- 172.21.15.144:0/1536321538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443f7750 0x55d0443f7b70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8554047fc0 tx=0x7f8554012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f83bbfff640 1 -- 172.21.15.144:0/1536321538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8554011c30 con 0x55d0443f7750 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855e012980 1 -- 172.21.15.144:0/1536321538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0443faca0 con 0x55d0443f7750 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f83bbfff640 1 -- 172.21.15.144:0/1536321538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8554043070 con 0x55d0443f7750 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855e012980 1 -- 172.21.15.144:0/1536321538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0443fb0a0 con 0x55d0443f7750 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f83bbfff640 1 -- 172.21.15.144:0/1536321538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f855404e060 con 0x55d0443f7750 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f83bbfff640 1 -- 172.21.15.144:0/1536321538 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8554010ca0 con 0x55d0443f7750 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f83bbfff640 1 --2- 172.21.15.144:0/1536321538 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8394034650 0x7f8394036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f83bbfff640 1 -- 172.21.15.144:0/1536321538 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f855401f070 con 0x55d0443f7750 2024-09-13T19:35:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855b321640 1 --2- 172.21.15.144:0/1536321538 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8394034650 0x7f8394036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f83b9ffb640 20 reqs_thread_entry: start 2024-09-13T19:35:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855e012980 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d0443fd260 0x55d0443ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d0443ffd10 con 0x55d0443fd260 2024-09-13T19:35:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855b321640 1 --2- 172.21.15.144:0/1536321538 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8394034650 0x7f8394036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f85500ae000 tx=0x7f85500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855c323640 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d0443fd260 0x55d0443ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855c323640 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d0443fd260 0x55d0443ff690 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855c323640 1 -- 172.21.15.144:0/14950935 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f854c028930 con 0x55d0443fd260 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d044400240 con 0x55d0443fd260 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855c323640 1 -- 172.21.15.144:0/14950935 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f854c028930 con 0x55d0443fd260 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.048+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d0444017d0 con 0x55d0443fd260 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855c323640 1 -- 172.21.15.144:0/14950935 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f854c028930 con 0x55d0443fd260 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1849773825 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f84340346a0 msgr2=0x7f8434036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/1849773825 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f84340346a0 0x7f8434036b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f854c028e20 tx=0x7f854c028db0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1849773825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 msgr2=0x55d0443dde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/1849773825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443dde30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55d0443d78a0 tx=0x7f854c003000 comp rx=0 tx=0).stop 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1849773825 shutdown_connections 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/1849773825 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f84340346a0 0x7f8434036b60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/1849773825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443d6af0 0x55d0443dde30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1849773825 >> 172.21.15.144:0/1849773825 conn(0x55d0442db9c0 msgr2=0x55d0443d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1849773825 shutdown_connections 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1849773825 wait complete. 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1536321538 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8394034650 msgr2=0x7f8394036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/1536321538 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8394034650 0x7f8394036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f85500ae000 tx=0x7f85500a6000 comp rx=0 tx=0).stop 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1536321538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443f7750 msgr2=0x55d0443f7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/1536321538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443f7750 0x55d0443f7b70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8554047fc0 tx=0x7f8554012630 comp rx=0 tx=0).stop 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1536321538 shutdown_connections 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/1536321538 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8394034650 0x7f8394036b10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/1536321538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0443f7750 0x55d0443f7b70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1536321538 >> 172.21.15.144:0/1536321538 conn(0x55d0443ec720 msgr2=0x55d0443ef010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1536321538 shutdown_connections 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/1536321538 wait complete. 2024-09-13T19:35:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d0443fd260 msgr2=0x55d0443ff690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d0443fd260 0x55d0443ff690 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8444034600 msgr2=0x7f8444036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8444034600 0x7f8444036ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8554011ff0 tx=0x7f855401de90 comp rx=0 tx=0).stop 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 msgr2=0x55d0443c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c9d40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8554000f90 tx=0x7f8554001260 comp rx=0 tx=0).stop 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 shutdown_connections 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55d0443fd260 0x55d0443ff690 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8444034600 0x7f8444036ac0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 --2- 172.21.15.144:0/14950935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0442d7640 0x55d0443c9d40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 >> 172.21.15.144:0/14950935 conn(0x55d0442d3160 msgr2=0x55d0443bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 shutdown_connections 2024-09-13T19:35:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.052+0000 7f855e012980 1 -- 172.21.15.144:0/14950935 wait complete. 2024-09-13T19:35:19.065 INFO:teuthology.orchestra.run.smithi144.stdout:{"id":"b5bcd2ca-839b-4a0e-a5d6-f37391d778b0","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"c35740e4-5d1f-401e-bba7-050c483b0bbd","zones":[{"id":"c35740e4-5d1f-401e-bba7-050c483b0bbd","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-13T19:35:19.066 DEBUG:tasks.util.rgw: json result: {'id': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'c35740e4-5d1f-401e-bba7-050c483b0bbd', 'zones': [{'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-13T19:35:19.068 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-13T19:35:19.089 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T19:35:19.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T19:35:19.089 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-13T19:35:19.156 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:19.156 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:19.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd7c315980 1 Processor -- start 2024-09-13T19:35:19.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd7c315980 1 -- start start 2024-09-13T19:35:19.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd7c315980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559782312a30 0x559782314e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd7c315980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559782196ae0 con 0x559782282a60 2024-09-13T19:35:19.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd7c315980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5597821bae30 con 0x559782312a30 2024-09-13T19:35:19.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd79624640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559782312a30 0x559782314e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd79624640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x559782312a30 0x559782314e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59420/0 (socket says 172.21.15.144:59420) 2024-09-13T19:35:19.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd79e25640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x559782282a60 0x559782311310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:33074/0 (socket says 172.21.15.144:33074) 2024-09-13T19:35:19.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.152+0000 7fdd79624640 1 -- 172.21.15.144:0/1210545361 learned_addr learned my addr 172.21.15.144:0/1210545361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd79624640 1 -- 172.21.15.144:0/1210545361 >> v1:172.21.15.18:6789/0 conn(0x559782282a60 legacy=0x559782311310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd79624640 1 -- 172.21.15.144:0/1210545361 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559782316370 con 0x559782312a30 2024-09-13T19:35:19.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd79624640 1 --2- 172.21.15.144:0/1210545361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782312a30 0x559782314e20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000a5c0 tx=0x7fdd7001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db000f6c55ec6bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd78e23640 1 -- 172.21.15.144:0/1210545361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd700a6070 con 0x559782312a30 2024-09-13T19:35:19.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd78e23640 1 -- 172.21.15.144:0/1210545361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd700af070 con 0x559782312a30 2024-09-13T19:35:19.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd78e23640 1 -- 172.21.15.144:0/1210545361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd700aa5c0 con 0x559782312a30 2024-09-13T19:35:19.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd7c315980 1 -- 172.21.15.144:0/1210545361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782312a30 msgr2=0x559782314e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd7c315980 1 --2- 172.21.15.144:0/1210545361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782312a30 0x559782314e20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000a5c0 tx=0x7fdd7001b340 comp rx=0 tx=0).stop 2024-09-13T19:35:19.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd7c315980 1 -- 172.21.15.144:0/1210545361 shutdown_connections 2024-09-13T19:35:19.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd7c315980 1 --2- 172.21.15.144:0/1210545361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782312a30 0x559782314e20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd7c315980 1 -- 172.21.15.144:0/1210545361 >> 172.21.15.144:0/1210545361 conn(0x559782309000 msgr2=0x55978230b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd7c315980 1 -- 172.21.15.144:0/1210545361 shutdown_connections 2024-09-13T19:35:19.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.156+0000 7fdd7c315980 1 -- 172.21.15.144:0/1210545361 wait complete. 2024-09-13T19:35:19.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd7c315980 1 Processor -- start 2024-09-13T19:35:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd7c315980 1 -- start start 2024-09-13T19:35:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd7c315980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x5597823f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd7c315980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5597821bc200 con 0x559782282a60 2024-09-13T19:35:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd79e25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x5597823f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd79e25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x5597823f9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59432/0 (socket says 172.21.15.144:59432) 2024-09-13T19:35:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd79e25640 1 -- 172.21.15.144:0/2043616964 learned_addr learned my addr 172.21.15.144:0/2043616964 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd79e25640 1 -- 172.21.15.144:0/2043616964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597823fa0f0 con 0x559782282a60 2024-09-13T19:35:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdd79e25640 1 --2- 172.21.15.144:0/2043616964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x5597823f9b20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c001e50 tx=0x7fdd6c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995ec82555d37434 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdc67e07640 1 -- 172.21.15.144:0/2043616964 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c00e5d0 con 0x559782282a60 2024-09-13T19:35:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdc67e07640 1 -- 172.21.15.144:0/2043616964 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6c00e770 con 0x559782282a60 2024-09-13T19:35:19.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.172+0000 7fdc67e07640 1 -- 172.21.15.144:0/2043616964 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c00eab0 con 0x559782282a60 2024-09-13T19:35:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- 172.21.15.144:0/2043616964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 msgr2=0x5597823f9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 --2- 172.21.15.144:0/2043616964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x5597823f9b20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c001e50 tx=0x7fdd6c001e80 comp rx=0 tx=0).stop 2024-09-13T19:35:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- 172.21.15.144:0/2043616964 shutdown_connections 2024-09-13T19:35:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 --2- 172.21.15.144:0/2043616964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x5597823f9b20 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- 172.21.15.144:0/2043616964 >> 172.21.15.144:0/2043616964 conn(0x559782309000 msgr2=0x5597823f5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- 172.21.15.144:0/2043616964 shutdown_connections 2024-09-13T19:35:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- 172.21.15.144:0/2043616964 wait complete. 2024-09-13T19:35:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 Processor -- start 2024-09-13T19:35:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- start start 2024-09-13T19:35:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x559782400f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559782315db0 con 0x559782282a60 2024-09-13T19:35:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd79e25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x559782400f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd79e25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x559782400f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59436/0 (socket says 172.21.15.144:59436) 2024-09-13T19:35:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd79e25640 1 -- 172.21.15.144:0/531321652 learned_addr learned my addr 172.21.15.144:0/531321652 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd79e25640 1 -- 172.21.15.144:0/531321652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559782401450 con 0x559782282a60 2024-09-13T19:35:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd79e25640 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x559782400f10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x5597823fad00 tx=0x7fdd6c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdc66604640 1 -- 172.21.15.144:0/531321652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c00f9f0 con 0x559782282a60 2024-09-13T19:35:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdc66604640 1 -- 172.21.15.144:0/531321652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6c00fbb0 con 0x559782282a60 2024-09-13T19:35:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597824016e0 con 0x559782282a60 2024-09-13T19:35:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdc66604640 1 -- 172.21.15.144:0/531321652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c01a480 con 0x559782282a60 2024-09-13T19:35:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597824043c0 con 0x559782282a60 2024-09-13T19:35:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdc66604640 1 -- 172.21.15.144:0/531321652 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdd6c017070 con 0x559782282a60 2024-09-13T19:35:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdc66604640 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc60034650 0x7fdc60036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.176+0000 7fdc66604640 1 -- 172.21.15.144:0/531321652 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdd6c015020 con 0x559782282a60 2024-09-13T19:35:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd79624640 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc60034650 0x7fdc60036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559782312a30 0x559782407ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782408550 con 0x559782312a30 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7a626640 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559782312a30 0x559782407ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd79624640 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc60034650 0x7fdc60036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdd700ae000 tx=0x7fdd700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7a626640 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559782312a30 0x559782407ee0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7a626640 1 -- 172.21.15.144:0/531321652 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd7400a4d0 con 0x559782312a30 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5597824055e0 con 0x559782312a30 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7a626640 1 -- 172.21.15.144:0/531321652 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd7400a4d0 con 0x559782312a30 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55978240a8a0 0x55978240cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55978240d380 con 0x55978240a8a0 2024-09-13T19:35:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd79e25640 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55978240a8a0 0x55978240cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd79e25640 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55978240a8a0 0x55978240cc90 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd79e25640 1 -- 172.21.15.144:0/531321652 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd6c02e070 con 0x55978240a8a0 2024-09-13T19:35:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782409740 con 0x559782312a30 2024-09-13T19:35:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7a626640 1 -- 172.21.15.144:0/531321652 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd7400a4d0 con 0x559782312a30 2024-09-13T19:35:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.180+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782409c20 con 0x559782312a30 2024-09-13T19:35:19.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7a626640 1 -- 172.21.15.144:0/531321652 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd7400a4d0 con 0x559782312a30 2024-09-13T19:35:19.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7c315980 1 Processor -- start 2024-09-13T19:35:19.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7c315980 1 -- start start 2024-09-13T19:35:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7c315980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55978241baa0 0x55978241bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7c315980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559782215800 con 0x55978241baa0 2024-09-13T19:35:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7a626640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55978241baa0 0x55978241bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7a626640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55978241baa0 0x55978241bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59440/0 (socket says 172.21.15.144:59440) 2024-09-13T19:35:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7a626640 1 -- 172.21.15.144:0/1009709909 learned_addr learned my addr 172.21.15.144:0/1009709909 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7a626640 1 -- 172.21.15.144:0/1009709909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978241c400 con 0x55978241baa0 2024-09-13T19:35:19.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7a626640 1 --2- 172.21.15.144:0/1009709909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55978241baa0 0x55978241bec0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x559782402160 tx=0x7fdd74018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdc5f7fe640 1 -- 172.21.15.144:0/1009709909 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd74014450 con 0x55978241baa0 2024-09-13T19:35:19.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdc5f7fe640 1 -- 172.21.15.144:0/1009709909 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd74014610 con 0x55978241baa0 2024-09-13T19:35:19.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7c315980 1 -- 172.21.15.144:0/1009709909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978241c690 con 0x55978241baa0 2024-09-13T19:35:19.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdc5f7fe640 1 -- 172.21.15.144:0/1009709909 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd74014930 con 0x55978241baa0 2024-09-13T19:35:19.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.184+0000 7fdd7c315980 1 -- 172.21.15.144:0/1009709909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978241f310 con 0x55978241baa0 2024-09-13T19:35:19.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdc5f7fe640 1 -- 172.21.15.144:0/1009709909 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdd74011040 con 0x55978241baa0 2024-09-13T19:35:19.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdc5f7fe640 1 --2- 172.21.15.144:0/1009709909 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc540346a0 0x7fdc54036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdc5f7fe640 1 -- 172.21.15.144:0/1009709909 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdd7401e070 con 0x55978241baa0 2024-09-13T19:35:19.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd79e25640 1 --2- 172.21.15.144:0/1009709909 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc540346a0 0x7fdc54036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 Processor -- start 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- start start 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd79e25640 1 --2- 172.21.15.144:0/1009709909 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc540346a0 0x7fdc54036b60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5597824089f0 tx=0x7fdd6c00ff10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x5597824289c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5597823fa470 con 0x5597824285c0 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7a626640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x5597824289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7a626640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x5597824289c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59448/0 (socket says 172.21.15.144:59448) 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7a626640 1 -- 172.21.15.144:0/1148878359 learned_addr learned my addr 172.21.15.144:0/1148878359 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7a626640 1 -- 172.21.15.144:0/1148878359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559782428f90 con 0x5597824285c0 2024-09-13T19:35:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7a626640 1 --2- 172.21.15.144:0/1148878359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x5597824289c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdd74049fc0 tx=0x7fdd74011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e826fc970eaca78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdc5d7fa640 1 -- 172.21.15.144:0/1148878359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd74014ad0 con 0x5597824285c0 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdc5d7fa640 1 -- 172.21.15.144:0/1148878359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd74014c70 con 0x5597824285c0 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdc5d7fa640 1 -- 172.21.15.144:0/1148878359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7402b4a0 con 0x5597824285c0 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- 172.21.15.144:0/1148878359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 msgr2=0x5597824289c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 --2- 172.21.15.144:0/1148878359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x5597824289c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdd74049fc0 tx=0x7fdd74011f20 comp rx=0 tx=0).stop 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- 172.21.15.144:0/1148878359 shutdown_connections 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 --2- 172.21.15.144:0/1148878359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x5597824289c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- 172.21.15.144:0/1148878359 >> 172.21.15.144:0/1148878359 conn(0x559782424950 msgr2=0x559782422a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- 172.21.15.144:0/1148878359 shutdown_connections 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- 172.21.15.144:0/1148878359 wait complete. 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 Processor -- start 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- start start 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x55978230ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7c315980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559782429570 con 0x5597824285c0 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7a626640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x55978230ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7a626640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x55978230ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59454/0 (socket says 172.21.15.144:59454) 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.188+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 learned_addr learned my addr 172.21.15.144:0/4269874074 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978230f130 con 0x5597824285c0 2024-09-13T19:35:19.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7a626640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x55978230ebf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x559782425030 tx=0x7fdd74049f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdc4b7fe640 1 -- 172.21.15.144:0/4269874074 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd74014ad0 con 0x5597824285c0 2024-09-13T19:35:19.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978230d310 con 0x5597824285c0 2024-09-13T19:35:19.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdc4b7fe640 1 -- 172.21.15.144:0/4269874074 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd7404b990 con 0x5597824285c0 2024-09-13T19:35:19.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdc4b7fe640 1 -- 172.21.15.144:0/4269874074 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd74013940 con 0x5597824285c0 2024-09-13T19:35:19.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978230d780 con 0x5597824285c0 2024-09-13T19:35:19.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdc4b7fe640 1 -- 172.21.15.144:0/4269874074 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdd7402b700 con 0x5597824285c0 2024-09-13T19:35:19.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdc4b7fe640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc44034650 0x7fdc44036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdc4b7fe640 1 -- 172.21.15.144:0/4269874074 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdd74035030 con 0x5597824285c0 2024-09-13T19:35:19.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd79e25640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc44034650 0x7fdc44036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55978243d160 0x55978243f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55978243fd70 con 0x55978243d160 2024-09-13T19:35:19.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd79624640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55978243d160 0x55978243f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd79e25640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc44034650 0x7fdc44036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0178c0 tx=0x7fdd6c04a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd79624640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55978243d160 0x55978243f620 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 20 realm 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5597824401a0 con 0x55978243d160 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.192+0000 7fdd7c315980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782440a70 con 0x55978243d160 2024-09-13T19:35:19.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782440e10 con 0x55978243d160 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559782441b70 0x559782443f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782444570 con 0x559782441b70 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7a626640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559782441b70 0x559782443f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7a626640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559782441b70 0x559782443f60 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:19.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 20 searching for the correct realm 2024-09-13T19:35:19.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559782446450 0x5597824488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd79e25640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559782446450 0x5597824488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd79e25640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559782446450 0x5597824488c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd79e25640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdd6c042c20 0x7fdd6c01b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x7fdd6c042c20 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.196+0000 7fdd79624640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdd6c042c20 0x7fdd6c01b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdd6c042c20 0x7fdd6c01b760 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782441b70 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782441b70 2024-09-13T19:35:19.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x7fdd6c042c20 2024-09-13T19:35:19.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.200+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782441b70 2024-09-13T19:35:19.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x7fdd6c042c20 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782441b70 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782441b70 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.204+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x7fdd6c042c20 2024-09-13T19:35:19.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782441b70 2024-09-13T19:35:19.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782441b70 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x7fdd6c042c20 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782446450 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x559782441b70 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.208+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x55978243d160 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559782448f90 con 0x7fdd6c042c20 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782444ec0 con 0x55978243d160 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782444ad0 con 0x55978243d160 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782444b20 con 0x55978243d160 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 zone default found 2024-09-13T19:35:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 4 Realm: () 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 zonegroup default 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782449410 con 0x559782441b70 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55978244b1c0 con 0x559782446450 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55978244b6a0 con 0x559782446450 2024-09-13T19:35:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 started sync module instance, tier type = 2024-09-13T19:35:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.212+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244a630 con 0x7fdd6c042c20 2024-09-13T19:35:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.216+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.216+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94109213961056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244a630 con 0x7fdd6c042c20 2024-09-13T19:35:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.216+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244c1c0 con 0x55978243d160 2024-09-13T19:35:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.216+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94109213961056] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.216+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.216+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94109213965472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244a630 con 0x55978243d160 2024-09-13T19:35:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.216+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244cbd0 con 0x559782446450 2024-09-13T19:35:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94109213965472] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94109213958528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244a5a0 con 0x559782446450 2024-09-13T19:35:19.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244d920 con 0x7fdd6c042c20 2024-09-13T19:35:19.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94109213971840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244dfd0 con 0x7fdd6c042c20 2024-09-13T19:35:19.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244eaf0 con 0x55978243d160 2024-09-13T19:35:19.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94109213958528] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94109213971840] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94109213976000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244eab0 con 0x55978243d160 2024-09-13T19:35:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.220+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244eee0 con 0x559782441b70 2024-09-13T19:35:19.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.224+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94109213976000] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.224+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.224+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94109213970368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244f2d0 con 0x559782441b70 2024-09-13T19:35:19.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.224+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244fc90 con 0x559782441b70 2024-09-13T19:35:19.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94109213970368] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94109213973024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244fc90 con 0x559782441b70 2024-09-13T19:35:19.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782450650 con 0x559782441b70 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94109213973024] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94109213980640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782450830 con 0x559782441b70 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 20 add_watcher() i=0 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 20 add_watcher() i=1 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 20 add_watcher() i=2 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 20 add_watcher() i=3 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 20 add_watcher() i=4 2024-09-13T19:35:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 20 add_watcher() i=5 2024-09-13T19:35:19.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.228+0000 7fdd7c315980 20 add_watcher() i=6 2024-09-13T19:35:19.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94109213980640] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 20 add_watcher() i=7 2024-09-13T19:35:19.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:19.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782453a50 con 0x55978243d160 2024-09-13T19:35:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94109213996160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782450890 con 0x55978243d160 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94109213996160] v32'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdc2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 5 note: GC not initialized 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdc2a7fc640 20 reqs_thread_entry: start 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.232+0000 7fdd7c315980 20 Filter name: none 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdb9bfff640 20 reqs_thread_entry: start 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5597824771a0 con 0x559782441b70 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782475940 con 0x55978243d160 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:35:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T19:35:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T19:35:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.236+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5597824762d0 con 0x559782441b70 2024-09-13T19:35:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94109214137728 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55978247ac40 con 0x55978243d160 2024-09-13T19:35:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== watch-notify(notify (1) cookie 94109213976000 notify 137438953491 ret 0) ==== 691+0+0 (crc 0 0 0) 0x559782316370 con 0x55978243d160 2024-09-13T19:35:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdc5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94109213976000 notifier 4825 bl.length()=649 2024-09-13T19:35:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdc5d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:19.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdc5d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:19.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdc5d7fa640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fdc3c003eb0 con 0x55978243d160 2024-09-13T19:35:19.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify cookie 94109214137728 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== watch-notify(notify_complete (2) cookie 94109214137728 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdd700d74f0 con 0x55978243d160 2024-09-13T19:35:19.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782475d80 con 0x55978243d160 2024-09-13T19:35:19.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T19:35:19.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:35:19.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-13T19:35:19.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94109214152576 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559782475d80 con 0x559782446450 2024-09-13T19:35:19.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== watch-notify(notify (1) cookie 94109213958528 notify 137438953482 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5597824043c0 con 0x559782446450 2024-09-13T19:35:19.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdc5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94109213958528 notifier 4825 bl.length()=177 2024-09-13T19:35:19.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdc5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T19:35:19.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(68 notify.2 [notify cookie 94109214152576 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdc5cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:35:19.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdc5cff9640 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fdba4003410 con 0x559782446450 2024-09-13T19:35:19.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.240+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== watch-notify(notify_complete (2) cookie 94109214152576 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5597824016e0 con 0x559782446450 2024-09-13T19:35:19.246 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:19.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.244+0000 7fdc2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:19.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.244+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94109213996160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782474f40 con 0x55978243d160 2024-09-13T19:35:19.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.244+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94109213996160] v32'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.244+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94109213961056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782474f40 con 0x7fdd6c042c20 2024-09-13T19:35:19.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.244+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94109213961056] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.244+0000 7fdd7c315980 20 remove_watcher() i=0 2024-09-13T19:35:19.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.244+0000 7fdd7c315980 2 removed watcher, disabling cache 2024-09-13T19:35:19.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.244+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94109213965472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782474f40 con 0x55978243d160 2024-09-13T19:35:19.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.248+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94109213965472] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.248+0000 7fdd7c315980 20 remove_watcher() i=1 2024-09-13T19:35:19.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.248+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94109213958528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244bca0 con 0x559782446450 2024-09-13T19:35:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.248+0000 7fdd79e25640 1 -- 172.21.15.144:0/4269874074 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94109213958528] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd6c02e070 con 0x559782446450 2024-09-13T19:35:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.248+0000 7fdd7c315980 20 remove_watcher() i=2 2024-09-13T19:35:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.248+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94109213971840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782474f40 con 0x7fdd6c042c20 2024-09-13T19:35:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.252+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94109213971840] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x7fdd6c042c20 2024-09-13T19:35:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.252+0000 7fdd7c315980 20 remove_watcher() i=3 2024-09-13T19:35:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.252+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94109213976000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244a180 con 0x55978243d160 2024-09-13T19:35:19.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.252+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94109213976000] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd700aaac0 con 0x55978243d160 2024-09-13T19:35:19.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.252+0000 7fdd7c315980 20 remove_watcher() i=4 2024-09-13T19:35:19.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.252+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94109213970368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244bca0 con 0x559782441b70 2024-09-13T19:35:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.256+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94109213970368] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.256+0000 7fdd7c315980 20 remove_watcher() i=5 2024-09-13T19:35:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.256+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94109213973024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55978244d580 con 0x559782441b70 2024-09-13T19:35:19.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.256+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94109213973024] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.256+0000 7fdd7c315980 20 remove_watcher() i=6 2024-09-13T19:35:19.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.256+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94109213980640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559782474f40 con 0x559782441b70 2024-09-13T19:35:19.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7a626640 1 -- 172.21.15.144:0/4269874074 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94109213980640] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd7405e040 con 0x559782441b70 2024-09-13T19:35:19.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 20 remove_watcher() i=7 2024-09-13T19:35:19.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559782441b70 msgr2=0x559782443f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x559782441b70 0x559782443f60 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55978243d160 msgr2=0x55978243f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55978243d160 0x55978243f620 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdd6c042c20 msgr2=0x7fdd6c01b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdd6c042c20 0x7fdd6c01b760 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559782446450 msgr2=0x5597824488c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x559782446450 0x5597824488c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc44034650 msgr2=0x7fdc44036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc44034650 0x7fdc44036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0178c0 tx=0x7fdd6c04a000 comp rx=0 tx=0).stop 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 msgr2=0x55978230ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd79624640 1 -- 172.21.15.144:0/4269874074 reap_dead start 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x55978230ebf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x559782425030 tx=0x7fdd74049f50 comp rx=0 tx=0).stop 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 shutdown_connections 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/4269874074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597824285c0 0x55978230ebf0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 >> 172.21.15.144:0/4269874074 conn(0x559782424950 msgr2=0x559782422a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 shutdown_connections 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/4269874074 wait complete. 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/1009709909 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc540346a0 msgr2=0x7fdc54036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/1009709909 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc540346a0 0x7fdc54036b60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5597824089f0 tx=0x7fdd6c00ff10 comp rx=0 tx=0).stop 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/1009709909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55978241baa0 msgr2=0x55978241bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/1009709909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55978241baa0 0x55978241bec0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x559782402160 tx=0x7fdd74018830 comp rx=0 tx=0).stop 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/1009709909 shutdown_connections 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/1009709909 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc540346a0 0x7fdc54036b60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/1009709909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55978241baa0 0x55978241bec0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/1009709909 >> 172.21.15.144:0/1009709909 conn(0x559782410bf0 msgr2=0x559782413670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/1009709909 shutdown_connections 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/1009709909 wait complete. 2024-09-13T19:35:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55978240a8a0 msgr2=0x55978240cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55978240a8a0 0x55978240cc90 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559782312a30 msgr2=0x559782407ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559782312a30 0x559782407ee0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc60034650 msgr2=0x7fdc60036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc60034650 0x7fdc60036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdd700ae000 tx=0x7fdd700a6000 comp rx=0 tx=0).stop 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 msgr2=0x559782400f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x559782400f10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x5597823fad00 tx=0x7fdd6c000bd0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 shutdown_connections 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x559782312a30 0x559782407ee0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55978240a8a0 0x55978240cc90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fdc60034650 0x7fdc60036b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 --2- 172.21.15.144:0/531321652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559782282a60 0x559782400f10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 >> 172.21.15.144:0/531321652 conn(0x559782309000 msgr2=0x5597823f42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 shutdown_connections 2024-09-13T19:35:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.260+0000 7fdd7c315980 1 -- 172.21.15.144:0/531321652 wait complete. 2024-09-13T19:35:19.276 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:19.276 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:19.276 ERROR:root:0 2024-09-13T19:35:19.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:19.310 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000058eb1e74848dccfa-0066e493f7-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:35:19.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-13T19:35:19.336 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:19.336 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-13T19:35:19.366 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-13T19:35:19.366 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-13T19:35:19.409 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T19:35:19.409 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T19:35:19.451 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-13T19:35:19.452 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:19.464 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:19.464 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-13T19:35:19.477 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:19.478 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:35:19.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:35:19.478 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-13T19:35:19.518 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:19.519 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:19.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a47fa980 1 Processor -- start 2024-09-13T19:35:19.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a47fa980 1 -- start start 2024-09-13T19:35:19.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a47fa980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563837849ba0 0x563837848360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a47fa980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56383775bae0 con 0x563837849fb0 2024-09-13T19:35:19.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a47fa980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56383777fe30 con 0x563837849ba0 2024-09-13T19:35:19.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a230a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563837849ba0 0x563837848360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a1b09640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x563837849fb0 0x5638378488a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:33084/0 (socket says 172.21.15.144:33084) 2024-09-13T19:35:19.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a1b09640 1 -- 172.21.15.144:0/3598007890 learned_addr learned my addr 172.21.15.144:0/3598007890 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:19.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a230a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563837849ba0 0x563837848360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59464/0 (socket says 172.21.15.144:59464) 2024-09-13T19:35:19.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a230a640 1 -- 172.21.15.144:0/3598007890 >> v1:172.21.15.18:6789/0 conn(0x563837849fb0 legacy=0x5638378488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.516+0000 7f50a230a640 1 -- 172.21.15.144:0/3598007890 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638378490d0 con 0x563837849ba0 2024-09-13T19:35:19.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a230a640 1 --2- 172.21.15.144:0/3598007890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x563837848360 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f509400a480 tx=0x7f509401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe6e5854034cd30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a1308640 1 -- 172.21.15.144:0/3598007890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940b0070 con 0x563837849ba0 2024-09-13T19:35:19.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a1308640 1 -- 172.21.15.144:0/3598007890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50940ab540 con 0x563837849ba0 2024-09-13T19:35:19.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a1308640 1 -- 172.21.15.144:0/3598007890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940ab840 con 0x563837849ba0 2024-09-13T19:35:19.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a47fa980 1 -- 172.21.15.144:0/3598007890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 msgr2=0x563837848360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a47fa980 1 --2- 172.21.15.144:0/3598007890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x563837848360 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f509400a480 tx=0x7f509401b280 comp rx=0 tx=0).stop 2024-09-13T19:35:19.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a47fa980 1 -- 172.21.15.144:0/3598007890 shutdown_connections 2024-09-13T19:35:19.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a47fa980 1 --2- 172.21.15.144:0/3598007890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x563837848360 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a47fa980 1 -- 172.21.15.144:0/3598007890 >> 172.21.15.144:0/3598007890 conn(0x5638378cf180 msgr2=0x5638378d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a47fa980 1 -- 172.21.15.144:0/3598007890 shutdown_connections 2024-09-13T19:35:19.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.520+0000 7f50a47fa980 1 -- 172.21.15.144:0/3598007890 wait complete. 2024-09-13T19:35:19.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.536+0000 7f50a47fa980 1 Processor -- start 2024-09-13T19:35:19.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.536+0000 7f50a47fa980 1 -- start start 2024-09-13T19:35:19.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.536+0000 7f50a47fa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x5638379c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.536+0000 7f50a47fa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563837781200 con 0x563837849ba0 2024-09-13T19:35:19.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x5638379c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x5638379c0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59476/0 (socket says 172.21.15.144:59476) 2024-09-13T19:35:19.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 -- 172.21.15.144:0/4115561809 learned_addr learned my addr 172.21.15.144:0/4115561809 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 -- 172.21.15.144:0/4115561809 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638379c1230 con 0x563837849ba0 2024-09-13T19:35:19.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 --2- 172.21.15.144:0/4115561809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x5638379c0c60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5094017e90 tx=0x7f5094003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29c7c2c34ca33b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f4f90608640 1 -- 172.21.15.144:0/4115561809 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940ba030 con 0x563837849ba0 2024-09-13T19:35:19.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f4f90608640 1 -- 172.21.15.144:0/4115561809 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50940abac0 con 0x563837849ba0 2024-09-13T19:35:19.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f4f90608640 1 -- 172.21.15.144:0/4115561809 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940b0040 con 0x563837849ba0 2024-09-13T19:35:19.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 -- 172.21.15.144:0/4115561809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 msgr2=0x5638379c0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 --2- 172.21.15.144:0/4115561809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x5638379c0c60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5094017e90 tx=0x7f5094003030 comp rx=0 tx=0).stop 2024-09-13T19:35:19.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 -- 172.21.15.144:0/4115561809 shutdown_connections 2024-09-13T19:35:19.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 --2- 172.21.15.144:0/4115561809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849ba0 0x5638379c0c60 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 -- 172.21.15.144:0/4115561809 >> 172.21.15.144:0/4115561809 conn(0x5638378cf180 msgr2=0x5638379bc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 -- 172.21.15.144:0/4115561809 shutdown_connections 2024-09-13T19:35:19.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 -- 172.21.15.144:0/4115561809 wait complete. 2024-09-13T19:35:19.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 Processor -- start 2024-09-13T19:35:19.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 -- start start 2024-09-13T19:35:19.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849fb0 0x5638379c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a47fa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5638378df1d0 con 0x563837849fb0 2024-09-13T19:35:19.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849fb0 0x5638379c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849fb0 0x5638379c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59486/0 (socket says 172.21.15.144:59486) 2024-09-13T19:35:19.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 -- 172.21.15.144:0/2981675981 learned_addr learned my addr 172.21.15.144:0/2981675981 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.540+0000 7f50a230a640 1 -- 172.21.15.144:0/2981675981 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638379c8610 con 0x563837849fb0 2024-09-13T19:35:19.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a230a640 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849fb0 0x5638379c80d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5094018eb0 tx=0x7f5094018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f4f8ee05640 1 -- 172.21.15.144:0/2981675981 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940ba030 con 0x563837849fb0 2024-09-13T19:35:19.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638379c88a0 con 0x563837849fb0 2024-09-13T19:35:19.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f4f8ee05640 1 -- 172.21.15.144:0/2981675981 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50940c8440 con 0x563837849fb0 2024-09-13T19:35:19.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f4f8ee05640 1 -- 172.21.15.144:0/2981675981 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940b0040 con 0x563837849fb0 2024-09-13T19:35:19.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638379cb580 con 0x563837849fb0 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f4f8ee05640 1 -- 172.21.15.144:0/2981675981 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f50940bd030 con 0x563837849fb0 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f4f8ee05640 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f88034650 0x7f4f88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f4f8ee05640 1 -- 172.21.15.144:0/2981675981 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f50940bb070 con 0x563837849fb0 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a1b09640 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f88034650 0x7f4f88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638379cd050 0x5638379cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638379cfab0 con 0x5638379cd050 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a2b0b640 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638379cd050 0x5638379cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a1b09640 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f88034650 0x7f4f88036b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f508c001da0 tx=0x7f508c001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a2b0b640 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638379cd050 0x5638379cf440 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2981675981 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f509c00a4d0 con 0x5638379cd050 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638379cc780 con 0x5638379cd050 2024-09-13T19:35:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2981675981 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f509c00a4d0 con 0x5638379cd050 2024-09-13T19:35:19.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638379d1de0 0x5638379d41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.544+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638379d48a0 con 0x5638379d1de0 2024-09-13T19:35:19.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a230a640 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638379d1de0 0x5638379d41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a230a640 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638379d1de0 0x5638379d41d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a230a640 1 -- 172.21.15.144:0/2981675981 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f50940ce020 con 0x5638379d1de0 2024-09-13T19:35:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638379d0c50 con 0x5638379cd050 2024-09-13T19:35:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2981675981 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f509c00a4d0 con 0x5638379cd050 2024-09-13T19:35:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638379d1130 con 0x5638379cd050 2024-09-13T19:35:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2981675981 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f509c00a4d0 con 0x5638379cd050 2024-09-13T19:35:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a47fa980 1 Processor -- start 2024-09-13T19:35:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a47fa980 1 -- start start 2024-09-13T19:35:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a47fa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379e2fa0 0x5638379e33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a47fa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5638377da800 con 0x5638379e2fa0 2024-09-13T19:35:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a2b0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379e2fa0 0x5638379e33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a2b0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379e2fa0 0x5638379e33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59488/0 (socket says 172.21.15.144:59488) 2024-09-13T19:35:19.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2228832065 learned_addr learned my addr 172.21.15.144:0/2228832065 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.548+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2228832065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638379e3900 con 0x5638379e2fa0 2024-09-13T19:35:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a2b0b640 1 --2- 172.21.15.144:0/2228832065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379e2fa0 0x5638379e33c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5638379c8fd0 tx=0x7f509c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f4f87fff640 1 -- 172.21.15.144:0/2228832065 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509c014450 con 0x5638379e2fa0 2024-09-13T19:35:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a47fa980 1 -- 172.21.15.144:0/2228832065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638379e3b90 con 0x5638379e2fa0 2024-09-13T19:35:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f4f87fff640 1 -- 172.21.15.144:0/2228832065 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c014610 con 0x5638379e2fa0 2024-09-13T19:35:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f4f87fff640 1 -- 172.21.15.144:0/2228832065 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509c014930 con 0x5638379e2fa0 2024-09-13T19:35:19.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a47fa980 1 -- 172.21.15.144:0/2228832065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638379e6810 con 0x5638379e2fa0 2024-09-13T19:35:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f4f87fff640 1 -- 172.21.15.144:0/2228832065 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f509c011040 con 0x5638379e2fa0 2024-09-13T19:35:19.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f4f87fff640 1 --2- 172.21.15.144:0/2228832065 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f7c034650 0x7f4f7c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f4f87fff640 1 -- 172.21.15.144:0/2228832065 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f509c01e070 con 0x5638379e2fa0 2024-09-13T19:35:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a230a640 1 --2- 172.21.15.144:0/2228832065 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f7c034650 0x7f4f7c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a47fa980 1 Processor -- start 2024-09-13T19:35:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a47fa980 1 -- start start 2024-09-13T19:35:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a230a640 1 --2- 172.21.15.144:0/2228832065 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f7c034650 0x7f4f7c036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50940e3440 tx=0x7f50940c86b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a47fa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379eff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a47fa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5638379c1550 con 0x5638379efb30 2024-09-13T19:35:19.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a2b0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a2b0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379eff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59498/0 (socket says 172.21.15.144:59498) 2024-09-13T19:35:19.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a2b0b640 1 -- 172.21.15.144:0/79227167 learned_addr learned my addr 172.21.15.144:0/79227167 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a2b0b640 1 -- 172.21.15.144:0/79227167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638379f0500 con 0x5638379efb30 2024-09-13T19:35:19.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.552+0000 7f50a2b0b640 1 --2- 172.21.15.144:0/79227167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379eff30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f509c04a050 tx=0x7f509c04a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5894c65dbcb60f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f4f85ffb640 1 -- 172.21.15.144:0/79227167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509c045e60 con 0x5638379efb30 2024-09-13T19:35:19.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f4f85ffb640 1 -- 172.21.15.144:0/79227167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c016960 con 0x5638379efb30 2024-09-13T19:35:19.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f4f85ffb640 1 -- 172.21.15.144:0/79227167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509c016440 con 0x5638379efb30 2024-09-13T19:35:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- 172.21.15.144:0/79227167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 msgr2=0x5638379eff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 --2- 172.21.15.144:0/79227167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379eff30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f509c04a050 tx=0x7f509c04a320 comp rx=0 tx=0).stop 2024-09-13T19:35:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- 172.21.15.144:0/79227167 shutdown_connections 2024-09-13T19:35:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 --2- 172.21.15.144:0/79227167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379eff30 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- 172.21.15.144:0/79227167 >> 172.21.15.144:0/79227167 conn(0x5638379ebe60 msgr2=0x5638379e9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- 172.21.15.144:0/79227167 shutdown_connections 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- 172.21.15.144:0/79227167 wait complete. 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 Processor -- start 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- start start 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5638379f0ab0 con 0x5638379efb30 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a2b0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a2b0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379f6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:59514/0 (socket says 172.21.15.144:59514) 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 learned_addr learned my addr 172.21.15.144:0/2630163931 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638379f7370 con 0x5638379efb30 2024-09-13T19:35:19.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a2b0b640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379f6e30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f509c047040 tx=0x7f509c049fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f4f73fff640 1 -- 172.21.15.144:0/2630163931 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509c014e20 con 0x5638379efb30 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638379f7600 con 0x5638379efb30 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f4f73fff640 1 -- 172.21.15.144:0/2630163931 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c0135c0 con 0x5638379efb30 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f4f73fff640 1 -- 172.21.15.144:0/2630163931 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509c02b350 con 0x5638379efb30 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.556+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638379fa2e0 con 0x5638379efb30 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f4f73fff640 1 -- 172.21.15.144:0/2630163931 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f509c02b4f0 con 0x5638379efb30 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f4f73fff640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f6c034650 0x7f4f6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f4f73fff640 1 -- 172.21.15.144:0/2630163931 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f509c034070 con 0x5638379efb30 2024-09-13T19:35:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a230a640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f6c034650 0x7f4f6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563837a024f0 0x563837a049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a05100 con 0x563837a024f0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a1b09640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563837a024f0 0x563837a049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a230a640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f6c034650 0x7f4f6c036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50940aa910 tx=0x7f50940e0000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a1b09640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563837a024f0 0x563837a049b0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c00e640 con 0x563837a024f0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 realm 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a01940 con 0x563837a024f0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c00e640 con 0x563837a024f0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a05c00 con 0x563837a024f0 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c00e640 con 0x563837a024f0 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a064d0 con 0x563837a024f0 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f508c00e640 con 0x563837a024f0 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563837a06e10 0x563837a09220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a099b0 con 0x563837a06e10 2024-09-13T19:35:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.560+0000 7f50a2b0b640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563837a06e10 0x563837a09220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a2b0b640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563837a06e10 0x563837a09220 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a47fa980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a47fa980 20 searching for the correct realm 2024-09-13T19:35:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563837a0b900 0x563837a0dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a230a640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563837a0b900 0x563837a0dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a230a640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563837a0b900 0x563837a0dd30 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a230a640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f50940dd070 0x7f50940dd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x7f50940dd070 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a1b09640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f50940dd070 0x7f50940dd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a1b09640 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f50940dd070 0x7f50940dd450 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c00e640 con 0x7f50940dd070 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a06e10 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f508c00e640 con 0x563837a024f0 2024-09-13T19:35:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.564+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a06e10 2024-09-13T19:35:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x7f50940dd070 2024-09-13T19:35:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a06e10 2024-09-13T19:35:19.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x7f50940dd070 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.568+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a06e10 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a06e10 2024-09-13T19:35:19.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x7f50940dd070 2024-09-13T19:35:19.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.572+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a06e10 2024-09-13T19:35:19.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a06e10 2024-09-13T19:35:19.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x7f50940dd070 2024-09-13T19:35:19.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a0b900 2024-09-13T19:35:19.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a06e10 2024-09-13T19:35:19.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x563837a024f0 2024-09-13T19:35:19.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e400 con 0x7f50940dd070 2024-09-13T19:35:19.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:19.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:19.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:19.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:19.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:19.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a0a370 con 0x563837a024f0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.576+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a09fb0 con 0x563837a024f0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a09fc0 con 0x563837a024f0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 zone default found 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 4 Realm: () 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 zonegroup default 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a0e880 con 0x563837a06e10 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a10b20 con 0x563837a0b900 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a10ec0 con 0x563837a0b900 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 started sync module instance, tier type = 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a0ffb0 con 0x7f50940dd070 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94799451456688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a0ffb0 con 0x7f50940dd070 2024-09-13T19:35:19.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.580+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a11950 con 0x563837a024f0 2024-09-13T19:35:19.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.584+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94799451456688] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.584+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.584+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94799451460640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a0ffb0 con 0x563837a024f0 2024-09-13T19:35:19.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.584+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a12360 con 0x563837a0b900 2024-09-13T19:35:19.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94799451460640] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94799451454208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a0ff20 con 0x563837a0b900 2024-09-13T19:35:19.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a130f0 con 0x7f50940dd070 2024-09-13T19:35:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94799451466752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a13990 con 0x7f50940dd070 2024-09-13T19:35:19.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a14390 con 0x563837a024f0 2024-09-13T19:35:19.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94799451454208] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94799451466752] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.588+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94799451465552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a13490 con 0x563837a024f0 2024-09-13T19:35:19.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.592+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a14c30 con 0x563837a06e10 2024-09-13T19:35:19.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.592+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94799451465552] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.592+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.592+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94799451471520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a13490 con 0x563837a06e10 2024-09-13T19:35:19.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.592+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a150e0 con 0x563837a06e10 2024-09-13T19:35:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94799451471520] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94799451473792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a15050 con 0x563837a06e10 2024-09-13T19:35:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a15ab0 con 0x563837a06e10 2024-09-13T19:35:19.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94799451473792] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94799451477392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a15c90 con 0x563837a06e10 2024-09-13T19:35:19.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 20 add_watcher() i=0 2024-09-13T19:35:19.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 20 add_watcher() i=1 2024-09-13T19:35:19.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 20 add_watcher() i=2 2024-09-13T19:35:19.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 20 add_watcher() i=3 2024-09-13T19:35:19.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 20 add_watcher() i=4 2024-09-13T19:35:19.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 20 add_watcher() i=5 2024-09-13T19:35:19.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.596+0000 7f50a47fa980 20 add_watcher() i=6 2024-09-13T19:35:19.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94799451477392] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a47fa980 20 add_watcher() i=7 2024-09-13T19:35:19.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a47fa980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:19.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a19060 con 0x563837a024f0 2024-09-13T19:35:19.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94799451478912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a16450 con 0x563837a024f0 2024-09-13T19:35:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94799451478912] v32'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f4f58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:19.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a47fa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:19.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a47fa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:19.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a47fa980 5 note: GC not initialized 2024-09-13T19:35:19.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f4ed37fe640 20 reqs_thread_entry: start 2024-09-13T19:35:19.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.600+0000 7f50a47fa980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:19.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 20 Filter name: none 2024-09-13T19:35:19.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f4ed17fa640 20 reqs_thread_entry: start 2024-09-13T19:35:19.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:19.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a3c5e0 con 0x563837a06e10 2024-09-13T19:35:19.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T19:35:19.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:19.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:19.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:19.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a42ee0 con 0x563837a06e10 2024-09-13T19:35:19.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.604+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94799451662672 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563837a3e570 con 0x563837a024f0 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 94799451465552 notify 137438953493 ret 0) ==== 678+0+0 (crc 0 0 0) 0x56383775bae0 con 0x563837a024f0 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f4f85ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94799451465552 notifier 4832 bl.length()=636 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f4f85ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f4f85ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 94799451662672 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f4f85ffb640 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4f68003eb0 con 0x563837a024f0 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 94799451662672 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f508c02e850 con 0x563837a024f0 2024-09-13T19:35:19.612 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:19.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f4f58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:19.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94799451478912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a3a3e0 con 0x563837a024f0 2024-09-13T19:35:19.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94799451478912] v32'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.608+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94799451456688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a3a3e0 con 0x7f50940dd070 2024-09-13T19:35:19.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.612+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94799451456688] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.612+0000 7f50a47fa980 20 remove_watcher() i=0 2024-09-13T19:35:19.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.612+0000 7f50a47fa980 2 removed watcher, disabling cache 2024-09-13T19:35:19.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.612+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94799451460640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a104b0 con 0x563837a024f0 2024-09-13T19:35:19.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.612+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94799451460640] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.612+0000 7f50a47fa980 20 remove_watcher() i=1 2024-09-13T19:35:19.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.612+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94799451454208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a3a3e0 con 0x563837a0b900 2024-09-13T19:35:19.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.616+0000 7f50a230a640 1 -- 172.21.15.144:0/2630163931 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94799451454208] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50940ce020 con 0x563837a0b900 2024-09-13T19:35:19.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.616+0000 7f50a47fa980 20 remove_watcher() i=2 2024-09-13T19:35:19.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.616+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94799451466752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a104b0 con 0x7f50940dd070 2024-09-13T19:35:19.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.616+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94799451466752] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x7f50940dd070 2024-09-13T19:35:19.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.616+0000 7f50a47fa980 20 remove_watcher() i=3 2024-09-13T19:35:19.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.616+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94799451465552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a0fb00 con 0x563837a024f0 2024-09-13T19:35:19.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.620+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94799451465552] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c029040 con 0x563837a024f0 2024-09-13T19:35:19.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.620+0000 7f50a47fa980 20 remove_watcher() i=4 2024-09-13T19:35:19.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.620+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94799451471520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a104b0 con 0x563837a06e10 2024-09-13T19:35:19.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.620+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94799451471520] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.620+0000 7f50a47fa980 20 remove_watcher() i=5 2024-09-13T19:35:19.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.620+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94799451473792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a12750 con 0x563837a06e10 2024-09-13T19:35:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.624+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94799451473792] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.624+0000 7f50a47fa980 20 remove_watcher() i=6 2024-09-13T19:35:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.624+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94799451477392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563837a0fb00 con 0x563837a06e10 2024-09-13T19:35:19.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a2b0b640 1 -- 172.21.15.144:0/2630163931 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94799451477392] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c02a070 con 0x563837a06e10 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 20 remove_watcher() i=7 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563837a06e10 msgr2=0x563837a09220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563837a06e10 0x563837a09220 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563837a024f0 msgr2=0x563837a049b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563837a024f0 0x563837a049b0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f50940dd070 msgr2=0x7f50940dd450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f50940dd070 0x7f50940dd450 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563837a0b900 msgr2=0x563837a0dd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563837a0b900 0x563837a0dd30 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f6c034650 msgr2=0x7f4f6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f6c034650 0x7f4f6c036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50940aa910 tx=0x7f50940e0000 comp rx=0 tx=0).stop 2024-09-13T19:35:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 msgr2=0x5638379f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2630163931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379efb30 0x5638379f6e30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f509c047040 tx=0x7f509c049fe0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a1b09640 1 -- 172.21.15.144:0/2630163931 reap_dead start 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 shutdown_connections 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 >> 172.21.15.144:0/2630163931 conn(0x5638379ebe60 msgr2=0x5638379f1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 shutdown_connections 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2630163931 wait complete. 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2228832065 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f7c034650 msgr2=0x7f4f7c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2228832065 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f7c034650 0x7f4f7c036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50940e3440 tx=0x7f50940c86b0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2228832065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379e2fa0 msgr2=0x5638379e33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2228832065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379e2fa0 0x5638379e33c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5638379c8fd0 tx=0x7f509c018830 comp rx=0 tx=0).stop 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2228832065 shutdown_connections 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2228832065 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f7c034650 0x7f4f7c036b10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2228832065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638379e2fa0 0x5638379e33c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2228832065 >> 172.21.15.144:0/2228832065 conn(0x5638379d80f0 msgr2=0x5638379dab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2228832065 shutdown_connections 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2228832065 wait complete. 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638379d1de0 msgr2=0x5638379d41d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638379d1de0 0x5638379d41d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638379cd050 msgr2=0x5638379cf440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638379cd050 0x5638379cf440 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f88034650 msgr2=0x7f4f88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f88034650 0x7f4f88036b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f508c001da0 tx=0x7f508c001300 comp rx=0 tx=0).stop 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849fb0 msgr2=0x5638379c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849fb0 0x5638379c80d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5094018eb0 tx=0x7f5094018020 comp rx=0 tx=0).stop 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 shutdown_connections 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5638379cd050 0x5638379cf440 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5638379d1de0 0x5638379d41d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4f88034650 0x7f4f88036b10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 --2- 172.21.15.144:0/2981675981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563837849fb0 0x5638379c80d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 >> 172.21.15.144:0/2981675981 conn(0x5638378cf180 msgr2=0x5638379bb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 shutdown_connections 2024-09-13T19:35:19.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.628+0000 7f50a47fa980 1 -- 172.21.15.144:0/2981675981 wait complete. 2024-09-13T19:35:19.643 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:19.643 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:19.643 ERROR:root:0 2024-09-13T19:35:19.643 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T19:35:19.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T19:35:19.644 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-13T19:35:19.729 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:19.729 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:19.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32574e980 1 Processor -- start 2024-09-13T19:35:19.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32574e980 1 -- start start 2024-09-13T19:35:19.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32574e980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x557839a3a270 0x557839ac8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32574e980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55783994dae0 con 0x557839ac8840 2024-09-13T19:35:19.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32574e980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x557839971e30 con 0x557839a3a270 2024-09-13T19:35:19.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32325e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x557839a3a270 0x557839ac8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc322a5d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x557839ac8840 0x557839acac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49374/0 (socket says 172.21.15.144:49374) 2024-09-13T19:35:19.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32325e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x557839a3a270 0x557839ac8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42312/0 (socket says 172.21.15.144:42312) 2024-09-13T19:35:19.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc322a5d640 1 -- 172.21.15.144:0/3752085724 learned_addr learned my addr 172.21.15.144:0/3752085724 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:19.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32325e640 1 -- 172.21.15.144:0/3752085724 >> v1:172.21.15.18:6789/0 conn(0x557839ac8840 legacy=0x557839acac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32325e640 1 -- 172.21.15.144:0/3752085724 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557839acd360 con 0x557839a3a270 2024-09-13T19:35:19.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.728+0000 7fc32325e640 1 --2- 172.21.15.144:0/3752085724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839ac8300 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00a420 tx=0x7fc31c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8482fc655537f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32225c640 1 -- 172.21.15.144:0/3752085724 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c0af070 con 0x557839a3a270 2024-09-13T19:35:19.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32225c640 1 -- 172.21.15.144:0/3752085724 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c0aa530 con 0x557839a3a270 2024-09-13T19:35:19.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32225c640 1 -- 172.21.15.144:0/3752085724 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c0aa850 con 0x557839a3a270 2024-09-13T19:35:19.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32574e980 1 -- 172.21.15.144:0/3752085724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 msgr2=0x557839ac8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32574e980 1 --2- 172.21.15.144:0/3752085724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839ac8300 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00a420 tx=0x7fc31c01afd0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32574e980 1 -- 172.21.15.144:0/3752085724 shutdown_connections 2024-09-13T19:35:19.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32574e980 1 --2- 172.21.15.144:0/3752085724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839ac8300 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32574e980 1 -- 172.21.15.144:0/3752085724 >> 172.21.15.144:0/3752085724 conn(0x557839ac0030 msgr2=0x557839ac2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32574e980 1 -- 172.21.15.144:0/3752085724 shutdown_connections 2024-09-13T19:35:19.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.732+0000 7fc32574e980 1 -- 172.21.15.144:0/3752085724 wait complete. 2024-09-13T19:35:19.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.744+0000 7fc32574e980 1 Processor -- start 2024-09-13T19:35:19.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- start start 2024-09-13T19:35:19.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557839973200 con 0x557839a3a270 2024-09-13T19:35:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32325e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32325e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42324/0 (socket says 172.21.15.144:42324) 2024-09-13T19:35:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32325e640 1 -- 172.21.15.144:0/3930649486 learned_addr learned my addr 172.21.15.144:0/3930649486 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32325e640 1 -- 172.21.15.144:0/3930649486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557839bb1020 con 0x557839a3a270 2024-09-13T19:35:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32325e640 1 --2- 172.21.15.144:0/3930649486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb0a50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ad040 tx=0x7fc31c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb4b8c144c920ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc21160a640 1 -- 172.21.15.144:0/3930649486 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c0af050 con 0x557839a3a270 2024-09-13T19:35:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc21160a640 1 -- 172.21.15.144:0/3930649486 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c0b0040 con 0x557839a3a270 2024-09-13T19:35:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc21160a640 1 -- 172.21.15.144:0/3930649486 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c0aaca0 con 0x557839a3a270 2024-09-13T19:35:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- 172.21.15.144:0/3930649486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 msgr2=0x557839bb0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 --2- 172.21.15.144:0/3930649486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb0a50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ad040 tx=0x7fc31c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- 172.21.15.144:0/3930649486 shutdown_connections 2024-09-13T19:35:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 --2- 172.21.15.144:0/3930649486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb0a50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- 172.21.15.144:0/3930649486 >> 172.21.15.144:0/3930649486 conn(0x557839ac0030 msgr2=0x557839bac680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- 172.21.15.144:0/3930649486 shutdown_connections 2024-09-13T19:35:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- 172.21.15.144:0/3930649486 wait complete. 2024-09-13T19:35:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 Processor -- start 2024-09-13T19:35:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- start start 2024-09-13T19:35:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32574e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557839accdd0 con 0x557839a3a270 2024-09-13T19:35:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32325e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32325e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42340/0 (socket says 172.21.15.144:42340) 2024-09-13T19:35:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.748+0000 7fc32325e640 1 -- 172.21.15.144:0/2084545012 learned_addr learned my addr 172.21.15.144:0/2084545012 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc32325e640 1 -- 172.21.15.144:0/2084545012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557839bb81a0 con 0x557839a3a270 2024-09-13T19:35:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc32325e640 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb7c60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc31c019680 tx=0x7fc31c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc20fe07640 1 -- 172.21.15.144:0/2084545012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c0c5070 con 0x557839a3a270 2024-09-13T19:35:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc20fe07640 1 -- 172.21.15.144:0/2084545012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c0b6d60 con 0x557839a3a270 2024-09-13T19:35:19.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557839bb8430 con 0x557839a3a270 2024-09-13T19:35:19.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc20fe07640 1 -- 172.21.15.144:0/2084545012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c0c15f0 con 0x557839a3a270 2024-09-13T19:35:19.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557839bbb110 con 0x557839a3a270 2024-09-13T19:35:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc20fe07640 1 -- 172.21.15.144:0/2084545012 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc31c0c8070 con 0x557839a3a270 2024-09-13T19:35:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc20fe07640 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc208034650 0x7fc208036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc20fe07640 1 -- 172.21.15.144:0/2084545012 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc31c0bb070 con 0x557839a3a270 2024-09-13T19:35:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc322a5d640 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc208034650 0x7fc208036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839ac8840 0x557839bbebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bbf210 con 0x557839ac8840 2024-09-13T19:35:19.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc323a5f640 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839ac8840 0x557839bbebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc322a5d640 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc208034650 0x7fc208036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000f70 tx=0x7fc30c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc323a5f640 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839ac8840 0x557839bbebf0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc323a5f640 1 -- 172.21.15.144:0/2084545012 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3140083f0 con 0x557839ac8840 2024-09-13T19:35:19.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.752+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bbc330 con 0x557839ac8840 2024-09-13T19:35:19.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc323a5f640 1 -- 172.21.15.144:0/2084545012 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3140083f0 con 0x557839ac8840 2024-09-13T19:35:19.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bc15b0 0x557839bc39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bc4070 con 0x557839bc15b0 2024-09-13T19:35:19.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32325e640 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bc15b0 0x557839bc39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32325e640 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bc15b0 0x557839bc39a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32325e640 1 -- 172.21.15.144:0/2084545012 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bc15b0 2024-09-13T19:35:19.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bc0450 con 0x557839ac8840 2024-09-13T19:35:19.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc323a5f640 1 -- 172.21.15.144:0/2084545012 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3140083f0 con 0x557839ac8840 2024-09-13T19:35:19.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bc0910 con 0x557839ac8840 2024-09-13T19:35:19.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc323a5f640 1 -- 172.21.15.144:0/2084545012 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc3140083f0 con 0x557839ac8840 2024-09-13T19:35:19.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32574e980 1 Processor -- start 2024-09-13T19:35:19.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32574e980 1 -- start start 2024-09-13T19:35:19.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32574e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bd2730 0x557839bd2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc32574e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5578399cc800 con 0x557839bd2730 2024-09-13T19:35:19.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc323a5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bd2730 0x557839bd2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc323a5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bd2730 0x557839bd2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42354/0 (socket says 172.21.15.144:42354) 2024-09-13T19:35:19.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.756+0000 7fc323a5f640 1 -- 172.21.15.144:0/4104053344 learned_addr learned my addr 172.21.15.144:0/4104053344 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc323a5f640 1 -- 172.21.15.144:0/4104053344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557839bd3090 con 0x557839bd2730 2024-09-13T19:35:19.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc323a5f640 1 --2- 172.21.15.144:0/4104053344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bd2730 0x557839bd2b50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x557839bbf610 tx=0x7fc31400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc20d602640 1 -- 172.21.15.144:0/4104053344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc314007da0 con 0x557839bd2730 2024-09-13T19:35:19.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc32574e980 1 -- 172.21.15.144:0/4104053344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557839bd3320 con 0x557839bd2730 2024-09-13T19:35:19.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc20d602640 1 -- 172.21.15.144:0/4104053344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31401e020 con 0x557839bd2730 2024-09-13T19:35:19.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc20d602640 1 -- 172.21.15.144:0/4104053344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc314019590 con 0x557839bd2730 2024-09-13T19:35:19.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc32574e980 1 -- 172.21.15.144:0/4104053344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557839bd5fa0 con 0x557839bd2730 2024-09-13T19:35:19.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc20d602640 1 -- 172.21.15.144:0/4104053344 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc314016040 con 0x557839bd2730 2024-09-13T19:35:19.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc20d602640 1 --2- 172.21.15.144:0/4104053344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1fc034650 0x7fc1fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc20d602640 1 -- 172.21.15.144:0/4104053344 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc31401f030 con 0x557839bd2730 2024-09-13T19:35:19.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc32325e640 1 --2- 172.21.15.144:0/4104053344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1fc034650 0x7fc1fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc32574e980 1 Processor -- start 2024-09-13T19:35:19.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc32574e980 1 -- start start 2024-09-13T19:35:19.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc32325e640 1 --2- 172.21.15.144:0/4104053344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1fc034650 0x7fc1fc036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x557839bbf700 tx=0x7fc31c0e5050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc32574e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839bdf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc32574e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557839bb12e0 con 0x557839bdf290 2024-09-13T19:35:19.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc323a5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839bdf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc323a5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839bdf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42366/0 (socket says 172.21.15.144:42366) 2024-09-13T19:35:19.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.760+0000 7fc323a5f640 1 -- 172.21.15.144:0/545205216 learned_addr learned my addr 172.21.15.144:0/545205216 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc323a5f640 1 -- 172.21.15.144:0/545205216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557839bdfc60 con 0x557839bdf290 2024-09-13T19:35:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc323a5f640 1 --2- 172.21.15.144:0/545205216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839bdf690 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc3140198a0 tx=0x7fc3140174e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8ae43ffcf5173b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc206ffd640 1 -- 172.21.15.144:0/545205216 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc314046070 con 0x557839bdf290 2024-09-13T19:35:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc206ffd640 1 -- 172.21.15.144:0/545205216 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31402b480 con 0x557839bdf290 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc206ffd640 1 -- 172.21.15.144:0/545205216 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31401d040 con 0x557839bdf290 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- 172.21.15.144:0/545205216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 msgr2=0x557839bdf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 --2- 172.21.15.144:0/545205216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839bdf690 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc3140198a0 tx=0x7fc3140174e0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- 172.21.15.144:0/545205216 shutdown_connections 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 --2- 172.21.15.144:0/545205216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839bdf690 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- 172.21.15.144:0/545205216 >> 172.21.15.144:0/545205216 conn(0x557839bdb670 msgr2=0x557839bd9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- 172.21.15.144:0/545205216 shutdown_connections 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- 172.21.15.144:0/545205216 wait complete. 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 Processor -- start 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- start start 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839be6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557839be0260 con 0x557839bdf290 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc323a5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839be6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc323a5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839be6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42382/0 (socket says 172.21.15.144:42382) 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 learned_addr learned my addr 172.21.15.144:0/4200735431 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557839be6b60 con 0x557839bdf290 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc323a5f640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839be6620 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc314015c40 tx=0x7fc31404a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc2057fa640 1 -- 172.21.15.144:0/4200735431 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31401d070 con 0x557839bdf290 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557839be6df0 con 0x557839bdf290 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc2057fa640 1 -- 172.21.15.144:0/4200735431 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc314022800 con 0x557839bdf290 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc2057fa640 1 -- 172.21.15.144:0/4200735431 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc314019910 con 0x557839bdf290 2024-09-13T19:35:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.764+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557839be7200 con 0x557839bdf290 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc2057fa640 1 -- 172.21.15.144:0/4200735431 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc314019ab0 con 0x557839bdf290 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc2057fa640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1ec034650 0x7fc1ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc2057fa640 1 -- 172.21.15.144:0/4200735431 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc314039bd0 con 0x557839bdf290 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32325e640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1ec034650 0x7fc1ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839bf1ac0 0x557839bf3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bf46d0 con 0x557839bf1ac0 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc322a5d640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839bf1ac0 0x557839bf3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32325e640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1ec034650 0x7fc1ec036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0c8fd0 tx=0x7fc31c0e0000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc322a5d640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839bf1ac0 0x557839bf3f80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc30c00e5a0 con 0x557839bf1ac0 2024-09-13T19:35:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 realm 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bf0f10 con 0x557839bf1ac0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc30c00e5a0 con 0x557839bf1ac0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bf51d0 con 0x557839bf1ac0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc30c00e5a0 con 0x557839bf1ac0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bf5aa0 con 0x557839bf1ac0 2024-09-13T19:35:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc30c00e5a0 con 0x557839bf1ac0 2024-09-13T19:35:19.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:19.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bf64c0 0x557839bf88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bf8fa0 con 0x557839bf64c0 2024-09-13T19:35:19.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.768+0000 7fc323a5f640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bf64c0 0x557839bf88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc323a5f640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bf64c0 0x557839bf88b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32574e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32574e980 20 searching for the correct realm 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557839bfaef0 0x557839bfd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32325e640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557839bfaef0 0x557839bfd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32325e640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557839bfaef0 0x557839bfd300 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32325e640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc31c0f5040 0x7fc31c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x7fc31c0f5040 2024-09-13T19:35:19.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc322a5d640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc31c0f5040 0x7fc31c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc322a5d640 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc31c0f5040 0x7fc31c0c0720 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c00e5a0 con 0x7fc31c0f5040 2024-09-13T19:35:19.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf64c0 2024-09-13T19:35:19.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc30c00e5a0 con 0x557839bf1ac0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.772+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf64c0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x7fc31c0f5040 2024-09-13T19:35:19.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf64c0 2024-09-13T19:35:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x7fc31c0f5040 2024-09-13T19:35:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.776+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf64c0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf64c0 2024-09-13T19:35:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x7fc31c0f5040 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf64c0 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.780+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf64c0 2024-09-13T19:35:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x7fc31c0f5040 2024-09-13T19:35:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bfaef0 2024-09-13T19:35:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf64c0 2024-09-13T19:35:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x557839bf1ac0 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557839bfd9d0 con 0x7fc31c0f5040 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bf9960 con 0x557839bf1ac0 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bf95a0 con 0x557839bf1ac0 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.784+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bfa280 con 0x557839bf1ac0 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 zone default found 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 4 Realm: () 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 zonegroup default 2024-09-13T19:35:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bfde50 con 0x557839bf64c0 2024-09-13T19:35:19.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839bffbd0 con 0x557839bfaef0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839c00050 con 0x557839bfaef0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 started sync module instance, tier type = 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:19.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839bff070 con 0x7fc31c0f5040 2024-09-13T19:35:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93974853318000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839bff070 con 0x7fc31c0f5040 2024-09-13T19:35:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.788+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c00bd0 con 0x557839bf1ac0 2024-09-13T19:35:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.792+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93974853318000] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.792+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.792+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93974853322400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839bff070 con 0x557839bf1ac0 2024-09-13T19:35:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.792+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c015e0 con 0x557839bfaef0 2024-09-13T19:35:19.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.792+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.792+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93974853325104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c01e80 con 0x557839bfaef0 2024-09-13T19:35:19.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.792+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c02840 con 0x7fc31c0f5040 2024-09-13T19:35:19.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93974853322400] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93974853329808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c027b0 con 0x7fc31c0f5040 2024-09-13T19:35:19.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c03590 con 0x557839bf1ac0 2024-09-13T19:35:19.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93974853325104] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93974853329808] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93974853327312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c03090 con 0x557839bf1ac0 2024-09-13T19:35:19.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.796+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c03e30 con 0x557839bf64c0 2024-09-13T19:35:19.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.800+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93974853327312] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.800+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.800+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93974853335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c03090 con 0x557839bf64c0 2024-09-13T19:35:19.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.800+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c04680 con 0x557839bf64c0 2024-09-13T19:35:19.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.800+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93974853335424] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.800+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.800+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93974853332416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c04680 con 0x557839bf64c0 2024-09-13T19:35:19.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.800+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c05080 con 0x557839bf64c0 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93974853332416] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93974853340048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c05260 con 0x557839bf64c0 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc32574e980 20 add_watcher() i=0 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc32574e980 20 add_watcher() i=1 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc32574e980 20 add_watcher() i=2 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc32574e980 20 add_watcher() i=3 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc32574e980 20 add_watcher() i=4 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc32574e980 20 add_watcher() i=5 2024-09-13T19:35:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.804+0000 7fc32574e980 20 add_watcher() i=6 2024-09-13T19:35:19.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93974853340048] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 20 add_watcher() i=7 2024-09-13T19:35:19.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:19.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839c08630 con 0x557839bf1ac0 2024-09-13T19:35:19.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93974853341520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c05a20 con 0x557839bf1ac0 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93974853341520] v32'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc1d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 5 note: GC not initialized 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc1d8fe1640 20 reqs_thread_entry: start 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 20 Filter name: none 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc1527fc640 20 reqs_thread_entry: start 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839c2bb90 con 0x557839bf64c0 2024-09-13T19:35:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-13T19:35:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:35:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-13T19:35:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.808+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839c2a330 con 0x557839bfaef0 2024-09-13T19:35:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-13T19:35:19.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:35:19.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T19:35:19.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T19:35:19.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c2ae50 con 0x557839bf64c0 2024-09-13T19:35:19.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v32'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T19:35:19.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:35:19.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T19:35:19.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93974853494848 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839c2f630 con 0x7fc31c0f5040 2024-09-13T19:35:19.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== watch-notify(notify (1) cookie 93974853318000 notify 137438953521 ret 0) ==== 575+0+0 (crc 0 0 0) 0x55783994dae0 con 0x7fc31c0f5040 2024-09-13T19:35:19.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc206ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953521 cookie 93974853318000 notifier 4839 bl.length()=533 2024-09-13T19:35:19.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc206ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T19:35:19.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc206ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:35:19.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc206ffd640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc1e8003eb0 con 0x7fc31c0f5040 2024-09-13T19:35:19.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(65 notify.0 [notify cookie 93974853494848 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== watch-notify(notify_complete (2) cookie 93974853494848 notify 137438953521 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc30c02e980 con 0x7fc31c0f5040 2024-09-13T19:35:19.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.812+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c2a840 con 0x557839bfaef0 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v32'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc32574e980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc32574e980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc32574e980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 93974853494848 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557839c2f790 con 0x557839bf1ac0 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 93974853322400 notify 137438953494 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7fc30c02e980 con 0x557839bf1ac0 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc2067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 93974853322400 notifier 4839 bl.length()=176 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc2067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T19:35:19.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc2067fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:35:19.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc2067fc640 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc158003410 con 0x557839bf1ac0 2024-09-13T19:35:19.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(68 notify.1 [notify cookie 93974853494848 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 93974853494848 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc30c02ecf0 con 0x557839bf1ac0 2024-09-13T19:35:19.821 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-13T19:35:19.814103Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.814089Z","tags":[],"group_ids":[]} 2024-09-13T19:35:19.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc1d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:19.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.816+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93974853341520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c29990 con 0x557839bf1ac0 2024-09-13T19:35:19.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.820+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93974853341520] v32'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.820+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93974853318000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c29990 con 0x7fc31c0f5040 2024-09-13T19:35:19.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.820+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93974853318000] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.820+0000 7fc32574e980 20 remove_watcher() i=0 2024-09-13T19:35:19.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.820+0000 7fc32574e980 2 removed watcher, disabling cache 2024-09-13T19:35:19.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.820+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93974853322400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839bff570 con 0x557839bf1ac0 2024-09-13T19:35:19.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93974853322400] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc32574e980 20 remove_watcher() i=1 2024-09-13T19:35:19.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93974853325104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c29990 con 0x557839bfaef0 2024-09-13T19:35:19.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc32325e640 1 -- 172.21.15.144:0/4200735431 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93974853325104] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0d1070 con 0x557839bfaef0 2024-09-13T19:35:19.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc32574e980 20 remove_watcher() i=2 2024-09-13T19:35:19.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93974853329808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c006a0 con 0x7fc31c0f5040 2024-09-13T19:35:19.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93974853329808] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x7fc31c0f5040 2024-09-13T19:35:19.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc32574e980 20 remove_watcher() i=3 2024-09-13T19:35:19.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.824+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93974853327312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839bff570 con 0x557839bf1ac0 2024-09-13T19:35:19.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.828+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93974853327312] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c029040 con 0x557839bf1ac0 2024-09-13T19:35:19.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.828+0000 7fc32574e980 20 remove_watcher() i=4 2024-09-13T19:35:19.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.828+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93974853335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c29990 con 0x557839bf64c0 2024-09-13T19:35:19.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.828+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93974853335424] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.828+0000 7fc32574e980 20 remove_watcher() i=5 2024-09-13T19:35:19.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.828+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93974853332416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c02390 con 0x557839bf64c0 2024-09-13T19:35:19.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.832+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93974853332416] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.832+0000 7fc32574e980 20 remove_watcher() i=6 2024-09-13T19:35:19.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.832+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93974853340048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557839c006a0 con 0x557839bf64c0 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.832+0000 7fc323a5f640 1 -- 172.21.15.144:0/4200735431 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93974853340048] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc314042020 con 0x557839bf64c0 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.832+0000 7fc32574e980 20 remove_watcher() i=7 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bf64c0 msgr2=0x557839bf88b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bf64c0 0x557839bf88b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839bf1ac0 msgr2=0x557839bf3f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839bf1ac0 0x557839bf3f80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc31c0f5040 msgr2=0x7fc31c0c0720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fc31c0f5040 0x7fc31c0c0720 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557839bfaef0 msgr2=0x557839bfd300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x557839bfaef0 0x557839bfd300 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1ec034650 msgr2=0x7fc1ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1ec034650 0x7fc1ec036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0c8fd0 tx=0x7fc31c0e0000 comp rx=0 tx=0).stop 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 msgr2=0x557839be6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4200735431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bdf290 0x557839be6620 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc314015c40 tx=0x7fc31404a270 comp rx=0 tx=0).stop 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc322a5d640 1 -- 172.21.15.144:0/4200735431 reap_dead start 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 shutdown_connections 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 >> 172.21.15.144:0/4200735431 conn(0x557839bdb670 msgr2=0x557839bd9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 shutdown_connections 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4200735431 wait complete. 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4104053344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1fc034650 msgr2=0x7fc1fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4104053344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1fc034650 0x7fc1fc036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x557839bbf700 tx=0x7fc31c0e5050 comp rx=0 tx=0).stop 2024-09-13T19:35:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4104053344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bd2730 msgr2=0x557839bd2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4104053344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bd2730 0x557839bd2b50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x557839bbf610 tx=0x7fc31400af40 comp rx=0 tx=0).stop 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4104053344 shutdown_connections 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4104053344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc1fc034650 0x7fc1fc036b10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/4104053344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839bd2730 0x557839bd2b50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4104053344 >> 172.21.15.144:0/4104053344 conn(0x557839bc7880 msgr2=0x557839bca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4104053344 shutdown_connections 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/4104053344 wait complete. 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bc15b0 msgr2=0x557839bc39a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bc15b0 0x557839bc39a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839ac8840 msgr2=0x557839bbebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839ac8840 0x557839bbebf0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc208034650 msgr2=0x7fc208036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc208034650 0x7fc208036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000f70 tx=0x7fc30c0012c0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 msgr2=0x557839bb7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb7c60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc31c019680 tx=0x7fc31c019810 comp rx=0 tx=0).stop 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 shutdown_connections 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x557839ac8840 0x557839bbebf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x557839bc15b0 0x557839bc39a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc208034650 0x7fc208036b10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 --2- 172.21.15.144:0/2084545012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557839a3a270 0x557839bb7c60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 >> 172.21.15.144:0/2084545012 conn(0x557839ac0030 msgr2=0x557839bab200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 shutdown_connections 2024-09-13T19:35:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.836+0000 7fc32574e980 1 -- 172.21.15.144:0/2084545012 wait complete. 2024-09-13T19:35:19.850 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T19:35:19.814103Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.814089Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:19.851 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T19:35:19.814103Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.814089Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:19.851 ERROR:root:0 2024-09-13T19:35:19.851 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:19.864 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:19.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-13T19:35:19.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-13T19:35:19.865 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-13T19:35:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c9c894980 1 Processor -- start 2024-09-13T19:35:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c9c894980 1 -- start start 2024-09-13T19:35:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c9c894980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f7d4902a10 0x55f7d4904e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c9c894980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7d4786ae0 con 0x55f7d48fe690 2024-09-13T19:35:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c9c894980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55f7d47aae30 con 0x55f7d4902a10 2024-09-13T19:35:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c99ba3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f7d4902a10 0x55f7d4904e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c99ba3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55f7d4902a10 0x55f7d4904e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42398/0 (socket says 172.21.15.144:42398) 2024-09-13T19:35:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c9a3a4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55f7d48fe690 0x55f7d48fea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49384/0 (socket says 172.21.15.144:49384) 2024-09-13T19:35:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c99ba3640 1 -- 172.21.15.144:0/2709107951 learned_addr learned my addr 172.21.15.144:0/2709107951 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c99ba3640 1 -- 172.21.15.144:0/2709107951 >> v1:172.21.15.18:6789/0 conn(0x55f7d48fe690 legacy=0x55f7d48fea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c993a2640 1 -- 172.21.15.144:0/2709107951 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832514253 0 0) 0x55f7d4786ae0 con 0x55f7d48fe690 2024-09-13T19:35:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.932+0000 7f6c99ba3640 1 -- 172.21.15.144:0/2709107951 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d4906350 con 0x55f7d4902a10 2024-09-13T19:35:19.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c99ba3640 1 --2- 172.21.15.144:0/2709107951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4902a10 0x55f7d4904e00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400a5c0 tx=0x7f6c8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e44a21d3ef4468 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c993a2640 1 -- 172.21.15.144:0/2709107951 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c840a6070 con 0x55f7d4902a10 2024-09-13T19:35:19.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c993a2640 1 -- 172.21.15.144:0/2709107951 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c840af070 con 0x55f7d4902a10 2024-09-13T19:35:19.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c993a2640 1 -- 172.21.15.144:0/2709107951 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c840aa5c0 con 0x55f7d4902a10 2024-09-13T19:35:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c9c894980 1 -- 172.21.15.144:0/2709107951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4902a10 msgr2=0x55f7d4904e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c9c894980 1 --2- 172.21.15.144:0/2709107951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4902a10 0x55f7d4904e00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400a5c0 tx=0x7f6c8401b340 comp rx=0 tx=0).stop 2024-09-13T19:35:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c9c894980 1 -- 172.21.15.144:0/2709107951 shutdown_connections 2024-09-13T19:35:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c9c894980 1 --2- 172.21.15.144:0/2709107951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4902a10 0x55f7d4904e00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c9c894980 1 -- 172.21.15.144:0/2709107951 >> 172.21.15.144:0/2709107951 conn(0x55f7d48fa1b0 msgr2=0x55f7d48fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c9c894980 1 -- 172.21.15.144:0/2709107951 shutdown_connections 2024-09-13T19:35:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.936+0000 7f6c9c894980 1 -- 172.21.15.144:0/2709107951 wait complete. 2024-09-13T19:35:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.952+0000 7f6c9c894980 1 Processor -- start 2024-09-13T19:35:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.952+0000 7f6c9c894980 1 -- start start 2024-09-13T19:35:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.952+0000 7f6c9c894980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49e99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.952+0000 7f6c9c894980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f7d47ac200 con 0x55f7d48fe690 2024-09-13T19:35:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.952+0000 7f6c9a3a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49e99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.952+0000 7f6c9a3a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49e99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42404/0 (socket says 172.21.15.144:42404) 2024-09-13T19:35:19.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.952+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/2525959684 learned_addr learned my addr 172.21.15.144:0/2525959684 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.952+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/2525959684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d49e9f70 con 0x55f7d48fe690 2024-09-13T19:35:19.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/2525959684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49e99a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400b270 tx=0x7f6c9400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf3a097f39cf38f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6b88608640 1 -- 172.21.15.144:0/2525959684 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9400d640 con 0x55f7d48fe690 2024-09-13T19:35:19.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6b88608640 1 -- 172.21.15.144:0/2525959684 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c94008070 con 0x55f7d48fe690 2024-09-13T19:35:19.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6b88608640 1 -- 172.21.15.144:0/2525959684 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9400d950 con 0x55f7d48fe690 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- 172.21.15.144:0/2525959684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 msgr2=0x55f7d49e99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 --2- 172.21.15.144:0/2525959684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49e99a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400b270 tx=0x7f6c9400b730 comp rx=0 tx=0).stop 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- 172.21.15.144:0/2525959684 shutdown_connections 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 --2- 172.21.15.144:0/2525959684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49e99a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- 172.21.15.144:0/2525959684 >> 172.21.15.144:0/2525959684 conn(0x55f7d48fa1b0 msgr2=0x55f7d49e5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- 172.21.15.144:0/2525959684 shutdown_connections 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- 172.21.15.144:0/2525959684 wait complete. 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 Processor -- start 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- start start 2024-09-13T19:35:19.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f7d4905e50 con 0x55f7d48fe690 2024-09-13T19:35:19.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9a3a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9a3a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42420/0 (socket says 172.21.15.144:42420) 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/793009187 learned_addr learned my addr 172.21.15.144:0/793009187 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/793009187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d49f12a0 con 0x55f7d48fe690 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49f0d60 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000c10 tx=0x7f6c94000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6b86e05640 1 -- 172.21.15.144:0/793009187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9401a690 con 0x55f7d48fe690 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6b86e05640 1 -- 172.21.15.144:0/793009187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9401a830 con 0x55f7d48fe690 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6b86e05640 1 -- 172.21.15.144:0/793009187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9401ab50 con 0x55f7d48fe690 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7d49f1530 con 0x55f7d48fe690 2024-09-13T19:35:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.956+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d49f4210 con 0x55f7d48fe690 2024-09-13T19:35:19.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6b86e05640 1 -- 172.21.15.144:0/793009187 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c94017070 con 0x55f7d48fe690 2024-09-13T19:35:19.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6b86e05640 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b80034650 0x7f6b80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6b86e05640 1 -- 172.21.15.144:0/793009187 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6c94015020 con 0x55f7d48fe690 2024-09-13T19:35:19.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d49f5ce0 0x55f7d49f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c99ba3640 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b80034650 0x7f6b80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d49f8770 con 0x55f7d49f5ce0 2024-09-13T19:35:19.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9aba5640 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d49f5ce0 0x55f7d49f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c99ba3640 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b80034650 0x7f6b80036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c840ae000 tx=0x7f6c840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9aba5640 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d49f5ce0 0x55f7d49f8130 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9aba5640 1 -- 172.21.15.144:0/793009187 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8c00a4d0 con 0x55f7d49f5ce0 2024-09-13T19:35:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d49f5410 con 0x55f7d49f5ce0 2024-09-13T19:35:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9aba5640 1 -- 172.21.15.144:0/793009187 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c8c00a4d0 con 0x55f7d49f5ce0 2024-09-13T19:35:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d49faaa0 0x55f7d49fce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d49fd560 con 0x55f7d49faaa0 2024-09-13T19:35:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d49faaa0 0x55f7d49fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.960+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d49faaa0 0x55f7d49fce90 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/793009187 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d49faaa0 2024-09-13T19:35:19.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d49f9910 con 0x55f7d49f5ce0 2024-09-13T19:35:19.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9aba5640 1 -- 172.21.15.144:0/793009187 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c8c00a4d0 con 0x55f7d49f5ce0 2024-09-13T19:35:19.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d49f9df0 con 0x55f7d49f5ce0 2024-09-13T19:35:19.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9aba5640 1 -- 172.21.15.144:0/793009187 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c8c00a4d0 con 0x55f7d49f5ce0 2024-09-13T19:35:19.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9c894980 1 Processor -- start 2024-09-13T19:35:19.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9c894980 1 -- start start 2024-09-13T19:35:19.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9c894980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a0de20 0x55f7d4a0e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9c894980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f7d4805800 con 0x55f7d4a0de20 2024-09-13T19:35:19.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9aba5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a0de20 0x55f7d4a0e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9aba5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a0de20 0x55f7d4a0e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42430/0 (socket says 172.21.15.144:42430) 2024-09-13T19:35:19.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9aba5640 1 -- 172.21.15.144:0/3582607985 learned_addr learned my addr 172.21.15.144:0/3582607985 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9aba5640 1 -- 172.21.15.144:0/3582607985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d4a0e780 con 0x55f7d4a0de20 2024-09-13T19:35:19.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9aba5640 1 --2- 172.21.15.144:0/3582607985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a0de20 0x55f7d4a0e240 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55f7d49f2190 tx=0x7f6c8c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6b7ffff640 1 -- 172.21.15.144:0/3582607985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c014450 con 0x55f7d4a0de20 2024-09-13T19:35:19.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6b7ffff640 1 -- 172.21.15.144:0/3582607985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c0145f0 con 0x55f7d4a0de20 2024-09-13T19:35:19.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9c894980 1 -- 172.21.15.144:0/3582607985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7d4a0ea10 con 0x55f7d4a0de20 2024-09-13T19:35:19.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6b7ffff640 1 -- 172.21.15.144:0/3582607985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c0148f0 con 0x55f7d4a0de20 2024-09-13T19:35:19.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.964+0000 7f6c9c894980 1 -- 172.21.15.144:0/3582607985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d4a11690 con 0x55f7d4a0de20 2024-09-13T19:35:19.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6b7ffff640 1 -- 172.21.15.144:0/3582607985 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c8c011040 con 0x55f7d4a0de20 2024-09-13T19:35:19.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6b7ffff640 1 --2- 172.21.15.144:0/3582607985 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b740346f0 0x7f6b74036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6b7ffff640 1 -- 172.21.15.144:0/3582607985 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6c8c01e070 con 0x55f7d4a0de20 2024-09-13T19:35:19.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/3582607985 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b740346f0 0x7f6b74036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9c894980 1 Processor -- start 2024-09-13T19:35:19.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9c894980 1 -- start start 2024-09-13T19:35:19.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/3582607985 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b740346f0 0x7f6b74036bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c94049010 tx=0x7f6c9401c970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9c894980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a1ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9c894980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f7d49ea2f0 con 0x55f7d4a1a920 2024-09-13T19:35:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9aba5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a1ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9aba5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a1ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42438/0 (socket says 172.21.15.144:42438) 2024-09-13T19:35:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9aba5640 1 -- 172.21.15.144:0/581521044 learned_addr learned my addr 172.21.15.144:0/581521044 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9aba5640 1 -- 172.21.15.144:0/581521044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d4a1b2f0 con 0x55f7d4a1a920 2024-09-13T19:35:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6c9aba5640 1 --2- 172.21.15.144:0/581521044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a1ad20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c04a110 tx=0x7f6c8c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c718750d144c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6b7dffb640 1 -- 172.21.15.144:0/581521044 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c028070 con 0x55f7d4a1a920 2024-09-13T19:35:19.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6b7dffb640 1 -- 172.21.15.144:0/581521044 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c016940 con 0x55f7d4a1a920 2024-09-13T19:35:19.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.968+0000 7f6b7dffb640 1 -- 172.21.15.144:0/581521044 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c02bb90 con 0x55f7d4a1a920 2024-09-13T19:35:19.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- 172.21.15.144:0/581521044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 msgr2=0x55f7d4a1ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:19.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 --2- 172.21.15.144:0/581521044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a1ad20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c04a110 tx=0x7f6c8c011700 comp rx=0 tx=0).stop 2024-09-13T19:35:19.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- 172.21.15.144:0/581521044 shutdown_connections 2024-09-13T19:35:19.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 --2- 172.21.15.144:0/581521044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a1ad20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:19.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- 172.21.15.144:0/581521044 >> 172.21.15.144:0/581521044 conn(0x55f7d4a16cb0 msgr2=0x55f7d4a14db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:19.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- 172.21.15.144:0/581521044 shutdown_connections 2024-09-13T19:35:19.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- 172.21.15.144:0/581521044 wait complete. 2024-09-13T19:35:19.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 Processor -- start 2024-09-13T19:35:19.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- start start 2024-09-13T19:35:19.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a21d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f7d4a1b8d0 con 0x55f7d4a1a920 2024-09-13T19:35:19.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9aba5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a21d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9aba5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a21d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42446/0 (socket says 172.21.15.144:42446) 2024-09-13T19:35:19.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 learned_addr learned my addr 172.21.15.144:0/30846882 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:19.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d4a22280 con 0x55f7d4a1a920 2024-09-13T19:35:19.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9aba5640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a21d40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c011e10 tx=0x7f6c8c04a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6b6bfff640 1 -- 172.21.15.144:0/30846882 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c0135c0 con 0x55f7d4a1a920 2024-09-13T19:35:19.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6b6bfff640 1 -- 172.21.15.144:0/30846882 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c013760 con 0x55f7d4a1a920 2024-09-13T19:35:19.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7d4a22510 con 0x55f7d4a1a920 2024-09-13T19:35:19.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6b6bfff640 1 -- 172.21.15.144:0/30846882 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c02b480 con 0x55f7d4a1a920 2024-09-13T19:35:19.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d4a251f0 con 0x55f7d4a1a920 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6b6bfff640 1 -- 172.21.15.144:0/30846882 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c8c02b6f0 con 0x55f7d4a1a920 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.972+0000 7f6b6bfff640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b64034650 0x7f6b64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6b6bfff640 1 -- 172.21.15.144:0/30846882 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6c8c034030 con 0x55f7d4a1a920 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b64034650 0x7f6b64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d4a2d360 0x55f7d4a2f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a2ff70 con 0x55f7d4a2d360 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c99ba3640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d4a2d360 0x55f7d4a2f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b64034650 0x7f6b64036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55f7d49fd940 tx=0x7f6c94036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c99ba3640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d4a2d360 0x55f7d4a2f820 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 realm 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a303a0 con 0x55f7d4a2d360 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a30c70 con 0x55f7d4a2d360 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a31010 con 0x55f7d4a2d360 2024-09-13T19:35:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d4a31d70 0x55f7d4a34160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a347b0 con 0x55f7d4a31d70 2024-09-13T19:35:19.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9aba5640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d4a31d70 0x55f7d4a34160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9aba5640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d4a31d70 0x55f7d4a34160 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:19.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 20 searching for the correct realm 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f7d4a36700 0x55f7d4a38b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.976+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f7d4a36700 0x55f7d4a38b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f7d4a36700 0x55f7d4a38b10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c9a3a4640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6c94042380 0x7f6c940138a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x7f6c94042380 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6c94042380 0x7f6c940138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6c94042380 0x7f6c940138a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a31d70 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.980+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a31d70 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x7f6c94042380 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a31d70 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x7f6c94042380 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a31d70 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.984+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a31d70 2024-09-13T19:35:19.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x7f6c94042380 2024-09-13T19:35:19.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:19.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a31d70 2024-09-13T19:35:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.988+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a31d70 2024-09-13T19:35:19.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x7f6c94042380 2024-09-13T19:35:19.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:19.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a36700 2024-09-13T19:35:19.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:19.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a31d70 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x55f7d4a2d360 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a391e0 con 0x7f6c94042380 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:19.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a35170 con 0x55f7d4a2d360 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a34db0 con 0x55f7d4a2d360 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a35a90 con 0x55f7d4a2d360 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 zone default found 2024-09-13T19:35:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 4 Realm: () 2024-09-13T19:35:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 zonegroup default 2024-09-13T19:35:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.992+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a39660 con 0x55f7d4a31d70 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3b3e0 con 0x55f7d4a36700 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3b890 con 0x55f7d4a36700 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 20 started sync module instance, tier type = 2024-09-13T19:35:20.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:20.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3a880 con 0x7f6c94042380 2024-09-13T19:35:20.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522912779728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3a880 con 0x7f6c94042380 2024-09-13T19:35:20.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:19.996+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3c390 con 0x55f7d4a2d360 2024-09-13T19:35:20.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.000+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522912779728] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.000+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.000+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522912783968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3a880 con 0x55f7d4a2d360 2024-09-13T19:35:20.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.000+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3cda0 con 0x55f7d4a36700 2024-09-13T19:35:20.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.000+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.000+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522912783968] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.000+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522912786672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3d190 con 0x55f7d4a36700 2024-09-13T19:35:20.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.000+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3db50 con 0x7f6c94042380 2024-09-13T19:35:20.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.004+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.004+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522912790448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3e1e0 con 0x7f6c94042380 2024-09-13T19:35:20.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.004+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3ed00 con 0x55f7d4a2d360 2024-09-13T19:35:20.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.004+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522912786672] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.004+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.004+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522912794576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3ecc0 con 0x55f7d4a2d360 2024-09-13T19:35:20.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.004+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3f710 con 0x55f7d4a31d70 2024-09-13T19:35:20.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.004+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522912790448] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.008+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522912794576] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.008+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.008+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522912777168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3dc30 con 0x55f7d4a31d70 2024-09-13T19:35:20.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.008+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3ff60 con 0x55f7d4a31d70 2024-09-13T19:35:20.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522912777168] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522912797280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3ff60 con 0x55f7d4a31d70 2024-09-13T19:35:20.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a40810 con 0x55f7d4a31d70 2024-09-13T19:35:20.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522912797280] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522912799408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a409f0 con 0x55f7d4a31d70 2024-09-13T19:35:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 20 add_watcher() i=0 2024-09-13T19:35:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 20 add_watcher() i=1 2024-09-13T19:35:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 20 add_watcher() i=2 2024-09-13T19:35:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 20 add_watcher() i=3 2024-09-13T19:35:20.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 20 add_watcher() i=4 2024-09-13T19:35:20.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 20 add_watcher() i=5 2024-09-13T19:35:20.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.012+0000 7f6c9c894980 20 add_watcher() i=6 2024-09-13T19:35:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.016+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522912799408] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.016+0000 7f6c9c894980 20 add_watcher() i=7 2024-09-13T19:35:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.016+0000 7f6c9c894980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.016+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a43dc0 con 0x55f7d4a2d360 2024-09-13T19:35:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.016+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.016+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522912803040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a411e0 con 0x55f7d4a2d360 2024-09-13T19:35:20.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.016+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522912803040] v32'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.016+0000 7f6b50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.020+0000 7f6c9c894980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:20.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.020+0000 7f6c9c894980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:20.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.020+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4c680 con 0x55f7d4a2d360 2024-09-13T19:35:20.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.020+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.020+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4ccd0 con 0x55f7d4a31d70 2024-09-13T19:35:20.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.024+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.024+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4ccd0 con 0x55f7d4a36700 2024-09-13T19:35:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.024+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.024+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4d7b0 con 0x55f7d4a2d360 2024-09-13T19:35:20.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.024+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'246 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.024+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4a4d0 con 0x7f6c94042380 2024-09-13T19:35:20.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.028+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'77 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.028+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4a4d0 con 0x55f7d4a36700 2024-09-13T19:35:20.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.028+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.028+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e110 con 0x55f7d4a2d360 2024-09-13T19:35:20.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.028+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.028+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e110 con 0x55f7d4a31d70 2024-09-13T19:35:20.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.032+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.032+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e110 con 0x7f6c94042380 2024-09-13T19:35:20.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.032+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.032+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e110 con 0x55f7d4a36700 2024-09-13T19:35:20.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.036+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.036+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e110 con 0x7f6c94042380 2024-09-13T19:35:20.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.036+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'78 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.036+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e110 con 0x55f7d4a31d70 2024-09-13T19:35:20.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.040+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.040+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1d0 con 0x7f6c94042380 2024-09-13T19:35:20.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.040+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.040+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1d0 con 0x55f7d4a31d70 2024-09-13T19:35:20.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.040+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.040+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a2d360 2024-09-13T19:35:20.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.044+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'247 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.044+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a36700 2024-09-13T19:35:20.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.044+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.044+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x7f6c94042380 2024-09-13T19:35:20.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.048+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'79 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.048+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a36700 2024-09-13T19:35:20.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.048+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.048+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a2d360 2024-09-13T19:35:20.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.048+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.048+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e740 con 0x55f7d4a2d360 2024-09-13T19:35:20.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.052+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'248 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.052+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e740 con 0x55f7d4a36700 2024-09-13T19:35:20.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.052+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.052+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e740 con 0x7f6c94042380 2024-09-13T19:35:20.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.056+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.056+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e740 con 0x55f7d4a36700 2024-09-13T19:35:20.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.056+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.056+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e740 con 0x55f7d4a36700 2024-09-13T19:35:20.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.056+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.056+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e740 con 0x55f7d4a36700 2024-09-13T19:35:20.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.060+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.060+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e740 con 0x55f7d4a36700 2024-09-13T19:35:20.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.060+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.060+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a31d70 2024-09-13T19:35:20.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.060+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.064+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a36700 2024-09-13T19:35:20.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.064+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.064+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a31d70 2024-09-13T19:35:20.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.064+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.064+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a36700 2024-09-13T19:35:20.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.068+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.068+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e1a0 con 0x55f7d4a31d70 2024-09-13T19:35:20.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a4e110 con 0x7f6c94042380 2024-09-13T19:35:20.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6acb7fe640 20 reqs_thread_entry: start 2024-09-13T19:35:20.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6c9c894980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:20.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6c9c894980 20 Filter name: none 2024-09-13T19:35:20.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6ac97fa640 20 reqs_thread_entry: start 2024-09-13T19:35:20.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6c9c894980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T19:35:20.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6c9c894980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.072+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a499b0 con 0x55f7d4a31d70 2024-09-13T19:35:20.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 20 rados_obj.operate() r=0 bl.length=349 2024-09-13T19:35:20.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-13T19:35:20.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:35:20.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:20.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a494d0 con 0x55f7d4a31d70 2024-09-13T19:35:20.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 10 removing key index: system_akey 2024-09-13T19:35:20.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a494d0 con 0x55f7d4a36700 2024-09-13T19:35:20.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(96 system_akey [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T19:35:20.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94522912976032 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a6c640 con 0x55f7d4a2d360 2024-09-13T19:35:20.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== watch-notify(notify (1) cookie 94522912783968 notify 137438953495 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55f7d4a4ab00 con 0x55f7d4a2d360 2024-09-13T19:35:20.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6b7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94522912783968 notifier 4846 bl.length()=161 2024-09-13T19:35:20.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(97 notify.1 [notify cookie 94522912976032 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6b7dffb640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6b60003d70 con 0x55f7d4a2d360 2024-09-13T19:35:20.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== watch-notify(notify_complete (2) cookie 94522912976032 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7d4a49e50 con 0x55f7d4a2d360 2024-09-13T19:35:20.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 10 removing email index: 2024-09-13T19:35:20.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 10 removing user buckets index 2024-09-13T19:35:20.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.076+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a6a140 con 0x55f7d4a31d70 2024-09-13T19:35:20.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.080+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(99 system_user.buckets [delete] v32'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.080+0000 7f6c9c894980 10 removing user index: system_user 2024-09-13T19:35:20.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.080+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a6bcb0 con 0x55f7d4a31d70 2024-09-13T19:35:20.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(100 system_user [call,call,delete] v32'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c9c894980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-13T19:35:20.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c9c894980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T19:35:20.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94522912971920 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a6b5b0 con 0x7f6c94042380 2024-09-13T19:35:20.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== watch-notify(notify (1) cookie 94522912779728 notify 137438953522 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55f7d4a49e50 con 0x7f6c94042380 2024-09-13T19:35:20.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6b7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953522 cookie 94522912779728 notifier 4846 bl.length()=160 2024-09-13T19:35:20.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6b7dffb640 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6b60003d70 con 0x7f6c94042380 2024-09-13T19:35:20.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(101 notify.0 [notify cookie 94522912971920 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== watch-notify(notify_complete (2) cookie 94522912971920 notify 137438953522 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7d4a4c210 con 0x7f6c94042380 2024-09-13T19:35:20.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6b50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.084+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522912803040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a47a50 con 0x55f7d4a2d360 2024-09-13T19:35:20.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94522912803040] v32'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522912779728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a408e0 con 0x7f6c94042380 2024-09-13T19:35:20.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94522912779728] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c9c894980 20 remove_watcher() i=0 2024-09-13T19:35:20.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c9c894980 2 removed watcher, disabling cache 2024-09-13T19:35:20.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522912783968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a408e0 con 0x55f7d4a2d360 2024-09-13T19:35:20.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94522912783968] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c9c894980 20 remove_watcher() i=1 2024-09-13T19:35:20.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.088+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522912786672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a408e0 con 0x55f7d4a36700 2024-09-13T19:35:20.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.092+0000 7f6c9a3a4640 1 -- 172.21.15.144:0/30846882 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94522912786672] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9402e070 con 0x55f7d4a36700 2024-09-13T19:35:20.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.092+0000 7f6c9c894980 20 remove_watcher() i=2 2024-09-13T19:35:20.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.092+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522912790448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3c8f0 con 0x7f6c94042380 2024-09-13T19:35:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.092+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94522912790448] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x7f6c94042380 2024-09-13T19:35:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.092+0000 7f6c9c894980 20 remove_watcher() i=3 2024-09-13T19:35:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.092+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522912794576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a408e0 con 0x55f7d4a2d360 2024-09-13T19:35:20.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.096+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94522912794576] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aa910 con 0x55f7d4a2d360 2024-09-13T19:35:20.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.096+0000 7f6c9c894980 20 remove_watcher() i=4 2024-09-13T19:35:20.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.096+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522912777168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3d7b0 con 0x55f7d4a31d70 2024-09-13T19:35:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.096+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94522912777168] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.096+0000 7f6c9c894980 20 remove_watcher() i=5 2024-09-13T19:35:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.096+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522912797280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a3c8f0 con 0x55f7d4a31d70 2024-09-13T19:35:20.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.100+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94522912797280] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.100+0000 7f6c9c894980 20 remove_watcher() i=6 2024-09-13T19:35:20.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.100+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522912799408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7d4a408e0 con 0x55f7d4a31d70 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.100+0000 7f6c9aba5640 1 -- 172.21.15.144:0/30846882 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94522912799408] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c052070 con 0x55f7d4a31d70 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.100+0000 7f6c9c894980 20 remove_watcher() i=7 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.100+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d4a31d70 msgr2=0x55f7d4a34160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.100+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d4a31d70 0x55f7d4a34160 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d4a2d360 msgr2=0x55f7d4a2f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d4a2d360 0x55f7d4a2f820 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6c94042380 msgr2=0x7f6c940138a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6c94042380 0x7f6c940138a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f7d4a36700 msgr2=0x55f7d4a38b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55f7d4a36700 0x55f7d4a38b10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b64034650 msgr2=0x7f6b64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b64034650 0x7f6b64036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55f7d49fd940 tx=0x7f6c94036000 comp rx=0 tx=0).stop 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c99ba3640 1 -- 172.21.15.144:0/30846882 reap_dead start 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 msgr2=0x55f7d4a21d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a21d40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c011e10 tx=0x7f6c8c04a070 comp rx=0 tx=0).stop 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 shutdown_connections 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/30846882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a1a920 0x55f7d4a21d40 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 >> 172.21.15.144:0/30846882 conn(0x55f7d4a16cb0 msgr2=0x55f7d4a14d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 shutdown_connections 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/30846882 wait complete. 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/3582607985 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b740346f0 msgr2=0x7f6b74036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/3582607985 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b740346f0 0x7f6b74036bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c94049010 tx=0x7f6c9401c970 comp rx=0 tx=0).stop 2024-09-13T19:35:20.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/3582607985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a0de20 msgr2=0x55f7d4a0e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/3582607985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a0de20 0x55f7d4a0e240 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55f7d49f2190 tx=0x7f6c8c018830 comp rx=0 tx=0).stop 2024-09-13T19:35:20.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/3582607985 shutdown_connections 2024-09-13T19:35:20.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/3582607985 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b740346f0 0x7f6b74036bb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/3582607985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d4a0de20 0x55f7d4a0e240 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/3582607985 >> 172.21.15.144:0/3582607985 conn(0x55f7d4873b90 msgr2=0x55f7d4873f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/3582607985 shutdown_connections 2024-09-13T19:35:20.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/3582607985 wait complete. 2024-09-13T19:35:20.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d49faaa0 msgr2=0x55f7d49fce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d49faaa0 0x55f7d49fce90 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d49f5ce0 msgr2=0x55f7d49f8130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d49f5ce0 0x55f7d49f8130 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b80034650 msgr2=0x7f6b80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b80034650 0x7f6b80036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c840ae000 tx=0x7f6c840a6000 comp rx=0 tx=0).stop 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 msgr2=0x55f7d49f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49f0d60 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000c10 tx=0x7f6c94000ee0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 shutdown_connections 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55f7d49f5ce0 0x55f7d49f8130 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55f7d49faaa0 0x55f7d49fce90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6b80034650 0x7f6b80036b10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 --2- 172.21.15.144:0/793009187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f7d48fe690 0x55f7d49f0d60 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 >> 172.21.15.144:0/793009187 conn(0x55f7d48fa1b0 msgr2=0x55f7d49e40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 shutdown_connections 2024-09-13T19:35:20.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.104+0000 7f6c9c894980 1 -- 172.21.15.144:0/793009187 wait complete. 2024-09-13T19:35:20.119 ERROR:root:None 2024-09-13T19:35:20.119 ERROR:root:0 2024-09-13T19:35:20.119 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T19:35:20.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T19:35:20.119 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-13T19:35:20.208 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:20.208 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:20.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.204+0000 7fb375f5b980 1 Processor -- start 2024-09-13T19:35:20.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.204+0000 7fb375f5b980 1 -- start start 2024-09-13T19:35:20.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.204+0000 7fb375f5b980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55746c496350 0x55746c494b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.204+0000 7fb375f5b980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55746c3a7ae0 con 0x55746c496760 2024-09-13T19:35:20.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.204+0000 7fb375f5b980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55746c3cbe30 con 0x55746c496350 2024-09-13T19:35:20.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb373a6b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55746c496350 0x55746c494b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb373a6b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55746c496350 0x55746c494b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42462/0 (socket says 172.21.15.144:42462) 2024-09-13T19:35:20.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb373a6b640 1 -- 172.21.15.144:0/2012044460 learned_addr learned my addr 172.21.15.144:0/2012044460 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb373a6b640 1 -- 172.21.15.144:0/2012044460 >> v1:172.21.15.18:6789/0 conn(0x55746c496760 legacy=0x55746c495050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb373a6b640 1 -- 172.21.15.144:0/2012044460 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746c495880 con 0x55746c496350 2024-09-13T19:35:20.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb373a6b640 1 --2- 172.21.15.144:0/2012044460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c494b10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb36400a4e0 tx=0x7fb36401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8fffd2f18a5189 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb372a69640 1 -- 172.21.15.144:0/2012044460 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640aa540 con 0x55746c496350 2024-09-13T19:35:20.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb372a69640 1 -- 172.21.15.144:0/2012044460 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3640aa6e0 con 0x55746c496350 2024-09-13T19:35:20.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.208+0000 7fb372a69640 1 -- 172.21.15.144:0/2012044460 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640aaa40 con 0x55746c496350 2024-09-13T19:35:20.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.212+0000 7fb375f5b980 1 -- 172.21.15.144:0/2012044460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 msgr2=0x55746c494b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.212+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2012044460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c494b10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb36400a4e0 tx=0x7fb36401b090 comp rx=0 tx=0).stop 2024-09-13T19:35:20.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.212+0000 7fb375f5b980 1 -- 172.21.15.144:0/2012044460 shutdown_connections 2024-09-13T19:35:20.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.212+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2012044460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c494b10 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.212+0000 7fb375f5b980 1 -- 172.21.15.144:0/2012044460 >> 172.21.15.144:0/2012044460 conn(0x55746c51b150 msgr2=0x55746c51d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.212+0000 7fb375f5b980 1 -- 172.21.15.144:0/2012044460 shutdown_connections 2024-09-13T19:35:20.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.212+0000 7fb375f5b980 1 -- 172.21.15.144:0/2012044460 wait complete. 2024-09-13T19:35:20.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.224+0000 7fb375f5b980 1 Processor -- start 2024-09-13T19:35:20.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.224+0000 7fb375f5b980 1 -- start start 2024-09-13T19:35:20.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.224+0000 7fb375f5b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c60cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.224+0000 7fb375f5b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55746c3cd200 con 0x55746c496350 2024-09-13T19:35:20.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb373a6b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c60cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb373a6b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c60cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42468/0 (socket says 172.21.15.144:42468) 2024-09-13T19:35:20.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb373a6b640 1 -- 172.21.15.144:0/2437290466 learned_addr learned my addr 172.21.15.144:0/2437290466 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb373a6b640 1 -- 172.21.15.144:0/2437290466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746c60d120 con 0x55746c496350 2024-09-13T19:35:20.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb373a6b640 1 --2- 172.21.15.144:0/2437290466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c60cb50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb364017ca0 tx=0x7fb3640033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5547c282df48a0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb261e0b640 1 -- 172.21.15.144:0/2437290466 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640b9070 con 0x55746c496350 2024-09-13T19:35:20.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb261e0b640 1 -- 172.21.15.144:0/2437290466 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3640aab30 con 0x55746c496350 2024-09-13T19:35:20.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb261e0b640 1 -- 172.21.15.144:0/2437290466 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640aae10 con 0x55746c496350 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 -- 172.21.15.144:0/2437290466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 msgr2=0x55746c60cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2437290466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c60cb50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb364017ca0 tx=0x7fb3640033b0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 -- 172.21.15.144:0/2437290466 shutdown_connections 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2437290466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c60cb50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 -- 172.21.15.144:0/2437290466 >> 172.21.15.144:0/2437290466 conn(0x55746c51b150 msgr2=0x55746c608780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 -- 172.21.15.144:0/2437290466 shutdown_connections 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 -- 172.21.15.144:0/2437290466 wait complete. 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 Processor -- start 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 -- start start 2024-09-13T19:35:20.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c613de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb375f5b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55746c52b1a0 con 0x55746c496350 2024-09-13T19:35:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb373a6b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c613de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb373a6b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c613de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42474/0 (socket says 172.21.15.144:42474) 2024-09-13T19:35:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.228+0000 7fb373a6b640 1 -- 172.21.15.144:0/1033796367 learned_addr learned my addr 172.21.15.144:0/1033796367 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb373a6b640 1 -- 172.21.15.144:0/1033796367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746c614320 con 0x55746c496350 2024-09-13T19:35:20.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb373a6b640 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c613de0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb364017ca0 tx=0x7fb364017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb25bfff640 1 -- 172.21.15.144:0/1033796367 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640b9070 con 0x55746c496350 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55746c6145b0 con 0x55746c496350 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb25bfff640 1 -- 172.21.15.144:0/1033796367 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3640c8470 con 0x55746c496350 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb25bfff640 1 -- 172.21.15.144:0/1033796367 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640a3b40 con 0x55746c496350 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55746c617290 con 0x55746c496350 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb25bfff640 1 -- 172.21.15.144:0/1033796367 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb3640b3040 con 0x55746c496350 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb25bfff640 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb25c034650 0x7fb25c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb25bfff640 1 -- 172.21.15.144:0/1033796367 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb3640c4070 con 0x55746c496350 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb37326a640 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb25c034650 0x7fb25c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c496760 0x55746c61adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c61b420 con 0x55746c496760 2024-09-13T19:35:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb37426c640 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c496760 0x55746c61adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb37326a640 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb25c034650 0x7fb25c036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb35c000f70 tx=0x7fb35c001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb37426c640 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c496760 0x55746c61adb0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb37426c640 1 -- 172.21.15.144:0/1033796367 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb36c0083f0 con 0x55746c496760 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c61bce0 con 0x55746c496760 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.232+0000 7fb37426c640 1 -- 172.21.15.144:0/1033796367 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb36c0083f0 con 0x55746c496760 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c61d5f0 0x55746c61fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c620240 con 0x55746c61d5f0 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb373a6b640 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c61d5f0 0x55746c61fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb373a6b640 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c61d5f0 0x55746c61fab0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb373a6b640 1 -- 172.21.15.144:0/1033796367 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb3640c8930 con 0x55746c61d5f0 2024-09-13T19:35:20.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c61c530 con 0x55746c496760 2024-09-13T19:35:20.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb37426c640 1 -- 172.21.15.144:0/1033796367 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb36c0083f0 con 0x55746c496760 2024-09-13T19:35:20.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c61c8d0 con 0x55746c496760 2024-09-13T19:35:20.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb37426c640 1 -- 172.21.15.144:0/1033796367 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb36c0083f0 con 0x55746c496760 2024-09-13T19:35:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb375f5b980 1 Processor -- start 2024-09-13T19:35:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb375f5b980 1 -- start start 2024-09-13T19:35:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb375f5b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c62e940 0x55746c62ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.236+0000 7fb375f5b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55746c426800 con 0x55746c62e940 2024-09-13T19:35:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb37426c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c62e940 0x55746c62ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb37426c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c62e940 0x55746c62ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42480/0 (socket says 172.21.15.144:42480) 2024-09-13T19:35:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb37426c640 1 -- 172.21.15.144:0/1416117874 learned_addr learned my addr 172.21.15.144:0/1416117874 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb37426c640 1 -- 172.21.15.144:0/1416117874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746c62f2a0 con 0x55746c62e940 2024-09-13T19:35:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb37426c640 1 --2- 172.21.15.144:0/1416117874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c62e940 0x55746c62ed60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55746c614ce0 tx=0x7fb36c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb2597fa640 1 -- 172.21.15.144:0/1416117874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c007dd0 con 0x55746c62e940 2024-09-13T19:35:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb2597fa640 1 -- 172.21.15.144:0/1416117874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c01e020 con 0x55746c62e940 2024-09-13T19:35:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb375f5b980 1 -- 172.21.15.144:0/1416117874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55746c62f530 con 0x55746c62e940 2024-09-13T19:35:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb2597fa640 1 -- 172.21.15.144:0/1416117874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c019590 con 0x55746c62e940 2024-09-13T19:35:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb375f5b980 1 -- 172.21.15.144:0/1416117874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55746c6321b0 con 0x55746c62e940 2024-09-13T19:35:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb2597fa640 1 -- 172.21.15.144:0/1416117874 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb36c016040 con 0x55746c62e940 2024-09-13T19:35:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb2597fa640 1 --2- 172.21.15.144:0/1416117874 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb24c034650 0x7fb24c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb2597fa640 1 -- 172.21.15.144:0/1416117874 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb36c01f030 con 0x55746c62e940 2024-09-13T19:35:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb373a6b640 1 --2- 172.21.15.144:0/1416117874 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb24c034650 0x7fb24c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb375f5b980 1 Processor -- start 2024-09-13T19:35:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb375f5b980 1 -- start start 2024-09-13T19:35:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb373a6b640 1 --2- 172.21.15.144:0/1416117874 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb24c034650 0x7fb24c036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3640e33c0 tx=0x7fb3640c87d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb375f5b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c63b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.240+0000 7fb375f5b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55746c60d3e0 con 0x55746c63b470 2024-09-13T19:35:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c63b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c63b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42494/0 (socket says 172.21.15.144:42494) 2024-09-13T19:35:20.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 -- 172.21.15.144:0/4163336914 learned_addr learned my addr 172.21.15.144:0/4163336914 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 -- 172.21.15.144:0/4163336914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746c63be40 con 0x55746c63b470 2024-09-13T19:35:20.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 --2- 172.21.15.144:0/4163336914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c63b870 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb36c04a350 tx=0x7fb36c023720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fec916108d1f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb252ffd640 1 -- 172.21.15.144:0/4163336914 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c046070 con 0x55746c63b470 2024-09-13T19:35:20.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb252ffd640 1 -- 172.21.15.144:0/4163336914 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c03be00 con 0x55746c63b470 2024-09-13T19:35:20.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb252ffd640 1 -- 172.21.15.144:0/4163336914 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c01d040 con 0x55746c63b470 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 -- 172.21.15.144:0/4163336914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 msgr2=0x55746c63b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 --2- 172.21.15.144:0/4163336914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c63b870 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb36c04a350 tx=0x7fb36c023720 comp rx=0 tx=0).stop 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 -- 172.21.15.144:0/4163336914 shutdown_connections 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 --2- 172.21.15.144:0/4163336914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c63b870 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 -- 172.21.15.144:0/4163336914 >> 172.21.15.144:0/4163336914 conn(0x55746c6377a0 msgr2=0x55746c6358a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 -- 172.21.15.144:0/4163336914 shutdown_connections 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 -- 172.21.15.144:0/4163336914 wait complete. 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 Processor -- start 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 -- start start 2024-09-13T19:35:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c642760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb375f5b980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55746c63c3f0 con 0x55746c63b470 2024-09-13T19:35:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c642760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c642760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42498/0 (socket says 172.21.15.144:42498) 2024-09-13T19:35:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 learned_addr learned my addr 172.21.15.144:0/2142730847 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746c642ca0 con 0x55746c63b470 2024-09-13T19:35:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb37426c640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c642760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb36c019f60 tx=0x7fb36c04a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.244+0000 7fb2517fa640 1 -- 172.21.15.144:0/2142730847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c01d040 con 0x55746c63b470 2024-09-13T19:35:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb2517fa640 1 -- 172.21.15.144:0/2142730847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c0224f0 con 0x55746c63b470 2024-09-13T19:35:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55746c642f30 con 0x55746c63b470 2024-09-13T19:35:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb2517fa640 1 -- 172.21.15.144:0/2142730847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36c0227d0 con 0x55746c63b470 2024-09-13T19:35:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55746c642f30 con 0x55746c63b470 2024-09-13T19:35:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb2517fa640 1 -- 172.21.15.144:0/2142730847 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb36c035070 con 0x55746c63b470 2024-09-13T19:35:20.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb2517fa640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb23c034650 0x7fb23c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb2517fa640 1 -- 172.21.15.144:0/2142730847 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb36c032030 con 0x55746c63b470 2024-09-13T19:35:20.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb373a6b640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb23c034650 0x7fb23c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c64da30 0x55746c64fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c650640 con 0x55746c64da30 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb37326a640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c64da30 0x55746c64fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb373a6b640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb23c034650 0x7fb23c036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55746c620640 tx=0x7fb3640e6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb37326a640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c64da30 0x55746c64fef0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb35c00d040 con 0x55746c64da30 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 realm 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c64ce80 con 0x55746c64da30 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb35c00d040 con 0x55746c64da30 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c651140 con 0x55746c64da30 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb35c00d040 con 0x55746c64da30 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c651a10 con 0x55746c64da30 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb35c00d040 con 0x55746c64da30 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c652430 0x55746c654820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.248+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c654f90 con 0x55746c652430 2024-09-13T19:35:20.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37426c640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c652430 0x55746c654820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37426c640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c652430 0x55746c654820 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb375f5b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb375f5b980 20 searching for the correct realm 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55746c656ee0 0x55746c659310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb373a6b640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55746c656ee0 0x55746c659310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb373a6b640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55746c656ee0 0x55746c659310 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb373a6b640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb3640f1070 0x7fb3640c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x7fb3640f1070 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37326a640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb3640f1070 0x7fb3640c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37326a640 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb3640f1070 0x7fb3640c67f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c00d040 con 0x7fb3640f1070 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c652430 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.252+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb35c00d040 con 0x55746c64da30 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c652430 2024-09-13T19:35:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x7fb3640f1070 2024-09-13T19:35:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c652430 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x7fb3640f1070 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.256+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c652430 2024-09-13T19:35:20.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c652430 2024-09-13T19:35:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x7fb3640f1070 2024-09-13T19:35:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.260+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c652430 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c652430 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x7fb3640f1070 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c656ee0 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c652430 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x55746c64da30 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55746c6599e0 con 0x7fb3640f1070 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb375f5b980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb375f5b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb375f5b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb375f5b980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb375f5b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb375f5b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.264+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c655950 con 0x55746c64da30 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c655560 con 0x55746c64da30 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c655530 con 0x55746c64da30 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 zone default found 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 4 Realm: () 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 zonegroup default 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c659e60 con 0x55746c652430 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c65bbe0 con 0x55746c656ee0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c65c020 con 0x55746c656ee0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 started sync module instance, tier type = 2024-09-13T19:35:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:20.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65b080 con 0x7fb3640f1070 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93958523172224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65b080 con 0x7fb3640f1070 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.268+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65cb50 con 0x55746c64da30 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.272+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93958523172224] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.272+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.272+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93958523176480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65b080 con 0x55746c64da30 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.272+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65d560 con 0x55746c656ee0 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93958523176480] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93958523169744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65aff0 con 0x55746c656ee0 2024-09-13T19:35:20.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65e260 con 0x7fb3640f1070 2024-09-13T19:35:20.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93958523182784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65e950 con 0x7fb3640f1070 2024-09-13T19:35:20.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65f450 con 0x55746c64da30 2024-09-13T19:35:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93958523169744] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93958523182784] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93958523187008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65f410 con 0x55746c64da30 2024-09-13T19:35:20.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.276+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65f870 con 0x55746c652430 2024-09-13T19:35:20.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.280+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93958523187008] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.280+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.280+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93958523184032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65fc60 con 0x55746c652430 2024-09-13T19:35:20.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.280+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c660620 con 0x55746c652430 2024-09-13T19:35:20.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.280+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93958523184032] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93958523181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c660620 con 0x55746c652430 2024-09-13T19:35:20.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c660fe0 con 0x55746c652430 2024-09-13T19:35:20.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93958523181312] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93958523192144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c660fe0 con 0x55746c652430 2024-09-13T19:35:20.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 20 add_watcher() i=0 2024-09-13T19:35:20.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 20 add_watcher() i=1 2024-09-13T19:35:20.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 20 add_watcher() i=2 2024-09-13T19:35:20.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 20 add_watcher() i=3 2024-09-13T19:35:20.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 20 add_watcher() i=4 2024-09-13T19:35:20.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 20 add_watcher() i=5 2024-09-13T19:35:20.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.284+0000 7fb375f5b980 20 add_watcher() i=6 2024-09-13T19:35:20.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93958523192144] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 20 add_watcher() i=7 2024-09-13T19:35:20.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:20.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c664410 con 0x55746c64da30 2024-09-13T19:35:20.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93958523194624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c661960 con 0x55746c64da30 2024-09-13T19:35:20.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93958523194624] v32'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb229fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 5 note: GC not initialized 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb228fe1640 20 reqs_thread_entry: start 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 20 Filter name: none 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb1a27fc640 20 reqs_thread_entry: start 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.288+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c687b00 con 0x55746c656ee0 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-13T19:35:20.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c686750 con 0x55746c656ee0 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T19:35:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c686750 con 0x55746c656ee0 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v32'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 93958523347936 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c68b870 con 0x55746c656ee0 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== watch-notify(notify (1) cookie 93958523169744 notify 137438953483 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55746c68b0f0 con 0x55746c656ee0 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb252ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 93958523169744 notifier 4853 bl.length()=542 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb252ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb252ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb252ffd640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb238003eb0 con 0x55746c656ee0 2024-09-13T19:35:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(65 notify.2 [notify cookie 93958523347936 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== watch-notify(notify_complete (2) cookie 93958523347936 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55746c686d90 con 0x55746c656ee0 2024-09-13T19:35:20.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.292+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c6863e0 con 0x55746c656ee0 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v32'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb375f5b980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb375f5b980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb375f5b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93958523347936 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55746c68bca0 con 0x55746c652430 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== watch-notify(notify (1) cookie 93958523184032 notify 137438953502 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55746c642ca0 con 0x55746c652430 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb2527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 93958523184032 notifier 4853 bl.length()=175 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb2527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb2527fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:35:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb2527fc640 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a8003410 con 0x55746c652430 2024-09-13T19:35:20.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(68 notify.5 [notify cookie 93958523347936 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== watch-notify(notify_complete (2) cookie 93958523347936 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55746c63be40 con 0x55746c652430 2024-09-13T19:35:20.301 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-13T19:35:20.294566Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:20.294551Z","tags":[],"group_ids":[]} 2024-09-13T19:35:20.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb229fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.296+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93958523194624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c685900 con 0x55746c64da30 2024-09-13T19:35:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.300+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93958523194624] v32'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.300+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93958523172224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c685900 con 0x7fb3640f1070 2024-09-13T19:35:20.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.300+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93958523172224] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.300+0000 7fb375f5b980 20 remove_watcher() i=0 2024-09-13T19:35:20.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.300+0000 7fb375f5b980 2 removed watcher, disabling cache 2024-09-13T19:35:20.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.300+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93958523176480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c685900 con 0x55746c64da30 2024-09-13T19:35:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.300+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93958523176480] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.304+0000 7fb375f5b980 20 remove_watcher() i=1 2024-09-13T19:35:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.304+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93958523169744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c685900 con 0x55746c656ee0 2024-09-13T19:35:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.304+0000 7fb373a6b640 1 -- 172.21.15.144:0/2142730847 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93958523169744] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640ed070 con 0x55746c656ee0 2024-09-13T19:35:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.304+0000 7fb375f5b980 20 remove_watcher() i=2 2024-09-13T19:35:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.304+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93958523182784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65abd0 con 0x7fb3640f1070 2024-09-13T19:35:20.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.304+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93958523182784] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x7fb3640f1070 2024-09-13T19:35:20.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.304+0000 7fb375f5b980 20 remove_watcher() i=3 2024-09-13T19:35:20.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.304+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93958523187008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c685900 con 0x55746c64da30 2024-09-13T19:35:20.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.308+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93958523187008] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c02a040 con 0x55746c64da30 2024-09-13T19:35:20.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.308+0000 7fb375f5b980 20 remove_watcher() i=4 2024-09-13T19:35:20.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.308+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93958523184032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65dec0 con 0x55746c652430 2024-09-13T19:35:20.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.308+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93958523184032] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.308+0000 7fb375f5b980 20 remove_watcher() i=5 2024-09-13T19:35:20.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.308+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93958523181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c65abd0 con 0x55746c652430 2024-09-13T19:35:20.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93958523181312] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 20 remove_watcher() i=6 2024-09-13T19:35:20.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93958523192144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55746c685900 con 0x55746c652430 2024-09-13T19:35:20.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb37426c640 1 -- 172.21.15.144:0/2142730847 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93958523192144] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb36c05e040 con 0x55746c652430 2024-09-13T19:35:20.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 20 remove_watcher() i=7 2024-09-13T19:35:20.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c652430 msgr2=0x55746c654820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c652430 0x55746c654820 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c64da30 msgr2=0x55746c64fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c64da30 0x55746c64fef0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb3640f1070 msgr2=0x7fb3640c67f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fb3640f1070 0x7fb3640c67f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55746c656ee0 msgr2=0x55746c659310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.312+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55746c656ee0 0x55746c659310 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb23c034650 msgr2=0x7fb23c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb23c034650 0x7fb23c036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55746c620640 tx=0x7fb3640e6070 comp rx=0 tx=0).stop 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 msgr2=0x55746c642760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/2142730847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c63b470 0x55746c642760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb36c019f60 tx=0x7fb36c04a2b0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 reap_dead start 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb37326a640 1 -- 172.21.15.144:0/2142730847 reap_dead start 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 shutdown_connections 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 >> 172.21.15.144:0/2142730847 conn(0x55746c6377a0 msgr2=0x55746c63caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 shutdown_connections 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/2142730847 wait complete. 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1416117874 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb24c034650 msgr2=0x7fb24c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1416117874 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb24c034650 0x7fb24c036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3640e33c0 tx=0x7fb3640c87d0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1416117874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c62e940 msgr2=0x55746c62ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1416117874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c62e940 0x55746c62ed60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55746c614ce0 tx=0x7fb36c00af40 comp rx=0 tx=0).stop 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1416117874 shutdown_connections 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1416117874 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb24c034650 0x7fb24c036b10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1416117874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c62e940 0x55746c62ed60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1416117874 >> 172.21.15.144:0/1416117874 conn(0x55746c623a90 msgr2=0x55746c626510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1416117874 shutdown_connections 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1416117874 wait complete. 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c61d5f0 msgr2=0x55746c61fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c61d5f0 0x55746c61fab0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c496760 msgr2=0x55746c61adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c496760 0x55746c61adb0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb25c034650 msgr2=0x7fb25c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb25c034650 0x7fb25c036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb35c000f70 tx=0x7fb35c001420 comp rx=0 tx=0).stop 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 msgr2=0x55746c613de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c613de0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb364017ca0 tx=0x7fb364017e30 comp rx=0 tx=0).stop 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 shutdown_connections 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55746c496760 0x55746c61adb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55746c61d5f0 0x55746c61fab0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb25c034650 0x7fb25c036b10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 --2- 172.21.15.144:0/1033796367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746c496350 0x55746c613de0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 >> 172.21.15.144:0/1033796367 conn(0x55746c51b150 msgr2=0x55746c607300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 shutdown_connections 2024-09-13T19:35:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.316+0000 7fb375f5b980 1 -- 172.21.15.144:0/1033796367 wait complete. 2024-09-13T19:35:20.331 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T19:35:20.294566Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:20.294551Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:20.331 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T19:35:20.294566Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:20.294551Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:20.331 ERROR:root:0 2024-09-13T19:35:20.332 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:20.347 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:20.348 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-13T19:35:20.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-13T19:35:20.348 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-13T19:35:20.380 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:20.380 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:20.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.376+0000 7f07de539980 1 Processor -- start 2024-09-13T19:35:20.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.376+0000 7f07de539980 1 -- start start 2024-09-13T19:35:20.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.376+0000 7f07de539980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a153276a90 0x55a153278e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.376+0000 7f07de539980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1530faae0 con 0x55a1531e6ac0 2024-09-13T19:35:20.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.376+0000 7f07de539980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55a15311ee30 con 0x55a153276a90 2024-09-13T19:35:20.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.376+0000 7f07db848640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a153276a90 0x55a153278e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07dc049640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55a1531e6ac0 0x55a153275370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49406/0 (socket says 172.21.15.144:49406) 2024-09-13T19:35:20.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07db848640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55a153276a90 0x55a153278e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42502/0 (socket says 172.21.15.144:42502) 2024-09-13T19:35:20.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07dc049640 1 -- 172.21.15.144:0/837682510 learned_addr learned my addr 172.21.15.144:0/837682510 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:20.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07db848640 1 -- 172.21.15.144:0/837682510 >> v1:172.21.15.18:6789/0 conn(0x55a1531e6ac0 legacy=0x55a153275370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07db848640 1 -- 172.21.15.144:0/837682510 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15327a3d0 con 0x55a153276a90 2024-09-13T19:35:20.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07db848640 1 --2- 172.21.15.144:0/837682510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153276a90 0x55a153278e80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f07d000a480 tx=0x7f07d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37b625204fe2d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07db047640 1 -- 172.21.15.144:0/837682510 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d00b0070 con 0x55a153276a90 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07db047640 1 -- 172.21.15.144:0/837682510 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d00ab540 con 0x55a153276a90 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07db047640 1 -- 172.21.15.144:0/837682510 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d00ab840 con 0x55a153276a90 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07de539980 1 -- 172.21.15.144:0/837682510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153276a90 msgr2=0x55a153278e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07de539980 1 --2- 172.21.15.144:0/837682510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153276a90 0x55a153278e80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f07d000a480 tx=0x7f07d001b280 comp rx=0 tx=0).stop 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07de539980 1 -- 172.21.15.144:0/837682510 shutdown_connections 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07de539980 1 --2- 172.21.15.144:0/837682510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153276a90 0x55a153278e80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.380+0000 7f07de539980 1 -- 172.21.15.144:0/837682510 >> 172.21.15.144:0/837682510 conn(0x55a15326d060 msgr2=0x55a15326f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.384+0000 7f07de539980 1 -- 172.21.15.144:0/837682510 shutdown_connections 2024-09-13T19:35:20.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.384+0000 7f07de539980 1 -- 172.21.15.144:0/837682510 wait complete. 2024-09-13T19:35:20.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.396+0000 7f07de539980 1 Processor -- start 2024-09-13T19:35:20.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.396+0000 7f07de539980 1 -- start start 2024-09-13T19:35:20.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.396+0000 7f07de539980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a15335da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.396+0000 7f07de539980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a153120200 con 0x55a1531e6ac0 2024-09-13T19:35:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a15335da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a15335da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42504/0 (socket says 172.21.15.144:42504) 2024-09-13T19:35:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 -- 172.21.15.144:0/2764283122 learned_addr learned my addr 172.21.15.144:0/2764283122 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 -- 172.21.15.144:0/2764283122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15335e030 con 0x55a1531e6ac0 2024-09-13T19:35:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 --2- 172.21.15.144:0/2764283122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a15335da60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f07cc001d90 tx=0x7f07cc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e483e55c0c821d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f06ca60c640 1 -- 172.21.15.144:0/2764283122 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07cc013030 con 0x55a1531e6ac0 2024-09-13T19:35:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f06ca60c640 1 -- 172.21.15.144:0/2764283122 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07cc00e690 con 0x55a1531e6ac0 2024-09-13T19:35:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f06ca60c640 1 -- 172.21.15.144:0/2764283122 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07cc00ea10 con 0x55a1531e6ac0 2024-09-13T19:35:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 -- 172.21.15.144:0/2764283122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 msgr2=0x55a15335da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 --2- 172.21.15.144:0/2764283122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a15335da60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f07cc001d90 tx=0x7f07cc001e80 comp rx=0 tx=0).stop 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 -- 172.21.15.144:0/2764283122 shutdown_connections 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 --2- 172.21.15.144:0/2764283122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a15335da60 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 -- 172.21.15.144:0/2764283122 >> 172.21.15.144:0/2764283122 conn(0x55a15326d060 msgr2=0x55a153359690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 -- 172.21.15.144:0/2764283122 shutdown_connections 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 -- 172.21.15.144:0/2764283122 wait complete. 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 Processor -- start 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 -- start start 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a153272c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07de539980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a153279e10 con 0x55a1531e6ac0 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a153272c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a153272c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42506/0 (socket says 172.21.15.144:42506) 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 -- 172.21.15.144:0/3705362343 learned_addr learned my addr 172.21.15.144:0/3705362343 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.400+0000 7f07dc049640 1 -- 172.21.15.144:0/3705362343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a153271390 con 0x55a1531e6ac0 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07dc049640 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a153272c70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55a15335ec40 tx=0x7f07cc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f06c8e09640 1 -- 172.21.15.144:0/3705362343 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07cc027070 con 0x55a1531e6ac0 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a153271620 con 0x55a1531e6ac0 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f06c8e09640 1 -- 172.21.15.144:0/3705362343 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07cc019900 con 0x55a1531e6ac0 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a153271b10 con 0x55a1531e6ac0 2024-09-13T19:35:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f06c8e09640 1 -- 172.21.15.144:0/3705362343 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07cc019be0 con 0x55a1531e6ac0 2024-09-13T19:35:20.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f06c8e09640 1 -- 172.21.15.144:0/3705362343 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07cc02a070 con 0x55a1531e6ac0 2024-09-13T19:35:20.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f06c8e09640 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06c4034650 0x7f06c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f06c8e09640 1 -- 172.21.15.144:0/3705362343 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f07cc01f070 con 0x55a1531e6ac0 2024-09-13T19:35:20.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07db848640 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06c4034650 0x7f06c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a153276a90 0x55a15336e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15336e750 con 0x55a153276a90 2024-09-13T19:35:20.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07dc84a640 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a153276a90 0x55a15336e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07db848640 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06c4034650 0x7f06c4036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f07d00ad000 tx=0x7f07d00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07dc84a640 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a153276a90 0x55a15336e210 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07dc84a640 1 -- 172.21.15.144:0/3705362343 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d400a4d0 con 0x55a153276a90 2024-09-13T19:35:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15336eb70 con 0x55a153276a90 2024-09-13T19:35:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07dc84a640 1 -- 172.21.15.144:0/3705362343 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07d400a4d0 con 0x55a153276a90 2024-09-13T19:35:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a153370980 0x55a153372d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.404+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a153373440 con 0x55a153370980 2024-09-13T19:35:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07dc049640 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a153370980 0x55a153372d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07dc049640 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a153370980 0x55a153372d70 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07dc049640 1 -- 172.21.15.144:0/3705362343 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07cc029030 con 0x55a153370980 2024-09-13T19:35:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15336f820 con 0x55a153276a90 2024-09-13T19:35:20.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07dc84a640 1 -- 172.21.15.144:0/3705362343 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07d400a4d0 con 0x55a153276a90 2024-09-13T19:35:20.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15336fce0 con 0x55a153276a90 2024-09-13T19:35:20.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07dc84a640 1 -- 172.21.15.144:0/3705362343 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07d400a4d0 con 0x55a153276a90 2024-09-13T19:35:20.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07de539980 1 Processor -- start 2024-09-13T19:35:20.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07de539980 1 -- start start 2024-09-13T19:35:20.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07de539980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153381b50 0x55a153381f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07de539980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a153179800 con 0x55a153381b50 2024-09-13T19:35:20.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07dc84a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153381b50 0x55a153381f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07dc84a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153381b50 0x55a153381f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42514/0 (socket says 172.21.15.144:42514) 2024-09-13T19:35:20.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.408+0000 7f07dc84a640 1 -- 172.21.15.144:0/3790399383 learned_addr learned my addr 172.21.15.144:0/3790399383 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc84a640 1 -- 172.21.15.144:0/3790399383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1533824b0 con 0x55a153381b50 2024-09-13T19:35:20.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc84a640 1 --2- 172.21.15.144:0/3790399383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153381b50 0x55a153381f70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55a1532729e0 tx=0x7f07d4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f06c1ffb640 1 -- 172.21.15.144:0/3790399383 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d4014450 con 0x55a153381b50 2024-09-13T19:35:20.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07de539980 1 -- 172.21.15.144:0/3790399383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a153382740 con 0x55a153381b50 2024-09-13T19:35:20.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f06c1ffb640 1 -- 172.21.15.144:0/3790399383 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d40145f0 con 0x55a153381b50 2024-09-13T19:35:20.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f06c1ffb640 1 -- 172.21.15.144:0/3790399383 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d4014910 con 0x55a153381b50 2024-09-13T19:35:20.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07de539980 1 -- 172.21.15.144:0/3790399383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1533853c0 con 0x55a153381b50 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f06c1ffb640 1 -- 172.21.15.144:0/3790399383 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07d4011040 con 0x55a153381b50 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f06c1ffb640 1 --2- 172.21.15.144:0/3790399383 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06b4034650 0x7f06b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f06c1ffb640 1 -- 172.21.15.144:0/3790399383 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f07d401e070 con 0x55a153381b50 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc049640 1 --2- 172.21.15.144:0/3790399383 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06b4034650 0x7f06b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07de539980 1 Processor -- start 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07de539980 1 -- start start 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc049640 1 --2- 172.21.15.144:0/3790399383 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06b4034650 0x7f06b4036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55a153271dc0 tx=0x7f07cc00df00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07de539980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a15338ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07de539980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a15335e3b0 con 0x55a15338e630 2024-09-13T19:35:20.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc84a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a15338ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc84a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a15338ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42530/0 (socket says 172.21.15.144:42530) 2024-09-13T19:35:20.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc84a640 1 -- 172.21.15.144:0/36826909 learned_addr learned my addr 172.21.15.144:0/36826909 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc84a640 1 -- 172.21.15.144:0/36826909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15338efe0 con 0x55a15338e630 2024-09-13T19:35:20.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.412+0000 7f07dc84a640 1 --2- 172.21.15.144:0/36826909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a15338ea10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f07d404a050 tx=0x7f07d4016960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a3ad5785063357 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f06bb7fe640 1 -- 172.21.15.144:0/36826909 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d4011510 con 0x55a15338e630 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f06bb7fe640 1 -- 172.21.15.144:0/36826909 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d4044e50 con 0x55a15338e630 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f06bb7fe640 1 -- 172.21.15.144:0/36826909 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d40117e0 con 0x55a15338e630 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- 172.21.15.144:0/36826909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 msgr2=0x55a15338ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 --2- 172.21.15.144:0/36826909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a15338ea10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f07d404a050 tx=0x7f07d4016960 comp rx=0 tx=0).stop 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- 172.21.15.144:0/36826909 shutdown_connections 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 --2- 172.21.15.144:0/36826909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a15338ea10 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- 172.21.15.144:0/36826909 >> 172.21.15.144:0/36826909 conn(0x55a15338aa10 msgr2=0x55a153388b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- 172.21.15.144:0/36826909 shutdown_connections 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- 172.21.15.144:0/36826909 wait complete. 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 Processor -- start 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- start start 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a153395970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a15338f600 con 0x55a15338e630 2024-09-13T19:35:20.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07dc84a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a153395970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07dc84a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a153395970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42540/0 (socket says 172.21.15.144:42540) 2024-09-13T19:35:20.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 learned_addr learned my addr 172.21.15.144:0/4046587082 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a153395eb0 con 0x55a15338e630 2024-09-13T19:35:20.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07dc84a640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a153395970 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55a15338b0f0 tx=0x7f07d4049fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f06b9ffb640 1 -- 172.21.15.144:0/4046587082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d4013c20 con 0x55a15338e630 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a153396140 con 0x55a15338e630 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f06b9ffb640 1 -- 172.21.15.144:0/4046587082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d4044340 con 0x55a15338e630 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f06b9ffb640 1 -- 172.21.15.144:0/4046587082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d40446a0 con 0x55a15338e630 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a153398e20 con 0x55a15338e630 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.416+0000 7f06b9ffb640 1 -- 172.21.15.144:0/4046587082 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07d4044840 con 0x55a15338e630 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f06b9ffb640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06ac034650 0x7f06ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f06b9ffb640 1 -- 172.21.15.144:0/4046587082 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f07d4034030 con 0x55a15338e630 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07dc049640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06ac034650 0x7f06ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a1533a10a0 0x55a1533a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a3cb0 con 0x55a1533a10a0 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07db848640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a1533a10a0 0x55a1533a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07dc049640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06ac034650 0x7f06ac036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f07cc017fd0 tx=0x7f07cc034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07db848640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a1533a10a0 0x55a1533a3560 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 realm 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a40e0 con 0x55a1533a10a0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a49b0 con 0x55a1533a10a0 2024-09-13T19:35:20.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a4d50 con 0x55a1533a10a0 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a1533a5ab0 0x55a1533a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a84b0 con 0x55a1533a5ab0 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07dc84a640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a1533a5ab0 0x55a1533a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.420+0000 7f07dc84a640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a1533a5ab0 0x55a1533a7ea0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07de539980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07de539980 20 searching for the correct realm 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a1533aa390 0x55a1533ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07dc049640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a1533aa390 0x55a1533ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07dc049640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a1533aa390 0x55a1533ac800 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07dc049640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07cc050070 0x7f07cc02b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x7f07cc050070 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07cc050070 0x7f07cc02b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07cc050070 0x7f07cc02b8c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a5ab0 2024-09-13T19:35:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.424+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a5ab0 2024-09-13T19:35:20.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x7f07cc050070 2024-09-13T19:35:20.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a5ab0 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x7f07cc050070 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a5ab0 2024-09-13T19:35:20.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.428+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a5ab0 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x7f07cc050070 2024-09-13T19:35:20.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a5ab0 2024-09-13T19:35:20.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.432+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a5ab0 2024-09-13T19:35:20.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x7f07cc050070 2024-09-13T19:35:20.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533aa390 2024-09-13T19:35:20.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a5ab0 2024-09-13T19:35:20.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x55a1533a10a0 2024-09-13T19:35:20.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aced0 con 0x7f07cc050070 2024-09-13T19:35:20.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a8e00 con 0x55a1533a10a0 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a91f0 con 0x55a1533a10a0 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a91f0 con 0x55a1533a10a0 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 zone default found 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 4 Realm: () 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 zonegroup default 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.436+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533a9610 con 0x55a1533a5ab0 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533aed30 con 0x55a1533aa390 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533af170 con 0x55a1533aa390 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 20 started sync module instance, tier type = 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae1d0 con 0x7f07cc050070 2024-09-13T19:35:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94151374464720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae1d0 con 0x7f07cc050070 2024-09-13T19:35:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533afc50 con 0x55a1533a10a0 2024-09-13T19:35:20.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.440+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94151374464720] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.444+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.444+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94151374468896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae1d0 con 0x55a1533a10a0 2024-09-13T19:35:20.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.444+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b0660 con 0x55a1533aa390 2024-09-13T19:35:20.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.444+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94151374468896] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.444+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.444+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94151374462240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae140 con 0x55a1533aa390 2024-09-13T19:35:20.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.444+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b13b0 con 0x7f07cc050070 2024-09-13T19:35:20.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.448+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.448+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94151374475280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b1aa0 con 0x7f07cc050070 2024-09-13T19:35:20.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.448+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b25a0 con 0x55a1533a10a0 2024-09-13T19:35:20.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.448+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94151374462240] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.448+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94151374475280] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.448+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.448+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94151374479504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b2560 con 0x55a1533a10a0 2024-09-13T19:35:20.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.448+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b29c0 con 0x55a1533a5ab0 2024-09-13T19:35:20.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.452+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94151374479504] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.452+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.452+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94151374476528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b2d60 con 0x55a1533a5ab0 2024-09-13T19:35:20.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.452+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b3720 con 0x55a1533a5ab0 2024-09-13T19:35:20.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.452+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.452+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94151374484080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b3b40 con 0x55a1533a5ab0 2024-09-13T19:35:20.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.452+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b4620 con 0x55a1533a5ab0 2024-09-13T19:35:20.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.452+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94151374476528] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94151374484080] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94151374473808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b4310 con 0x55a1533a5ab0 2024-09-13T19:35:20.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 20 add_watcher() i=0 2024-09-13T19:35:20.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 20 add_watcher() i=1 2024-09-13T19:35:20.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 20 add_watcher() i=2 2024-09-13T19:35:20.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 20 add_watcher() i=3 2024-09-13T19:35:20.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 20 add_watcher() i=4 2024-09-13T19:35:20.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 20 add_watcher() i=5 2024-09-13T19:35:20.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 20 add_watcher() i=6 2024-09-13T19:35:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94151374473808] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 20 add_watcher() i=7 2024-09-13T19:35:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b76e0 con 0x55a1533a10a0 2024-09-13T19:35:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.456+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.460+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94151374488064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b4ad0 con 0x55a1533a10a0 2024-09-13T19:35:20.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.460+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94151374488064] v32'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.460+0000 7f06927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.460+0000 7f07de539980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:20.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.460+0000 7f07de539980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:20.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.460+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533bfe20 con 0x55a1533a10a0 2024-09-13T19:35:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.460+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.460+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c04f0 con 0x55a1533a5ab0 2024-09-13T19:35:20.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.464+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.464+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c04f0 con 0x55a1533aa390 2024-09-13T19:35:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.468+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.468+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c08f0 con 0x55a1533a10a0 2024-09-13T19:35:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.468+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'253 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.468+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c0d40 con 0x7f07cc050070 2024-09-13T19:35:20.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.468+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'80 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.468+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533bdd60 con 0x55a1533aa390 2024-09-13T19:35:20.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.468+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.468+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533bdd60 con 0x55a1533a10a0 2024-09-13T19:35:20.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.472+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.472+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533bdd60 con 0x55a1533a5ab0 2024-09-13T19:35:20.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.476+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.476+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533bdd60 con 0x7f07cc050070 2024-09-13T19:35:20.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.476+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.476+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533bdd60 con 0x55a1533aa390 2024-09-13T19:35:20.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.476+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.476+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18c0 con 0x7f07cc050070 2024-09-13T19:35:20.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.480+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'81 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.480+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533a5ab0 2024-09-13T19:35:20.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.480+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.480+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x7f07cc050070 2024-09-13T19:35:20.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.484+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.484+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533a5ab0 2024-09-13T19:35:20.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.484+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.484+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533a10a0 2024-09-13T19:35:20.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.488+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'254 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.488+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.488+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.488+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x7f07cc050070 2024-09-13T19:35:20.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.492+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'82 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.492+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.492+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.492+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533a10a0 2024-09-13T19:35:20.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.496+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.496+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533a10a0 2024-09-13T19:35:20.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.496+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'255 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.496+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.496+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.500+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x7f07cc050070 2024-09-13T19:35:20.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.500+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.500+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.500+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.500+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.504+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.504+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.504+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.504+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.508+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.508+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533a5ab0 2024-09-13T19:35:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.508+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.508+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.512+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.512+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533a5ab0 2024-09-13T19:35:20.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.512+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.512+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533aa390 2024-09-13T19:35:20.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.516+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.516+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x55a1533a5ab0 2024-09-13T19:35:20.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.520+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.520+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533c18a0 con 0x7f07cc050070 2024-09-13T19:35:20.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.520+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.520+0000 7f06917e2640 20 reqs_thread_entry: start 2024-09-13T19:35:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.520+0000 7f07de539980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.520+0000 7f07de539980 20 Filter name: none 2024-09-13T19:35:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.520+0000 7f060affd640 20 reqs_thread_entry: start 2024-09-13T19:35:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T19:35:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533bd0d0 con 0x55a1533aa390 2024-09-13T19:35:20.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 20 rados_obj.operate() r=0 bl.length=363 2024-09-13T19:35:20.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-13T19:35:20.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:35:20.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:20.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533df480 con 0x55a1533aa390 2024-09-13T19:35:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 10 removing key index: true_admin_akey 2024-09-13T19:35:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533dd460 con 0x55a1533aa390 2024-09-13T19:35:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(96 true_admin_akey [delete] v32'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T19:35:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94151374659440 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533df9d0 con 0x55a1533a5ab0 2024-09-13T19:35:20.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== watch-notify(notify (1) cookie 94151374476528 notify 137438953503 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55a153398e20 con 0x55a1533a5ab0 2024-09-13T19:35:20.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f06bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94151374476528 notifier 4860 bl.length()=165 2024-09-13T19:35:20.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f06bb7fe640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f06a0003d70 con 0x55a1533a5ab0 2024-09-13T19:35:20.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.524+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(97 notify.5 [notify cookie 94151374659440 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== watch-notify(notify_complete (2) cookie 94151374659440 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a153396140 con 0x55a1533a5ab0 2024-09-13T19:35:20.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07de539980 10 removing email index: 2024-09-13T19:35:20.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07de539980 10 removing user buckets index 2024-09-13T19:35:20.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533df950 con 0x55a1533aa390 2024-09-13T19:35:20.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(99 a_user.buckets [delete] v32'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07de539980 10 removing user index: a_user 2024-09-13T19:35:20.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533def80 con 0x55a1533aa390 2024-09-13T19:35:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(100 a_user [call,call,delete] v32'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07de539980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-13T19:35:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07de539980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T19:35:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.528+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94151374664704 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a1533de420 con 0x55a1533aa390 2024-09-13T19:35:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== watch-notify(notify (1) cookie 94151374462240 notify 137438953484 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55a1533bfde0 con 0x55a1533aa390 2024-09-13T19:35:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f06baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94151374462240 notifier 4860 bl.length()=155 2024-09-13T19:35:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(101 notify.2 [notify cookie 94151374664704 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f06baffd640 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f06100032d0 con 0x55a1533aa390 2024-09-13T19:35:20.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 34 ==== watch-notify(notify_complete (2) cookie 94151374664704 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f07cc04c040 con 0x55a1533aa390 2024-09-13T19:35:20.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f06927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94151374488064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15339e560 con 0x55a1533a10a0 2024-09-13T19:35:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94151374488064] v32'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.532+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94151374464720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15339e560 con 0x7f07cc050070 2024-09-13T19:35:20.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.536+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94151374464720] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.536+0000 7f07de539980 20 remove_watcher() i=0 2024-09-13T19:35:20.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.536+0000 7f07de539980 2 removed watcher, disabling cache 2024-09-13T19:35:20.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.536+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94151374468896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae6d0 con 0x55a1533a10a0 2024-09-13T19:35:20.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.536+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94151374468896] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.536+0000 7f07de539980 20 remove_watcher() i=1 2024-09-13T19:35:20.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.536+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94151374462240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae6d0 con 0x55a1533aa390 2024-09-13T19:35:20.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.540+0000 7f07dc049640 1 -- 172.21.15.144:0/4046587082 <== osd.3 v2:172.21.15.144:6800/1157716661 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94151374462240] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07cc029030 con 0x55a1533aa390 2024-09-13T19:35:20.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.540+0000 7f07de539980 20 remove_watcher() i=2 2024-09-13T19:35:20.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.540+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94151374475280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae6d0 con 0x7f07cc050070 2024-09-13T19:35:20.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.540+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94151374475280] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x7f07cc050070 2024-09-13T19:35:20.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.540+0000 7f07de539980 20 remove_watcher() i=3 2024-09-13T19:35:20.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.540+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94151374479504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b1010 con 0x55a1533a10a0 2024-09-13T19:35:20.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.544+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94151374479504] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d00b3040 con 0x55a1533a10a0 2024-09-13T19:35:20.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.544+0000 7f07de539980 20 remove_watcher() i=4 2024-09-13T19:35:20.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.544+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94151374476528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae6d0 con 0x55a1533a5ab0 2024-09-13T19:35:20.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.544+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94151374476528] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.544+0000 7f07de539980 20 remove_watcher() i=5 2024-09-13T19:35:20.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.544+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94151374484080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533b1010 con 0x55a1533a5ab0 2024-09-13T19:35:20.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.548+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94151374484080] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.548+0000 7f07de539980 20 remove_watcher() i=6 2024-09-13T19:35:20.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.548+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94151374473808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a1533ae6d0 con 0x55a1533a5ab0 2024-09-13T19:35:20.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07dc84a640 1 -- 172.21.15.144:0/4046587082 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94151374473808] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d402a070 con 0x55a1533a5ab0 2024-09-13T19:35:20.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 20 remove_watcher() i=7 2024-09-13T19:35:20.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a1533a5ab0 msgr2=0x55a1533a7ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a1533a5ab0 0x55a1533a7ea0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a1533a10a0 msgr2=0x55a1533a3560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a1533a10a0 0x55a1533a3560 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07cc050070 msgr2=0x7f07cc02b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f07cc050070 0x7f07cc02b8c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a1533aa390 msgr2=0x55a1533ac800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55a1533aa390 0x55a1533ac800 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06ac034650 msgr2=0x7f06ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06ac034650 0x7f06ac036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f07cc017fd0 tx=0x7f07cc034000 comp rx=0 tx=0).stop 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 msgr2=0x55a153395970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07db848640 1 -- 172.21.15.144:0/4046587082 reap_dead start 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a153395970 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55a15338b0f0 tx=0x7f07d4049fe0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 shutdown_connections 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/4046587082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a15338e630 0x55a153395970 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 >> 172.21.15.144:0/4046587082 conn(0x55a15338aa10 msgr2=0x55a153388ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 shutdown_connections 2024-09-13T19:35:20.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/4046587082 wait complete. 2024-09-13T19:35:20.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3790399383 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06b4034650 msgr2=0x7f06b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3790399383 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06b4034650 0x7f06b4036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55a153271dc0 tx=0x7f07cc00df00 comp rx=0 tx=0).stop 2024-09-13T19:35:20.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3790399383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153381b50 msgr2=0x55a153381f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3790399383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153381b50 0x55a153381f70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55a1532729e0 tx=0x7f07d4018830 comp rx=0 tx=0).stop 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3790399383 shutdown_connections 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3790399383 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06b4034650 0x7f06b4036b10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3790399383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a153381b50 0x55a153381f70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3790399383 >> 172.21.15.144:0/3790399383 conn(0x55a153376ca0 msgr2=0x55a153379720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3790399383 shutdown_connections 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3790399383 wait complete. 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a153370980 msgr2=0x55a153372d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a153370980 0x55a153372d70 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a153276a90 msgr2=0x55a15336e210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a153276a90 0x55a15336e210 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06c4034650 msgr2=0x7f06c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06c4034650 0x7f06c4036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f07d00ad000 tx=0x7f07d00a5040 comp rx=0 tx=0).stop 2024-09-13T19:35:20.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 msgr2=0x55a153272c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a153272c70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55a15335ec40 tx=0x7f07cc000bd0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 shutdown_connections 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55a153276a90 0x55a15336e210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55a153370980 0x55a153372d70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f06c4034650 0x7f06c4036b10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 --2- 172.21.15.144:0/3705362343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1531e6ac0 0x55a153272c70 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 >> 172.21.15.144:0/3705362343 conn(0x55a15326d060 msgr2=0x55a153358210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 shutdown_connections 2024-09-13T19:35:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.552+0000 7f07de539980 1 -- 172.21.15.144:0/3705362343 wait complete. 2024-09-13T19:35:20.568 ERROR:root:None 2024-09-13T19:35:20.568 ERROR:root:0 2024-09-13T19:35:20.568 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T19:35:20.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T19:35:20.568 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-13T19:35:20.648 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:20.648 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.644+0000 7eff5ea20980 1 Processor -- start 2024-09-13T19:35:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.644+0000 7eff5ea20980 1 -- start start 2024-09-13T19:35:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.644+0000 7eff5ea20980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5573ae020580 0x5573ae020960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.644+0000 7eff5ea20980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573adea9ae0 con 0x5573ae020ed0 2024-09-13T19:35:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.644+0000 7eff5ea20980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x5573adecde30 con 0x5573ae020580 2024-09-13T19:35:20.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.644+0000 7eff5c530640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5573ae020580 0x5573ae020960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5bd2f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x5573ae020ed0 0x5573ae025900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49410/0 (socket says 172.21.15.144:49410) 2024-09-13T19:35:20.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5c530640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x5573ae020580 0x5573ae020960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42546/0 (socket says 172.21.15.144:42546) 2024-09-13T19:35:20.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3166521088 learned_addr learned my addr 172.21.15.144:0/3166521088 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5c530640 1 -- 172.21.15.144:0/3166521088 >> v1:172.21.15.18:6789/0 conn(0x5573ae020ed0 legacy=0x5573ae025900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5c530640 1 -- 172.21.15.144:0/3166521088 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ae028150 con 0x5573ae020580 2024-09-13T19:35:20.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5c530640 1 --2- 172.21.15.144:0/3166521088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae020960 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00a480 tx=0x7eff4c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8765618607fa84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5b52e640 1 -- 172.21.15.144:0/3166521088 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff4c0b0070 con 0x5573ae020580 2024-09-13T19:35:20.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5b52e640 1 -- 172.21.15.144:0/3166521088 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c0ab540 con 0x5573ae020580 2024-09-13T19:35:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.648+0000 7eff5b52e640 1 -- 172.21.15.144:0/3166521088 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff4c0ab840 con 0x5573ae020580 2024-09-13T19:35:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.652+0000 7eff5ea20980 1 -- 172.21.15.144:0/3166521088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 msgr2=0x5573ae020960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.652+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3166521088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae020960 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00a480 tx=0x7eff4c01b280 comp rx=0 tx=0).stop 2024-09-13T19:35:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.652+0000 7eff5ea20980 1 -- 172.21.15.144:0/3166521088 shutdown_connections 2024-09-13T19:35:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.652+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3166521088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae020960 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.652+0000 7eff5ea20980 1 -- 172.21.15.144:0/3166521088 >> 172.21.15.144:0/3166521088 conn(0x5573ae01c0a0 msgr2=0x5573ae01e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.652+0000 7eff5ea20980 1 -- 172.21.15.144:0/3166521088 shutdown_connections 2024-09-13T19:35:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.652+0000 7eff5ea20980 1 -- 172.21.15.144:0/3166521088 wait complete. 2024-09-13T19:35:20.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 Processor -- start 2024-09-13T19:35:20.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- start start 2024-09-13T19:35:20.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae10b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5573adecf200 con 0x5573ae020580 2024-09-13T19:35:20.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5c530640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae10b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5c530640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae10b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42556/0 (socket says 172.21.15.144:42556) 2024-09-13T19:35:20.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5c530640 1 -- 172.21.15.144:0/860489781 learned_addr learned my addr 172.21.15.144:0/860489781 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5c530640 1 -- 172.21.15.144:0/860489781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ae10bf70 con 0x5573ae020580 2024-09-13T19:35:20.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5c530640 1 --2- 172.21.15.144:0/860489781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae10b9a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0ae040 tx=0x7eff4c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca5ce3da079c426 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7efe4a60c640 1 -- 172.21.15.144:0/860489781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff4c0b0040 con 0x5573ae020580 2024-09-13T19:35:20.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7efe4a60c640 1 -- 172.21.15.144:0/860489781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c0ab9b0 con 0x5573ae020580 2024-09-13T19:35:20.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7efe4a60c640 1 -- 172.21.15.144:0/860489781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff4c0abc90 con 0x5573ae020580 2024-09-13T19:35:20.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- 172.21.15.144:0/860489781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 msgr2=0x5573ae10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 --2- 172.21.15.144:0/860489781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae10b9a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0ae040 tx=0x7eff4c003030 comp rx=0 tx=0).stop 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- 172.21.15.144:0/860489781 shutdown_connections 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 --2- 172.21.15.144:0/860489781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae10b9a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- 172.21.15.144:0/860489781 >> 172.21.15.144:0/860489781 conn(0x5573ae01c0a0 msgr2=0x5573ae1075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- 172.21.15.144:0/860489781 shutdown_connections 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- 172.21.15.144:0/860489781 wait complete. 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 Processor -- start 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- start start 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae112b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.668+0000 7eff5ea20980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5573ae027b90 con 0x5573ae020580 2024-09-13T19:35:20.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5c530640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae112b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5c530640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae112b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42568/0 (socket says 172.21.15.144:42568) 2024-09-13T19:35:20.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5c530640 1 -- 172.21.15.144:0/2996103459 learned_addr learned my addr 172.21.15.144:0/2996103459 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5c530640 1 -- 172.21.15.144:0/2996103459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ae113080 con 0x5573ae020580 2024-09-13T19:35:20.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5c530640 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae112b40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0030b0 tx=0x7eff4c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7efe48e09640 1 -- 172.21.15.144:0/2996103459 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff4c0c5070 con 0x5573ae020580 2024-09-13T19:35:20.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ae113310 con 0x5573ae020580 2024-09-13T19:35:20.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7efe48e09640 1 -- 172.21.15.144:0/2996103459 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c0b6970 con 0x5573ae020580 2024-09-13T19:35:20.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7efe48e09640 1 -- 172.21.15.144:0/2996103459 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff4c0b0050 con 0x5573ae020580 2024-09-13T19:35:20.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ae115ff0 con 0x5573ae020580 2024-09-13T19:35:20.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7efe48e09640 1 -- 172.21.15.144:0/2996103459 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7eff4c0c8070 con 0x5573ae020580 2024-09-13T19:35:20.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7efe48e09640 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe44034650 0x7efe44036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7efe48e09640 1 -- 172.21.15.144:0/2996103459 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7eff4c0bc070 con 0x5573ae020580 2024-09-13T19:35:20.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5bd2f640 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe44034650 0x7efe44036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae020ed0 0x5573ae119c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae11a1c0 con 0x5573ae020ed0 2024-09-13T19:35:20.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5cd31640 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae020ed0 0x5573ae119c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.672+0000 7eff5bd2f640 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe44034650 0x7efe44036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7eff44000f70 tx=0x7eff440012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5cd31640 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae020ed0 0x5573ae119c40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5cd31640 1 -- 172.21.15.144:0/2996103459 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff5400a4d0 con 0x5573ae020ed0 2024-09-13T19:35:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae117210 con 0x5573ae020ed0 2024-09-13T19:35:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5cd31640 1 -- 172.21.15.144:0/2996103459 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff5400a4d0 con 0x5573ae020ed0 2024-09-13T19:35:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae11c520 0x5573ae11e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae11f000 con 0x5573ae11c520 2024-09-13T19:35:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5c530640 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae11c520 0x5573ae11e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5c530640 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae11c520 0x5573ae11e910 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5c530640 1 -- 172.21.15.144:0/2996103459 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff4c0c7030 con 0x5573ae11c520 2024-09-13T19:35:20.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae11b3c0 con 0x5573ae020ed0 2024-09-13T19:35:20.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5cd31640 1 -- 172.21.15.144:0/2996103459 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff5400a4d0 con 0x5573ae020ed0 2024-09-13T19:35:20.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae11b8a0 con 0x5573ae020ed0 2024-09-13T19:35:20.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5cd31640 1 -- 172.21.15.144:0/2996103459 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff5400a4d0 con 0x5573ae020ed0 2024-09-13T19:35:20.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5ea20980 1 Processor -- start 2024-09-13T19:35:20.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.676+0000 7eff5ea20980 1 -- start start 2024-09-13T19:35:20.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5ea20980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae12e820 0x5573ae12ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5ea20980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5573adf28800 con 0x5573ae12e820 2024-09-13T19:35:20.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5cd31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae12e820 0x5573ae12ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5cd31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae12e820 0x5573ae12ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42578/0 (socket says 172.21.15.144:42578) 2024-09-13T19:35:20.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5cd31640 1 -- 172.21.15.144:0/955473968 learned_addr learned my addr 172.21.15.144:0/955473968 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5cd31640 1 -- 172.21.15.144:0/955473968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ae12f180 con 0x5573ae12e820 2024-09-13T19:35:20.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5cd31640 1 --2- 172.21.15.144:0/955473968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae12e820 0x5573ae12ec40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x5573ae113a40 tx=0x7eff54018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7efe41ffb640 1 -- 172.21.15.144:0/955473968 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff54014450 con 0x5573ae12e820 2024-09-13T19:35:20.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7efe41ffb640 1 -- 172.21.15.144:0/955473968 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff54014610 con 0x5573ae12e820 2024-09-13T19:35:20.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7efe41ffb640 1 -- 172.21.15.144:0/955473968 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff54014930 con 0x5573ae12e820 2024-09-13T19:35:20.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5ea20980 1 -- 172.21.15.144:0/955473968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ae12f410 con 0x5573ae12e820 2024-09-13T19:35:20.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5ea20980 1 -- 172.21.15.144:0/955473968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ae132090 con 0x5573ae12e820 2024-09-13T19:35:20.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7efe41ffb640 1 -- 172.21.15.144:0/955473968 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7eff54011040 con 0x5573ae12e820 2024-09-13T19:35:20.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7efe41ffb640 1 --2- 172.21.15.144:0/955473968 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe340346f0 0x7efe34036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7efe41ffb640 1 -- 172.21.15.144:0/955473968 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7eff5401e070 con 0x5573ae12e820 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5c530640 1 --2- 172.21.15.144:0/955473968 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe340346f0 0x7efe34036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5ea20980 1 Processor -- start 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5ea20980 1 -- start start 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.680+0000 7eff5c530640 1 --2- 172.21.15.144:0/955473968 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe340346f0 0x7efe34036bb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5573ae11a670 tx=0x7eff4c0b7b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae122160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5573ae10c230 con 0x5573ae121d60 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae122160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae122160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42584/0 (socket says 172.21.15.144:42584) 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 -- 172.21.15.144:0/4063617000 learned_addr learned my addr 172.21.15.144:0/4063617000 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 -- 172.21.15.144:0/4063617000 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ae122730 con 0x5573ae121d60 2024-09-13T19:35:20.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 --2- 172.21.15.144:0/4063617000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae122160 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7eff5400b010 tx=0x7eff54011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78e81545b631def server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7efe337fe640 1 -- 172.21.15.144:0/4063617000 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff54013c90 con 0x5573ae121d60 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7efe337fe640 1 -- 172.21.15.144:0/4063617000 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff54013e30 con 0x5573ae121d60 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7efe337fe640 1 -- 172.21.15.144:0/4063617000 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff5402bb90 con 0x5573ae121d60 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 -- 172.21.15.144:0/4063617000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 msgr2=0x5573ae122160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 --2- 172.21.15.144:0/4063617000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae122160 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7eff5400b010 tx=0x7eff54011700 comp rx=0 tx=0).stop 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 -- 172.21.15.144:0/4063617000 shutdown_connections 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 --2- 172.21.15.144:0/4063617000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae122160 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 -- 172.21.15.144:0/4063617000 >> 172.21.15.144:0/4063617000 conn(0x5573ae137690 msgr2=0x5573ae135790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 -- 172.21.15.144:0/4063617000 shutdown_connections 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 -- 172.21.15.144:0/4063617000 wait complete. 2024-09-13T19:35:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 Processor -- start 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 -- start start 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5ea20980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5573ae122ee0 con 0x5573ae121d60 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae1448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42590/0 (socket says 172.21.15.144:42590) 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 learned_addr learned my addr 172.21.15.144:0/3162232341 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ae144df0 con 0x5573ae121d60 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.684+0000 7eff5cd31640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae1448b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7eff5400b010 tx=0x7eff54049f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7efe31ffb640 1 -- 172.21.15.144:0/3162232341 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff54013c90 con 0x5573ae121d60 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7efe31ffb640 1 -- 172.21.15.144:0/3162232341 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff540135c0 con 0x5573ae121d60 2024-09-13T19:35:20.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ae145080 con 0x5573ae121d60 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7efe31ffb640 1 -- 172.21.15.144:0/3162232341 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff5402b350 con 0x5573ae121d60 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ae147d60 con 0x5573ae121d60 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7efe31ffb640 1 -- 172.21.15.144:0/3162232341 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7eff5402b540 con 0x5573ae121d60 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7efe31ffb640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe24034650 0x7efe24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7efe31ffb640 1 -- 172.21.15.144:0/3162232341 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7eff54034070 con 0x5573ae121d60 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5c530640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe24034650 0x7efe24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae14ff50 0x5573ae1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae152b40 con 0x5573ae14ff50 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5bd2f640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae14ff50 0x5573ae1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5c530640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe24034650 0x7efe24036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0acf80 tx=0x7eff4c0df000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5bd2f640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae14ff50 0x5573ae1523f0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff4400e5a0 con 0x5573ae14ff50 2024-09-13T19:35:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 20 realm 2024-09-13T19:35:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae14f420 con 0x5573ae14ff50 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff4400e5a0 con 0x5573ae14ff50 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae153640 con 0x5573ae14ff50 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff4400e5a0 con 0x5573ae14ff50 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.688+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae153f10 con 0x5573ae14ff50 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff4400e5a0 con 0x5573ae14ff50 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5ea20980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae154930 0x5573ae156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae154930 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5cd31640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae154930 0x5573ae156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5cd31640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae154930 0x5573ae156d20 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5ea20980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5ea20980 20 searching for the correct realm 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5573ae159360 0x5573ae15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15be60 con 0x5573ae159360 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5c530640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5573ae159360 0x5573ae15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5c530640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5573ae159360 0x5573ae15b790 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5c530640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7eff4c0ca060 0x7eff4c0e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15be60 con 0x7eff4c0ca060 2024-09-13T19:35:20.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5bd2f640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7eff4c0ca060 0x7eff4c0e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.692+0000 7eff5bd2f640 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7eff4c0ca060 0x7eff4c0e31a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4400e5a0 con 0x7eff4c0ca060 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15be60 con 0x5573ae154930 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae14ff50 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff4400e5a0 con 0x5573ae14ff50 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae14ff50 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae14ff50 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae154930 2024-09-13T19:35:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x7eff4c0ca060 2024-09-13T19:35:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae159360 2024-09-13T19:35:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae14ff50 2024-09-13T19:35:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.696+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae154930 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae14ff50 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x7eff4c0ca060 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157410 con 0x5573ae159360 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae159360 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae154930 2024-09-13T19:35:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae159360 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae159360 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae14ff50 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae14ff50 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.700+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae154930 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae159360 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x7eff4c0ca060 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae14ff50 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae154930 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae159360 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae154930 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x7eff4c0ca060 2024-09-13T19:35:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae159360 2024-09-13T19:35:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.704+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae154930 2024-09-13T19:35:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x5573ae14ff50 2024-09-13T19:35:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7eff4c0fd040 con 0x7eff4c0ca060 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157cd0 con 0x5573ae14ff50 2024-09-13T19:35:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae1580c0 con 0x5573ae14ff50 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae1580c0 con 0x5573ae14ff50 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 zone default found 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 4 Realm: () 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 zonegroup default 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae157890 con 0x5573ae154930 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15dcf0 con 0x5573ae159360 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15e1a0 con 0x5573ae159360 2024-09-13T19:35:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.708+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5ea20980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5ea20980 20 started sync module instance, tier type = 2024-09-13T19:35:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5ea20980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15d160 con 0x7eff4c0ca060 2024-09-13T19:35:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93955330266720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15e600 con 0x7eff4c0ca060 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15ee50 con 0x5573ae14ff50 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93955330266720] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93955330270720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15eed0 con 0x5573ae14ff50 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.712+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15f720 con 0x5573ae159360 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.716+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93955330270720] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.716+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.716+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93955330272048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15fb10 con 0x5573ae159360 2024-09-13T19:35:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.716+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae1604d0 con 0x7eff4c0ca060 2024-09-13T19:35:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.716+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.716+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93955330277680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae160b40 con 0x7eff4c0ca060 2024-09-13T19:35:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.716+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae161660 con 0x5573ae14ff50 2024-09-13T19:35:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.720+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93955330272048] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.720+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93955330277680] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.720+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.720+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93955330281776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae161620 con 0x5573ae14ff50 2024-09-13T19:35:20.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.720+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae161a50 con 0x5573ae154930 2024-09-13T19:35:20.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.720+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93955330281776] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.724+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.724+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93955330273104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae161a50 con 0x5573ae154930 2024-09-13T19:35:20.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.724+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae162460 con 0x5573ae154930 2024-09-13T19:35:20.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.724+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.724+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93955330285488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae162880 con 0x5573ae154930 2024-09-13T19:35:20.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.724+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae1633a0 con 0x5573ae154930 2024-09-13T19:35:20.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.724+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93955330273104] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93955330285488] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93955330286544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae160590 con 0x5573ae154930 2024-09-13T19:35:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 20 add_watcher() i=0 2024-09-13T19:35:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 20 add_watcher() i=1 2024-09-13T19:35:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 20 add_watcher() i=2 2024-09-13T19:35:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 20 add_watcher() i=3 2024-09-13T19:35:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 20 add_watcher() i=4 2024-09-13T19:35:20.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 20 add_watcher() i=5 2024-09-13T19:35:20.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 20 add_watcher() i=6 2024-09-13T19:35:20.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93955330286544] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 20 add_watcher() i=7 2024-09-13T19:35:20.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:20.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae166390 con 0x5573ae14ff50 2024-09-13T19:35:20.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.728+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93955330289264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae163810 con 0x5573ae14ff50 2024-09-13T19:35:20.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93955330289264] v32'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7efe127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:20.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:20.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 5 note: GC not initialized 2024-09-13T19:35:20.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7efe117e2640 20 reqs_thread_entry: start 2024-09-13T19:35:20.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:20.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 20 Filter name: none 2024-09-13T19:35:20.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:20.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7efd82ffd640 20 reqs_thread_entry: start 2024-09-13T19:35:20.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae189930 con 0x5573ae154930 2024-09-13T19:35:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:35:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.732+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae18ff10 con 0x5573ae154930 2024-09-13T19:35:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5ea20980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5ea20980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5ea20980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93955330472320 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5573ae18b620 con 0x5573ae14ff50 2024-09-13T19:35:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 93955330281776 notify 137438953496 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5573adea9ae0 con 0x5573ae14ff50 2024-09-13T19:35:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7efe337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 93955330281776 notifier 4867 bl.length()=666 2024-09-13T19:35:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7efe337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7efe337fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7efe337fe640 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efe20003eb0 con 0x5573ae14ff50 2024-09-13T19:35:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 93955330472320 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.736+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 93955330472320 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff4402e980 con 0x5573ae14ff50 2024-09-13T19:35:20.742 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.740+0000 7efe127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.740+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93955330289264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae187730 con 0x5573ae14ff50 2024-09-13T19:35:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.740+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93955330289264] v32'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.740+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93955330266720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae187730 con 0x7eff4c0ca060 2024-09-13T19:35:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.740+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93955330266720] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.740+0000 7eff5ea20980 20 remove_watcher() i=0 2024-09-13T19:35:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.740+0000 7eff5ea20980 2 removed watcher, disabling cache 2024-09-13T19:35:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.740+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93955330270720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15d660 con 0x5573ae14ff50 2024-09-13T19:35:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.744+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93955330270720] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.744+0000 7eff5ea20980 20 remove_watcher() i=1 2024-09-13T19:35:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.744+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93955330272048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae187730 con 0x5573ae159360 2024-09-13T19:35:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.744+0000 7eff5c530640 1 -- 172.21.15.144:0/3162232341 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93955330272048] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c0ee070 con 0x5573ae159360 2024-09-13T19:35:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.744+0000 7eff5ea20980 20 remove_watcher() i=2 2024-09-13T19:35:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.744+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93955330277680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15e600 con 0x7eff4c0ca060 2024-09-13T19:35:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.748+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93955330277680] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x7eff4c0ca060 2024-09-13T19:35:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.748+0000 7eff5ea20980 20 remove_watcher() i=3 2024-09-13T19:35:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.748+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93955330281776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15d660 con 0x5573ae14ff50 2024-09-13T19:35:20.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.748+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93955330281776] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff44029040 con 0x5573ae14ff50 2024-09-13T19:35:20.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.748+0000 7eff5ea20980 20 remove_watcher() i=4 2024-09-13T19:35:20.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.748+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93955330273104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15eb30 con 0x5573ae154930 2024-09-13T19:35:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.752+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93955330273104] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.752+0000 7eff5ea20980 20 remove_watcher() i=5 2024-09-13T19:35:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.752+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93955330285488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae187730 con 0x5573ae154930 2024-09-13T19:35:20.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.752+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93955330285488] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.752+0000 7eff5ea20980 20 remove_watcher() i=6 2024-09-13T19:35:20.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.752+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93955330286544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5573ae15e600 con 0x5573ae154930 2024-09-13T19:35:20.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5cd31640 1 -- 172.21.15.144:0/3162232341 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93955330286544] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff54052070 con 0x5573ae154930 2024-09-13T19:35:20.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 20 remove_watcher() i=7 2024-09-13T19:35:20.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae154930 msgr2=0x5573ae156d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae154930 0x5573ae156d20 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae14ff50 msgr2=0x5573ae1523f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae14ff50 0x5573ae1523f0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7eff4c0ca060 msgr2=0x7eff4c0e31a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7eff4c0ca060 0x7eff4c0e31a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5573ae159360 msgr2=0x5573ae15b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x5573ae159360 0x5573ae15b790 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe24034650 msgr2=0x7efe24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe24034650 0x7efe24036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0acf80 tx=0x7eff4c0df000 comp rx=0 tx=0).stop 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 msgr2=0x5573ae1448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5bd2f640 1 -- 172.21.15.144:0/3162232341 reap_dead start 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae1448b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7eff5400b010 tx=0x7eff54049f40 comp rx=0 tx=0).stop 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 shutdown_connections 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/3162232341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae121d60 0x5573ae1448b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 >> 172.21.15.144:0/3162232341 conn(0x5573ae137690 msgr2=0x5573ae135760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 shutdown_connections 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/3162232341 wait complete. 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/955473968 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe340346f0 msgr2=0x7efe34036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/955473968 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe340346f0 0x7efe34036bb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5573ae11a670 tx=0x7eff4c0b7b60 comp rx=0 tx=0).stop 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/955473968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae12e820 msgr2=0x5573ae12ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/955473968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae12e820 0x5573ae12ec40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x5573ae113a40 tx=0x7eff54018830 comp rx=0 tx=0).stop 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/955473968 shutdown_connections 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/955473968 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe340346f0 0x7efe34036bb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/955473968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae12e820 0x5573ae12ec40 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/955473968 >> 172.21.15.144:0/955473968 conn(0x5573ae123f00 msgr2=0x5573ae1262f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/955473968 shutdown_connections 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/955473968 wait complete. 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae11c520 msgr2=0x5573ae11e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae11c520 0x5573ae11e910 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae020ed0 msgr2=0x5573ae119c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae020ed0 0x5573ae119c40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe44034650 msgr2=0x7efe44036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe44034650 0x7efe44036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7eff44000f70 tx=0x7eff440012c0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 msgr2=0x5573ae112b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae112b40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0030b0 tx=0x7eff4c018020 comp rx=0 tx=0).stop 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 shutdown_connections 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x5573ae020ed0 0x5573ae119c40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x5573ae11c520 0x5573ae11e910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7efe44034650 0x7efe44036b10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 --2- 172.21.15.144:0/2996103459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573ae020580 0x5573ae112b40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 >> 172.21.15.144:0/2996103459 conn(0x5573ae01c0a0 msgr2=0x5573ae106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 shutdown_connections 2024-09-13T19:35:20.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.756+0000 7eff5ea20980 1 -- 172.21.15.144:0/2996103459 wait complete. 2024-09-13T19:35:20.773 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:20.773 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:20.773 ERROR:root:0 2024-09-13T19:35:20.773 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:20.786 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:20.786 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T19:35:20.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T19:35:20.787 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-13T19:35:20.848 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:20.848 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:20.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.844+0000 7f8415430980 1 Processor -- start 2024-09-13T19:35:20.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.844+0000 7f8415430980 1 -- start start 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.844+0000 7f8415430980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dbc9efba00 0x55dbc9efbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.844+0000 7f8415430980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dbc9e09ae0 con 0x55dbc9ef8690 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.844+0000 7f8415430980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55dbc9e2de30 con 0x55dbc9efba00 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.844+0000 7f841273f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dbc9efba00 0x55dbc9efbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.844+0000 7f841273f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55dbc9efba00 0x55dbc9efbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42602/0 (socket says 172.21.15.144:42602) 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.844+0000 7f8412f40640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55dbc9ef8690 0x55dbc9ef8a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49422/0 (socket says 172.21.15.144:49422) 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.848+0000 7f841273f640 1 -- 172.21.15.144:0/1083873391 learned_addr learned my addr 172.21.15.144:0/1083873391 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.848+0000 7f841273f640 1 -- 172.21.15.144:0/1083873391 >> v1:172.21.15.18:6789/0 conn(0x55dbc9ef8690 legacy=0x55dbc9ef8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.848+0000 7f841273f640 1 -- 172.21.15.144:0/1083873391 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbc9efc350 con 0x55dbc9efba00 2024-09-13T19:35:20.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.848+0000 7f841273f640 1 --2- 172.21.15.144:0/1083873391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9efba00 0x55dbc9efbe10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f840800a4e0 tx=0x7f840801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7d58503e702e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.848+0000 7f8411f3e640 1 -- 172.21.15.144:0/1083873391 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84080aa540 con 0x55dbc9efba00 2024-09-13T19:35:20.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.848+0000 7f8411f3e640 1 -- 172.21.15.144:0/1083873391 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84080aa6e0 con 0x55dbc9efba00 2024-09-13T19:35:20.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.848+0000 7f8411f3e640 1 -- 172.21.15.144:0/1083873391 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84080aaa40 con 0x55dbc9efba00 2024-09-13T19:35:20.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.852+0000 7f8415430980 1 -- 172.21.15.144:0/1083873391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9efba00 msgr2=0x55dbc9efbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.852+0000 7f8415430980 1 --2- 172.21.15.144:0/1083873391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9efba00 0x55dbc9efbe10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f840800a4e0 tx=0x7f840801b090 comp rx=0 tx=0).stop 2024-09-13T19:35:20.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.852+0000 7f8415430980 1 -- 172.21.15.144:0/1083873391 shutdown_connections 2024-09-13T19:35:20.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.852+0000 7f8415430980 1 --2- 172.21.15.144:0/1083873391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9efba00 0x55dbc9efbe10 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.852+0000 7f8415430980 1 -- 172.21.15.144:0/1083873391 >> 172.21.15.144:0/1083873391 conn(0x55dbc9ef7240 msgr2=0x55dbc9ef7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.852+0000 7f8415430980 1 -- 172.21.15.144:0/1083873391 shutdown_connections 2024-09-13T19:35:20.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.852+0000 7f8415430980 1 -- 172.21.15.144:0/1083873391 wait complete. 2024-09-13T19:35:20.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.864+0000 7f8415430980 1 Processor -- start 2024-09-13T19:35:20.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.864+0000 7f8415430980 1 -- start start 2024-09-13T19:35:20.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca0733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbc9e2f200 con 0x55dbc9ef8690 2024-09-13T19:35:20.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8412f40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca0733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8412f40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca0733e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42618/0 (socket says 172.21.15.144:42618) 2024-09-13T19:35:20.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8412f40640 1 -- 172.21.15.144:0/674240264 learned_addr learned my addr 172.21.15.144:0/674240264 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8412f40640 1 -- 172.21.15.144:0/674240264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbca0739b0 con 0x55dbc9ef8690 2024-09-13T19:35:20.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8412f40640 1 --2- 172.21.15.144:0/674240264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca0733e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8404001e50 tx=0x7f8404001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143ef95093c89930 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8300e09640 1 -- 172.21.15.144:0/674240264 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840400e5d0 con 0x55dbc9ef8690 2024-09-13T19:35:20.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8300e09640 1 -- 172.21.15.144:0/674240264 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840400e770 con 0x55dbc9ef8690 2024-09-13T19:35:20.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8300e09640 1 -- 172.21.15.144:0/674240264 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840400eab0 con 0x55dbc9ef8690 2024-09-13T19:35:20.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 -- 172.21.15.144:0/674240264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 msgr2=0x55dbca0733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 --2- 172.21.15.144:0/674240264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca0733e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8404001e50 tx=0x7f8404001e80 comp rx=0 tx=0).stop 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 -- 172.21.15.144:0/674240264 shutdown_connections 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 --2- 172.21.15.144:0/674240264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca0733e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 -- 172.21.15.144:0/674240264 >> 172.21.15.144:0/674240264 conn(0x55dbc9ef7240 msgr2=0x55dbca06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 -- 172.21.15.144:0/674240264 shutdown_connections 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 -- 172.21.15.144:0/674240264 wait complete. 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 Processor -- start 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 -- start start 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca07a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8415430980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbc9f91930 con 0x55dbc9ef8690 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8412f40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca07a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8412f40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca07a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42630/0 (socket says 172.21.15.144:42630) 2024-09-13T19:35:20.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.868+0000 7f8412f40640 1 -- 172.21.15.144:0/726085177 learned_addr learned my addr 172.21.15.144:0/726085177 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8412f40640 1 -- 172.21.15.144:0/726085177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbca07ac70 con 0x55dbc9ef8690 2024-09-13T19:35:20.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8412f40640 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca07a730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55dbca0745c0 tx=0x7f8404000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f82ff606640 1 -- 172.21.15.144:0/726085177 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8404001260 con 0x55dbc9ef8690 2024-09-13T19:35:20.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbca07af00 con 0x55dbc9ef8690 2024-09-13T19:35:20.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbca07dbe0 con 0x55dbc9ef8690 2024-09-13T19:35:20.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f82ff606640 1 -- 172.21.15.144:0/726085177 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840400fa40 con 0x55dbc9ef8690 2024-09-13T19:35:20.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f82ff606640 1 -- 172.21.15.144:0/726085177 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840402c060 con 0x55dbc9ef8690 2024-09-13T19:35:20.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f82ff606640 1 -- 172.21.15.144:0/726085177 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8404017070 con 0x55dbc9ef8690 2024-09-13T19:35:20.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f82ff606640 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82f8034650 0x7f82f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f82ff606640 1 -- 172.21.15.144:0/726085177 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8404015020 con 0x55dbc9ef8690 2024-09-13T19:35:20.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f841273f640 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82f8034650 0x7f82f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbc9efba00 0x55dbca081770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca081d90 con 0x55dbc9efba00 2024-09-13T19:35:20.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8413741640 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbc9efba00 0x55dbca081770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f841273f640 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82f8034650 0x7f82f8036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84080ab000 tx=0x7f84080a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8413741640 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbc9efba00 0x55dbca081770 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8413741640 1 -- 172.21.15.144:0/726085177 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f840c0083f0 con 0x55dbc9efba00 2024-09-13T19:35:20.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca07ede0 con 0x55dbc9efba00 2024-09-13T19:35:20.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.872+0000 7f8413741640 1 -- 172.21.15.144:0/726085177 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f840c0083f0 con 0x55dbc9efba00 2024-09-13T19:35:20.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0840c0 0x55dbca0864b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca086ba0 con 0x55dbca0840c0 2024-09-13T19:35:20.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8412f40640 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0840c0 0x55dbca0864b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8412f40640 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0840c0 0x55dbca0864b0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8412f40640 1 -- 172.21.15.144:0/726085177 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0840c0 2024-09-13T19:35:20.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca082f60 con 0x55dbc9efba00 2024-09-13T19:35:20.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8413741640 1 -- 172.21.15.144:0/726085177 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f840c0083f0 con 0x55dbc9efba00 2024-09-13T19:35:20.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca083440 con 0x55dbc9efba00 2024-09-13T19:35:20.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8413741640 1 -- 172.21.15.144:0/726085177 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f840c0083f0 con 0x55dbc9efba00 2024-09-13T19:35:20.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8415430980 1 Processor -- start 2024-09-13T19:35:20.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8415430980 1 -- start start 2024-09-13T19:35:20.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8415430980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0952c0 0x55dbca0956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8415430980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbc9e88800 con 0x55dbca0952c0 2024-09-13T19:35:20.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8413741640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0952c0 0x55dbca0956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8413741640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0952c0 0x55dbca0956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42640/0 (socket says 172.21.15.144:42640) 2024-09-13T19:35:20.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.876+0000 7f8413741640 1 -- 172.21.15.144:0/3284894541 learned_addr learned my addr 172.21.15.144:0/3284894541 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8413741640 1 -- 172.21.15.144:0/3284894541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbca095c20 con 0x55dbca0952c0 2024-09-13T19:35:20.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8413741640 1 --2- 172.21.15.144:0/3284894541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0952c0 0x55dbca0956e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55dbca07bb60 tx=0x7f840c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f82fce01640 1 -- 172.21.15.144:0/3284894541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c007dd0 con 0x55dbca0952c0 2024-09-13T19:35:20.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f82fce01640 1 -- 172.21.15.144:0/3284894541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c01e020 con 0x55dbca0952c0 2024-09-13T19:35:20.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f82fce01640 1 -- 172.21.15.144:0/3284894541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c019590 con 0x55dbca0952c0 2024-09-13T19:35:20.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8415430980 1 -- 172.21.15.144:0/3284894541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbca095eb0 con 0x55dbca0952c0 2024-09-13T19:35:20.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8415430980 1 -- 172.21.15.144:0/3284894541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbca098b30 con 0x55dbca0952c0 2024-09-13T19:35:20.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f82fce01640 1 -- 172.21.15.144:0/3284894541 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f840c016040 con 0x55dbca0952c0 2024-09-13T19:35:20.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f82fce01640 1 --2- 172.21.15.144:0/3284894541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82ec0346a0 0x7f82ec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f82fce01640 1 -- 172.21.15.144:0/3284894541 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f840c01f030 con 0x55dbca0952c0 2024-09-13T19:35:20.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8412f40640 1 --2- 172.21.15.144:0/3284894541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82ec0346a0 0x7f82ec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8415430980 1 Processor -- start 2024-09-13T19:35:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8415430980 1 -- start start 2024-09-13T19:35:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8412f40640 1 --2- 172.21.15.144:0/3284894541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82ec0346a0 0x7f82ec036b60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55dbca082230 tx=0x7f8404048dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8415430980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8415430980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbca073d30 con 0x55dbca0a1d50 2024-09-13T19:35:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8413741640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8413741640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42648/0 (socket says 172.21.15.144:42648) 2024-09-13T19:35:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.880+0000 7f8413741640 1 -- 172.21.15.144:0/3440874857 learned_addr learned my addr 172.21.15.144:0/3440874857 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8413741640 1 -- 172.21.15.144:0/3440874857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbca0a2700 con 0x55dbca0a1d50 2024-09-13T19:35:20.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8413741640 1 --2- 172.21.15.144:0/3440874857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a2130 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f840c04a2e0 tx=0x7f840c0236e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cfe3bd71a43fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f82f67fc640 1 -- 172.21.15.144:0/3440874857 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c01d040 con 0x55dbca0a1d50 2024-09-13T19:35:20.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f82f67fc640 1 -- 172.21.15.144:0/3440874857 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c019dd0 con 0x55dbca0a1d50 2024-09-13T19:35:20.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f82f67fc640 1 -- 172.21.15.144:0/3440874857 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c015dc0 con 0x55dbca0a1d50 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- 172.21.15.144:0/3440874857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 msgr2=0x55dbca0a2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 --2- 172.21.15.144:0/3440874857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a2130 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f840c04a2e0 tx=0x7f840c0236e0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- 172.21.15.144:0/3440874857 shutdown_connections 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 --2- 172.21.15.144:0/3440874857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a2130 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- 172.21.15.144:0/3440874857 >> 172.21.15.144:0/3440874857 conn(0x55dbca09e130 msgr2=0x55dbca09c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- 172.21.15.144:0/3440874857 shutdown_connections 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- 172.21.15.144:0/3440874857 wait complete. 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 Processor -- start 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- start start 2024-09-13T19:35:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbca0a2d20 con 0x55dbca0a1d50 2024-09-13T19:35:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8413741640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8413741640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42662/0 (socket says 172.21.15.144:42662) 2024-09-13T19:35:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 learned_addr learned my addr 172.21.15.144:0/955766026 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:20.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbca0a96a0 con 0x55dbca0a1d50 2024-09-13T19:35:20.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8413741640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a9160 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f840c023720 tx=0x7f840c04a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f82f4ff9640 1 -- 172.21.15.144:0/955766026 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c01d030 con 0x55dbca0a1d50 2024-09-13T19:35:20.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f82f4ff9640 1 -- 172.21.15.144:0/955766026 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c022700 con 0x55dbca0a1d50 2024-09-13T19:35:20.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f82f4ff9640 1 -- 172.21.15.144:0/955766026 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840c0153e0 con 0x55dbca0a1d50 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbca0a9930 con 0x55dbca0a1d50 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.884+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbca0ac610 con 0x55dbca0a1d50 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f82f4ff9640 1 -- 172.21.15.144:0/955766026 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f840c015580 con 0x55dbca0a1d50 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f82f4ff9640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82dc0346a0 0x7f82dc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f82f4ff9640 1 -- 172.21.15.144:0/955766026 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f840c034070 con 0x55dbca0a1d50 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8412f40640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82dc0346a0 0x7f82dc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbca0b4560 0x55dbca0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0b7170 con 0x55dbca0b4560 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f841273f640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbca0b4560 0x55dbca0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8412f40640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82dc0346a0 0x7f82dc036b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f84040014a0 tx=0x7f840403a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f841273f640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbca0b4560 0x55dbca0b6a20 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 realm 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0b75a0 con 0x55dbca0b4560 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0b7e70 con 0x55dbca0b4560 2024-09-13T19:35:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0b8210 con 0x55dbca0b4560 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0b8f70 0x55dbca0bb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0bb970 con 0x55dbca0b8f70 2024-09-13T19:35:20.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.888+0000 7f8413741640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0b8f70 0x55dbca0bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8413741640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0b8f70 0x55dbca0bb360 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8415430980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8415430980 20 searching for the correct realm 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbca0bd8c0 0x55dbca0bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8412f40640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbca0bd8c0 0x55dbca0bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8412f40640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbca0bd8c0 0x55dbca0bfcf0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8412f40640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f840404ab80 0x7f840401d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x7f840404ab80 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f841273f640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f840404ab80 0x7f840401d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f841273f640 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f840404ab80 0x7f840401d5f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:20.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b8f70 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.892+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b8f70 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x7f840404ab80 2024-09-13T19:35:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b8f70 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x7f840404ab80 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.896+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b8f70 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b8f70 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x7f840404ab80 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.900+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b8f70 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b8f70 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x7f840404ab80 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b8f70 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x55dbca0b4560 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c03c0 con 0x7f840404ab80 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0bc330 con 0x55dbca0b4560 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0bbf70 con 0x55dbca0b4560 2024-09-13T19:35:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.904+0000 7f8415430980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0bbf80 con 0x55dbca0b4560 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 zone default found 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 4 Realm: () 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 zonegroup default 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c08d0 con 0x55dbca0b8f70 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c2ba0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c2f40 con 0x55dbca0bd8c0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 started sync module instance, tier type = 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c2030 con 0x7f840404ab80 2024-09-13T19:35:20.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94402475992400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c2030 con 0x7f840404ab80 2024-09-13T19:35:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.908+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c3960 con 0x55dbca0b4560 2024-09-13T19:35:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.912+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94402475992400] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.912+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.912+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94402475996240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c2030 con 0x55dbca0b4560 2024-09-13T19:35:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.912+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c4370 con 0x55dbca0bd8c0 2024-09-13T19:35:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.912+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94402475996240] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94402475989888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c1fa0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c5070 con 0x7f840404ab80 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94402476002544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c5910 con 0x7f840404ab80 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c6310 con 0x55dbca0b4560 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94402475989888] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94402476002544] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94402476001040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c53f0 con 0x55dbca0b4560 2024-09-13T19:35:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.916+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c6bb0 con 0x55dbca0b8f70 2024-09-13T19:35:20.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.920+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94402476001040] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.920+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.920+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94402476006944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c53f0 con 0x55dbca0b8f70 2024-09-13T19:35:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.920+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c7060 con 0x55dbca0b8f70 2024-09-13T19:35:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94402476010416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c74e0 con 0x55dbca0b8f70 2024-09-13T19:35:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c7ff0 con 0x55dbca0b8f70 2024-09-13T19:35:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94402476006944] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94402476010416] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94402476011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c6700 con 0x55dbca0b8f70 2024-09-13T19:35:20.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 20 add_watcher() i=0 2024-09-13T19:35:20.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 20 add_watcher() i=1 2024-09-13T19:35:20.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 20 add_watcher() i=2 2024-09-13T19:35:20.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 20 add_watcher() i=3 2024-09-13T19:35:20.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 20 add_watcher() i=4 2024-09-13T19:35:20.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 20 add_watcher() i=5 2024-09-13T19:35:20.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.924+0000 7f8415430980 20 add_watcher() i=6 2024-09-13T19:35:20.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94402476011472] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8415430980 20 add_watcher() i=7 2024-09-13T19:35:20.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8415430980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:20.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0cafe0 con 0x55dbca0b4560 2024-09-13T19:35:20.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94402476014240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c8460 con 0x55dbca0b4560 2024-09-13T19:35:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94402476014240] v32'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f82c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8415430980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8415430980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8415430980 5 note: GC not initialized 2024-09-13T19:35:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.928+0000 7f8243fff640 20 reqs_thread_entry: start 2024-09-13T19:35:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 20 Filter name: none 2024-09-13T19:35:20.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8241ffb640 20 reqs_thread_entry: start 2024-09-13T19:35:20.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:20.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 20 rados->read ofs=0 len=0 2024-09-13T19:35:20.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0ee4d0 con 0x55dbca0b8f70 2024-09-13T19:35:20.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:35:20.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:20.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:20.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:20.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0f4e30 con 0x55dbca0b8f70 2024-09-13T19:35:20.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.932+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f8415430980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f8415430980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f8415430980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94402476198048 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0f04c0 con 0x55dbca0b4560 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 94402476001040 notify 137438953497 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55dbc9efc350 con 0x55dbca0b4560 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f82f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94402476001040 notifier 4874 bl.length()=666 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f82f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f82f67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 94402476198048 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f82f67fc640 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f82d8003eb0 con 0x55dbca0b4560 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 94402476198048 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f84080cdb50 con 0x55dbca0b4560 2024-09-13T19:35:20.940 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:20.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f82c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:20.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94402476014240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0ec2d0 con 0x55dbca0b4560 2024-09-13T19:35:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94402476014240] v32'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.936+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94402475992400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0ec2d0 con 0x7f840404ab80 2024-09-13T19:35:20.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.940+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94402475992400] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.940+0000 7f8415430980 20 remove_watcher() i=0 2024-09-13T19:35:20.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.940+0000 7f8415430980 2 removed watcher, disabling cache 2024-09-13T19:35:20.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.940+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94402475996240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0ec2d0 con 0x55dbca0b4560 2024-09-13T19:35:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.940+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94402475996240] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.940+0000 7f8415430980 20 remove_watcher() i=1 2024-09-13T19:35:20.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.940+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94402475989888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0ec2d0 con 0x55dbca0bd8c0 2024-09-13T19:35:20.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.944+0000 7f8412f40640 1 -- 172.21.15.144:0/955766026 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94402475989888] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840402e070 con 0x55dbca0bd8c0 2024-09-13T19:35:20.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.944+0000 7f8415430980 20 remove_watcher() i=2 2024-09-13T19:35:20.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.944+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94402476002544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c1b80 con 0x7f840404ab80 2024-09-13T19:35:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.944+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94402476002544] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x7f840404ab80 2024-09-13T19:35:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.944+0000 7f8415430980 20 remove_watcher() i=3 2024-09-13T19:35:20.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.944+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94402476001040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c1b80 con 0x55dbca0b4560 2024-09-13T19:35:20.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.948+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94402476001040] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84080bc040 con 0x55dbca0b4560 2024-09-13T19:35:20.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.948+0000 7f8415430980 20 remove_watcher() i=4 2024-09-13T19:35:20.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.948+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94402476006944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c4710 con 0x55dbca0b8f70 2024-09-13T19:35:20.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.948+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94402476006944] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.948+0000 7f8415430980 20 remove_watcher() i=5 2024-09-13T19:35:20.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.948+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94402476010416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c1b80 con 0x55dbca0b8f70 2024-09-13T19:35:20.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94402476010416] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 20 remove_watcher() i=6 2024-09-13T19:35:20.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94402476011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbca0c4710 con 0x55dbca0b8f70 2024-09-13T19:35:20.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8413741640 1 -- 172.21.15.144:0/955766026 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94402476011472] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c042020 con 0x55dbca0b8f70 2024-09-13T19:35:20.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 20 remove_watcher() i=7 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0b8f70 msgr2=0x55dbca0bb360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0b8f70 0x55dbca0bb360 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbca0b4560 msgr2=0x55dbca0b6a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbca0b4560 0x55dbca0b6a20 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f840404ab80 msgr2=0x7f840401d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f840404ab80 0x7f840401d5f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbca0bd8c0 msgr2=0x55dbca0bfcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55dbca0bd8c0 0x55dbca0bfcf0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82dc0346a0 msgr2=0x7f82dc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82dc0346a0 0x7f82dc036b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f84040014a0 tx=0x7f840403a000 comp rx=0 tx=0).stop 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 msgr2=0x55dbca0a9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f841273f640 1 -- 172.21.15.144:0/955766026 reap_dead start 2024-09-13T19:35:20.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a9160 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f840c023720 tx=0x7f840c04a240 comp rx=0 tx=0).stop 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 shutdown_connections 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/955766026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0a1d50 0x55dbca0a9160 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 >> 172.21.15.144:0/955766026 conn(0x55dbca09e130 msgr2=0x55dbca09c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 shutdown_connections 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/955766026 wait complete. 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/3284894541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82ec0346a0 msgr2=0x7f82ec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/3284894541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82ec0346a0 0x7f82ec036b60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55dbca082230 tx=0x7f8404048dd0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/3284894541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0952c0 msgr2=0x55dbca0956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/3284894541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0952c0 0x55dbca0956e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55dbca07bb60 tx=0x7f840c00af40 comp rx=0 tx=0).stop 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/3284894541 shutdown_connections 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/3284894541 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82ec0346a0 0x7f82ec036b60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/3284894541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbca0952c0 0x55dbca0956e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/3284894541 >> 172.21.15.144:0/3284894541 conn(0x55dbca08a410 msgr2=0x55dbca08ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/3284894541 shutdown_connections 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/3284894541 wait complete. 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0840c0 msgr2=0x55dbca0864b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0840c0 0x55dbca0864b0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbc9efba00 msgr2=0x55dbca081770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.952+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbc9efba00 0x55dbca081770 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82f8034650 msgr2=0x7f82f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82f8034650 0x7f82f8036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84080ab000 tx=0x7f84080a5000 comp rx=0 tx=0).stop 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 msgr2=0x55dbca07a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca07a730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55dbca0745c0 tx=0x7f8404000bd0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 shutdown_connections 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55dbc9efba00 0x55dbca081770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55dbca0840c0 0x55dbca0864b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f82f8034650 0x7f82f8036b10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 --2- 172.21.15.144:0/726085177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbc9ef8690 0x55dbca07a730 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:20.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 >> 172.21.15.144:0/726085177 conn(0x55dbc9ef7240 msgr2=0x55dbca06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:20.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 shutdown_connections 2024-09-13T19:35:20.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:20.956+0000 7f8415430980 1 -- 172.21.15.144:0/726085177 wait complete. 2024-09-13T19:35:20.969 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:20.969 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:20.970 ERROR:root:0 2024-09-13T19:35:20.970 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:21.000 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:21.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:35:21.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:35:21.001 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:35:21.043 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:21.043 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17ab68c980 1 Processor -- start 2024-09-13T19:35:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17ab68c980 1 -- start start 2024-09-13T19:35:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17ab68c980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556f749012e0 0x556f7498f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17ab68c980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f74814ae0 con 0x556f7498f8b0 2024-09-13T19:35:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17ab68c980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x556f74838e30 con 0x556f749012e0 2024-09-13T19:35:21.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17a919c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556f749012e0 0x556f7498f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17a919c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x556f749012e0 0x556f7498f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42670/0 (socket says 172.21.15.144:42670) 2024-09-13T19:35:21.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17a899b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x556f7498f8b0 0x556f74991ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49428/0 (socket says 172.21.15.144:49428) 2024-09-13T19:35:21.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17a919c640 1 -- 172.21.15.144:0/77544142 learned_addr learned my addr 172.21.15.144:0/77544142 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17a919c640 1 -- 172.21.15.144:0/77544142 >> v1:172.21.15.18:6789/0 conn(0x556f7498f8b0 legacy=0x556f74991ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.040+0000 7f17a919c640 1 -- 172.21.15.144:0/77544142 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f749943d0 con 0x556f749012e0 2024-09-13T19:35:21.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f17a919c640 1 --2- 172.21.15.144:0/77544142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498f370 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f179c00a4e0 tx=0x7f179c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62a8f144f885602 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f179bfff640 1 -- 172.21.15.144:0/77544142 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179c0aa540 con 0x556f749012e0 2024-09-13T19:35:21.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f179bfff640 1 -- 172.21.15.144:0/77544142 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c0aa6e0 con 0x556f749012e0 2024-09-13T19:35:21.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f179bfff640 1 -- 172.21.15.144:0/77544142 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179c0aaa40 con 0x556f749012e0 2024-09-13T19:35:21.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f17ab68c980 1 -- 172.21.15.144:0/77544142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 msgr2=0x556f7498f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f17ab68c980 1 --2- 172.21.15.144:0/77544142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498f370 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f179c00a4e0 tx=0x7f179c01b090 comp rx=0 tx=0).stop 2024-09-13T19:35:21.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f17ab68c980 1 -- 172.21.15.144:0/77544142 shutdown_connections 2024-09-13T19:35:21.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f17ab68c980 1 --2- 172.21.15.144:0/77544142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498f370 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f17ab68c980 1 -- 172.21.15.144:0/77544142 >> 172.21.15.144:0/77544142 conn(0x556f749870a0 msgr2=0x556f749894c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f17ab68c980 1 -- 172.21.15.144:0/77544142 shutdown_connections 2024-09-13T19:35:21.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.044+0000 7f17ab68c980 1 -- 172.21.15.144:0/77544142 wait complete. 2024-09-13T19:35:21.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17ab68c980 1 Processor -- start 2024-09-13T19:35:21.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17ab68c980 1 -- start start 2024-09-13T19:35:21.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17ab68c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f74a77a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17ab68c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f7483a200 con 0x556f749012e0 2024-09-13T19:35:21.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17a919c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f74a77a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17a919c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f74a77a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42686/0 (socket says 172.21.15.144:42686) 2024-09-13T19:35:21.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17a919c640 1 -- 172.21.15.144:0/4056675566 learned_addr learned my addr 172.21.15.144:0/4056675566 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17a919c640 1 -- 172.21.15.144:0/4056675566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f74a77fe0 con 0x556f749012e0 2024-09-13T19:35:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f17a919c640 1 --2- 172.21.15.144:0/4056675566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f74a77a10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f179c017ca0 tx=0x7f179c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61a2599e4d02908 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f1697606640 1 -- 172.21.15.144:0/4056675566 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179c0b9030 con 0x556f749012e0 2024-09-13T19:35:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.060+0000 7f1697606640 1 -- 172.21.15.144:0/4056675566 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c0aaac0 con 0x556f749012e0 2024-09-13T19:35:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f1697606640 1 -- 172.21.15.144:0/4056675566 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179c0aada0 con 0x556f749012e0 2024-09-13T19:35:21.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- 172.21.15.144:0/4056675566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 msgr2=0x556f74a77a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 --2- 172.21.15.144:0/4056675566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f74a77a10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f179c017ca0 tx=0x7f179c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- 172.21.15.144:0/4056675566 shutdown_connections 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 --2- 172.21.15.144:0/4056675566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f74a77a10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- 172.21.15.144:0/4056675566 >> 172.21.15.144:0/4056675566 conn(0x556f749870a0 msgr2=0x556f74a73640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- 172.21.15.144:0/4056675566 shutdown_connections 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- 172.21.15.144:0/4056675566 wait complete. 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 Processor -- start 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- start start 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f74993e40 con 0x556f749012e0 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17a919c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17a919c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42694/0 (socket says 172.21.15.144:42694) 2024-09-13T19:35:21.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17a919c640 1 -- 172.21.15.144:0/1715649447 learned_addr learned my addr 172.21.15.144:0/1715649447 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17a919c640 1 -- 172.21.15.144:0/1715649447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7498d190 con 0x556f749012e0 2024-09-13T19:35:21.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17a919c640 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498cc50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f179c005cc0 tx=0x7f179c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f1695e03640 1 -- 172.21.15.144:0/1715649447 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179c0b9030 con 0x556f749012e0 2024-09-13T19:35:21.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f7498b370 con 0x556f749012e0 2024-09-13T19:35:21.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f7498b860 con 0x556f749012e0 2024-09-13T19:35:21.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f1695e03640 1 -- 172.21.15.144:0/1715649447 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c0c3070 con 0x556f749012e0 2024-09-13T19:35:21.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.064+0000 7f1695e03640 1 -- 172.21.15.144:0/1715649447 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179c0cc060 con 0x556f749012e0 2024-09-13T19:35:21.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f1695e03640 1 -- 172.21.15.144:0/1715649447 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f179c0c5030 con 0x556f749012e0 2024-09-13T19:35:21.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f1695e03640 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16900346a0 0x7f1690036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f1695e03640 1 -- 172.21.15.144:0/1715649447 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f179c0ba070 con 0x556f749012e0 2024-09-13T19:35:21.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17a899b640 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16900346a0 0x7f1690036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f7498f8b0 0x556f74a88060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74a885a0 con 0x556f7498f8b0 2024-09-13T19:35:21.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17a999d640 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f7498f8b0 0x556f74a88060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17a899b640 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16900346a0 0x7f1690036b60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f17a0001e50 tx=0x7f17a00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17a999d640 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f7498f8b0 0x556f74a88060 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17a999d640 1 -- 172.21.15.144:0/1715649447 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17a40083f0 con 0x556f7498f8b0 2024-09-13T19:35:21.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74a88980 con 0x556f7498f8b0 2024-09-13T19:35:21.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17a999d640 1 -- 172.21.15.144:0/1715649447 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17a40083f0 con 0x556f7498f8b0 2024-09-13T19:35:21.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74a8a790 0x556f74a8cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74a8d270 con 0x556f74a8a790 2024-09-13T19:35:21.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17a919c640 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74a8a790 0x556f74a8cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.068+0000 7f17a919c640 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74a8a790 0x556f74a8cb80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17a919c640 1 -- 172.21.15.144:0/1715649447 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74a8a790 2024-09-13T19:35:21.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74a89630 con 0x556f7498f8b0 2024-09-13T19:35:21.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17a999d640 1 -- 172.21.15.144:0/1715649447 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17a40083f0 con 0x556f7498f8b0 2024-09-13T19:35:21.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74a89b10 con 0x556f7498f8b0 2024-09-13T19:35:21.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17a999d640 1 -- 172.21.15.144:0/1715649447 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f17a40083f0 con 0x556f7498f8b0 2024-09-13T19:35:21.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17ab68c980 1 Processor -- start 2024-09-13T19:35:21.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17ab68c980 1 -- start start 2024-09-13T19:35:21.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17ab68c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74a9b990 0x556f74a9bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17ab68c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f74893800 con 0x556f74a9b990 2024-09-13T19:35:21.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17a999d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74a9b990 0x556f74a9bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17a999d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74a9b990 0x556f74a9bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42696/0 (socket says 172.21.15.144:42696) 2024-09-13T19:35:21.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17a999d640 1 -- 172.21.15.144:0/3837906568 learned_addr learned my addr 172.21.15.144:0/3837906568 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17a999d640 1 -- 172.21.15.144:0/3837906568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f74a9c2f0 con 0x556f74a9b990 2024-09-13T19:35:21.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17a999d640 1 --2- 172.21.15.144:0/3837906568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74a9b990 0x556f74a9bdb0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x556f7498c4e0 tx=0x7f17a400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f168effd640 1 -- 172.21.15.144:0/3837906568 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4007d70 con 0x556f74a9b990 2024-09-13T19:35:21.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f168effd640 1 -- 172.21.15.144:0/3837906568 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a401e020 con 0x556f74a9b990 2024-09-13T19:35:21.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17ab68c980 1 -- 172.21.15.144:0/3837906568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f74a9c580 con 0x556f74a9b990 2024-09-13T19:35:21.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f168effd640 1 -- 172.21.15.144:0/3837906568 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4019590 con 0x556f74a9b990 2024-09-13T19:35:21.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.072+0000 7f17ab68c980 1 -- 172.21.15.144:0/3837906568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f74a9f200 con 0x556f74a9b990 2024-09-13T19:35:21.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f168effd640 1 -- 172.21.15.144:0/3837906568 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17a4016040 con 0x556f74a9b990 2024-09-13T19:35:21.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f168effd640 1 --2- 172.21.15.144:0/3837906568 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16800346a0 0x7f1680036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f168effd640 1 -- 172.21.15.144:0/3837906568 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f17a401f030 con 0x556f74a9b990 2024-09-13T19:35:21.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17a919c640 1 --2- 172.21.15.144:0/3837906568 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16800346a0 0x7f1680036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 Processor -- start 2024-09-13T19:35:21.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 -- start start 2024-09-13T19:35:21.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17a919c640 1 --2- 172.21.15.144:0/3837906568 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16800346a0 0x7f1680036b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x556f7498bb50 tx=0x7f179c0e5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aa8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f74a782a0 con 0x556f74aa8470 2024-09-13T19:35:21.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17a999d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aa8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17a999d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aa8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42702/0 (socket says 172.21.15.144:42702) 2024-09-13T19:35:21.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17a999d640 1 -- 172.21.15.144:0/3390526529 learned_addr learned my addr 172.21.15.144:0/3390526529 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17a999d640 1 -- 172.21.15.144:0/3390526529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f74aa8e20 con 0x556f74aa8470 2024-09-13T19:35:21.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17a999d640 1 --2- 172.21.15.144:0/3390526529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aa8850 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f17a404a2c0 tx=0x7f17a4023610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e8565b835d35e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f168cff9640 1 -- 172.21.15.144:0/3390526529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a401d040 con 0x556f74aa8470 2024-09-13T19:35:21.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f168cff9640 1 -- 172.21.15.144:0/3390526529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a40153e0 con 0x556f74aa8470 2024-09-13T19:35:21.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f168cff9640 1 -- 172.21.15.144:0/3390526529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4017b90 con 0x556f74aa8470 2024-09-13T19:35:21.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 -- 172.21.15.144:0/3390526529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 msgr2=0x556f74aa8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3390526529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aa8850 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f17a404a2c0 tx=0x7f17a4023610 comp rx=0 tx=0).stop 2024-09-13T19:35:21.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 -- 172.21.15.144:0/3390526529 shutdown_connections 2024-09-13T19:35:21.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3390526529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aa8850 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 -- 172.21.15.144:0/3390526529 >> 172.21.15.144:0/3390526529 conn(0x556f74aa4850 msgr2=0x556f74aa2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 -- 172.21.15.144:0/3390526529 shutdown_connections 2024-09-13T19:35:21.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.076+0000 7f17ab68c980 1 -- 172.21.15.144:0/3390526529 wait complete. 2024-09-13T19:35:21.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 1 Processor -- start 2024-09-13T19:35:21.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 1 -- start start 2024-09-13T19:35:21.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aaf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f74aa9440 con 0x556f74aa8470 2024-09-13T19:35:21.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17a999d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aaf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17a999d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aaf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42710/0 (socket says 172.21.15.144:42710) 2024-09-13T19:35:21.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 learned_addr learned my addr 172.21.15.144:0/3865039888 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f74aafda0 con 0x556f74aa8470 2024-09-13T19:35:21.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17a999d640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aaf860 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f17a4015fd0 tx=0x7f17a404a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f167effd640 1 -- 172.21.15.144:0/3865039888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a401d070 con 0x556f74aa8470 2024-09-13T19:35:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f167effd640 1 -- 172.21.15.144:0/3865039888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a4019a30 con 0x556f74aa8470 2024-09-13T19:35:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f74ab0030 con 0x556f74aa8470 2024-09-13T19:35:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f167effd640 1 -- 172.21.15.144:0/3865039888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a402b7d0 con 0x556f74aa8470 2024-09-13T19:35:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f74ab2d10 con 0x556f74aa8470 2024-09-13T19:35:21.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f167effd640 1 -- 172.21.15.144:0/3865039888 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f17a4035070 con 0x556f74aa8470 2024-09-13T19:35:21.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f167effd640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16740346a0 0x7f1674036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f167effd640 1 -- 172.21.15.144:0/3865039888 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f17a4038c50 con 0x556f74aa8470 2024-09-13T19:35:21.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17a919c640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16740346a0 0x7f1674036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f74abacf0 0x556f74abd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74abd900 con 0x556f74abacf0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.080+0000 7f17a899b640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f74abacf0 0x556f74abd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a919c640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16740346a0 0x7f1674036b60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f179c0ac010 tx=0x7f179c0d5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a899b640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f74abacf0 0x556f74abd1b0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17a000f6a0 con 0x556f74abacf0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 realm 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74aba140 con 0x556f74abacf0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17a000f6a0 con 0x556f74abacf0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74abe3d0 con 0x556f74abacf0 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17a000f6a0 con 0x556f74abacf0 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74abeca0 con 0x556f74abacf0 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17a000f6a0 con 0x556f74abacf0 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74abf590 0x556f74ac19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac2150 con 0x556f74abf590 2024-09-13T19:35:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a999d640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74abf590 0x556f74ac19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a999d640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74abf590 0x556f74ac19c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 20 searching for the correct realm 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556f74ac40a0 0x556f74ac64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a919c640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556f74ac40a0 0x556f74ac64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.084+0000 7f17a919c640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556f74ac40a0 0x556f74ac64b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a919c640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f179c0f2040 0x7f179c0dd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x7f179c0f2040 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f179c0f2040 0x7f179c0dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f179c0f2040 0x7f179c0dd040 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a000f6a0 con 0x7f179c0f2040 2024-09-13T19:35:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abf590 2024-09-13T19:35:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f17a000f6a0 con 0x556f74abacf0 2024-09-13T19:35:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abf590 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x7f179c0f2040 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.088+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abf590 2024-09-13T19:35:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x7f179c0f2040 2024-09-13T19:35:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abf590 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.092+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abf590 2024-09-13T19:35:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x7f179c0f2040 2024-09-13T19:35:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abf590 2024-09-13T19:35:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abf590 2024-09-13T19:35:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x7f179c0f2040 2024-09-13T19:35:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74ac40a0 2024-09-13T19:35:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.096+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abf590 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x556f74abacf0 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac6b80 con 0x7f179c0f2040 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac2b10 con 0x556f74abacf0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac2750 con 0x556f74abacf0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac34b0 con 0x556f74abacf0 2024-09-13T19:35:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 zone default found 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 4 Realm: () 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 zonegroup default 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac7090 con 0x556f74abf590 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac9360 con 0x556f74ac40a0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac9700 con 0x556f74ac40a0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 started sync module instance, tier type = 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:21.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.100+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac87f0 con 0x7f179c0f2040 2024-09-13T19:35:21.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.104+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.104+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93937187196144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac87f0 con 0x7f179c0f2040 2024-09-13T19:35:21.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.104+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74aca110 con 0x556f74abacf0 2024-09-13T19:35:21.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.104+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93937187196144] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.104+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.104+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93937187200368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac87f0 con 0x556f74abacf0 2024-09-13T19:35:21.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.104+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acab50 con 0x556f74ac40a0 2024-09-13T19:35:21.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.108+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.108+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93937187200368] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.108+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93937187193664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac8760 con 0x556f74ac40a0 2024-09-13T19:35:21.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.108+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acb850 con 0x7f179c0f2040 2024-09-13T19:35:21.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.108+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.108+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93937187206320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acc0f0 con 0x7f179c0f2040 2024-09-13T19:35:21.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.108+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74accab0 con 0x556f74abacf0 2024-09-13T19:35:21.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93937187193664] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93937187206320] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93937187210752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acc060 con 0x556f74abacf0 2024-09-13T19:35:21.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acca20 con 0x556f74abf590 2024-09-13T19:35:21.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93937187210752] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93937187208384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acd350 con 0x556f74abf590 2024-09-13T19:35:21.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.112+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acdba0 con 0x556f74abf590 2024-09-13T19:35:21.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.116+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93937187208384] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.116+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.116+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93937187213440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acda50 con 0x556f74abf590 2024-09-13T19:35:21.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.116+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74ace5b0 con 0x556f74abf590 2024-09-13T19:35:21.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.116+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93937187213440] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.116+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93937187214496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74ace5b0 con 0x556f74abf590 2024-09-13T19:35:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 20 add_watcher() i=0 2024-09-13T19:35:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 20 add_watcher() i=1 2024-09-13T19:35:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 20 add_watcher() i=2 2024-09-13T19:35:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 20 add_watcher() i=3 2024-09-13T19:35:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 20 add_watcher() i=4 2024-09-13T19:35:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 20 add_watcher() i=5 2024-09-13T19:35:21.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 20 add_watcher() i=6 2024-09-13T19:35:21.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93937187214496] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 20 add_watcher() i=7 2024-09-13T19:35:21.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:21.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74ad1a10 con 0x556f74abacf0 2024-09-13T19:35:21.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.120+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93937187218128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acef60 con 0x556f74abacf0 2024-09-13T19:35:21.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93937187218128] v32'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f165f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:21.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:21.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 5 note: GC not initialized 2024-09-13T19:35:21.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f165e7e4640 20 reqs_thread_entry: start 2024-09-13T19:35:21.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:21.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 20 Filter name: none 2024-09-13T19:35:21.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f15cffff640 20 reqs_thread_entry: start 2024-09-13T19:35:21.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:21.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74af50b0 con 0x556f74abf590 2024-09-13T19:35:21.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:35:21.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:21.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:21.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.124+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74afba20 con 0x556f74abf590 2024-09-13T19:35:21.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17ab68c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17ab68c980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17ab68c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93937187402896 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f74af70b0 con 0x556f74abacf0 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 93937187210752 notify 137438953498 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f17a0018040 con 0x556f74abacf0 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f168cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 93937187210752 notifier 4881 bl.length()=679 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f168cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f168cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 93937187402896 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f168cff9640 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f166c003eb0 con 0x556f74abacf0 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 93937187402896 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f74814ae0 con 0x556f74abacf0 2024-09-13T19:35:21.133 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:21.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f165f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.128+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93937187218128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74af2eb0 con 0x556f74abacf0 2024-09-13T19:35:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.132+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93937187218128] v32'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.132+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93937187196144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74af2eb0 con 0x7f179c0f2040 2024-09-13T19:35:21.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.132+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93937187196144] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.132+0000 7f17ab68c980 20 remove_watcher() i=0 2024-09-13T19:35:21.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.132+0000 7f17ab68c980 2 removed watcher, disabling cache 2024-09-13T19:35:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.132+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93937187200368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74af2eb0 con 0x556f74abacf0 2024-09-13T19:35:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.136+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93937187200368] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.136+0000 7f17ab68c980 20 remove_watcher() i=1 2024-09-13T19:35:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.136+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93937187193664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74af2eb0 con 0x556f74ac40a0 2024-09-13T19:35:21.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.136+0000 7f17a919c640 1 -- 172.21.15.144:0/3865039888 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93937187193664] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c0bf930 con 0x556f74ac40a0 2024-09-13T19:35:21.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.136+0000 7f17ab68c980 20 remove_watcher() i=2 2024-09-13T19:35:21.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.136+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93937187206320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac8340 con 0x7f179c0f2040 2024-09-13T19:35:21.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.136+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93937187206320] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x7f179c0f2040 2024-09-13T19:35:21.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.140+0000 7f17ab68c980 20 remove_watcher() i=3 2024-09-13T19:35:21.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.140+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93937187210752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acb4b0 con 0x556f74abacf0 2024-09-13T19:35:21.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.140+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93937187210752] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a002b040 con 0x556f74abacf0 2024-09-13T19:35:21.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.140+0000 7f17ab68c980 20 remove_watcher() i=4 2024-09-13T19:35:21.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.140+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93937187208384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74ac8340 con 0x556f74abf590 2024-09-13T19:35:21.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.144+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93937187208384] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.144+0000 7f17ab68c980 20 remove_watcher() i=5 2024-09-13T19:35:21.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.144+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93937187213440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acc600 con 0x556f74abf590 2024-09-13T19:35:21.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.144+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93937187213440] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.144+0000 7f17ab68c980 20 remove_watcher() i=6 2024-09-13T19:35:21.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.144+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93937187214496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f74acb4b0 con 0x556f74abf590 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17a999d640 1 -- 172.21.15.144:0/3865039888 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93937187214496] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17a4042020 con 0x556f74abf590 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 20 remove_watcher() i=7 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74abf590 msgr2=0x556f74ac19c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74abf590 0x556f74ac19c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f74abacf0 msgr2=0x556f74abd1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f74abacf0 0x556f74abd1b0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f179c0f2040 msgr2=0x7f179c0dd040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f179c0f2040 0x7f179c0dd040 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556f74ac40a0 msgr2=0x556f74ac64b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x556f74ac40a0 0x556f74ac64b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16740346a0 msgr2=0x7f1674036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16740346a0 0x7f1674036b60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f179c0ac010 tx=0x7f179c0d5000 comp rx=0 tx=0).stop 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 msgr2=0x556f74aaf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aaf860 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f17a4015fd0 tx=0x7f17a404a250 comp rx=0 tx=0).stop 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17a899b640 1 -- 172.21.15.144:0/3865039888 reap_dead start 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 shutdown_connections 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3865039888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74aa8470 0x556f74aaf860 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 >> 172.21.15.144:0/3865039888 conn(0x556f74aa4850 msgr2=0x556f74aa2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 shutdown_connections 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3865039888 wait complete. 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3837906568 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16800346a0 msgr2=0x7f1680036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3837906568 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16800346a0 0x7f1680036b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x556f7498bb50 tx=0x7f179c0e5040 comp rx=0 tx=0).stop 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3837906568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74a9b990 msgr2=0x556f74a9bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3837906568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74a9b990 0x556f74a9bdb0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x556f7498c4e0 tx=0x7f17a400af40 comp rx=0 tx=0).stop 2024-09-13T19:35:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3837906568 shutdown_connections 2024-09-13T19:35:21.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3837906568 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16800346a0 0x7f1680036b60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/3837906568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f74a9b990 0x556f74a9bdb0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3837906568 >> 172.21.15.144:0/3837906568 conn(0x556f74a90ae0 msgr2=0x556f74a93560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3837906568 shutdown_connections 2024-09-13T19:35:21.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/3837906568 wait complete. 2024-09-13T19:35:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74a8a790 msgr2=0x556f74a8cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74a8a790 0x556f74a8cb80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f7498f8b0 msgr2=0x556f74a88060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f7498f8b0 0x556f74a88060 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16900346a0 msgr2=0x7f1690036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16900346a0 0x7f1690036b60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f17a0001e50 tx=0x7f17a00013b0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 msgr2=0x556f7498cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498cc50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f179c005cc0 tx=0x7f179c017e30 comp rx=0 tx=0).stop 2024-09-13T19:35:21.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 shutdown_connections 2024-09-13T19:35:21.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x556f7498f8b0 0x556f74a88060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x556f74a8a790 0x556f74a8cb80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f16900346a0 0x7f1690036b60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 --2- 172.21.15.144:0/1715649447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f749012e0 0x556f7498cc50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 >> 172.21.15.144:0/1715649447 conn(0x556f749870a0 msgr2=0x556f74a721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 shutdown_connections 2024-09-13T19:35:21.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.148+0000 7f17ab68c980 1 -- 172.21.15.144:0/1715649447 wait complete. 2024-09-13T19:35:21.165 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.165 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.165 ERROR:root:0 2024-09-13T19:35:21.165 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:21.178 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:21.178 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T19:35:21.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T19:35:21.179 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-13T19:35:21.244 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:21.245 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:21.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.240+0000 7fd25e846980 1 Processor -- start 2024-09-13T19:35:21.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.240+0000 7fd25e846980 1 -- start start 2024-09-13T19:35:21.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.240+0000 7fd25e846980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560570138550 0x560570138930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25e846980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56056ffc1ae0 con 0x560570138ea0 2024-09-13T19:35:21.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25e846980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56056ffe5e30 con 0x560570138550 2024-09-13T19:35:21.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25c356640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560570138550 0x560570138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25c356640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x560570138550 0x560570138930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42714/0 (socket says 172.21.15.144:42714) 2024-09-13T19:35:21.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25bb55640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x560570138ea0 0x56057013d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49436/0 (socket says 172.21.15.144:49436) 2024-09-13T19:35:21.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25c356640 1 -- 172.21.15.144:0/3664073736 learned_addr learned my addr 172.21.15.144:0/3664073736 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25c356640 1 -- 172.21.15.144:0/3664073736 >> v1:172.21.15.18:6789/0 conn(0x560570138ea0 legacy=0x56057013d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25c356640 1 -- 172.21.15.144:0/3664073736 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560570140170 con 0x560570138550 2024-09-13T19:35:21.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25c356640 1 --2- 172.21.15.144:0/3664073736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570138930 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00a5c0 tx=0x7fd24c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59efd8103ae6491f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.244+0000 7fd25b354640 1 -- 172.21.15.144:0/3664073736 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0a6070 con 0x560570138550 2024-09-13T19:35:21.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25b354640 1 -- 172.21.15.144:0/3664073736 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0af070 con 0x560570138550 2024-09-13T19:35:21.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25b354640 1 -- 172.21.15.144:0/3664073736 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0aa5c0 con 0x560570138550 2024-09-13T19:35:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25e846980 1 -- 172.21.15.144:0/3664073736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 msgr2=0x560570138930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25e846980 1 --2- 172.21.15.144:0/3664073736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570138930 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00a5c0 tx=0x7fd24c01b340 comp rx=0 tx=0).stop 2024-09-13T19:35:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25e846980 1 -- 172.21.15.144:0/3664073736 shutdown_connections 2024-09-13T19:35:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25e846980 1 --2- 172.21.15.144:0/3664073736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570138930 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25e846980 1 -- 172.21.15.144:0/3664073736 >> 172.21.15.144:0/3664073736 conn(0x560570134070 msgr2=0x560570136490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25e846980 1 -- 172.21.15.144:0/3664073736 shutdown_connections 2024-09-13T19:35:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.248+0000 7fd25e846980 1 -- 172.21.15.144:0/3664073736 wait complete. 2024-09-13T19:35:21.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 Processor -- start 2024-09-13T19:35:21.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 -- start start 2024-09-13T19:35:21.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x5605702228b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56056ffe7200 con 0x560570138550 2024-09-13T19:35:21.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25c356640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x5605702228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25c356640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x5605702228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42728/0 (socket says 172.21.15.144:42728) 2024-09-13T19:35:21.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25c356640 1 -- 172.21.15.144:0/1223685908 learned_addr learned my addr 172.21.15.144:0/1223685908 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25c356640 1 -- 172.21.15.144:0/1223685908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560570222e80 con 0x560570138550 2024-09-13T19:35:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25c356640 1 --2- 172.21.15.144:0/1223685908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x5605702228b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0199f0 tx=0x7fd24c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b80d7ac019d123c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd14a60c640 1 -- 172.21.15.144:0/1223685908 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0aaa00 con 0x560570138550 2024-09-13T19:35:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd14a60c640 1 -- 172.21.15.144:0/1223685908 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0aaba0 con 0x560570138550 2024-09-13T19:35:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd14a60c640 1 -- 172.21.15.144:0/1223685908 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0bd3f0 con 0x560570138550 2024-09-13T19:35:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 -- 172.21.15.144:0/1223685908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 msgr2=0x5605702228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 --2- 172.21.15.144:0/1223685908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x5605702228b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0199f0 tx=0x7fd24c003030 comp rx=0 tx=0).stop 2024-09-13T19:35:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 -- 172.21.15.144:0/1223685908 shutdown_connections 2024-09-13T19:35:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 --2- 172.21.15.144:0/1223685908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x5605702228b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 -- 172.21.15.144:0/1223685908 >> 172.21.15.144:0/1223685908 conn(0x560570134070 msgr2=0x56057021e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 -- 172.21.15.144:0/1223685908 shutdown_connections 2024-09-13T19:35:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 -- 172.21.15.144:0/1223685908 wait complete. 2024-09-13T19:35:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 Processor -- start 2024-09-13T19:35:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.264+0000 7fd25e846980 1 -- start start 2024-09-13T19:35:21.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25e846980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570229b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25e846980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56057013fbb0 con 0x560570138550 2024-09-13T19:35:21.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25c356640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570229b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25c356640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570229b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42742/0 (socket says 172.21.15.144:42742) 2024-09-13T19:35:21.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25c356640 1 -- 172.21.15.144:0/2628108897 learned_addr learned my addr 172.21.15.144:0/2628108897 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25c356640 1 -- 172.21.15.144:0/2628108897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057022a040 con 0x560570138550 2024-09-13T19:35:21.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25c356640 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570229b00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0199f0 tx=0x7fd24c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd148e09640 1 -- 172.21.15.144:0/2628108897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0bd7c0 con 0x560570138550 2024-09-13T19:35:21.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56057022a2d0 con 0x560570138550 2024-09-13T19:35:21.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd148e09640 1 -- 172.21.15.144:0/2628108897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0bd960 con 0x560570138550 2024-09-13T19:35:21.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd148e09640 1 -- 172.21.15.144:0/2628108897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0bdc40 con 0x560570138550 2024-09-13T19:35:21.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057022cfb0 con 0x560570138550 2024-09-13T19:35:21.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd148e09640 1 -- 172.21.15.144:0/2628108897 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd24c0ce020 con 0x560570138550 2024-09-13T19:35:21.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd148e09640 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd1440346a0 0x7fd144036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd148e09640 1 -- 172.21.15.144:0/2628108897 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd24c0cc020 con 0x560570138550 2024-09-13T19:35:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25bb55640 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd1440346a0 0x7fd144036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570138ea0 0x560570230ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605702310f0 con 0x560570138ea0 2024-09-13T19:35:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25cb57640 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570138ea0 0x560570230ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.268+0000 7fd25bb55640 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd1440346a0 0x7fd144036b60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd244001e50 tx=0x7fd2440013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25cb57640 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570138ea0 0x560570230ab0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25cb57640 1 -- 172.21.15.144:0/2628108897 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd25400a4d0 con 0x560570138ea0 2024-09-13T19:35:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56057022e1b0 con 0x560570138ea0 2024-09-13T19:35:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25cb57640 1 -- 172.21.15.144:0/2628108897 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd25400a4d0 con 0x560570138ea0 2024-09-13T19:35:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560570233420 0x560570235810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560570235ee0 con 0x560570233420 2024-09-13T19:35:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25c356640 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560570233420 0x560570235810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25c356640 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560570233420 0x560570235810 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25c356640 1 -- 172.21.15.144:0/2628108897 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570233420 2024-09-13T19:35:21.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605702322c0 con 0x560570138ea0 2024-09-13T19:35:21.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25cb57640 1 -- 172.21.15.144:0/2628108897 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd25400a4d0 con 0x560570138ea0 2024-09-13T19:35:21.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.272+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605702327a0 con 0x560570138ea0 2024-09-13T19:35:21.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25cb57640 1 -- 172.21.15.144:0/2628108897 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd25400a4d0 con 0x560570138ea0 2024-09-13T19:35:21.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25e846980 1 Processor -- start 2024-09-13T19:35:21.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25e846980 1 -- start start 2024-09-13T19:35:21.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25e846980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605702445c0 0x5605702449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25e846980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560570040800 con 0x5605702445c0 2024-09-13T19:35:21.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25cb57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605702445c0 0x5605702449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25cb57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605702445c0 0x5605702449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42746/0 (socket says 172.21.15.144:42746) 2024-09-13T19:35:21.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25cb57640 1 -- 172.21.15.144:0/3322669510 learned_addr learned my addr 172.21.15.144:0/3322669510 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25cb57640 1 -- 172.21.15.144:0/3322669510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560570244f20 con 0x5605702445c0 2024-09-13T19:35:21.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25cb57640 1 --2- 172.21.15.144:0/3322669510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605702445c0 0x5605702449e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x5605702314f0 tx=0x7fd254018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd141ffb640 1 -- 172.21.15.144:0/3322669510 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254014450 con 0x5605702445c0 2024-09-13T19:35:21.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25e846980 1 -- 172.21.15.144:0/3322669510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605702451b0 con 0x5605702445c0 2024-09-13T19:35:21.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd141ffb640 1 -- 172.21.15.144:0/3322669510 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2540145f0 con 0x5605702445c0 2024-09-13T19:35:21.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd141ffb640 1 -- 172.21.15.144:0/3322669510 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254014910 con 0x5605702445c0 2024-09-13T19:35:21.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd25e846980 1 -- 172.21.15.144:0/3322669510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560570247e30 con 0x5605702445c0 2024-09-13T19:35:21.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.276+0000 7fd141ffb640 1 -- 172.21.15.144:0/3322669510 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd254011040 con 0x5605702445c0 2024-09-13T19:35:21.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd141ffb640 1 --2- 172.21.15.144:0/3322669510 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd134034650 0x7fd134036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd141ffb640 1 -- 172.21.15.144:0/3322669510 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd25401e070 con 0x5605702445c0 2024-09-13T19:35:21.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25c356640 1 --2- 172.21.15.144:0/3322669510 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd134034650 0x7fd134036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 Processor -- start 2024-09-13T19:35:21.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- start start 2024-09-13T19:35:21.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25c356640 1 --2- 172.21.15.144:0/3322669510 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd134034650 0x7fd134036b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x560570231590 tx=0x7fd24c0de040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x560570255950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560570223140 con 0x560570255570 2024-09-13T19:35:21.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25cb57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x560570255950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25cb57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x560570255950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42750/0 (socket says 172.21.15.144:42750) 2024-09-13T19:35:21.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25cb57640 1 -- 172.21.15.144:0/825379352 learned_addr learned my addr 172.21.15.144:0/825379352 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25cb57640 1 -- 172.21.15.144:0/825379352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560570255f20 con 0x560570255570 2024-09-13T19:35:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25cb57640 1 --2- 172.21.15.144:0/825379352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x560570255950 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd25404a140 tx=0x7fd254011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1594dc9169e68e59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd13b7fe640 1 -- 172.21.15.144:0/825379352 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254028070 con 0x560570255570 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd13b7fe640 1 -- 172.21.15.144:0/825379352 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25403aa60 con 0x560570255570 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd13b7fe640 1 -- 172.21.15.144:0/825379352 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd25403ad40 con 0x560570255570 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- 172.21.15.144:0/825379352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 msgr2=0x560570255950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 --2- 172.21.15.144:0/825379352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x560570255950 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd25404a140 tx=0x7fd254011700 comp rx=0 tx=0).stop 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- 172.21.15.144:0/825379352 shutdown_connections 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 --2- 172.21.15.144:0/825379352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x560570255950 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- 172.21.15.144:0/825379352 >> 172.21.15.144:0/825379352 conn(0x56057024d4a0 msgr2=0x56057024b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- 172.21.15.144:0/825379352 shutdown_connections 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- 172.21.15.144:0/825379352 wait complete. 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 Processor -- start 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- start start 2024-09-13T19:35:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x56057025c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.280+0000 7fd25e846980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560570256500 con 0x560570255570 2024-09-13T19:35:21.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25cb57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x56057025c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25cb57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x56057025c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42762/0 (socket says 172.21.15.144:42762) 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 learned_addr learned my addr 172.21.15.144:0/3628983442 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057025cd60 con 0x560570255570 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25cb57640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x56057025c820 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd2540117d0 tx=0x7fd25404a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd139ffb640 1 -- 172.21.15.144:0/3628983442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254022d90 con 0x560570255570 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56057025cff0 con 0x560570255570 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd139ffb640 1 -- 172.21.15.144:0/3628983442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2540133b0 con 0x560570255570 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd139ffb640 1 -- 172.21.15.144:0/3628983442 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254013690 con 0x560570255570 2024-09-13T19:35:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057025d400 con 0x560570255570 2024-09-13T19:35:21.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd139ffb640 1 -- 172.21.15.144:0/3628983442 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd25402b350 con 0x560570255570 2024-09-13T19:35:21.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd139ffb640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd12c034650 0x7fd12c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd139ffb640 1 -- 172.21.15.144:0/3628983442 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd254034030 con 0x560570255570 2024-09-13T19:35:21.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25c356640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd12c034650 0x7fd12c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570267ea0 0x56057026a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56057026aab0 con 0x560570267ea0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25bb55640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570267ea0 0x56057026a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25c356640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd12c034650 0x7fd12c036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0de3f0 tx=0x7fd24c0e6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25bb55640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570267ea0 0x56057026a360 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd24400f6a0 con 0x560570267ea0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 20 realm 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.284+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605702672f0 con 0x560570267ea0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd24400f6a0 con 0x560570267ea0 2024-09-13T19:35:21.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56057026b580 con 0x560570267ea0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd24400f6a0 con 0x560570267ea0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56057026be50 con 0x560570267ea0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd24400f6a0 con 0x560570267ea0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56057026c740 0x56057026eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56057026f300 con 0x56057026c740 2024-09-13T19:35:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25cb57640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56057026c740 0x56057026eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25cb57640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56057026c740 0x56057026eb70 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 20 searching for the correct realm 2024-09-13T19:35:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560570271250 0x560570273680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25c356640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560570271250 0x560570273680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25c356640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560570271250 0x560570273680 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25c356640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fd24c0f8040 0x7fd24c0e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x7fd24c0f8040 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.288+0000 7fd25bb55640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fd24c0f8040 0x7fd24c0e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fd24c0f8040 0x7fd24c0e38c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24400f6a0 con 0x7fd24c0f8040 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x56057026c740 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd24400f6a0 con 0x560570267ea0 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x56057026c740 2024-09-13T19:35:21.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x7fd24c0f8040 2024-09-13T19:35:21.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.292+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x56057026c740 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x7fd24c0f8040 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x56057026c740 2024-09-13T19:35:21.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.296+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x56057026c740 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x7fd24c0f8040 2024-09-13T19:35:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x56057026c740 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x56057026c740 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x7fd24c0f8040 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570271250 2024-09-13T19:35:21.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.300+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x56057026c740 2024-09-13T19:35:21.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x560570267ea0 2024-09-13T19:35:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560570273d50 con 0x7fd24c0f8040 2024-09-13T19:35:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56057026fcc0 con 0x560570267ea0 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560570270560 con 0x560570267ea0 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56057026f900 con 0x560570267ea0 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 zone default found 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 4 Realm: () 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 zonegroup default 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560570274210 con 0x56057026c740 2024-09-13T19:35:21.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605702764e0 con 0x560570271250 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560570276880 con 0x560570271250 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 started sync module instance, tier type = 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.304+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570275970 con 0x7fd24c0f8040 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.308+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.308+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94581356453520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570275970 con 0x7fd24c0f8040 2024-09-13T19:35:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.308+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702772d0 con 0x560570267ea0 2024-09-13T19:35:21.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.308+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94581356453520] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.308+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.308+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94581356457440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570275970 con 0x560570267ea0 2024-09-13T19:35:21.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.308+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570277ce0 con 0x560570271250 2024-09-13T19:35:21.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.312+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94581356457440] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.312+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.312+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94581356451008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702758e0 con 0x560570271250 2024-09-13T19:35:21.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.312+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570278a70 con 0x7fd24c0f8040 2024-09-13T19:35:21.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.312+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.312+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94581356463488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570279310 con 0x7fd24c0f8040 2024-09-13T19:35:21.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.312+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570279d10 con 0x560570267ea0 2024-09-13T19:35:21.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.312+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94581356451008] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.316+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94581356463488] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.316+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.316+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94581356462288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570278de0 con 0x560570267ea0 2024-09-13T19:35:21.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.316+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56057027a5b0 con 0x56057026c740 2024-09-13T19:35:21.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.316+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94581356462288] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.316+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.316+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94581356470528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570278de0 con 0x56057026c740 2024-09-13T19:35:21.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.316+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56057027ae00 con 0x56057026c740 2024-09-13T19:35:21.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.320+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94581356470528] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.320+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.320+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94581356468256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56057027ae00 con 0x56057026c740 2024-09-13T19:35:21.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.320+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56057027b7c0 con 0x56057026c740 2024-09-13T19:35:21.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.320+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94581356468256] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94581356472656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56057027b9a0 con 0x56057026c740 2024-09-13T19:35:21.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 20 add_watcher() i=0 2024-09-13T19:35:21.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 20 add_watcher() i=1 2024-09-13T19:35:21.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 20 add_watcher() i=2 2024-09-13T19:35:21.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 20 add_watcher() i=3 2024-09-13T19:35:21.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 20 add_watcher() i=4 2024-09-13T19:35:21.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 20 add_watcher() i=5 2024-09-13T19:35:21.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 20 add_watcher() i=6 2024-09-13T19:35:21.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94581356472656] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 20 add_watcher() i=7 2024-09-13T19:35:21.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:21.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56057027eba0 con 0x560570267ea0 2024-09-13T19:35:21.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.324+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94581356488048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56057027b940 con 0x560570267ea0 2024-09-13T19:35:21.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94581356488048] v32'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd1127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:21.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:21.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 5 note: GC not initialized 2024-09-13T19:35:21.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd1117e2640 20 reqs_thread_entry: start 2024-09-13T19:35:21.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:21.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 20 Filter name: none 2024-09-13T19:35:21.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd082ffd640 20 reqs_thread_entry: start 2024-09-13T19:35:21.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:21.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605702a2310 con 0x56057026c740 2024-09-13T19:35:21.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 20 rados_obj.operate() r=0 bl.length=503 2024-09-13T19:35:21.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:21.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:21.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.328+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702a8cd0 con 0x56057026c740 2024-09-13T19:35:21.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25e846980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25e846980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25e846980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94581356660544 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605702a43a0 con 0x560570267ea0 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 94581356462288 notify 137438953499 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fd244018040 con 0x560570267ea0 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd13b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94581356462288 notifier 4888 bl.length()=636 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd13b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd13b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 94581356660544 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd13b7fe640 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd120003eb0 con 0x560570267ea0 2024-09-13T19:35:21.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.332+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 94581356660544 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56056ffc1ae0 con 0x560570267ea0 2024-09-13T19:35:21.338 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:21.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.336+0000 7fd1127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.336+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94581356488048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702a0100 con 0x560570267ea0 2024-09-13T19:35:21.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.336+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94581356488048] v32'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.336+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94581356453520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702a0100 con 0x7fd24c0f8040 2024-09-13T19:35:21.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.336+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94581356453520] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.336+0000 7fd25e846980 20 remove_watcher() i=0 2024-09-13T19:35:21.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.336+0000 7fd25e846980 2 removed watcher, disabling cache 2024-09-13T19:35:21.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.336+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94581356457440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570275e90 con 0x560570267ea0 2024-09-13T19:35:21.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.340+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94581356457440] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.340+0000 7fd25e846980 20 remove_watcher() i=1 2024-09-13T19:35:21.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.340+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94581356451008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702a0100 con 0x560570271250 2024-09-13T19:35:21.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.340+0000 7fd25c356640 1 -- 172.21.15.144:0/3628983442 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94581356451008] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c0c6cd0 con 0x560570271250 2024-09-13T19:35:21.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.340+0000 7fd25e846980 20 remove_watcher() i=2 2024-09-13T19:35:21.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.340+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94581356463488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570276de0 con 0x7fd24c0f8040 2024-09-13T19:35:21.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.344+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94581356463488] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x7fd24c0f8040 2024-09-13T19:35:21.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.344+0000 7fd25e846980 20 remove_watcher() i=3 2024-09-13T19:35:21.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.344+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94581356462288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702754c0 con 0x560570267ea0 2024-09-13T19:35:21.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.344+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94581356462288] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24402b040 con 0x560570267ea0 2024-09-13T19:35:21.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.344+0000 7fd25e846980 20 remove_watcher() i=4 2024-09-13T19:35:21.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.344+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94581356470528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702a0100 con 0x56057026c740 2024-09-13T19:35:21.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.348+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94581356470528] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.348+0000 7fd25e846980 20 remove_watcher() i=5 2024-09-13T19:35:21.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.348+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94581356468256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560570276de0 con 0x56057026c740 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.348+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94581356468256] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.348+0000 7fd25e846980 20 remove_watcher() i=6 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.348+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94581356472656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605702754c0 con 0x56057026c740 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25cb57640 1 -- 172.21.15.144:0/3628983442 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94581356472656] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd254052070 con 0x56057026c740 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 20 remove_watcher() i=7 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56057026c740 msgr2=0x56057026eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56057026c740 0x56057026eb70 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570267ea0 msgr2=0x56057026a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570267ea0 0x56057026a360 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fd24c0f8040 msgr2=0x7fd24c0e38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fd24c0f8040 0x7fd24c0e38c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560570271250 msgr2=0x560570273680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x560570271250 0x560570273680 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd12c034650 msgr2=0x7fd12c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd12c034650 0x7fd12c036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0de3f0 tx=0x7fd24c0e6000 comp rx=0 tx=0).stop 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 msgr2=0x56057025c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25bb55640 1 -- 172.21.15.144:0/3628983442 reap_dead start 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x56057025c820 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd2540117d0 tx=0x7fd25404a0a0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 shutdown_connections 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3628983442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570255570 0x56057025c820 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 >> 172.21.15.144:0/3628983442 conn(0x56057024d4a0 msgr2=0x560570256bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 shutdown_connections 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3628983442 wait complete. 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3322669510 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd134034650 msgr2=0x7fd134036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3322669510 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd134034650 0x7fd134036b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x560570231590 tx=0x7fd24c0de040 comp rx=0 tx=0).stop 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3322669510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605702445c0 msgr2=0x5605702449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3322669510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605702445c0 0x5605702449e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x5605702314f0 tx=0x7fd254018830 comp rx=0 tx=0).stop 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3322669510 shutdown_connections 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3322669510 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd134034650 0x7fd134036b10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/3322669510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605702445c0 0x5605702449e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3322669510 >> 172.21.15.144:0/3322669510 conn(0x560570239710 msgr2=0x56057023c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3322669510 shutdown_connections 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/3322669510 wait complete. 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560570233420 msgr2=0x560570235810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.352+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560570233420 0x560570235810 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570138ea0 msgr2=0x560570230ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570138ea0 0x560570230ab0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd1440346a0 msgr2=0x7fd144036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd1440346a0 0x7fd144036b60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd244001e50 tx=0x7fd2440013b0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 msgr2=0x560570229b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570229b00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0199f0 tx=0x7fd24c0180e0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 shutdown_connections 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x560570138ea0 0x560570230ab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x560570233420 0x560570235810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd1440346a0 0x7fd144036b60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 --2- 172.21.15.144:0/2628108897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560570138550 0x560570229b00 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 >> 172.21.15.144:0/2628108897 conn(0x560570134070 msgr2=0x56057021d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 shutdown_connections 2024-09-13T19:35:21.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.356+0000 7fd25e846980 1 -- 172.21.15.144:0/2628108897 wait complete. 2024-09-13T19:35:21.370 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.370 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.370 ERROR:root:0 2024-09-13T19:35:21.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:35:21.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:35:21.370 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-13T19:35:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.444+0000 7f7e8403f980 1 Processor -- start 2024-09-13T19:35:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.444+0000 7f7e8403f980 1 -- start start 2024-09-13T19:35:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.444+0000 7f7e8403f980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56548f92b580 0x56548f92b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.444+0000 7f7e8403f980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56548f7b4ae0 con 0x56548f92bed0 2024-09-13T19:35:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.444+0000 7f7e8403f980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x56548f7d8e30 con 0x56548f92b580 2024-09-13T19:35:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e81b4f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56548f92b580 0x56548f92b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e8134e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x56548f92bed0 0x56548f930900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49450/0 (socket says 172.21.15.144:49450) 2024-09-13T19:35:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e81b4f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x56548f92b580 0x56548f92b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42776/0 (socket says 172.21.15.144:42776) 2024-09-13T19:35:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e8134e640 1 -- 172.21.15.144:0/2376855346 learned_addr learned my addr 172.21.15.144:0/2376855346 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e81b4f640 1 -- 172.21.15.144:0/2376855346 >> v1:172.21.15.18:6789/0 conn(0x56548f92bed0 legacy=0x56548f930900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e81b4f640 1 -- 172.21.15.144:0/2376855346 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548f933150 con 0x56548f92b580 2024-09-13T19:35:21.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/2376855346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548f92b960 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400a480 tx=0x7f7e7401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c0fc37eadceb86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e80b4d640 1 -- 172.21.15.144:0/2376855346 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e740b0070 con 0x56548f92b580 2024-09-13T19:35:21.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e80b4d640 1 -- 172.21.15.144:0/2376855346 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e740ab540 con 0x56548f92b580 2024-09-13T19:35:21.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.448+0000 7f7e80b4d640 1 -- 172.21.15.144:0/2376855346 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e740ab840 con 0x56548f92b580 2024-09-13T19:35:21.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.452+0000 7f7e8403f980 1 -- 172.21.15.144:0/2376855346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 msgr2=0x56548f92b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.452+0000 7f7e8403f980 1 --2- 172.21.15.144:0/2376855346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548f92b960 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400a480 tx=0x7f7e7401b280 comp rx=0 tx=0).stop 2024-09-13T19:35:21.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.452+0000 7f7e8403f980 1 -- 172.21.15.144:0/2376855346 shutdown_connections 2024-09-13T19:35:21.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.452+0000 7f7e8403f980 1 --2- 172.21.15.144:0/2376855346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548f92b960 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.452+0000 7f7e8403f980 1 -- 172.21.15.144:0/2376855346 >> 172.21.15.144:0/2376855346 conn(0x56548f9270a0 msgr2=0x56548f9294c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.452+0000 7f7e8403f980 1 -- 172.21.15.144:0/2376855346 shutdown_connections 2024-09-13T19:35:21.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.452+0000 7f7e8403f980 1 -- 172.21.15.144:0/2376855346 wait complete. 2024-09-13T19:35:21.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 Processor -- start 2024-09-13T19:35:21.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- start start 2024-09-13T19:35:21.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa19cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56548f7da200 con 0x56548f92b580 2024-09-13T19:35:21.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e81b4f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa19cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e81b4f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa19cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42786/0 (socket says 172.21.15.144:42786) 2024-09-13T19:35:21.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e81b4f640 1 -- 172.21.15.144:0/472794723 learned_addr learned my addr 172.21.15.144:0/472794723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e81b4f640 1 -- 172.21.15.144:0/472794723 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548fa1a280 con 0x56548f92b580 2024-09-13T19:35:21.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/472794723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa19cb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7e740ae040 tx=0x7f7e74003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164bcfe23d4b577f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7d6fe07640 1 -- 172.21.15.144:0/472794723 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e740b0040 con 0x56548f92b580 2024-09-13T19:35:21.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7d6fe07640 1 -- 172.21.15.144:0/472794723 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e740ab9b0 con 0x56548f92b580 2024-09-13T19:35:21.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7d6fe07640 1 -- 172.21.15.144:0/472794723 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e740abc90 con 0x56548f92b580 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- 172.21.15.144:0/472794723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 msgr2=0x56548fa19cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 --2- 172.21.15.144:0/472794723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa19cb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7e740ae040 tx=0x7f7e74003030 comp rx=0 tx=0).stop 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- 172.21.15.144:0/472794723 shutdown_connections 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 --2- 172.21.15.144:0/472794723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa19cb0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- 172.21.15.144:0/472794723 >> 172.21.15.144:0/472794723 conn(0x56548f9270a0 msgr2=0x56548fa114d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- 172.21.15.144:0/472794723 shutdown_connections 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- 172.21.15.144:0/472794723 wait complete. 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 Processor -- start 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- start start 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa20e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e8403f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56548f932b90 con 0x56548f92b580 2024-09-13T19:35:21.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e81b4f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa20e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e81b4f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa20e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42800/0 (socket says 172.21.15.144:42800) 2024-09-13T19:35:21.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.468+0000 7f7e81b4f640 1 -- 172.21.15.144:0/3062423301 learned_addr learned my addr 172.21.15.144:0/3062423301 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e81b4f640 1 -- 172.21.15.144:0/3062423301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548fa21390 con 0x56548f92b580 2024-09-13T19:35:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa20e50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7e740030b0 tx=0x7f7e74018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7d6e604640 1 -- 172.21.15.144:0/3062423301 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e740c5070 con 0x56548f92b580 2024-09-13T19:35:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56548fa21620 con 0x56548f92b580 2024-09-13T19:35:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56548fa24300 con 0x56548f92b580 2024-09-13T19:35:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7d6e604640 1 -- 172.21.15.144:0/3062423301 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e740b6970 con 0x56548f92b580 2024-09-13T19:35:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7d6e604640 1 -- 172.21.15.144:0/3062423301 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e740b0050 con 0x56548f92b580 2024-09-13T19:35:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7d6e604640 1 -- 172.21.15.144:0/3062423301 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7e740c8070 con 0x56548f92b580 2024-09-13T19:35:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7d6e604640 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d680346a0 0x7f7d68036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7d6e604640 1 -- 172.21.15.144:0/3062423301 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7e740bc070 con 0x56548f92b580 2024-09-13T19:35:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e8134e640 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d680346a0 0x7f7d68036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548f92bed0 0x56548fa27e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa28470 con 0x56548f92bed0 2024-09-13T19:35:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e82350640 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548f92bed0 0x56548fa27e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e8134e640 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d680346a0 0x7f7d68036b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c000f70 tx=0x7f7e6c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e82350640 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548f92bed0 0x56548fa27e00 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.472+0000 7f7e82350640 1 -- 172.21.15.144:0/3062423301 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e7c00a4d0 con 0x56548f92bed0 2024-09-13T19:35:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa25500 con 0x56548f92bed0 2024-09-13T19:35:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e82350640 1 -- 172.21.15.144:0/3062423301 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e7c00a4d0 con 0x56548f92bed0 2024-09-13T19:35:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa2a7a0 0x56548fa2cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa2d260 con 0x56548fa2a7a0 2024-09-13T19:35:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa2a7a0 0x56548fa2cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa2a7a0 0x56548fa2cb90 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e81b4f640 1 -- 172.21.15.144:0/3062423301 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e740c7030 con 0x56548fa2a7a0 2024-09-13T19:35:21.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa29640 con 0x56548f92bed0 2024-09-13T19:35:21.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e82350640 1 -- 172.21.15.144:0/3062423301 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e7c00a4d0 con 0x56548f92bed0 2024-09-13T19:35:21.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa29b20 con 0x56548f92bed0 2024-09-13T19:35:21.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e82350640 1 -- 172.21.15.144:0/3062423301 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e7c00a4d0 con 0x56548f92bed0 2024-09-13T19:35:21.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 Processor -- start 2024-09-13T19:35:21.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 -- start start 2024-09-13T19:35:21.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa3b940 0x56548fa3bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.476+0000 7f7e8403f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56548f833800 con 0x56548fa3b940 2024-09-13T19:35:21.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e82350640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa3b940 0x56548fa3bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e82350640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa3b940 0x56548fa3bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42806/0 (socket says 172.21.15.144:42806) 2024-09-13T19:35:21.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e82350640 1 -- 172.21.15.144:0/1681192494 learned_addr learned my addr 172.21.15.144:0/1681192494 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e82350640 1 -- 172.21.15.144:0/1681192494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548fa3c2a0 con 0x56548fa3b940 2024-09-13T19:35:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e82350640 1 --2- 172.21.15.144:0/1681192494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa3b940 0x56548fa3bd60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x56548fa28870 tx=0x7f7e7c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7d677fe640 1 -- 172.21.15.144:0/1681192494 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c014450 con 0x56548fa3b940 2024-09-13T19:35:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7d677fe640 1 -- 172.21.15.144:0/1681192494 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c0145f0 con 0x56548fa3b940 2024-09-13T19:35:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e8403f980 1 -- 172.21.15.144:0/1681192494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56548fa3c530 con 0x56548fa3b940 2024-09-13T19:35:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7d677fe640 1 -- 172.21.15.144:0/1681192494 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c014910 con 0x56548fa3b940 2024-09-13T19:35:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e8403f980 1 -- 172.21.15.144:0/1681192494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56548fa3f1b0 con 0x56548fa3b940 2024-09-13T19:35:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7d677fe640 1 -- 172.21.15.144:0/1681192494 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7e7c011040 con 0x56548fa3b940 2024-09-13T19:35:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7d677fe640 1 --2- 172.21.15.144:0/1681192494 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d5c034650 0x7f7d5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7d677fe640 1 -- 172.21.15.144:0/1681192494 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7e7c01e070 con 0x56548fa3b940 2024-09-13T19:35:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/1681192494 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d5c034650 0x7f7d5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e8403f980 1 Processor -- start 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e8403f980 1 -- start start 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/1681192494 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d5c034650 0x7f7d5c036b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x56548fa28910 tx=0x7f7e740b53d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e8403f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa4eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e8403f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56548fa1a540 con 0x56548fa194c0 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e82350640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa4eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e82350640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa4eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42818/0 (socket says 172.21.15.144:42818) 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.480+0000 7f7e82350640 1 -- 172.21.15.144:0/3269043403 learned_addr learned my addr 172.21.15.144:0/3269043403 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e82350640 1 -- 172.21.15.144:0/3269043403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548fa4f530 con 0x56548fa194c0 2024-09-13T19:35:21.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e82350640 1 --2- 172.21.15.144:0/3269043403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa4eff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c04a120 tx=0x7f7e7c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1d205625f96723 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7d657fa640 1 -- 172.21.15.144:0/3269043403 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c041070 con 0x56548fa194c0 2024-09-13T19:35:21.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7d657fa640 1 -- 172.21.15.144:0/3269043403 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c013c50 con 0x56548fa194c0 2024-09-13T19:35:21.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7d657fa640 1 -- 172.21.15.144:0/3269043403 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c028070 con 0x56548fa194c0 2024-09-13T19:35:21.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- 172.21.15.144:0/3269043403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 msgr2=0x56548fa4eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3269043403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa4eff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c04a120 tx=0x7f7e7c011f90 comp rx=0 tx=0).stop 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- 172.21.15.144:0/3269043403 shutdown_connections 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3269043403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa4eff0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- 172.21.15.144:0/3269043403 >> 172.21.15.144:0/3269043403 conn(0x56548fa17590 msgr2=0x56548fa156e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- 172.21.15.144:0/3269043403 shutdown_connections 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- 172.21.15.144:0/3269043403 wait complete. 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 Processor -- start 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- start start 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa53ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56548fa4f9a0 con 0x56548fa194c0 2024-09-13T19:35:21.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e82350640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa53ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e82350640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa53ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42826/0 (socket says 172.21.15.144:42826) 2024-09-13T19:35:21.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 learned_addr learned my addr 172.21.15.144:0/1034452135 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548fa540e0 con 0x56548fa194c0 2024-09-13T19:35:21.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e82350640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa53ba0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c011b50 tx=0x7f7e7c04a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7d537fe640 1 -- 172.21.15.144:0/1034452135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c041030 con 0x56548fa194c0 2024-09-13T19:35:21.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56548fa54370 con 0x56548fa194c0 2024-09-13T19:35:21.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7d537fe640 1 -- 172.21.15.144:0/1034452135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c013e00 con 0x56548fa194c0 2024-09-13T19:35:21.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7d537fe640 1 -- 172.21.15.144:0/1034452135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c022e40 con 0x56548fa194c0 2024-09-13T19:35:21.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.484+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56548fa57050 con 0x56548fa194c0 2024-09-13T19:35:21.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7d537fe640 1 -- 172.21.15.144:0/1034452135 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7e7c02b350 con 0x56548fa194c0 2024-09-13T19:35:21.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7d537fe640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d4c034650 0x7f7d4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7d537fe640 1 -- 172.21.15.144:0/1034452135 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7e7c042070 con 0x56548fa194c0 2024-09-13T19:35:21.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d4c034650 0x7f7d4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548fa5f270 0x56548fa61730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa61e80 con 0x56548fa5f270 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8134e640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548fa5f270 0x56548fa61730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d4c034650 0x7f7d4c036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7e740c9fd0 tx=0x7f7e740df000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8134e640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548fa5f270 0x56548fa61730 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6c00e5a0 con 0x56548fa5f270 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 realm 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa5e6c0 con 0x56548fa5f270 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6c00e5a0 con 0x56548fa5f270 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa62970 con 0x56548fa5f270 2024-09-13T19:35:21.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6c00e5a0 con 0x56548fa5f270 2024-09-13T19:35:21.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa63240 con 0x56548fa5f270 2024-09-13T19:35:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e6c00e5a0 con 0x56548fa5f270 2024-09-13T19:35:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa63c60 0x56548fa66050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa66790 con 0x56548fa63c60 2024-09-13T19:35:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.488+0000 7f7e82350640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa63c60 0x56548fa66050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e82350640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa63c60 0x56548fa66050 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e8403f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e8403f980 20 searching for the correct realm 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56548fa68670 0x56548fa6aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa68670 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56548fa68670 0x56548fa6aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56548fa68670 0x56548fa6aae0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e81b4f640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7e740ca060 0x7f7e740d6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x7f7e740ca060 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e8134e640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7e740ca060 0x7f7e740d6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e8134e640 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7e740ca060 0x7f7e740d6690 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c00e5a0 con 0x7f7e740ca060 2024-09-13T19:35:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa63c60 2024-09-13T19:35:21.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.492+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa5f270 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7e6c00e5a0 con 0x56548fa5f270 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa5f270 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa5f270 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa63c60 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x7f7e740ca060 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa68670 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa5f270 2024-09-13T19:35:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa63c60 2024-09-13T19:35:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa5f270 2024-09-13T19:35:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x7f7e740ca060 2024-09-13T19:35:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.496+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b1b0 con 0x56548fa68670 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa68670 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa63c60 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa68670 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa68670 2024-09-13T19:35:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa5f270 2024-09-13T19:35:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa5f270 2024-09-13T19:35:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa63c60 2024-09-13T19:35:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa68670 2024-09-13T19:35:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x7f7e740ca060 2024-09-13T19:35:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.500+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa5f270 2024-09-13T19:35:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa63c60 2024-09-13T19:35:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa68670 2024-09-13T19:35:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa63c60 2024-09-13T19:35:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x7f7e740ca060 2024-09-13T19:35:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa68670 2024-09-13T19:35:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa63c60 2024-09-13T19:35:21.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.504+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x56548fa5f270 2024-09-13T19:35:21.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7e740fd040 con 0x7f7e740ca060 2024-09-13T19:35:21.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa670e0 con 0x56548fa5f270 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa67980 con 0x56548fa5f270 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa66d20 con 0x56548fa5f270 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 zone default found 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 4 Realm: () 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 zonegroup default 2024-09-13T19:35:21.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6b630 con 0x56548fa63c60 2024-09-13T19:35:21.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6d410 con 0x56548fa68670 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6d8e0 con 0x56548fa68670 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 started sync module instance, tier type = 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.508+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6c850 con 0x7f7e740ca060 2024-09-13T19:35:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.512+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.512+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94921187315024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6c850 con 0x7f7e740ca060 2024-09-13T19:35:21.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.512+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6e3e0 con 0x56548fa5f270 2024-09-13T19:35:21.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.512+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94921187315024] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.512+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.512+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94921187319472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6c850 con 0x56548fa5f270 2024-09-13T19:35:21.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.512+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6edf0 con 0x56548fa68670 2024-09-13T19:35:21.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.516+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94921187319472] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.516+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.516+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94921187312544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6c7c0 con 0x56548fa68670 2024-09-13T19:35:21.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.516+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6fb40 con 0x7f7e740ca060 2024-09-13T19:35:21.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.516+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.516+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94921187325856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa70250 con 0x7f7e740ca060 2024-09-13T19:35:21.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.516+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa70d70 con 0x56548fa5f270 2024-09-13T19:35:21.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.516+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94921187312544] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.520+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94921187325856] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.520+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.520+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94921187330112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa70d30 con 0x56548fa5f270 2024-09-13T19:35:21.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.520+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa71160 con 0x56548fa63c60 2024-09-13T19:35:21.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.520+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94921187330112] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.520+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.520+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94921187327136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa71550 con 0x56548fa63c60 2024-09-13T19:35:21.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.520+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa71f10 con 0x56548fa63c60 2024-09-13T19:35:21.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.524+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.524+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94921187334752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa72330 con 0x56548fa63c60 2024-09-13T19:35:21.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.524+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94921187327136] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.524+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6f1e0 con 0x56548fa63c60 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94921187334752] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94921187338400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa72330 con 0x56548fa63c60 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 20 add_watcher() i=0 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 20 add_watcher() i=1 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 20 add_watcher() i=2 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 20 add_watcher() i=3 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 20 add_watcher() i=4 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 20 add_watcher() i=5 2024-09-13T19:35:21.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 20 add_watcher() i=6 2024-09-13T19:35:21.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94921187338400] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 20 add_watcher() i=7 2024-09-13T19:35:21.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:21.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa75dc0 con 0x56548fa5f270 2024-09-13T19:35:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.528+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94921187336224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa73240 con 0x56548fa5f270 2024-09-13T19:35:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94921187336224] v32'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7d337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:21.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 5 note: GC not initialized 2024-09-13T19:35:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7d327fc640 20 reqs_thread_entry: start 2024-09-13T19:35:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 20 Filter name: none 2024-09-13T19:35:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7ca3fff640 20 reqs_thread_entry: start 2024-09-13T19:35:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa993a0 con 0x56548fa63c60 2024-09-13T19:35:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:35:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:21.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.532+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa9f950 con 0x56548fa63c60 2024-09-13T19:35:21.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e8403f980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e8403f980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e8403f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:21.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94921187521472 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56548fa9b020 con 0x56548fa5f270 2024-09-13T19:35:21.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 94921187330112 notify 137438953500 ret 0) ==== 708+0+0 (crc 0 0 0) 0x56548f7b4ae0 con 0x56548fa5f270 2024-09-13T19:35:21.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7d657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94921187330112 notifier 4895 bl.length()=666 2024-09-13T19:35:21.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7d657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7d657fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 94921187521472 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7d657fa640 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7d44003eb0 con 0x56548fa5f270 2024-09-13T19:35:21.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== watch-notify(notify_complete (2) cookie 94921187521472 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7e6c02e980 con 0x56548fa5f270 2024-09-13T19:35:21.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.536+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.542 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:21.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.540+0000 7f7d337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.540+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94921187336224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa971a0 con 0x56548fa5f270 2024-09-13T19:35:21.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.540+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94921187336224] v32'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.540+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94921187315024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa971a0 con 0x7f7e740ca060 2024-09-13T19:35:21.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.540+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94921187315024] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.540+0000 7f7e8403f980 20 remove_watcher() i=0 2024-09-13T19:35:21.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.540+0000 7f7e8403f980 2 removed watcher, disabling cache 2024-09-13T19:35:21.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.540+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94921187319472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa971a0 con 0x56548fa5f270 2024-09-13T19:35:21.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.544+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94921187319472] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.544+0000 7f7e8403f980 20 remove_watcher() i=1 2024-09-13T19:35:21.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.544+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94921187312544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa971a0 con 0x56548fa68670 2024-09-13T19:35:21.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.544+0000 7f7e81b4f640 1 -- 172.21.15.144:0/1034452135 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94921187312544] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e740ee070 con 0x56548fa68670 2024-09-13T19:35:21.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.544+0000 7f7e8403f980 20 remove_watcher() i=2 2024-09-13T19:35:21.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.544+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94921187325856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6c3a0 con 0x7f7e740ca060 2024-09-13T19:35:21.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.548+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94921187325856] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x7f7e740ca060 2024-09-13T19:35:21.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.548+0000 7f7e8403f980 20 remove_watcher() i=3 2024-09-13T19:35:21.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.548+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94921187330112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa971a0 con 0x56548fa5f270 2024-09-13T19:35:21.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.548+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94921187330112] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6c029040 con 0x56548fa5f270 2024-09-13T19:35:21.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.548+0000 7f7e8403f980 20 remove_watcher() i=4 2024-09-13T19:35:21.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.548+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94921187327136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6c3a0 con 0x56548fa63c60 2024-09-13T19:35:21.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.552+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94921187327136] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.552+0000 7f7e8403f980 20 remove_watcher() i=5 2024-09-13T19:35:21.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.552+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94921187334752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa971a0 con 0x56548fa63c60 2024-09-13T19:35:21.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.552+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94921187334752] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.552+0000 7f7e8403f980 20 remove_watcher() i=6 2024-09-13T19:35:21.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.552+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94921187338400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56548fa6c3a0 con 0x56548fa63c60 2024-09-13T19:35:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e82350640 1 -- 172.21.15.144:0/1034452135 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94921187338400] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c02a070 con 0x56548fa63c60 2024-09-13T19:35:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 20 remove_watcher() i=7 2024-09-13T19:35:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa63c60 msgr2=0x56548fa66050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa63c60 0x56548fa66050 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548fa5f270 msgr2=0x56548fa61730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548fa5f270 0x56548fa61730 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7e740ca060 msgr2=0x7f7e740d6690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f7e740ca060 0x7f7e740d6690 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56548fa68670 msgr2=0x56548fa6aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x56548fa68670 0x56548fa6aae0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d4c034650 msgr2=0x7f7d4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d4c034650 0x7f7d4c036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7e740c9fd0 tx=0x7f7e740df000 comp rx=0 tx=0).stop 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 msgr2=0x56548fa53ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8134e640 1 -- 172.21.15.144:0/1034452135 reap_dead start 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa53ba0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c011b50 tx=0x7f7e7c04a0b0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 shutdown_connections 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1034452135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa194c0 0x56548fa53ba0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 >> 172.21.15.144:0/1034452135 conn(0x56548fa17590 msgr2=0x56548fa156b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 shutdown_connections 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1034452135 wait complete. 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1681192494 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d5c034650 msgr2=0x7f7d5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1681192494 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d5c034650 0x7f7d5c036b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x56548fa28910 tx=0x7f7e740b53d0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1681192494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa3b940 msgr2=0x56548fa3bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1681192494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa3b940 0x56548fa3bd60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x56548fa28870 tx=0x7f7e7c018830 comp rx=0 tx=0).stop 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1681192494 shutdown_connections 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1681192494 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d5c034650 0x7f7d5c036b10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/1681192494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548fa3b940 0x56548fa3bd60 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1681192494 >> 172.21.15.144:0/1681192494 conn(0x56548fa30a90 msgr2=0x56548fa33510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1681192494 shutdown_connections 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/1681192494 wait complete. 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa2a7a0 msgr2=0x56548fa2cb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa2a7a0 0x56548fa2cb90 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548f92bed0 msgr2=0x56548fa27e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548f92bed0 0x56548fa27e00 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d680346a0 msgr2=0x7f7d68036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d680346a0 0x7f7d68036b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c000f70 tx=0x7f7e6c0012c0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 msgr2=0x56548fa20e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa20e50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7e740030b0 tx=0x7f7e74018020 comp rx=0 tx=0).stop 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 shutdown_connections 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x56548f92bed0 0x56548fa27e00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x56548fa2a7a0 0x56548fa2cb90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f7d680346a0 0x7f7d68036b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 --2- 172.21.15.144:0/3062423301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56548f92b580 0x56548fa20e50 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 >> 172.21.15.144:0/3062423301 conn(0x56548f9270a0 msgr2=0x56548fa10050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 shutdown_connections 2024-09-13T19:35:21.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.556+0000 7f7e8403f980 1 -- 172.21.15.144:0/3062423301 wait complete. 2024-09-13T19:35:21.572 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.572 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.572 ERROR:root:0 2024-09-13T19:35:21.572 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:21.585 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000002a33c658b1774daa-0066e493f9-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:35:21.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:35:21.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:35:21.585 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-13T19:35:21.651 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:21.651 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:21.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf3c4a8980 1 Processor -- start 2024-09-13T19:35:21.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf3c4a8980 1 -- start start 2024-09-13T19:35:21.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf3c4a8980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55ef03626b10 0x55ef036b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf3c4a8980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef0353aae0 con 0x55ef036b3670 2024-09-13T19:35:21.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf3c4a8980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55ef0355ee30 con 0x55ef03626b10 2024-09-13T19:35:21.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf39fb8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55ef03626b10 0x55ef036b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf397b7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55ef036b3670 0x55ef036b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49464/0 (socket says 172.21.15.144:49464) 2024-09-13T19:35:21.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf397b7640 1 -- 172.21.15.144:0/714699206 learned_addr learned my addr 172.21.15.144:0/714699206 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:21.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf39fb8640 1 -- 172.21.15.144:0/714699206 >> v1:172.21.15.18:6789/0 conn(0x55ef036b3670 legacy=0x55ef036b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.648+0000 7fcf39fb8640 1 -- 172.21.15.144:0/714699206 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef036b71b0 con 0x55ef03626b10 2024-09-13T19:35:21.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/714699206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef036b3130 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00a480 tx=0x7fcf2c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4b07d208b48c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf38fb6640 1 -- 172.21.15.144:0/714699206 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf2c0af070 con 0x55ef03626b10 2024-09-13T19:35:21.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf38fb6640 1 -- 172.21.15.144:0/714699206 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0a3e50 con 0x55ef03626b10 2024-09-13T19:35:21.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf38fb6640 1 -- 172.21.15.144:0/714699206 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf2c0aa680 con 0x55ef03626b10 2024-09-13T19:35:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/714699206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 msgr2=0x55ef036b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/714699206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef036b3130 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00a480 tx=0x7fcf2c01b280 comp rx=0 tx=0).stop 2024-09-13T19:35:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/714699206 shutdown_connections 2024-09-13T19:35:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/714699206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef036b3130 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/714699206 >> 172.21.15.144:0/714699206 conn(0x55ef036ad070 msgr2=0x55ef036af490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/714699206 shutdown_connections 2024-09-13T19:35:21.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.652+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/714699206 wait complete. 2024-09-13T19:35:21.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf3c4a8980 1 Processor -- start 2024-09-13T19:35:21.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf3c4a8980 1 -- start start 2024-09-13T19:35:21.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf3c4a8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf3c4a8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ef03560200 con 0x55ef03626b10 2024-09-13T19:35:21.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf39fb8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf39fb8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037a4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42832/0 (socket says 172.21.15.144:42832) 2024-09-13T19:35:21.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf39fb8640 1 -- 172.21.15.144:0/2145970180 learned_addr learned my addr 172.21.15.144:0/2145970180 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf39fb8640 1 -- 172.21.15.144:0/2145970180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef037a4b10 con 0x55ef03626b10 2024-09-13T19:35:21.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/2145970180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037a4540 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0ad040 tx=0x7fcf2c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b15ec6c6c543713 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fce27e07640 1 -- 172.21.15.144:0/2145970180 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf2c0af040 con 0x55ef03626b10 2024-09-13T19:35:21.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fce27e07640 1 -- 172.21.15.144:0/2145970180 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0aa870 con 0x55ef03626b10 2024-09-13T19:35:21.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.668+0000 7fce27e07640 1 -- 172.21.15.144:0/2145970180 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf2c0aab90 con 0x55ef03626b10 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/2145970180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 msgr2=0x55ef037a4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/2145970180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037a4540 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0ad040 tx=0x7fcf2c003030 comp rx=0 tx=0).stop 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/2145970180 shutdown_connections 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/2145970180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037a4540 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/2145970180 >> 172.21.15.144:0/2145970180 conn(0x55ef036ad070 msgr2=0x55ef037a0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/2145970180 shutdown_connections 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/2145970180 wait complete. 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 Processor -- start 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- start start 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ef036c2a10 con 0x55ef03626b10 2024-09-13T19:35:21.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf39fb8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf39fb8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037ab790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42846/0 (socket says 172.21.15.144:42846) 2024-09-13T19:35:21.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1650604920 learned_addr learned my addr 172.21.15.144:0/1650604920 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1650604920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef037abcd0 con 0x55ef03626b10 2024-09-13T19:35:21.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037ab790 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c019930 tx=0x7fcf2c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fce26604640 1 -- 172.21.15.144:0/1650604920 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf2c0c2070 con 0x55ef03626b10 2024-09-13T19:35:21.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fce26604640 1 -- 172.21.15.144:0/1650604920 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0b58f0 con 0x55ef03626b10 2024-09-13T19:35:21.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef037abf60 con 0x55ef03626b10 2024-09-13T19:35:21.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fce26604640 1 -- 172.21.15.144:0/1650604920 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf2c0af050 con 0x55ef03626b10 2024-09-13T19:35:21.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.672+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef037aec40 con 0x55ef03626b10 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fce26604640 1 -- 172.21.15.144:0/1650604920 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf2c0c5070 con 0x55ef03626b10 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fce26604640 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce20034650 0x7fce20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fce26604640 1 -- 172.21.15.144:0/1650604920 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fcf2c0ba070 con 0x55ef03626b10 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef036b3670 0x55ef037b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf397b7640 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce20034650 0x7fce20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037b2d70 con 0x55ef036b3670 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3a7b9640 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef036b3670 0x55ef037b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf397b7640 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce20034650 0x7fce20036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf300012f0 tx=0x7fcf30006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3a7b9640 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef036b3670 0x55ef037b2720 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1650604920 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf340083f0 con 0x55ef036b3670 2024-09-13T19:35:21.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037afe40 con 0x55ef036b3670 2024-09-13T19:35:21.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1650604920 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf340083f0 con 0x55ef036b3670 2024-09-13T19:35:21.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037b50d0 0x55ef037b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037b7b90 con 0x55ef037b50d0 2024-09-13T19:35:21.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037b50d0 0x55ef037b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037b50d0 0x55ef037b74c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.676+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1650604920 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037b50d0 2024-09-13T19:35:21.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037b3f70 con 0x55ef036b3670 2024-09-13T19:35:21.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1650604920 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf340083f0 con 0x55ef036b3670 2024-09-13T19:35:21.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037b4450 con 0x55ef036b3670 2024-09-13T19:35:21.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1650604920 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf340083f0 con 0x55ef036b3670 2024-09-13T19:35:21.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3c4a8980 1 Processor -- start 2024-09-13T19:35:21.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3c4a8980 1 -- start start 2024-09-13T19:35:21.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3c4a8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037c62d0 0x55ef037c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3c4a8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ef035b9800 con 0x55ef037c62d0 2024-09-13T19:35:21.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3a7b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037c62d0 0x55ef037c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3a7b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037c62d0 0x55ef037c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42860/0 (socket says 172.21.15.144:42860) 2024-09-13T19:35:21.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/127189482 learned_addr learned my addr 172.21.15.144:0/127189482 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/127189482 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef037c6c30 con 0x55ef037c62d0 2024-09-13T19:35:21.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3a7b9640 1 --2- 172.21.15.144:0/127189482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037c62d0 0x55ef037c66f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x55ef037ac690 tx=0x7fcf3400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fce1f7fe640 1 -- 172.21.15.144:0/127189482 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf34007d70 con 0x55ef037c62d0 2024-09-13T19:35:21.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fce1f7fe640 1 -- 172.21.15.144:0/127189482 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3401e020 con 0x55ef037c62d0 2024-09-13T19:35:21.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/127189482 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef037c6ec0 con 0x55ef037c62d0 2024-09-13T19:35:21.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fce1f7fe640 1 -- 172.21.15.144:0/127189482 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf34019590 con 0x55ef037c62d0 2024-09-13T19:35:21.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.680+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/127189482 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef037c9b40 con 0x55ef037c62d0 2024-09-13T19:35:21.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fce1f7fe640 1 -- 172.21.15.144:0/127189482 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf34016040 con 0x55ef037c62d0 2024-09-13T19:35:21.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fce1f7fe640 1 --2- 172.21.15.144:0/127189482 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce140346a0 0x7fce14036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fce1f7fe640 1 -- 172.21.15.144:0/127189482 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fcf3401f030 con 0x55ef037c62d0 2024-09-13T19:35:21.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/127189482 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce140346a0 0x7fce14036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 Processor -- start 2024-09-13T19:35:21.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- start start 2024-09-13T19:35:21.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/127189482 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce140346a0 0x7fce14036b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55ef037b3240 tx=0x7fcf2c0e2a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ef037a4dd0 con 0x55ef037d2d10 2024-09-13T19:35:21.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3a7b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3a7b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42864/0 (socket says 172.21.15.144:42864) 2024-09-13T19:35:21.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/234745991 learned_addr learned my addr 172.21.15.144:0/234745991 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/234745991 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef037d36e0 con 0x55ef037d2d10 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3a7b9640 1 --2- 172.21.15.144:0/234745991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037d3110 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcf3404a2a0 tx=0x7fcf340236e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732b80da0d848b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fce1d7fa640 1 -- 172.21.15.144:0/234745991 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3401d040 con 0x55ef037d2d10 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fce1d7fa640 1 -- 172.21.15.144:0/234745991 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3403abc0 con 0x55ef037d2d10 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fce1d7fa640 1 -- 172.21.15.144:0/234745991 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf34019730 con 0x55ef037d2d10 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/234745991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 msgr2=0x55ef037d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/234745991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037d3110 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcf3404a2a0 tx=0x7fcf340236e0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/234745991 shutdown_connections 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/234745991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037d3110 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/234745991 >> 172.21.15.144:0/234745991 conn(0x55ef037cf140 msgr2=0x55ef037cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/234745991 shutdown_connections 2024-09-13T19:35:21.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/234745991 wait complete. 2024-09-13T19:35:21.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 Processor -- start 2024-09-13T19:35:21.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- start start 2024-09-13T19:35:21.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037da170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3c4a8980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ef037d3d30 con 0x55ef037d2d10 2024-09-13T19:35:21.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3a7b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037da170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3a7b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037da170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42866/0 (socket says 172.21.15.144:42866) 2024-09-13T19:35:21.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.684+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 learned_addr learned my addr 172.21.15.144:0/1352733105 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef037da6b0 con 0x55ef037d2d10 2024-09-13T19:35:21.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3a7b9640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037da170 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcf3403d010 tx=0x7fcf3404a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fce0b7fe640 1 -- 172.21.15.144:0/1352733105 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3401d070 con 0x55ef037d2d10 2024-09-13T19:35:21.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef037da940 con 0x55ef037d2d10 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fce0b7fe640 1 -- 172.21.15.144:0/1352733105 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf34033070 con 0x55ef037d2d10 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fce0b7fe640 1 -- 172.21.15.144:0/1352733105 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf340223c0 con 0x55ef037d2d10 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef037dd620 con 0x55ef037d2d10 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fce0b7fe640 1 -- 172.21.15.144:0/1352733105 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf34022560 con 0x55ef037d2d10 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fce0b7fe640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce04034650 0x7fce04036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fce0b7fe640 1 -- 172.21.15.144:0/1352733105 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fcf3402f090 con 0x55ef037d2d10 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce04034650 0x7fce04036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef037e5610 0x55ef037e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037e8200 con 0x55ef037e5610 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf397b7640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef037e5610 0x55ef037e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce04034650 0x7fce04036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c008380 tx=0x7fcf2c0e0000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf397b7640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef037e5610 0x55ef037e7ab0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 20 realm 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037e4ae0 con 0x55ef037e5610 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037e8d00 con 0x55ef037e5610 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.688+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037e95d0 con 0x55ef037e5610 2024-09-13T19:35:21.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3c4a8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037e9ec0 0x55ef037ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037eca60 con 0x55ef037e9ec0 2024-09-13T19:35:21.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3a7b9640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037e9ec0 0x55ef037ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3a7b9640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037e9ec0 0x55ef037ec2d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3c4a8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3c4a8980 20 searching for the correct realm 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ef037ee9b0 0x55ef037f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ef037ee9b0 0x55ef037f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ef037ee9b0 0x55ef037f0de0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf39fb8640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf2c0f2040 0x7fcf2c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x7fcf2c0f2040 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf397b7640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf2c0f2040 0x7fcf2c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf397b7640 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf2c0f2040 0x7fcf2c0b3370 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.692+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e9ec0 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e9ec0 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x7fcf2c0f2040 2024-09-13T19:35:21.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e9ec0 2024-09-13T19:35:21.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x7fcf2c0f2040 2024-09-13T19:35:21.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.696+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e9ec0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e9ec0 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x7fcf2c0f2040 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.700+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e9ec0 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e9ec0 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x7fcf2c0f2040 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037ee9b0 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e9ec0 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x55ef037e5610 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f14b0 con 0x7fcf2c0f2040 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037ed420 con 0x55ef037e5610 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037edcc0 con 0x55ef037e5610 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037ed060 con 0x55ef037e5610 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 zone default found 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 4 Realm: () 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 zonegroup default 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.704+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f1930 con 0x55ef037e9ec0 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f3c00 con 0x55ef037ee9b0 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f3fa0 con 0x55ef037ee9b0 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 20 started sync module instance, tier type = 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f3090 con 0x7fcf2c0f2040 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94485044213184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f3090 con 0x7fcf2c0f2040 2024-09-13T19:35:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f49b0 con 0x55ef037e5610 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.708+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94485044213184] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94485044217360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f3090 con 0x55ef037e5610 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f53f0 con 0x55ef037ee9b0 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94485044217360] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94485044210656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f5790 con 0x55ef037ee9b0 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f6150 con 0x7fcf2c0f2040 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94485044223408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f67e0 con 0x7fcf2c0f2040 2024-09-13T19:35:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.712+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f7300 con 0x55ef037e5610 2024-09-13T19:35:21.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.716+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94485044210656] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.716+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94485044223408] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.716+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.716+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94485044227536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f72c0 con 0x55ef037e5610 2024-09-13T19:35:21.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.716+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f76f0 con 0x55ef037e9ec0 2024-09-13T19:35:21.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.716+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94485044227536] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.720+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.720+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94485044219712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f76f0 con 0x55ef037e9ec0 2024-09-13T19:35:21.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.720+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f8100 con 0x55ef037e9ec0 2024-09-13T19:35:21.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.720+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.720+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94485044231248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f8520 con 0x55ef037e9ec0 2024-09-13T19:35:21.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.720+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f8ff0 con 0x55ef037e9ec0 2024-09-13T19:35:21.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.720+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94485044219712] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94485044231248] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94485044234976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f8070 con 0x55ef037e9ec0 2024-09-13T19:35:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 20 add_watcher() i=0 2024-09-13T19:35:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 20 add_watcher() i=1 2024-09-13T19:35:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 20 add_watcher() i=2 2024-09-13T19:35:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 20 add_watcher() i=3 2024-09-13T19:35:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 20 add_watcher() i=4 2024-09-13T19:35:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 20 add_watcher() i=5 2024-09-13T19:35:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 20 add_watcher() i=6 2024-09-13T19:35:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94485044234976] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 20 add_watcher() i=7 2024-09-13T19:35:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f8070 con 0x55ef037e5610 2024-09-13T19:35:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.724+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94485044224560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f8070 con 0x55ef037e5610 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94485044224560] v32'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcdeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 5 note: GC not initialized 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcdea7fc640 20 reqs_thread_entry: start 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 20 Filter name: none 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcd5bfff640 20 reqs_thread_entry: start 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef0381f590 con 0x55ef037e9ec0 2024-09-13T19:35:21.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:35:21.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:21.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:21.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.728+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef03825ee0 con 0x55ef037e9ec0 2024-09-13T19:35:21.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf3c4a8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf3c4a8980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf3c4a8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:21.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94485044418896 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef038215d0 con 0x55ef037e5610 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 94485044227536 notify 137438953501 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fcf3001b040 con 0x55ef037e5610 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fce1d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94485044227536 notifier 4902 bl.length()=636 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fce1d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fce1d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 94485044418896 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fce1d7fa640 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcdfc003eb0 con 0x55ef037e5610 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 94485044418896 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef0353aae0 con 0x55ef037e5610 2024-09-13T19:35:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:21.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcdeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.732+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94485044224560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0381d3c0 con 0x55ef037e5610 2024-09-13T19:35:21.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94485044224560] v32'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94485044213184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0381d3c0 con 0x7fcf2c0f2040 2024-09-13T19:35:21.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94485044213184] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf3c4a8980 20 remove_watcher() i=0 2024-09-13T19:35:21.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf3c4a8980 2 removed watcher, disabling cache 2024-09-13T19:35:21.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94485044217360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0381d3c0 con 0x55ef037e5610 2024-09-13T19:35:21.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94485044217360] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf3c4a8980 20 remove_watcher() i=1 2024-09-13T19:35:21.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.736+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94485044210656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0381d3c0 con 0x55ef037ee9b0 2024-09-13T19:35:21.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.740+0000 7fcf39fb8640 1 -- 172.21.15.144:0/1352733105 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94485044210656] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2c0ce070 con 0x55ef037ee9b0 2024-09-13T19:35:21.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.740+0000 7fcf3c4a8980 20 remove_watcher() i=2 2024-09-13T19:35:21.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.740+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94485044223408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f4610 con 0x7fcf2c0f2040 2024-09-13T19:35:21.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.740+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94485044223408] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x7fcf2c0f2040 2024-09-13T19:35:21.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.740+0000 7fcf3c4a8980 20 remove_watcher() i=3 2024-09-13T19:35:21.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.740+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94485044227536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f2be0 con 0x55ef037e5610 2024-09-13T19:35:21.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.744+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94485044227536] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3000f070 con 0x55ef037e5610 2024-09-13T19:35:21.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.744+0000 7fcf3c4a8980 20 remove_watcher() i=4 2024-09-13T19:35:21.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.744+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94485044219712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f5db0 con 0x55ef037e9ec0 2024-09-13T19:35:21.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.744+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94485044219712] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.744+0000 7fcf3c4a8980 20 remove_watcher() i=5 2024-09-13T19:35:21.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.744+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94485044231248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f4610 con 0x55ef037e9ec0 2024-09-13T19:35:21.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94485044231248] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 20 remove_watcher() i=6 2024-09-13T19:35:21.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94485044234976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef037f5db0 con 0x55ef037e9ec0 2024-09-13T19:35:21.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3a7b9640 1 -- 172.21.15.144:0/1352733105 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94485044234976] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34052070 con 0x55ef037e9ec0 2024-09-13T19:35:21.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 20 remove_watcher() i=7 2024-09-13T19:35:21.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037e9ec0 msgr2=0x55ef037ec2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037e9ec0 0x55ef037ec2d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef037e5610 msgr2=0x55ef037e7ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef037e5610 0x55ef037e7ab0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf2c0f2040 msgr2=0x7fcf2c0b3370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fcf2c0f2040 0x7fcf2c0b3370 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ef037ee9b0 msgr2=0x55ef037f0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55ef037ee9b0 0x55ef037f0de0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce04034650 msgr2=0x7fce04036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce04034650 0x7fce04036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c008380 tx=0x7fcf2c0e0000 comp rx=0 tx=0).stop 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 msgr2=0x55ef037da170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf397b7640 1 -- 172.21.15.144:0/1352733105 reap_dead start 2024-09-13T19:35:21.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037da170 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcf3403d010 tx=0x7fcf3404a200 comp rx=0 tx=0).stop 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 shutdown_connections 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1352733105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037d2d10 0x55ef037da170 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 >> 172.21.15.144:0/1352733105 conn(0x55ef037cf140 msgr2=0x55ef037cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 shutdown_connections 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1352733105 wait complete. 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/127189482 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce140346a0 msgr2=0x7fce14036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/127189482 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce140346a0 0x7fce14036b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55ef037b3240 tx=0x7fcf2c0e2a60 comp rx=0 tx=0).stop 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/127189482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037c62d0 msgr2=0x55ef037c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/127189482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037c62d0 0x55ef037c66f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x55ef037ac690 tx=0x7fcf3400af40 comp rx=0 tx=0).stop 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/127189482 shutdown_connections 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/127189482 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce140346a0 0x7fce14036b60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/127189482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef037c62d0 0x55ef037c66f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/127189482 >> 172.21.15.144:0/127189482 conn(0x55ef037bb420 msgr2=0x55ef037bdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/127189482 shutdown_connections 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/127189482 wait complete. 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037b50d0 msgr2=0x55ef037b74c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037b50d0 0x55ef037b74c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef036b3670 msgr2=0x55ef037b2720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef036b3670 0x55ef037b2720 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce20034650 msgr2=0x7fce20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce20034650 0x7fce20036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf300012f0 tx=0x7fcf30006700 comp rx=0 tx=0).stop 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 msgr2=0x55ef037ab790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.748+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037ab790 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c019930 tx=0x7fcf2c018020 comp rx=0 tx=0).stop 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.752+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 shutdown_connections 2024-09-13T19:35:21.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.752+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55ef036b3670 0x55ef037b2720 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.752+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55ef037b50d0 0x55ef037b74c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.752+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fce20034650 0x7fce20036b10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.752+0000 7fcf3c4a8980 1 --2- 172.21.15.144:0/1650604920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef03626b10 0x55ef037ab790 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.752+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 >> 172.21.15.144:0/1650604920 conn(0x55ef036ad070 msgr2=0x55ef0379ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.752+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 shutdown_connections 2024-09-13T19:35:21.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.752+0000 7fcf3c4a8980 1 -- 172.21.15.144:0/1650604920 wait complete. 2024-09-13T19:35:21.765 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.766 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.766 ERROR:root:0 2024-09-13T19:35:21.766 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:35:21.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:35:21.766 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:35:21.837 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:21.837 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:21.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.832+0000 7f8283e9a980 1 Processor -- start 2024-09-13T19:35:21.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.832+0000 7f8283e9a980 1 -- start start 2024-09-13T19:35:21.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.832+0000 7f8283e9a980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b84e0e3a60 0x55b84e0e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.832+0000 7f8283e9a980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b84df67ae0 con 0x55b84e053b10 2024-09-13T19:35:21.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.832+0000 7f8283e9a980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55b84df8be30 con 0x55b84e0e3a60 2024-09-13T19:35:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82811a9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b84e0e3a60 0x55b84e0e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82811a9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55b84e0e3a60 0x55b84e0e5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42870/0 (socket says 172.21.15.144:42870) 2024-09-13T19:35:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82811a9640 1 -- 172.21.15.144:0/1383595261 learned_addr learned my addr 172.21.15.144:0/1383595261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82819aa640 1 --1- 172.21.15.144:0/1383595261 >> v1:172.21.15.18:6789/0 conn(0x55b84e053b10 0x55b84e0e2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49468/0 (socket says 172.21.15.144:49468) 2024-09-13T19:35:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82809a8640 1 -- 172.21.15.144:0/1383595261 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214825389 0 0) 0x55b84df67ae0 con 0x55b84e053b10 2024-09-13T19:35:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82809a8640 1 -- 172.21.15.144:0/1383595261 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f826c001e20 con 0x55b84e053b10 2024-09-13T19:35:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82811a9640 1 -- 172.21.15.144:0/1383595261 >> v1:172.21.15.18:6789/0 conn(0x55b84e053b10 legacy=0x55b84e0e2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82811a9640 1 -- 172.21.15.144:0/1383595261 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84e0e73a0 con 0x55b84e0e3a60 2024-09-13T19:35:21.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82811a9640 1 --2- 172.21.15.144:0/1383595261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e0e3a60 0x55b84e0e5e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f827800a5c0 tx=0x7f827801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaed51645943b7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82809a8640 1 -- 172.21.15.144:0/1383595261 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82780a6070 con 0x55b84e0e3a60 2024-09-13T19:35:21.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82809a8640 1 -- 172.21.15.144:0/1383595261 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82780af070 con 0x55b84e0e3a60 2024-09-13T19:35:21.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.836+0000 7f82809a8640 1 -- 172.21.15.144:0/1383595261 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82780aa5c0 con 0x55b84e0e3a60 2024-09-13T19:35:21.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.840+0000 7f8283e9a980 1 -- 172.21.15.144:0/1383595261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e0e3a60 msgr2=0x55b84e0e5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.840+0000 7f8283e9a980 1 --2- 172.21.15.144:0/1383595261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e0e3a60 0x55b84e0e5e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f827800a5c0 tx=0x7f827801b340 comp rx=0 tx=0).stop 2024-09-13T19:35:21.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.840+0000 7f8283e9a980 1 -- 172.21.15.144:0/1383595261 shutdown_connections 2024-09-13T19:35:21.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.840+0000 7f8283e9a980 1 --2- 172.21.15.144:0/1383595261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e0e3a60 0x55b84e0e5e50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.840+0000 7f8283e9a980 1 -- 172.21.15.144:0/1383595261 >> 172.21.15.144:0/1383595261 conn(0x55b84e0da070 msgr2=0x55b84e0dc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.840+0000 7f8283e9a980 1 -- 172.21.15.144:0/1383595261 shutdown_connections 2024-09-13T19:35:21.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.840+0000 7f8283e9a980 1 -- 172.21.15.144:0/1383595261 wait complete. 2024-09-13T19:35:21.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f8283e9a980 1 Processor -- start 2024-09-13T19:35:21.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f8283e9a980 1 -- start start 2024-09-13T19:35:21.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f8283e9a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e1ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f8283e9a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b84df8d200 con 0x55b84e053b10 2024-09-13T19:35:21.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f82819aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e1ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f82819aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e1ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42872/0 (socket says 172.21.15.144:42872) 2024-09-13T19:35:21.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f82819aa640 1 -- 172.21.15.144:0/3524764259 learned_addr learned my addr 172.21.15.144:0/3524764259 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f82819aa640 1 -- 172.21.15.144:0/3524764259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84e1caec0 con 0x55b84e053b10 2024-09-13T19:35:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f82819aa640 1 --2- 172.21.15.144:0/3524764259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e1ca8f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fb0 tx=0x7f827c001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9202bcef9d48b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f816fe07640 1 -- 172.21.15.144:0/3524764259 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827c013420 con 0x55b84e053b10 2024-09-13T19:35:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f816fe07640 1 -- 172.21.15.144:0/3524764259 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c0135e0 con 0x55b84e053b10 2024-09-13T19:35:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f816fe07640 1 -- 172.21.15.144:0/3524764259 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827c013940 con 0x55b84e053b10 2024-09-13T19:35:21.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f8283e9a980 1 -- 172.21.15.144:0/3524764259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 msgr2=0x55b84e1ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.852+0000 7f8283e9a980 1 --2- 172.21.15.144:0/3524764259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e1ca8f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fb0 tx=0x7f827c001af0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 -- 172.21.15.144:0/3524764259 shutdown_connections 2024-09-13T19:35:21.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 --2- 172.21.15.144:0/3524764259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e1ca8f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 -- 172.21.15.144:0/3524764259 >> 172.21.15.144:0/3524764259 conn(0x55b84e0da070 msgr2=0x55b84e1c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 -- 172.21.15.144:0/3524764259 shutdown_connections 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 -- 172.21.15.144:0/3524764259 wait complete. 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 Processor -- start 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 -- start start 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e0dfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b84e0e6e40 con 0x55b84e053b10 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f82819aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e0dfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f82819aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e0dfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42882/0 (socket says 172.21.15.144:42882) 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f82819aa640 1 -- 172.21.15.144:0/583200730 learned_addr learned my addr 172.21.15.144:0/583200730 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f82819aa640 1 -- 172.21.15.144:0/583200730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84e0de360 con 0x55b84e053b10 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f82819aa640 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e0dfc40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f827c002260 tx=0x7f827c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f816e604640 1 -- 172.21.15.144:0/583200730 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827c022020 con 0x55b84e053b10 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b84e0de5f0 con 0x55b84e053b10 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f816e604640 1 -- 172.21.15.144:0/583200730 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c019040 con 0x55b84e053b10 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f816e604640 1 -- 172.21.15.144:0/583200730 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827c004a50 con 0x55b84e053b10 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84e0deae0 con 0x55b84e053b10 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f816e604640 1 -- 172.21.15.144:0/583200730 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f827c025020 con 0x55b84e053b10 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f816e604640 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8168034650 0x7f8168036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f816e604640 1 -- 172.21.15.144:0/583200730 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f827c0498e0 con 0x55b84e053b10 2024-09-13T19:35:21.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.856+0000 7f82811a9640 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8168034650 0x7f8168036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e0e3a60 0x55b84e1db120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e1db660 con 0x55b84e0e3a60 2024-09-13T19:35:21.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82821ab640 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e0e3a60 0x55b84e1db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82811a9640 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8168034650 0x7f8168036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f82780ae000 tx=0x7f82780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82821ab640 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e0e3a60 0x55b84e1db120 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82821ab640 1 -- 172.21.15.144:0/583200730 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82740083f0 con 0x55b84e0e3a60 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e1dba60 con 0x55b84e0e3a60 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82821ab640 1 -- 172.21.15.144:0/583200730 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f82740083f0 con 0x55b84e0e3a60 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e1dd870 0x55b84e1dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e1e0350 con 0x55b84e1dd870 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82819aa640 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e1dd870 0x55b84e1dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82819aa640 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e1dd870 0x55b84e1dfc60 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82819aa640 1 -- 172.21.15.144:0/583200730 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e1dd870 2024-09-13T19:35:21.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e1dc710 con 0x55b84e0e3a60 2024-09-13T19:35:21.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82821ab640 1 -- 172.21.15.144:0/583200730 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f82740083f0 con 0x55b84e0e3a60 2024-09-13T19:35:21.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e1dcbf0 con 0x55b84e0e3a60 2024-09-13T19:35:21.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.860+0000 7f82821ab640 1 -- 172.21.15.144:0/583200730 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f82740083f0 con 0x55b84e0e3a60 2024-09-13T19:35:21.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f8283e9a980 1 Processor -- start 2024-09-13T19:35:21.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f8283e9a980 1 -- start start 2024-09-13T19:35:21.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f8283e9a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1eea70 0x55b84e1eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f8283e9a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b84dfe6800 con 0x55b84e1eea70 2024-09-13T19:35:21.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f82821ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1eea70 0x55b84e1eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f82821ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1eea70 0x55b84e1eee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42894/0 (socket says 172.21.15.144:42894) 2024-09-13T19:35:21.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f82821ab640 1 -- 172.21.15.144:0/1590046840 learned_addr learned my addr 172.21.15.144:0/1590046840 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f82821ab640 1 -- 172.21.15.144:0/1590046840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84e1ef3d0 con 0x55b84e1eea70 2024-09-13T19:35:21.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f82821ab640 1 --2- 172.21.15.144:0/1590046840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1eea70 0x55b84e1eee90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55b84e0df9b0 tx=0x7f827400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f81677fe640 1 -- 172.21.15.144:0/1590046840 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274007dd0 con 0x55b84e1eea70 2024-09-13T19:35:21.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f81677fe640 1 -- 172.21.15.144:0/1590046840 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827401e020 con 0x55b84e1eea70 2024-09-13T19:35:21.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f81677fe640 1 -- 172.21.15.144:0/1590046840 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274019590 con 0x55b84e1eea70 2024-09-13T19:35:21.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f8283e9a980 1 -- 172.21.15.144:0/1590046840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b84e1ef660 con 0x55b84e1eea70 2024-09-13T19:35:21.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f8283e9a980 1 -- 172.21.15.144:0/1590046840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84e1f22e0 con 0x55b84e1eea70 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f81677fe640 1 -- 172.21.15.144:0/1590046840 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8274016040 con 0x55b84e1eea70 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f81677fe640 1 --2- 172.21.15.144:0/1590046840 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f815c034650 0x7f815c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f81677fe640 1 -- 172.21.15.144:0/1590046840 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f827401f030 con 0x55b84e1eea70 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f82819aa640 1 --2- 172.21.15.144:0/1590046840 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f815c034650 0x7f815c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f8283e9a980 1 Processor -- start 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.864+0000 7f8283e9a980 1 -- start start 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82819aa640 1 --2- 172.21.15.144:0/1590046840 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f815c034650 0x7f815c036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55b84e0dedd0 tx=0x7f827c0063e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e1fb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b84e1cb240 con 0x55b84e1fb560 2024-09-13T19:35:21.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e1fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e1fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42904/0 (socket says 172.21.15.144:42904) 2024-09-13T19:35:21.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 -- 172.21.15.144:0/2336009359 learned_addr learned my addr 172.21.15.144:0/2336009359 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 -- 172.21.15.144:0/2336009359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84e1fbf30 con 0x55b84e1fb560 2024-09-13T19:35:21.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 --2- 172.21.15.144:0/2336009359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e1fb960 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f827404a300 tx=0x7f8274017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2fcf3e86e2a8ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f81657fa640 1 -- 172.21.15.144:0/2336009359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274040070 con 0x55b84e1fb560 2024-09-13T19:35:21.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f81657fa640 1 -- 172.21.15.144:0/2336009359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8274048070 con 0x55b84e1fb560 2024-09-13T19:35:21.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f81657fa640 1 -- 172.21.15.144:0/2336009359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827401d040 con 0x55b84e1fb560 2024-09-13T19:35:21.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 -- 172.21.15.144:0/2336009359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 msgr2=0x55b84e1fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2336009359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e1fb960 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f827404a300 tx=0x7f8274017fa0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 -- 172.21.15.144:0/2336009359 shutdown_connections 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2336009359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e1fb960 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 -- 172.21.15.144:0/2336009359 >> 172.21.15.144:0/2336009359 conn(0x55b84e1f7990 msgr2=0x55b84e1f5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 -- 172.21.15.144:0/2336009359 shutdown_connections 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 -- 172.21.15.144:0/2336009359 wait complete. 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 Processor -- start 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 -- start start 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e202980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f8283e9a980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b84e1fc580 con 0x55b84e1fb560 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e202980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e202980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42920/0 (socket says 172.21.15.144:42920) 2024-09-13T19:35:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 learned_addr learned my addr 172.21.15.144:0/2342887644 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:21.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84e202ec0 con 0x55b84e1fb560 2024-09-13T19:35:21.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.868+0000 7f82821ab640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e202980 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8274017b10 tx=0x7f827404a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f81537fe640 1 -- 172.21.15.144:0/2342887644 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827401d070 con 0x55b84e1fb560 2024-09-13T19:35:21.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b84e203150 con 0x55b84e1fb560 2024-09-13T19:35:21.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f81537fe640 1 -- 172.21.15.144:0/2342887644 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827403bde0 con 0x55b84e1fb560 2024-09-13T19:35:21.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f81537fe640 1 -- 172.21.15.144:0/2342887644 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274032040 con 0x55b84e1fb560 2024-09-13T19:35:21.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84e205e30 con 0x55b84e1fb560 2024-09-13T19:35:21.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f81537fe640 1 -- 172.21.15.144:0/2342887644 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8274019860 con 0x55b84e1fb560 2024-09-13T19:35:21.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f81537fe640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f814c034650 0x7f814c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f81537fe640 1 -- 172.21.15.144:0/2342887644 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f827401a070 con 0x55b84e1fb560 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82819aa640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f814c034650 0x7f814c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e20de60 0x55b84e2102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e210a40 con 0x55b84e20de60 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82811a9640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e20de60 0x55b84e2102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82819aa640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f814c034650 0x7f814c036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f827c010500 tx=0x7f827c039000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82811a9640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e20de60 0x55b84e2102f0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 realm 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e210e70 con 0x55b84e20de60 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e211740 con 0x55b84e20de60 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e211ae0 con 0x55b84e20de60 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e212840 0x55b84e214c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e215280 con 0x55b84e212840 2024-09-13T19:35:21.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.872+0000 7f82821ab640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e212840 0x55b84e214c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82821ab640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e212840 0x55b84e214c30 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f8283e9a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f8283e9a980 20 searching for the correct realm 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b84e2171d0 0x55b84e2195e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82819aa640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b84e2171d0 0x55b84e2195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82819aa640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b84e2171d0 0x55b84e2195e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82819aa640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f827c027020 0x7f827c0113d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x7f827c027020 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82811a9640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f827c027020 0x7f827c0113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82811a9640 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f827c027020 0x7f827c0113d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:21.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e212840 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.876+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e212840 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x7f827c027020 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e212840 2024-09-13T19:35:21.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x7f827c027020 2024-09-13T19:35:21.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e212840 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.880+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e212840 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x7f827c027020 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e212840 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.884+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e212840 2024-09-13T19:35:21.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x7f827c027020 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e2171d0 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e212840 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x55b84e20de60 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b84e219cb0 con 0x7f827c027020 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e215c40 con 0x55b84e20de60 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e2164e0 con 0x55b84e20de60 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e215880 con 0x55b84e20de60 2024-09-13T19:35:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 zone default found 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 4 Realm: () 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 zonegroup default 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21a130 con 0x55b84e212840 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21bf10 con 0x55b84e2171d0 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.888+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21c350 con 0x55b84e2171d0 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 20 started sync module instance, tier type = 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21b350 con 0x7f827c027020 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250073176144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21b350 con 0x7f827c027020 2024-09-13T19:35:21.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21ce90 con 0x55b84e20de60 2024-09-13T19:35:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250073176144] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250073180544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21b350 con 0x55b84e20de60 2024-09-13T19:35:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.892+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21d8a0 con 0x55b84e2171d0 2024-09-13T19:35:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.896+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250073180544] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.896+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.896+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250073173664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21b2c0 con 0x55b84e2171d0 2024-09-13T19:35:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.896+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21e630 con 0x7f827c027020 2024-09-13T19:35:21.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.896+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.896+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250073186624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21eed0 con 0x7f827c027020 2024-09-13T19:35:21.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.896+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21f8d0 con 0x55b84e20de60 2024-09-13T19:35:21.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.896+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250073173664] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.900+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250073186624] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.900+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.900+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250073185424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21e9a0 con 0x55b84e20de60 2024-09-13T19:35:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.900+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e220170 con 0x55b84e212840 2024-09-13T19:35:21.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.900+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250073185424] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.900+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.900+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250073191392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21e9a0 con 0x55b84e212840 2024-09-13T19:35:21.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.900+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e220620 con 0x55b84e212840 2024-09-13T19:35:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250073194864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e220a40 con 0x55b84e212840 2024-09-13T19:35:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e221560 con 0x55b84e212840 2024-09-13T19:35:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250073191392] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250073194864] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250073198640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e2205d0 con 0x55b84e212840 2024-09-13T19:35:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 20 add_watcher() i=0 2024-09-13T19:35:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 20 add_watcher() i=1 2024-09-13T19:35:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 20 add_watcher() i=2 2024-09-13T19:35:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 20 add_watcher() i=3 2024-09-13T19:35:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 20 add_watcher() i=4 2024-09-13T19:35:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 20 add_watcher() i=5 2024-09-13T19:35:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.904+0000 7f8283e9a980 20 add_watcher() i=6 2024-09-13T19:35:21.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250073198640] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f8283e9a980 20 add_watcher() i=7 2024-09-13T19:35:21.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f8283e9a980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:21.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e224660 con 0x55b84e20de60 2024-09-13T19:35:21.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250073193584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e221ae0 con 0x55b84e20de60 2024-09-13T19:35:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250073193584] v32'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f81337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f8283e9a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f8283e9a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f8283e9a980 5 note: GC not initialized 2024-09-13T19:35:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f81327fc640 20 reqs_thread_entry: start 2024-09-13T19:35:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.908+0000 7f8283e9a980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 20 Filter name: none 2024-09-13T19:35:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f80a3fff640 20 reqs_thread_entry: start 2024-09-13T19:35:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 20 rados->read ofs=0 len=0 2024-09-13T19:35:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e247a90 con 0x55b84e212840 2024-09-13T19:35:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:35:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.912+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e24e040 con 0x55b84e212840 2024-09-13T19:35:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f8283e9a980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f8283e9a980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f8283e9a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94250073381552 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b84e2496d0 con 0x55b84e20de60 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 94250073185424 notify 137438953502 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55b84e0e73a0 con 0x55b84e20de60 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f81657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94250073185424 notifier 4909 bl.length()=649 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f81657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f81657fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 94250073381552 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f81657fa640 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8144003eb0 con 0x55b84e20de60 2024-09-13T19:35:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 94250073381552 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f82780d7e20 con 0x55b84e20de60 2024-09-13T19:35:21.920 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:21.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f81337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:21.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250073193584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e24d350 con 0x55b84e20de60 2024-09-13T19:35:21.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94250073193584] v32'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.916+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250073176144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e24d350 con 0x7f827c027020 2024-09-13T19:35:21.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.920+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94250073176144] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.920+0000 7f8283e9a980 20 remove_watcher() i=0 2024-09-13T19:35:21.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.920+0000 7f8283e9a980 2 removed watcher, disabling cache 2024-09-13T19:35:21.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.920+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250073180544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e24d350 con 0x55b84e20de60 2024-09-13T19:35:21.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.920+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94250073180544] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.920+0000 7f8283e9a980 20 remove_watcher() i=1 2024-09-13T19:35:21.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.920+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250073173664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e24d350 con 0x55b84e2171d0 2024-09-13T19:35:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.920+0000 7f82819aa640 1 -- 172.21.15.144:0/2342887644 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94250073173664] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00f030 con 0x55b84e2171d0 2024-09-13T19:35:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.924+0000 7f8283e9a980 20 remove_watcher() i=2 2024-09-13T19:35:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.924+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250073186624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21fc70 con 0x7f827c027020 2024-09-13T19:35:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.924+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94250073186624] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x7f827c027020 2024-09-13T19:35:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.924+0000 7f8283e9a980 20 remove_watcher() i=3 2024-09-13T19:35:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.924+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250073185424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21b850 con 0x55b84e20de60 2024-09-13T19:35:21.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.924+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94250073185424] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82780aa900 con 0x55b84e20de60 2024-09-13T19:35:21.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.924+0000 7f8283e9a980 20 remove_watcher() i=4 2024-09-13T19:35:21.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.924+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250073191392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21aea0 con 0x55b84e212840 2024-09-13T19:35:21.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.928+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94250073191392] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.928+0000 7f8283e9a980 20 remove_watcher() i=5 2024-09-13T19:35:21.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.928+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250073194864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21fc70 con 0x55b84e212840 2024-09-13T19:35:21.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.928+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94250073194864] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.928+0000 7f8283e9a980 20 remove_watcher() i=6 2024-09-13T19:35:21.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.928+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250073198640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b84e21b850 con 0x55b84e212840 2024-09-13T19:35:21.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f82821ab640 1 -- 172.21.15.144:0/2342887644 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94250073198640] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8274035040 con 0x55b84e212840 2024-09-13T19:35:21.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 20 remove_watcher() i=7 2024-09-13T19:35:21.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e212840 msgr2=0x55b84e214c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e212840 0x55b84e214c30 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e20de60 msgr2=0x55b84e2102f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e20de60 0x55b84e2102f0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f827c027020 msgr2=0x7f827c0113d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f827c027020 0x7f827c0113d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b84e2171d0 msgr2=0x55b84e2195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55b84e2171d0 0x55b84e2195e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f814c034650 msgr2=0x7f814c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f814c034650 0x7f814c036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f827c010500 tx=0x7f827c039000 comp rx=0 tx=0).stop 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 msgr2=0x55b84e202980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f82811a9640 1 -- 172.21.15.144:0/2342887644 reap_dead start 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e202980 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8274017b10 tx=0x7f827404a290 comp rx=0 tx=0).stop 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 shutdown_connections 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/2342887644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1fb560 0x55b84e202980 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 >> 172.21.15.144:0/2342887644 conn(0x55b84e1f7990 msgr2=0x55b84e1f5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 shutdown_connections 2024-09-13T19:35:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/2342887644 wait complete. 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/1590046840 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f815c034650 msgr2=0x7f815c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/1590046840 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f815c034650 0x7f815c036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55b84e0dedd0 tx=0x7f827c0063e0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/1590046840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1eea70 msgr2=0x55b84e1eee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/1590046840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1eea70 0x55b84e1eee90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55b84e0df9b0 tx=0x7f827400af40 comp rx=0 tx=0).stop 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/1590046840 shutdown_connections 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/1590046840 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f815c034650 0x7f815c036b10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/1590046840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e1eea70 0x55b84e1eee90 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/1590046840 >> 172.21.15.144:0/1590046840 conn(0x55b84e1e3bc0 msgr2=0x55b84e1e6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/1590046840 shutdown_connections 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/1590046840 wait complete. 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e1dd870 msgr2=0x55b84e1dfc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e1dd870 0x55b84e1dfc60 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e0e3a60 msgr2=0x55b84e1db120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e0e3a60 0x55b84e1db120 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8168034650 msgr2=0x7f8168036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8168034650 0x7f8168036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f82780ae000 tx=0x7f82780a6000 comp rx=0 tx=0).stop 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 msgr2=0x55b84e0dfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e0dfc40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f827c002260 tx=0x7f827c000f50 comp rx=0 tx=0).stop 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 shutdown_connections 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55b84e0e3a60 0x55b84e1db120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55b84e1dd870 0x55b84e1dfc60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8168034650 0x7f8168036b10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 --2- 172.21.15.144:0/583200730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b84e053b10 0x55b84e0dfc40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 >> 172.21.15.144:0/583200730 conn(0x55b84e0da070 msgr2=0x55b84e1c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 shutdown_connections 2024-09-13T19:35:21.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:21.932+0000 7f8283e9a980 1 -- 172.21.15.144:0/583200730 wait complete. 2024-09-13T19:35:21.946 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.946 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:21.946 ERROR:root:0 2024-09-13T19:35:21.946 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:35:21.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:35:21.947 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:35:22.019 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:35:22.019 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:35:22.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb08a78980 1 Processor -- start 2024-09-13T19:35:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb08a78980 1 -- start start 2024-09-13T19:35:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb08a78980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x55fa19d07a20 0x55fa19d09e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb08a78980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa19b8bae0 con 0x55fa19d036a0 2024-09-13T19:35:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb08a78980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x55fa19bafe30 con 0x55fa19d07a20 2024-09-13T19:35:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb06588640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x55fa19d036a0 0x55fa19d03a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:49472/0 (socket says 172.21.15.144:49472) 2024-09-13T19:35:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb06588640 1 -- 172.21.15.144:0/3890979068 learned_addr learned my addr 172.21.15.144:0/3890979068 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-13T19:35:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb05d87640 1 --2- 172.21.15.144:0/3890979068 >> v2:172.21.15.18:3300/0 conn(0x55fa19d07a20 0x55fa19d09e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb05586640 1 -- 172.21.15.144:0/3890979068 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347402350 0 0) 0x55fa19b8bae0 con 0x55fa19d036a0 2024-09-13T19:35:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb05586640 1 -- 172.21.15.144:0/3890979068 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaf0001e20 con 0x55fa19d036a0 2024-09-13T19:35:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb05d87640 1 -- 172.21.15.144:0/3890979068 >> v1:172.21.15.18:6789/0 conn(0x55fa19d036a0 legacy=0x55fa19d03a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.016+0000 7fdb05d87640 1 -- 172.21.15.144:0/3890979068 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa19d0b360 con 0x55fa19d07a20 2024-09-13T19:35:22.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb05d87640 1 --2- 172.21.15.144:0/3890979068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d07a20 0x55fa19d09e10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00a480 tx=0x7fdafc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3746fa40cc9455ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb05586640 1 -- 172.21.15.144:0/3890979068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdafc0b0070 con 0x55fa19d07a20 2024-09-13T19:35:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb05586640 1 -- 172.21.15.144:0/3890979068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc0ab540 con 0x55fa19d07a20 2024-09-13T19:35:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb05586640 1 -- 172.21.15.144:0/3890979068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdafc0ab840 con 0x55fa19d07a20 2024-09-13T19:35:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb08a78980 1 -- 172.21.15.144:0/3890979068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d07a20 msgr2=0x55fa19d09e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb08a78980 1 --2- 172.21.15.144:0/3890979068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d07a20 0x55fa19d09e10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00a480 tx=0x7fdafc01b280 comp rx=0 tx=0).stop 2024-09-13T19:35:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb08a78980 1 -- 172.21.15.144:0/3890979068 shutdown_connections 2024-09-13T19:35:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb08a78980 1 --2- 172.21.15.144:0/3890979068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d07a20 0x55fa19d09e10 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb08a78980 1 -- 172.21.15.144:0/3890979068 >> 172.21.15.144:0/3890979068 conn(0x55fa19cff1c0 msgr2=0x55fa19d015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:22.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb08a78980 1 -- 172.21.15.144:0/3890979068 shutdown_connections 2024-09-13T19:35:22.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.020+0000 7fdb08a78980 1 -- 172.21.15.144:0/3890979068 wait complete. 2024-09-13T19:35:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.032+0000 7fdb08a78980 1 Processor -- start 2024-09-13T19:35:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.032+0000 7fdb08a78980 1 -- start start 2024-09-13T19:35:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.032+0000 7fdb08a78980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19dee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.032+0000 7fdb08a78980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fa19bb1200 con 0x55fa19d036a0 2024-09-13T19:35:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb06588640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19dee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb06588640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19dee8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42930/0 (socket says 172.21.15.144:42930) 2024-09-13T19:35:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb06588640 1 -- 172.21.15.144:0/2187451666 learned_addr learned my addr 172.21.15.144:0/2187451666 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb06588640 1 -- 172.21.15.144:0/2187451666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa19deeec0 con 0x55fa19d036a0 2024-09-13T19:35:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb06588640 1 --2- 172.21.15.144:0/2187451666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19dee8f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdb00006fc0 tx=0x7fdb00001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d77d21f7544fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fd9f4608640 1 -- 172.21.15.144:0/2187451666 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb00004530 con 0x55fa19d036a0 2024-09-13T19:35:22.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fd9f4608640 1 -- 172.21.15.144:0/2187451666 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb000046d0 con 0x55fa19d036a0 2024-09-13T19:35:22.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fd9f4608640 1 -- 172.21.15.144:0/2187451666 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb00004a70 con 0x55fa19d036a0 2024-09-13T19:35:22.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 -- 172.21.15.144:0/2187451666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 msgr2=0x55fa19dee8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 --2- 172.21.15.144:0/2187451666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19dee8f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdb00006fc0 tx=0x7fdb00001af0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 -- 172.21.15.144:0/2187451666 shutdown_connections 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 --2- 172.21.15.144:0/2187451666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19dee8f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 -- 172.21.15.144:0/2187451666 >> 172.21.15.144:0/2187451666 conn(0x55fa19cff1c0 msgr2=0x55fa19dea520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 -- 172.21.15.144:0/2187451666 shutdown_connections 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 -- 172.21.15.144:0/2187451666 wait complete. 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 Processor -- start 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 -- start start 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19df5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb08a78980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fa19d0ae60 con 0x55fa19d036a0 2024-09-13T19:35:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb06588640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19df5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb06588640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19df5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42938/0 (socket says 172.21.15.144:42938) 2024-09-13T19:35:22.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.036+0000 7fdb06588640 1 -- 172.21.15.144:0/730918139 learned_addr learned my addr 172.21.15.144:0/730918139 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb06588640 1 -- 172.21.15.144:0/730918139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa19df61c0 con 0x55fa19d036a0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb06588640 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19df5c80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fdb00002260 tx=0x7fdb00000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fd9f2e05640 1 -- 172.21.15.144:0/730918139 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb00013760 con 0x55fa19d036a0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa19df6450 con 0x55fa19d036a0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fd9f2e05640 1 -- 172.21.15.144:0/730918139 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb00013900 con 0x55fa19d036a0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fd9f2e05640 1 -- 172.21.15.144:0/730918139 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb00013c00 con 0x55fa19d036a0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa19df9130 con 0x55fa19d036a0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fd9f2e05640 1 -- 172.21.15.144:0/730918139 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdb00010070 con 0x55fa19d036a0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fd9f2e05640 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9ec034650 0x7fd9ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fd9f2e05640 1 -- 172.21.15.144:0/730918139 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb00018070 con 0x55fa19d036a0 2024-09-13T19:35:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb05d87640 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9ec034650 0x7fd9ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19d07a20 0x55fa19dfcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19dfd260 con 0x55fa19d07a20 2024-09-13T19:35:22.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb06d89640 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19d07a20 0x55fa19dfcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb05d87640 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9ec034650 0x7fd9ec036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0ad000 tx=0x7fdafc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb06d89640 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19d07a20 0x55fa19dfcc10 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb06d89640 1 -- 172.21.15.144:0/730918139 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdaf80083f0 con 0x55fa19d07a20 2024-09-13T19:35:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19dfa330 con 0x55fa19d07a20 2024-09-13T19:35:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb06d89640 1 -- 172.21.15.144:0/730918139 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdaf80083f0 con 0x55fa19d07a20 2024-09-13T19:35:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19dff590 0x55fa19e01980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e02050 con 0x55fa19dff590 2024-09-13T19:35:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.040+0000 7fdb06588640 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19dff590 0x55fa19e01980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb06588640 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19dff590 0x55fa19e01980 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb06588640 1 -- 172.21.15.144:0/730918139 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb0001b030 con 0x55fa19dff590 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19dfe430 con 0x55fa19d07a20 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb06d89640 1 -- 172.21.15.144:0/730918139 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdaf80083f0 con 0x55fa19d07a20 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19dfe910 con 0x55fa19d07a20 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb06d89640 1 -- 172.21.15.144:0/730918139 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdaf80083f0 con 0x55fa19d07a20 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb08a78980 1 Processor -- start 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb08a78980 1 -- start start 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb08a78980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e10790 0x55fa19e10bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb08a78980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fa19c0a800 con 0x55fa19e10790 2024-09-13T19:35:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb06d89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e10790 0x55fa19e10bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb06d89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e10790 0x55fa19e10bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42952/0 (socket says 172.21.15.144:42952) 2024-09-13T19:35:22.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb06d89640 1 -- 172.21.15.144:0/1300581688 learned_addr learned my addr 172.21.15.144:0/1300581688 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:22.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.044+0000 7fdb06d89640 1 -- 172.21.15.144:0/1300581688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa19e110f0 con 0x55fa19e10790 2024-09-13T19:35:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb06d89640 1 --2- 172.21.15.144:0/1300581688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e10790 0x55fa19e10bb0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55fa19df6b80 tx=0x7fdaf800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9ebfff640 1 -- 172.21.15.144:0/1300581688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf8007dd0 con 0x55fa19e10790 2024-09-13T19:35:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb08a78980 1 -- 172.21.15.144:0/1300581688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa19e11380 con 0x55fa19e10790 2024-09-13T19:35:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9ebfff640 1 -- 172.21.15.144:0/1300581688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf801e020 con 0x55fa19e10790 2024-09-13T19:35:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9ebfff640 1 -- 172.21.15.144:0/1300581688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf8019590 con 0x55fa19e10790 2024-09-13T19:35:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb08a78980 1 -- 172.21.15.144:0/1300581688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa19e14000 con 0x55fa19e10790 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9ebfff640 1 -- 172.21.15.144:0/1300581688 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdaf8016040 con 0x55fa19e10790 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9ebfff640 1 --2- 172.21.15.144:0/1300581688 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9e0034650 0x7fd9e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9ebfff640 1 -- 172.21.15.144:0/1300581688 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdaf801f030 con 0x55fa19e10790 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb06588640 1 --2- 172.21.15.144:0/1300581688 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9e0034650 0x7fd9e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb08a78980 1 Processor -- start 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb08a78980 1 -- start start 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb06588640 1 --2- 172.21.15.144:0/1300581688 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9e0034650 0x7fd9e0036b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55fa19dfd700 tx=0x7fdb00013da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb08a78980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e1d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb08a78980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fa19def240 con 0x55fa19e1d230 2024-09-13T19:35:22.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb06d89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e1d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb06d89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e1d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42954/0 (socket says 172.21.15.144:42954) 2024-09-13T19:35:22.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb06d89640 1 -- 172.21.15.144:0/3391587492 learned_addr learned my addr 172.21.15.144:0/3391587492 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:22.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb06d89640 1 -- 172.21.15.144:0/3391587492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa19e1dc00 con 0x55fa19e1d230 2024-09-13T19:35:22.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fdb06d89640 1 --2- 172.21.15.144:0/3391587492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e1d630 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdaf804a320 tx=0x7fdaf8023660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3516b3dbf8f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9e9ffb640 1 -- 172.21.15.144:0/3391587492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf801d040 con 0x55fa19e1d230 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9e9ffb640 1 -- 172.21.15.144:0/3391587492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf8015c90 con 0x55fa19e1d230 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.048+0000 7fd9e9ffb640 1 -- 172.21.15.144:0/3391587492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf8022a60 con 0x55fa19e1d230 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- 172.21.15.144:0/3391587492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 msgr2=0x55fa19e1d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 --2- 172.21.15.144:0/3391587492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e1d630 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdaf804a320 tx=0x7fdaf8023660 comp rx=0 tx=0).stop 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- 172.21.15.144:0/3391587492 shutdown_connections 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 --2- 172.21.15.144:0/3391587492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e1d630 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- 172.21.15.144:0/3391587492 >> 172.21.15.144:0/3391587492 conn(0x55fa19e19610 msgr2=0x55fa19e17710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- 172.21.15.144:0/3391587492 shutdown_connections 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- 172.21.15.144:0/3391587492 wait complete. 2024-09-13T19:35:22.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 Processor -- start 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- start start 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e24530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fa19e1e1a0 con 0x55fa19e1d230 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb06d89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e24530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb06d89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e24530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:42968/0 (socket says 172.21.15.144:42968) 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 learned_addr learned my addr 172.21.15.144:0/668350278 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa19e24a70 con 0x55fa19e1d230 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb06d89640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e24530 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8017930 tx=0x7fdaf80179a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fd9d7fff640 1 -- 172.21.15.144:0/668350278 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf801d040 con 0x55fa19e1d230 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa19e24a70 con 0x55fa19e1d230 2024-09-13T19:35:22.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fd9d7fff640 1 -- 172.21.15.144:0/668350278 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf8015e40 con 0x55fa19e1d230 2024-09-13T19:35:22.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fd9d7fff640 1 -- 172.21.15.144:0/668350278 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf8017770 con 0x55fa19e1d230 2024-09-13T19:35:22.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa19e24a70 con 0x55fa19e1d230 2024-09-13T19:35:22.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fd9d7fff640 1 -- 172.21.15.144:0/668350278 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdaf80155f0 con 0x55fa19e1d230 2024-09-13T19:35:22.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fd9d7fff640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9d00345b0 0x7fd9d0036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fd9d7fff640 1 -- 172.21.15.144:0/668350278 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdaf801a190 con 0x55fa19e1d230 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb06588640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9d00345b0 0x7fd9d0036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19e2f650 0x55fa19e31b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.052+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e32260 con 0x55fa19e2f650 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb05d87640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19e2f650 0x55fa19e31b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb06588640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9d00345b0 0x7fd9d0036a70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55fa19e02450 tx=0x7fdb00035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb05d87640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19e2f650 0x55fa19e31b10 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 realm 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e32630 con 0x55fa19e2f650 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e32ed0 con 0x55fa19e2f650 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e33270 con 0x55fa19e2f650 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19e33fd0 0x55fa19e363c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e36a10 con 0x55fa19e33fd0 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb06d89640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19e33fd0 0x55fa19e363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb06d89640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19e33fd0 0x55fa19e363c0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 20 searching for the correct realm 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fa19e38960 0x55fa19e3ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb06588640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fa19e38960 0x55fa19e3ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.056+0000 7fdb06588640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fa19e38960 0x55fa19e3ad90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0001b030 con 0x55fa19e38960 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06588640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb00050070 0x7fdb00041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x7fdb00050070 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb00050070 0x7fdb00041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb00050070 0x7fdb00041ad0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e33fd0 2024-09-13T19:35:22.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e33fd0 2024-09-13T19:35:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x7fdb00050070 2024-09-13T19:35:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0001b030 con 0x55fa19e38960 2024-09-13T19:35:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.060+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e33fd0 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x7fdb00050070 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e33fd0 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e33fd0 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.064+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x7fdb00050070 2024-09-13T19:35:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e33fd0 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e33fd0 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x7fdb00050070 2024-09-13T19:35:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e38960 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e33fd0 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x55fa19e2f650 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3b460 con 0x7fdb00050070 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb08a78980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb08a78980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb08a78980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:35:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb08a78980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb08a78980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb08a78980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.068+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e373d0 con 0x55fa19e2f650 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e37c70 con 0x55fa19e2f650 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e37010 con 0x55fa19e2f650 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 zone default found 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 4 Realm: () 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 zonegroup default 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e37880 con 0x55fa19e33fd0 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3dc70 con 0x55fa19e38960 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3e010 con 0x55fa19e38960 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 started sync module instance, tier type = 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3d100 con 0x7fdb00050070 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94532664546848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3d100 con 0x7fdb00050070 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.072+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3ea60 con 0x55fa19e2f650 2024-09-13T19:35:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.076+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94532664546848] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.076+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.076+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94532664550768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3d100 con 0x55fa19e2f650 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.076+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3f470 con 0x55fa19e38960 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.076+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94532664550768] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.076+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.076+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94532664544336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3d070 con 0x55fa19e38960 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.076+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e40170 con 0x7fdb00050070 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.080+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.080+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94532664557008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e40a10 con 0x7fdb00050070 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.080+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e413d0 con 0x55fa19e2f650 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.080+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94532664557008] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.080+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94532664544336] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.080+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.080+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94532664561440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e41340 con 0x55fa19e2f650 2024-09-13T19:35:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.080+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e40960 con 0x55fa19e33fd0 2024-09-13T19:35:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.084+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94532664561440] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.084+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.084+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94532664558768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e41c70 con 0x55fa19e33fd0 2024-09-13T19:35:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.084+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e424c0 con 0x55fa19e33fd0 2024-09-13T19:35:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.084+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(56 notify.6 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.084+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94532664565360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e428e0 con 0x55fa19e33fd0 2024-09-13T19:35:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.084+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e43400 con 0x55fa19e33fd0 2024-09-13T19:35:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.084+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94532664558768] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94532664565360] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94532664569552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e42330 con 0x55fa19e33fd0 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 20 add_watcher() i=0 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 20 add_watcher() i=1 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 20 add_watcher() i=2 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 20 add_watcher() i=3 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 20 add_watcher() i=4 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 20 add_watcher() i=5 2024-09-13T19:35:22.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 20 add_watcher() i=6 2024-09-13T19:35:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94532664569552] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 20 add_watcher() i=7 2024-09-13T19:35:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 2 all 8 watchers are set, enabling cache 2024-09-13T19:35:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e463f0 con 0x55fa19e2f650 2024-09-13T19:35:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.088+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94532664563568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e43870 con 0x55fa19e2f650 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94532664563568] v32'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fd9bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 5 note: GC not initialized 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fd9377fe640 20 reqs_thread_entry: start 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 20 init_complete bucket index max shards: 11 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 20 Filter name: none 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fd9357fa640 20 reqs_thread_entry: start 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:35:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 20 rados->read ofs=0 len=0 2024-09-13T19:35:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e698f0 con 0x55fa19e33fd0 2024-09-13T19:35:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T19:35:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:35:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:22.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:35:22.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.092+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e70140 con 0x55fa19e33fd0 2024-09-13T19:35:22.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb08a78980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb08a78980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb08a78980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94532664753072 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e6b830 con 0x55fa19e2f650 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== watch-notify(notify (1) cookie 94532664561440 notify 137438953503 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55fa19d0b360 con 0x55fa19e2f650 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fd9e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94532664561440 notifier 4916 bl.length()=649 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fd9e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fd9e9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(64 notify.4 [notify cookie 94532664753072 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fd9e9ffb640 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd9cc003eb0 con 0x55fa19e2f650 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== watch-notify(notify_complete (2) cookie 94532664753072 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdafc0d2450 con 0x55fa19e2f650 2024-09-13T19:35:22.102 INFO:teuthology.orchestra.run.smithi144.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:35:19.239220Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:35:19.239201Z","tags":[],"group_ids":[]} 2024-09-13T19:35:22.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fd9bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:35:22.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.096+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94532664563568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e6f450 con 0x55fa19e2f650 2024-09-13T19:35:22.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.100+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94532664563568] v32'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.100+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94532664546848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e6f450 con 0x7fdb00050070 2024-09-13T19:35:22.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.100+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94532664546848] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.100+0000 7fdb08a78980 20 remove_watcher() i=0 2024-09-13T19:35:22.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.100+0000 7fdb08a78980 2 removed watcher, disabling cache 2024-09-13T19:35:22.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.100+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94532664550768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e676f0 con 0x55fa19e2f650 2024-09-13T19:35:22.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94532664550768] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb08a78980 20 remove_watcher() i=1 2024-09-13T19:35:22.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94532664544336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e676f0 con 0x55fa19e38960 2024-09-13T19:35:22.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb06588640 1 -- 172.21.15.144:0/668350278 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94532664544336] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb0005f040 con 0x55fa19e38960 2024-09-13T19:35:22.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb08a78980 20 remove_watcher() i=2 2024-09-13T19:35:22.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94532664557008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3cc50 con 0x7fdb00050070 2024-09-13T19:35:22.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94532664557008] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x7fdb00050070 2024-09-13T19:35:22.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb08a78980 20 remove_watcher() i=3 2024-09-13T19:35:22.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.104+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94532664561440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e676f0 con 0x55fa19e2f650 2024-09-13T19:35:22.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.108+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94532664561440] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdafc0abc70 con 0x55fa19e2f650 2024-09-13T19:35:22.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.108+0000 7fdb08a78980 20 remove_watcher() i=4 2024-09-13T19:35:22.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.108+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94532664558768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3fdd0 con 0x55fa19e33fd0 2024-09-13T19:35:22.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.108+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94532664558768] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.108+0000 7fdb08a78980 20 remove_watcher() i=5 2024-09-13T19:35:22.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.108+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94532664565360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e3cc50 con 0x55fa19e33fd0 2024-09-13T19:35:22.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.112+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94532664565360] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.112+0000 7fdb08a78980 20 remove_watcher() i=6 2024-09-13T19:35:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.112+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94532664569552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa19e40f20 con 0x55fa19e33fd0 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.112+0000 7fdb06d89640 1 -- 172.21.15.144:0/668350278 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94532664569552] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf802a070 con 0x55fa19e33fd0 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.112+0000 7fdb08a78980 20 remove_watcher() i=7 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.112+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19e33fd0 msgr2=0x55fa19e363c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19e33fd0 0x55fa19e363c0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19e2f650 msgr2=0x55fa19e31b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19e2f650 0x55fa19e31b10 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb00050070 msgr2=0x7fdb00041ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7fdb00050070 0x7fdb00041ad0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fa19e38960 msgr2=0x55fa19e3ad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x55fa19e38960 0x55fa19e3ad90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9d00345b0 msgr2=0x7fd9d0036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9d00345b0 0x7fd9d0036a70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55fa19e02450 tx=0x7fdb00035000 comp rx=0 tx=0).stop 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 msgr2=0x55fa19e24530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb05d87640 1 -- 172.21.15.144:0/668350278 reap_dead start 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e24530 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8017930 tx=0x7fdaf80179a0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 shutdown_connections 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/668350278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e1d230 0x55fa19e24530 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 >> 172.21.15.144:0/668350278 conn(0x55fa19e19610 msgr2=0x55fa19e176e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 shutdown_connections 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/668350278 wait complete. 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/1300581688 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9e0034650 msgr2=0x7fd9e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/1300581688 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9e0034650 0x7fd9e0036b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55fa19dfd700 tx=0x7fdb00013da0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/1300581688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e10790 msgr2=0x55fa19e10bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/1300581688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e10790 0x55fa19e10bb0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55fa19df6b80 tx=0x7fdaf800af40 comp rx=0 tx=0).stop 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/1300581688 shutdown_connections 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/1300581688 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9e0034650 0x7fd9e0036b10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/1300581688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19e10790 0x55fa19e10bb0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/1300581688 >> 172.21.15.144:0/1300581688 conn(0x55fa19e058e0 msgr2=0x55fa19e08360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/1300581688 shutdown_connections 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/1300581688 wait complete. 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19dff590 msgr2=0x55fa19e01980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19dff590 0x55fa19e01980 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19d07a20 msgr2=0x55fa19dfcc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19d07a20 0x55fa19dfcc10 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9ec034650 msgr2=0x7fd9ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9ec034650 0x7fd9ec036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0ad000 tx=0x7fdafc0a5040 comp rx=0 tx=0).stop 2024-09-13T19:35:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 msgr2=0x55fa19df5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19df5c80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fdb00002260 tx=0x7fdb00000f50 comp rx=0 tx=0).stop 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 shutdown_connections 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x55fa19d07a20 0x55fa19dfcc10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x55fa19dff590 0x55fa19e01980 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd9ec034650 0x7fd9ec036b10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 --2- 172.21.15.144:0/730918139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fa19d036a0 0x55fa19df5c80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 >> 172.21.15.144:0/730918139 conn(0x55fa19cff1c0 msgr2=0x55fa19de90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 shutdown_connections 2024-09-13T19:35:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:35:22.116+0000 7fdb08a78980 1 -- 172.21.15.144:0/730918139 wait complete. 2024-09-13T19:35:22.128 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:22.128 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:35:19.239220Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:35:19.239201Z', 'tags': [], 'group_ids': []} 2024-09-13T19:35:22.128 ERROR:root:0 2024-09-13T19:35:22.128 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T19:35:22.143 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.144 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.156 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.156 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T19:35:22.169 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.170 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.181 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.182 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-13T19:35:22.201 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-13T19:35:22.202 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.213 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.213 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-13T19:35:22.233 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.233 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.246 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.246 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-13T19:35:22.265 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-13T19:35:22.266 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.278 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.278 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-13T19:35:22.301 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-13T19:35:22.302 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.315 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.315 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-13T19:35:22.336 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.336 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.350 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.350 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-13T19:35:22.366 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.378 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.379 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-13T19:35:22.399 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.399 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.412 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.412 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.426 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:35:22.427 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T19:35:22.440 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:35:22.475 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T19:35:22.489 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-13T19:35:22.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:35:22.504 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:35:22.461186Z', 'creation_time': '2024-09-13T19:35:22.453119Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:35:22.505 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T19:35:22.521 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:35:22.461186Z', 'creation_time': '2024-09-13T19:35:22.453119Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T19:35:22.530 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:35:22.545 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:35:22.461186Z', 'creation_time': '2024-09-13T19:35:22.453119Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:35:22.545 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-13T19:35:22.558 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000fb709bb54e3eb703-0066e493fa-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:35:22.567 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-13T19:35:22.589 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.592 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-13T19:35:22.617 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:35:22.637 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11'} 2024-09-13T19:35:22.666 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.713 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11'} 2024-09-13T19:35:22.744 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.744 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-13T19:35:22.773 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.794 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-13T19:35:22.814 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:35:22.814 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:35:22.829 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b5bcd2ca-839b-4a0e-a5d6-f37391d778b0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11', 'marker': 'c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:35:22.729439Z', 'creation_time': '2024-09-13T19:35:22.453119Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:36:22.943 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-13T19:36:22.983 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-13T19:36:22.983 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-13T19:36:23.021 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T19:36:23.022 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T19:36:23.035 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-13T19:36:23.036 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-13T19:36:23.050 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-13T19:36:23.050 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-13T19:36:23.064 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:36:23.064 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-13T19:36:23.078 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-13T19:36:23.078 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-13T19:36:23.092 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-13T19:36:23.093 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-13T19:36:23.112 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:36:23.113 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T19:36:23.126 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-13T19:36:23.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T19:36:23.150 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:36:23.164 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T19:36:23.189 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:36:23.596 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T19:36:23.611 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000008b142610034f8ad3-0066e49437-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:23.840 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T19:36:23.854 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T19:36:23.866 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T19:36:23.880 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T19:36:24.029 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-13T19:36:24.124 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:36:24.124 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T19:36:24.142 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-13T19:36:24.142 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T19:36:24.160 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:36:24.185 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T19:36:24.198 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000b126b43383693449-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-13T19:36:24.327 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:36:24.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:36:24.342 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000086c2511563ab84d6-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-13T19:36:24.356 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'b2385e7c-a71a-4af5-b7af-4c90a204f1ea'}]}} 2024-09-13T19:36:24.357 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-13T19:36:24.390 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:36:24.390 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T19:36:24.403 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:36:24.404 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-13T19:36:24.417 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000fcd42cb428391f26-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.418 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-13T19:36:24.431 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000005301888b47523690-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.454 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T19:36:24.467 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:36:24.468 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-13T19:36:24.482 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000010e2a00cd9693dba-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.483 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-13T19:36:24.495 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000b055e4e96cfa6a0f-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.496 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-13T19:36:24.509 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:36:24.509 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-13T19:36:24.522 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000237ea5ef1185ebca-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.522 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-13T19:36:24.534 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000fc3c2c46b410f663-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.535 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-13T19:36:24.547 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000089dd6b57a7f126bf-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.548 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-13T19:36:24.561 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000002d3bbe79a5bded50-0066e49438-4223-default', 'HostId': '4223-default-default'} 2024-09-13T19:36:24.561 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-13T19:36:24.593 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:36:24.594 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T19:36:24.606 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-13T19:36:24.606 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-13T19:36:24.625 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:36:24.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T19:36:24.637 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-13T19:36:24.637 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-13T19:36:24.655 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:36:24.659 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-13T19:36:24.668 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-13T19:36:24.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:36:24.670 INFO:tasks.rgw.client.0.smithi144.stdout:2024-09-13T19:36:24.662+0000 7f73d1a35640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29528) UID: 0 2024-09-13T19:36:24.670 INFO:tasks.rgw.client.0.smithi144.stdout:2024-09-13T19:36:24.662+0000 7f73d527da40 -1 shutting down 2024-09-13T19:36:51.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-13T19:36:55.177 INFO:tasks.rgw.client.0:Stopped 2024-09-13T19:36:55.178 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-13T19:36:55.184 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/vault-root-token 2024-09-13T19:36:55.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-13T19:36:55.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-13T19:36:55.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-13T19:36:55.296 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-13T19:36:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:36:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:36:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6eeba7f980 1 Processor -- start 2024-09-13T19:36:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6eeba7f980 1 -- start start 2024-09-13T19:36:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6eeba7f980 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563ed9cd9290 0x563ed9d697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6eeba7f980 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ed9becae0 con 0x563ed9d69ce0 2024-09-13T19:36:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6eeba7f980 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x563ed9c10e30 con 0x563ed9cd9290 2024-09-13T19:36:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6ee958f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563ed9cd9290 0x563ed9d697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6ee958f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x563ed9cd9290 0x563ed9d697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37530/0 (socket says 172.21.15.144:37530) 2024-09-13T19:36:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6ee958f640 1 -- 172.21.15.144:0/1257125269 learned_addr learned my addr 172.21.15.144:0/1257125269 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:36:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6ee8d8e640 1 --1- 172.21.15.144:0/1257125269 >> v1:172.21.15.18:6789/0 conn(0x563ed9d69ce0 0x563ed9d6c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.144:34008/0 (socket says 172.21.15.144:34008) 2024-09-13T19:36:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6ee958f640 1 -- 172.21.15.144:0/1257125269 >> v1:172.21.15.18:6789/0 conn(0x563ed9d69ce0 legacy=0x563ed9d6c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.373+0000 7f6ee958f640 1 -- 172.21.15.144:0/1257125269 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed9cd9670 con 0x563ed9cd9290 2024-09-13T19:36:55.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1257125269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9d697a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00a4e0 tx=0x7f6edc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c569031fcd1b05c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6edbfff640 1 -- 172.21.15.144:0/1257125269 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6edc0aa540 con 0x563ed9cd9290 2024-09-13T19:36:55.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6edbfff640 1 -- 172.21.15.144:0/1257125269 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc0aa6e0 con 0x563ed9cd9290 2024-09-13T19:36:55.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6edbfff640 1 -- 172.21.15.144:0/1257125269 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6edc0aaa40 con 0x563ed9cd9290 2024-09-13T19:36:55.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1257125269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 msgr2=0x563ed9d697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1257125269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9d697a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00a4e0 tx=0x7f6edc01b090 comp rx=0 tx=0).stop 2024-09-13T19:36:55.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1257125269 shutdown_connections 2024-09-13T19:36:55.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1257125269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9d697a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1257125269 >> 172.21.15.144:0/1257125269 conn(0x563ed9d5f090 msgr2=0x563ed9d614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:55.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1257125269 shutdown_connections 2024-09-13T19:36:55.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.377+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1257125269 wait complete. 2024-09-13T19:36:55.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6eeba7f980 1 Processor -- start 2024-09-13T19:36:55.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6eeba7f980 1 -- start start 2024-09-13T19:36:55.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6eeba7f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e51c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6eeba7f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563ed9c12200 con 0x563ed9cd9290 2024-09-13T19:36:55.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6ee958f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e51c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6ee958f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e51c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37542/0 (socket says 172.21.15.144:37542) 2024-09-13T19:36:55.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6ee958f640 1 -- 172.21.15.144:0/786429116 learned_addr learned my addr 172.21.15.144:0/786429116 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:36:55.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6ee958f640 1 -- 172.21.15.144:0/786429116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed9e52240 con 0x563ed9cd9290 2024-09-13T19:36:55.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6ee958f640 1 --2- 172.21.15.144:0/786429116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e51c70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6edc018cc0 tx=0x7f6edc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ea8796ad314716 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6dd7606640 1 -- 172.21.15.144:0/786429116 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6edc0b9030 con 0x563ed9cd9290 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6dd7606640 1 -- 172.21.15.144:0/786429116 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc0aaa80 con 0x563ed9cd9290 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.393+0000 7f6dd7606640 1 -- 172.21.15.144:0/786429116 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6edc0aad80 con 0x563ed9cd9290 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- 172.21.15.144:0/786429116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 msgr2=0x563ed9e51c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/786429116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e51c70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6edc018cc0 tx=0x7f6edc0033b0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- 172.21.15.144:0/786429116 shutdown_connections 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/786429116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e51c70 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- 172.21.15.144:0/786429116 >> 172.21.15.144:0/786429116 conn(0x563ed9d5f090 msgr2=0x563ed9e4d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:55.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- 172.21.15.144:0/786429116 shutdown_connections 2024-09-13T19:36:55.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- 172.21.15.144:0/786429116 wait complete. 2024-09-13T19:36:55.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 Processor -- start 2024-09-13T19:36:55.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- start start 2024-09-13T19:36:55.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e58e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563ed9d70220 con 0x563ed9cd9290 2024-09-13T19:36:55.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6ee958f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e58e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6ee958f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e58e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37550/0 (socket says 172.21.15.144:37550) 2024-09-13T19:36:55.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6ee958f640 1 -- 172.21.15.144:0/1767657870 learned_addr learned my addr 172.21.15.144:0/1767657870 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:36:55.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6ee958f640 1 -- 172.21.15.144:0/1767657870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed9e59340 con 0x563ed9cd9290 2024-09-13T19:36:55.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e58e00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0b7040 tx=0x7f6edc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6dd5e03640 1 -- 172.21.15.144:0/1767657870 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6edc0b9070 con 0x563ed9cd9290 2024-09-13T19:36:55.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6dd5e03640 1 -- 172.21.15.144:0/1767657870 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc0c3030 con 0x563ed9cd9290 2024-09-13T19:36:55.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ed9e595d0 con 0x563ed9cd9290 2024-09-13T19:36:55.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6dd5e03640 1 -- 172.21.15.144:0/1767657870 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6edc0bf770 con 0x563ed9cd9290 2024-09-13T19:36:55.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed9e5c2b0 con 0x563ed9cd9290 2024-09-13T19:36:55.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6dd5e03640 1 -- 172.21.15.144:0/1767657870 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6edc0b3040 con 0x563ed9cd9290 2024-09-13T19:36:55.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6dd5e03640 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dd0034650 0x7f6dd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.397+0000 7f6dd5e03640 1 -- 172.21.15.144:0/1767657870 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6edc0ba070 con 0x563ed9cd9290 2024-09-13T19:36:55.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee8d8e640 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dd0034650 0x7f6dd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9d69ce0 0x563ed9e5fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e603b0 con 0x563ed9d69ce0 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee9d90640 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9d69ce0 0x563ed9e5fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee8d8e640 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dd0034650 0x7f6dd0036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0001e50 tx=0x7f6ee00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee9d90640 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9d69ce0 0x563ed9e5fd90 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1767657870 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ee40083f0 con 0x563ed9d69ce0 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e60ce0 con 0x563ed9d69ce0 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1767657870 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ee40083f0 con 0x563ed9d69ce0 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e625f0 0x563ed9e64a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:3 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e65220 con 0x563ed9e625f0 2024-09-13T19:36:55.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e625f0 0x563ed9e64a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e625f0 0x563ed9e64a90 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee958f640 1 -- 172.21.15.144:0/1767657870 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(3 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e625f0 2024-09-13T19:36:55.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e61530 con 0x563ed9d69ce0 2024-09-13T19:36:55.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1767657870 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ee40083f0 con 0x563ed9d69ce0 2024-09-13T19:36:55.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.401+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:5 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e61910 con 0x563ed9d69ce0 2024-09-13T19:36:55.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1767657870 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(5 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ee40083f0 con 0x563ed9d69ce0 2024-09-13T19:36:55.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6eeba7f980 1 Processor -- start 2024-09-13T19:36:55.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6eeba7f980 1 -- start start 2024-09-13T19:36:55.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6eeba7f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e73980 0x563ed9e73da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6eeba7f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563ed9c6b800 con 0x563ed9e73980 2024-09-13T19:36:55.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6ee9d90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e73980 0x563ed9e73da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6ee9d90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e73980 0x563ed9e73da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37566/0 (socket says 172.21.15.144:37566) 2024-09-13T19:36:55.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6ee9d90640 1 -- 172.21.15.144:0/2416177221 learned_addr learned my addr 172.21.15.144:0/2416177221 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:36:55.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6ee9d90640 1 -- 172.21.15.144:0/2416177221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed9e742e0 con 0x563ed9e73980 2024-09-13T19:36:55.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6ee9d90640 1 --2- 172.21.15.144:0/2416177221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e73980 0x563ed9e73da0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x563ed9e5d420 tx=0x7f6ee400aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6dceffd640 1 -- 172.21.15.144:0/2416177221 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4007d10 con 0x563ed9e73980 2024-09-13T19:36:55.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6dceffd640 1 -- 172.21.15.144:0/2416177221 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee401e020 con 0x563ed9e73980 2024-09-13T19:36:55.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6dceffd640 1 -- 172.21.15.144:0/2416177221 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4019420 con 0x563ed9e73980 2024-09-13T19:36:55.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6eeba7f980 1 -- 172.21.15.144:0/2416177221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ed9e74570 con 0x563ed9e73980 2024-09-13T19:36:55.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6eeba7f980 1 -- 172.21.15.144:0/2416177221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed9e771f0 con 0x563ed9e73980 2024-09-13T19:36:55.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6dceffd640 1 -- 172.21.15.144:0/2416177221 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6ee4016040 con 0x563ed9e73980 2024-09-13T19:36:55.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.405+0000 7f6dceffd640 1 --2- 172.21.15.144:0/2416177221 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dc0034650 0x7f6dc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6dceffd640 1 -- 172.21.15.144:0/2416177221 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ee401f030 con 0x563ed9e73980 2024-09-13T19:36:55.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee958f640 1 --2- 172.21.15.144:0/2416177221 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dc0034650 0x7f6dc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 Processor -- start 2024-09-13T19:36:55.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- start start 2024-09-13T19:36:55.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee958f640 1 --2- 172.21.15.144:0/2416177221 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dc0034650 0x7f6dc0036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x563ed9e5d600 tx=0x7f6edc0e38e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e80920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563ed9e52500 con 0x563ed9e80520 2024-09-13T19:36:55.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee9d90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e80920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee9d90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e80920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37578/0 (socket says 172.21.15.144:37578) 2024-09-13T19:36:55.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee9d90640 1 -- 172.21.15.144:0/568584413 learned_addr learned my addr 172.21.15.144:0/568584413 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:36:55.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee9d90640 1 -- 172.21.15.144:0/568584413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed9e80ef0 con 0x563ed9e80520 2024-09-13T19:36:55.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee9d90640 1 --2- 172.21.15.144:0/568584413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e80920 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4049f70 tx=0x7f6ee4015500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b685e0fc44d706e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6dccff9640 1 -- 172.21.15.144:0/568584413 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee401d070 con 0x563ed9e80520 2024-09-13T19:36:55.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6dccff9640 1 -- 172.21.15.144:0/568584413 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee40184e0 con 0x563ed9e80520 2024-09-13T19:36:55.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6dccff9640 1 -- 172.21.15.144:0/568584413 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4014470 con 0x563ed9e80520 2024-09-13T19:36:55.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- 172.21.15.144:0/568584413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 msgr2=0x563ed9e80920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/568584413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e80920 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4049f70 tx=0x7f6ee4015500 comp rx=0 tx=0).stop 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- 172.21.15.144:0/568584413 shutdown_connections 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/568584413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e80920 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- 172.21.15.144:0/568584413 >> 172.21.15.144:0/568584413 conn(0x563ed9e7c900 msgr2=0x563ed9e7aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- 172.21.15.144:0/568584413 shutdown_connections 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- 172.21.15.144:0/568584413 wait complete. 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 Processor -- start 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- start start 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e87860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6eeba7f980 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563ed9e81490 con 0x563ed9e80520 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee9d90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e87860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee9d90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e87860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.144:37592/0 (socket says 172.21.15.144:37592) 2024-09-13T19:36:55.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.409+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 learned_addr learned my addr 172.21.15.144:0/1722093399 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-13T19:36:55.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed9e87da0 con 0x563ed9e80520 2024-09-13T19:36:55.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6ee9d90640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e87860 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x563ed9e7cfe0 tx=0x7f6ee4049ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6dbeffd640 1 -- 172.21.15.144:0/1722093399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4019820 con 0x563ed9e80520 2024-09-13T19:36:55.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6dbeffd640 1 -- 172.21.15.144:0/1722093399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee40199c0 con 0x563ed9e80520 2024-09-13T19:36:55.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ed9e88030 con 0x563ed9e80520 2024-09-13T19:36:55.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6dbeffd640 1 -- 172.21.15.144:0/1722093399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4022730 con 0x563ed9e80520 2024-09-13T19:36:55.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed9e8ad10 con 0x563ed9e80520 2024-09-13T19:36:55.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6dbeffd640 1 -- 172.21.15.144:0/1722093399 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6ee4022960 con 0x563ed9e80520 2024-09-13T19:36:55.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6dbeffd640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db4034650 0x7f6db4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6dbeffd640 1 -- 172.21.15.144:0/1722093399 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ee403abf0 con 0x563ed9e80520 2024-09-13T19:36:55.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db4034650 0x7f6db4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9e92d20 0x563ed9e951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e95910 con 0x563ed9e92d20 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6ee8d8e640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9e92d20 0x563ed9e951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db4034650 0x7f6db4036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x563ed9e65620 tx=0x7f6edc0c9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.413+0000 7f6ee8d8e640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9e92d20 0x563ed9e951c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ee000f6a0 con 0x563ed9e92d20 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 realm 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e921f0 con 0x563ed9e92d20 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ee000f6a0 con 0x563ed9e92d20 2024-09-13T19:36:55.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:36:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:36:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e963e0 con 0x563ed9e92d20 2024-09-13T19:36:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ee000f6a0 con 0x563ed9e92d20 2024-09-13T19:36:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:36:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e96cb0 con 0x563ed9e92d20 2024-09-13T19:36:55.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ee000f6a0 con 0x563ed9e92d20 2024-09-13T19:36:55.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:36:55.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e975a0 0x563ed9e999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:5 5.17 5:eeeaa3ac:::zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9a160 con 0x563ed9e975a0 2024-09-13T19:36:55.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee9d90640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e975a0 0x563ed9e999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee9d90640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e975a0 0x563ed9e999d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== osd_op_reply(5 zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 20 searching for the correct realm 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563ed9e9c0b0 0x563ed9e9e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e9c0b0 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563ed9e9c0b0 0x563ed9e9e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563ed9e9c0b0 0x563ed9e9e4c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee958f640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6edc0f3040 0x7f6edc0bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.417+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x7f6edc0f3040 2024-09-13T19:36:55.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6edc0f3040 0x7f6edc0bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6edc0f3040 0x7f6edc0bfa20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee000f6a0 con 0x7f6edc0f3040 2024-09-13T19:36:55.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e975a0 2024-09-13T19:36:55.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e92d20 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ee000f6a0 con 0x563ed9e92d20 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e92d20 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e92d20 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e975a0 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x7f6edc0f3040 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e9c0b0 2024-09-13T19:36:55.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.421+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e92d20 2024-09-13T19:36:55.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e975a0 2024-09-13T19:36:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e92d20 2024-09-13T19:36:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x7f6edc0f3040 2024-09-13T19:36:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e9c0b0 2024-09-13T19:36:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e9c0b0 2024-09-13T19:36:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e975a0 2024-09-13T19:36:55.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e9c0b0 2024-09-13T19:36:55.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9eb90 con 0x563ed9e9c0b0 2024-09-13T19:36:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e92d20 2024-09-13T19:36:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.425+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e92d20 2024-09-13T19:36:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e975a0 2024-09-13T19:36:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e9c0b0 2024-09-13T19:36:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x7f6edc0f3040 2024-09-13T19:36:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e92d20 2024-09-13T19:36:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e975a0 2024-09-13T19:36:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=82b] v32'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e9c0b0 2024-09-13T19:36:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e975a0 2024-09-13T19:36:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x7f6edc0f3040 2024-09-13T19:36:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.429+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e9c0b0 2024-09-13T19:36:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e975a0 2024-09-13T19:36:55.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x563ed9e92d20 2024-09-13T19:36:55.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6edc101040 con 0x7f6edc0f3040 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 RGWRados::pool_iterate: got zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 RGWRados::pool_iterate: got period_config.default 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 RGWRados::pool_iterate: got zone_info.c35740e4-5d1f-401e-bba7-050c483b0bbd 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9ab20 con 0x563ed9e92d20 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9b3c0 con 0x563ed9e92d20 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:40 5.18 5:1c2d52ae:::zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9a760 con 0x563ed9e92d20 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 16 ==== osd_op_reply(40 zonegroup_info.b5bcd2ca-839b-4a0e-a5d6-f37391d778b0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 zone default found 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 4 Realm: () 2024-09-13T19:36:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 4 ZoneGroup: default (b5bcd2ca-839b-4a0e-a5d6-f37391d778b0) 2024-09-13T19:36:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 4 Zone: default (c35740e4-5d1f-401e-bba7-050c483b0bbd) 2024-09-13T19:36:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:36:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 zonegroup default 2024-09-13T19:36:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9e9f0c0 con 0x563ed9e975a0 2024-09-13T19:36:55.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados_obj.operate() r=0 bl.length=187 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.433+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea1390 con 0x563ed9e9c0b0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 20 rados->read ofs=0 len=0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea1780 con 0x563ed9e9c0b0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 20 started sync module instance, tier type = 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 20 started zone id=c35740e4-5d1f-401e-bba7-050c483b0bbd (name=default) with tier type = 2024-09-13T19:36:55.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea0820 con 0x7f6edc0f3040 2024-09-13T19:36:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 7 ==== osd_op_reply(44 notify.0 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94827943955744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea0820 con 0x7f6edc0f3040 2024-09-13T19:36:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea2260 con 0x563ed9e92d20 2024-09-13T19:36:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.437+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94827943955744] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.441+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 17 ==== osd_op_reply(46 notify.1 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.441+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94827943959888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea0820 con 0x563ed9e92d20 2024-09-13T19:36:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.441+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea2c70 con 0x563ed9e9c0b0 2024-09-13T19:36:55.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.441+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94827943959888] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.441+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 12 ==== osd_op_reply(48 notify.2 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.441+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94827943953264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea0790 con 0x563ed9e9c0b0 2024-09-13T19:36:55.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.441+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea39b0 con 0x7f6edc0f3040 2024-09-13T19:36:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.445+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 9 ==== osd_op_reply(50 notify.3 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.445+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94827943965888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea4250 con 0x7f6edc0f3040 2024-09-13T19:36:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.445+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea4c10 con 0x563ed9e92d20 2024-09-13T19:36:55.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.445+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94827943953264] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.445+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94827943965888] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.445+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 19 ==== osd_op_reply(52 notify.4 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.445+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94827943970656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea4b80 con 0x563ed9e92d20 2024-09-13T19:36:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.445+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea41a0 con 0x563ed9e975a0 2024-09-13T19:36:55.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.449+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94827943970656] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.449+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 11 ==== osd_op_reply(54 notify.5 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.449+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94827943967984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea54b0 con 0x563ed9e975a0 2024-09-13T19:36:55.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.449+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea5d00 con 0x563ed9e975a0 2024-09-13T19:36:55.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.449+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94827943967984] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.449+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 13 ==== osd_op_reply(56 notify.6 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.449+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94827943973136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea5ae0 con 0x563ed9e975a0 2024-09-13T19:36:55.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.449+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea65d0 con 0x563ed9e975a0 2024-09-13T19:36:55.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94827943973136] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 15 ==== osd_op_reply(58 notify.7 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94827943977120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea6590 con 0x563ed9e975a0 2024-09-13T19:36:55.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6eeba7f980 20 add_watcher() i=0 2024-09-13T19:36:55.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6eeba7f980 20 add_watcher() i=1 2024-09-13T19:36:55.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6eeba7f980 20 add_watcher() i=2 2024-09-13T19:36:55.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6eeba7f980 20 add_watcher() i=3 2024-09-13T19:36:55.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6eeba7f980 20 add_watcher() i=4 2024-09-13T19:36:55.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6eeba7f980 20 add_watcher() i=5 2024-09-13T19:36:55.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.453+0000 7f6eeba7f980 20 add_watcher() i=6 2024-09-13T19:36:55.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94827943977120] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6eeba7f980 20 add_watcher() i=7 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6eeba7f980 2 all 8 watchers are set, enabling cache 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea9a20 con 0x563ed9e92d20 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94827943974192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea6f40 con 0x563ed9e92d20 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94827943974192] v32'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6d9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6eeba7f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6eeba7f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:36:55.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.457+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb2260 con 0x563ed9e92d20 2024-09-13T19:36:55.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.461+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.461+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb28b0 con 0x563ed9e975a0 2024-09-13T19:36:55.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.461+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.461+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb28b0 con 0x563ed9e9c0b0 2024-09-13T19:36:55.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.465+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'33 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.465+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb3180 con 0x563ed9e92d20 2024-09-13T19:36:55.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.465+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'275 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.465+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb00e0 con 0x7f6edc0f3040 2024-09-13T19:36:55.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.469+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.469+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb00e0 con 0x563ed9e9c0b0 2024-09-13T19:36:55.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.469+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.469+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb02b0 con 0x563ed9e92d20 2024-09-13T19:36:55.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.469+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.469+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb3c60 con 0x563ed9e975a0 2024-09-13T19:36:55.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.473+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'57 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.473+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb3c60 con 0x7f6edc0f3040 2024-09-13T19:36:55.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.473+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.477+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb3c60 con 0x563ed9e9c0b0 2024-09-13T19:36:55.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.477+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.477+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4060 con 0x7f6edc0f3040 2024-09-13T19:36:55.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.477+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.477+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb3e30 con 0x563ed9e975a0 2024-09-13T19:36:55.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.481+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.481+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb3e30 con 0x7f6edc0f3040 2024-09-13T19:36:55.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.481+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.481+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e975a0 2024-09-13T19:36:55.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.485+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.485+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e92d20 2024-09-13T19:36:55.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.485+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'276 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.485+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e9c0b0 2024-09-13T19:36:55.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.489+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.489+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x7f6edc0f3040 2024-09-13T19:36:55.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.489+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'86 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.489+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e9c0b0 2024-09-13T19:36:55.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.493+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.493+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e92d20 2024-09-13T19:36:55.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.493+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.493+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e92d20 2024-09-13T19:36:55.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.497+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'277 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.497+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e9c0b0 2024-09-13T19:36:55.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.497+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.497+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x7f6edc0f3040 2024-09-13T19:36:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.501+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.501+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e9c0b0 2024-09-13T19:36:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.501+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.501+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e9c0b0 2024-09-13T19:36:55.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.501+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.501+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e9c0b0 2024-09-13T19:36:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.505+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.505+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e9c0b0 2024-09-13T19:36:55.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.505+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.505+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eb4110 con 0x563ed9e975a0 2024-09-13T19:36:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.509+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.509+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eafa60 con 0x563ed9e9c0b0 2024-09-13T19:36:55.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.509+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'34 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.509+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eafa60 con 0x563ed9e975a0 2024-09-13T19:36:55.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.513+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'58 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.513+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eafa60 con 0x563ed9e9c0b0 2024-09-13T19:36:55.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.513+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.517+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eafa60 con 0x563ed9e975a0 2024-09-13T19:36:55.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.517+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.517+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eafa60 con 0x7f6edc0f3040 2024-09-13T19:36:55.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.521+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.521+0000 7f6d9efe5640 20 reqs_thread_entry: start 2024-09-13T19:36:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.521+0000 7f6eeba7f980 20 init_complete bucket index max shards: 11 2024-09-13T19:36:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.521+0000 7f6eeba7f980 20 Filter name: none 2024-09-13T19:36:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.521+0000 7f6d9cfe1640 20 reqs_thread_entry: start 2024-09-13T19:36:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.521+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-13T19:36:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.521+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:94 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 18 ==== osd_op_reply(94 gc.10 [call] v32'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:95 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 19 ==== osd_op_reply(95 gc.10 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:96 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x7f6edc0f3040 2024-09-13T19:36:55.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 20 ==== osd_op_reply(96 gc.10 [call out=24b] v0'0 uv87 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:97 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 21 ==== osd_op_reply(97 gc.10 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:98 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 22 ==== osd_op_reply(98 gc.10 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.525+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:99 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.529+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 23 ==== osd_op_reply(99 gc.10 [call] v32'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.529+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-13T19:36:55.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.529+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:100 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.529+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 24 ==== osd_op_reply(100 gc.11 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.529+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:101 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.529+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 25 ==== osd_op_reply(101 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.529+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.529+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:102 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e975a0 2024-09-13T19:36:55.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.533+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 26 ==== osd_op_reply(102 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.533+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:103 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.533+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 27 ==== osd_op_reply(103 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.533+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.533+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:104 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.533+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 28 ==== osd_op_reply(104 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.533+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.533+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:105 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 29 ==== osd_op_reply(105 gc.11 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-13T19:36:55.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:106 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 24 ==== osd_op_reply(106 gc.12 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:107 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 25 ==== osd_op_reply(107 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:108 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x7f6edc0f3040 2024-09-13T19:36:55.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 26 ==== osd_op_reply(108 gc.12 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.537+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:109 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 27 ==== osd_op_reply(109 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:110 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 28 ==== osd_op_reply(110 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:111 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 29 ==== osd_op_reply(111 gc.12 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-13T19:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.541+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:112 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 30 ==== osd_op_reply(112 gc.13 [call] v32'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:113 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 31 ==== osd_op_reply(113 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:114 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e975a0 2024-09-13T19:36:55.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 32 ==== osd_op_reply(114 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:115 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 33 ==== osd_op_reply(115 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:116 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 34 ==== osd_op_reply(116 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.545+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:117 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.549+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 35 ==== osd_op_reply(117 gc.13 [call] v32'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.549+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-13T19:36:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.549+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:118 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 29 ==== osd_op_reply(118 gc.14 [call] v32'278 uv278 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:119 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 30 ==== osd_op_reply(119 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:120 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e92d20 2024-09-13T19:36:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 31 ==== osd_op_reply(120 gc.14 [call out=24b] v0'0 uv278 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:121 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 32 ==== osd_op_reply(121 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:122 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 33 ==== osd_op_reply(122 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:123 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 34 ==== osd_op_reply(123 gc.14 [call] v32'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-13T19:36:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.553+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:124 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 26 ==== osd_op_reply(124 gc.15 [call] v32'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:125 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 27 ==== osd_op_reply(125 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:126 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 28 ==== osd_op_reply(126 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:127 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 29 ==== osd_op_reply(127 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.557+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:128 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.561+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 30 ==== osd_op_reply(128 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.561+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.561+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:129 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.561+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 31 ==== osd_op_reply(129 gc.15 [call] v32'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.561+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-13T19:36:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.561+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:130 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 30 ==== osd_op_reply(130 gc.16 [call] v32'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:131 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 31 ==== osd_op_reply(131 gc.16 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:132 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x7f6edc0f3040 2024-09-13T19:36:55.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 32 ==== osd_op_reply(132 gc.16 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:133 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 33 ==== osd_op_reply(133 gc.16 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:134 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 34 ==== osd_op_reply(134 gc.16 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.565+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:135 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 35 ==== osd_op_reply(135 gc.16 [call] v32'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-13T19:36:55.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:136 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 32 ==== osd_op_reply(136 gc.17 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:137 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 33 ==== osd_op_reply(137 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:138 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 34 ==== osd_op_reply(138 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:139 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 35 ==== osd_op_reply(139 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:140 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 36 ==== osd_op_reply(140 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.569+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:141 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.573+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 37 ==== osd_op_reply(141 gc.17 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.573+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-13T19:36:55.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.573+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:142 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.573+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 35 ==== osd_op_reply(142 gc.18 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.573+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:143 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 36 ==== osd_op_reply(143 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:144 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e92d20 2024-09-13T19:36:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 37 ==== osd_op_reply(144 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:145 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 38 ==== osd_op_reply(145 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:146 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 39 ==== osd_op_reply(146 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:147 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 40 ==== osd_op_reply(147 gc.18 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-13T19:36:55.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.577+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:148 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 41 ==== osd_op_reply(148 gc.19 [call] v32'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:149 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 42 ==== osd_op_reply(149 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:150 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e92d20 2024-09-13T19:36:55.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 43 ==== osd_op_reply(150 gc.19 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.581+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.585+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 45 ==== osd_op_reply(152 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.585+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.585+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.585+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 46 ==== osd_op_reply(153 gc.19 [call] v32'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.585+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-13T19:36:55.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.585+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 38 ==== osd_op_reply(154 gc.20 [call] v32'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 39 ==== osd_op_reply(155 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 40 ==== osd_op_reply(156 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:157 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 41 ==== osd_op_reply(157 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:158 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 42 ==== osd_op_reply(158 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.589+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:159 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.593+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 43 ==== osd_op_reply(159 gc.20 [call] v32'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.593+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-13T19:36:55.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.593+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:160 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 36 ==== osd_op_reply(160 gc.21 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:161 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 37 ==== osd_op_reply(161 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:162 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x7f6edc0f3040 2024-09-13T19:36:55.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 38 ==== osd_op_reply(162 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:163 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 39 ==== osd_op_reply(163 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:164 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 40 ==== osd_op_reply(164 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.597+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:165 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.601+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 41 ==== osd_op_reply(165 gc.21 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.601+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-13T19:36:55.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.601+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:166 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.601+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 44 ==== osd_op_reply(166 gc.22 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.601+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:167 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.601+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 45 ==== osd_op_reply(167 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.601+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.601+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:168 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 46 ==== osd_op_reply(168 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:169 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 47 ==== osd_op_reply(169 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:170 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 48 ==== osd_op_reply(170 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:171 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 49 ==== osd_op_reply(171 gc.22 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-13T19:36:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.605+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:172 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 50 ==== osd_op_reply(172 gc.23 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:173 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 51 ==== osd_op_reply(173 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:174 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 52 ==== osd_op_reply(174 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:175 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 53 ==== osd_op_reply(175 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:176 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 54 ==== osd_op_reply(176 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.609+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:177 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.613+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 55 ==== osd_op_reply(177 gc.23 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.613+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-13T19:36:55.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.613+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:178 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.613+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 56 ==== osd_op_reply(178 gc.24 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.613+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:179 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.613+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 57 ==== osd_op_reply(179 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.613+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.613+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:180 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 58 ==== osd_op_reply(180 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:181 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 59 ==== osd_op_reply(181 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:182 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 60 ==== osd_op_reply(182 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:183 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 61 ==== osd_op_reply(183 gc.24 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-13T19:36:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.617+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:184 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 62 ==== osd_op_reply(184 gc.25 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:185 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 63 ==== osd_op_reply(185 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:186 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 64 ==== osd_op_reply(186 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:187 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 65 ==== osd_op_reply(187 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:188 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 66 ==== osd_op_reply(188 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.621+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:189 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.625+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 67 ==== osd_op_reply(189 gc.25 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.625+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-13T19:36:55.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.625+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:190 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.625+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 36 ==== osd_op_reply(190 gc.26 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.625+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:191 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.629+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 37 ==== osd_op_reply(191 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.629+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.629+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:192 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e975a0 2024-09-13T19:36:55.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.629+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 38 ==== osd_op_reply(192 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.629+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:193 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.629+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 39 ==== osd_op_reply(193 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.629+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.629+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:194 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.633+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 40 ==== osd_op_reply(194 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.633+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.633+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:195 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.633+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 41 ==== osd_op_reply(195 gc.26 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.633+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-13T19:36:55.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.633+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:196 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 68 ==== osd_op_reply(196 gc.27 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:197 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 69 ==== osd_op_reply(197 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:198 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 70 ==== osd_op_reply(198 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:199 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 71 ==== osd_op_reply(199 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:200 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 72 ==== osd_op_reply(200 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.637+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:201 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.641+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 73 ==== osd_op_reply(201 gc.27 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.641+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-13T19:36:55.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.641+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:202 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.641+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 42 ==== osd_op_reply(202 gc.28 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.641+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:203 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 43 ==== osd_op_reply(203 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:204 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e975a0 2024-09-13T19:36:55.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 44 ==== osd_op_reply(204 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:205 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 45 ==== osd_op_reply(205 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:206 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 46 ==== osd_op_reply(206 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.645+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:207 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.649+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 47 ==== osd_op_reply(207 gc.28 [call] v32'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.649+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-13T19:36:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.649+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:208 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.649+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 74 ==== osd_op_reply(208 gc.29 [call] v32'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.649+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:209 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 75 ==== osd_op_reply(209 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:210 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 76 ==== osd_op_reply(210 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:211 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 77 ==== osd_op_reply(211 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:212 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 78 ==== osd_op_reply(212 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:213 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 79 ==== osd_op_reply(213 gc.29 [call] v32'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-13T19:36:55.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.653+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:214 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.657+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 48 ==== osd_op_reply(214 gc.30 [call] v32'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.657+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:215 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.657+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 49 ==== osd_op_reply(215 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.657+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.657+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:216 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e975a0 2024-09-13T19:36:55.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.661+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 50 ==== osd_op_reply(216 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.661+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:217 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.661+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 51 ==== osd_op_reply(217 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.661+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.661+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:218 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.661+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 52 ==== osd_op_reply(218 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.661+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.661+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:219 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.665+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 53 ==== osd_op_reply(219 gc.30 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.665+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-13T19:36:55.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.665+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:220 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 42 ==== osd_op_reply(220 gc.31 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:221 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 43 ==== osd_op_reply(221 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:222 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x7f6edc0f3040 2024-09-13T19:36:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 44 ==== osd_op_reply(222 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:223 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 45 ==== osd_op_reply(223 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:224 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 46 ==== osd_op_reply(224 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.669+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:225 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.673+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 47 ==== osd_op_reply(225 gc.31 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.673+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-13T19:36:55.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.673+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:226 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 47 ==== osd_op_reply(226 gc.0 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:227 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 48 ==== osd_op_reply(227 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:228 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e92d20 2024-09-13T19:36:55.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 49 ==== osd_op_reply(228 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:229 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 50 ==== osd_op_reply(229 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:230 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 51 ==== osd_op_reply(230 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.677+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:231 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.681+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 52 ==== osd_op_reply(231 gc.0 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.681+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-13T19:36:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.681+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:232 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 54 ==== osd_op_reply(232 gc.1 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:233 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 55 ==== osd_op_reply(233 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:234 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e975a0 2024-09-13T19:36:55.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 56 ==== osd_op_reply(234 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:235 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 57 ==== osd_op_reply(235 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:236 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 58 ==== osd_op_reply(236 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.685+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:237 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.689+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 59 ==== osd_op_reply(237 gc.1 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.689+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-13T19:36:55.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.689+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:238 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 80 ==== osd_op_reply(238 gc.2 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:239 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 81 ==== osd_op_reply(239 gc.2 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:240 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 82 ==== osd_op_reply(240 gc.2 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:241 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 83 ==== osd_op_reply(241 gc.2 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:242 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 84 ==== osd_op_reply(242 gc.2 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.693+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:243 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.697+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 85 ==== osd_op_reply(243 gc.2 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.697+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-13T19:36:55.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.697+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:244 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 53 ==== osd_op_reply(244 gc.3 [call] v32'282 uv282 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:245 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 54 ==== osd_op_reply(245 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:246 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e92d20 2024-09-13T19:36:55.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 55 ==== osd_op_reply(246 gc.3 [call out=24b] v0'0 uv282 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:247 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 56 ==== osd_op_reply(247 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:248 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 57 ==== osd_op_reply(248 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.701+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:249 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.705+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 58 ==== osd_op_reply(249 gc.3 [call] v32'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.705+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-13T19:36:55.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.705+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:250 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.705+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 48 ==== osd_op_reply(250 gc.4 [call] v32'91 uv91 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.705+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:251 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 49 ==== osd_op_reply(251 gc.4 [call out=15b] v0'0 uv91 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:252 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x7f6edc0f3040 2024-09-13T19:36:55.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 50 ==== osd_op_reply(252 gc.4 [call out=24b] v0'0 uv91 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:253 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 51 ==== osd_op_reply(253 gc.4 [call out=15b] v0'0 uv91 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:254 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 52 ==== osd_op_reply(254 gc.4 [call out=15b] v0'0 uv91 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.709+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:255 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x7f6edc0f3040 2024-09-13T19:36:55.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.713+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 53 ==== osd_op_reply(255 gc.4 [call] v32'92 uv92 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.713+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-13T19:36:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.713+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:256 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.713+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 86 ==== osd_op_reply(256 gc.5 [call] v32'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.713+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:257 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.713+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 87 ==== osd_op_reply(257 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.713+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.713+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:258 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e9c0b0 2024-09-13T19:36:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 88 ==== osd_op_reply(258 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:259 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 89 ==== osd_op_reply(259 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:260 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 90 ==== osd_op_reply(260 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:261 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e9c0b0 2024-09-13T19:36:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 91 ==== osd_op_reply(261 gc.5 [call] v32'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-13T19:36:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.717+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:262 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 59 ==== osd_op_reply(262 gc.6 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:263 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 60 ==== osd_op_reply(263 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:264 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e92d20 2024-09-13T19:36:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 61 ==== osd_op_reply(264 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:265 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 62 ==== osd_op_reply(265 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.721+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:266 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.725+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 63 ==== osd_op_reply(266 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.725+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.725+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:267 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e92d20 2024-09-13T19:36:55.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.725+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 64 ==== osd_op_reply(267 gc.6 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.725+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-13T19:36:55.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.725+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:268 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.729+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 60 ==== osd_op_reply(268 gc.7 [call] v32'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.729+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:269 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.729+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 61 ==== osd_op_reply(269 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.729+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.729+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:270 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ecf610 con 0x563ed9e975a0 2024-09-13T19:36:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.729+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 62 ==== osd_op_reply(270 gc.7 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.729+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:271 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 63 ==== osd_op_reply(271 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:272 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0620 con 0x563ed9e975a0 2024-09-13T19:36:55.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 64 ==== osd_op_reply(272 gc.7 [call out=1716b] v0'0 uv61 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T19:36:55.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 20 garbage collection: RGWGC::process iterating over entry tag='c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.17292852796016447746', time=2024-09-13T19:36:38.593437+0000, chain.objs.size()=7 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_1 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:273 3.13 3:c87f52f9:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0ad0 con 0x563ed9e9c0b0 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_2 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:274 3.8 3:101d3b27:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x563ed9e9c0b0 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_3 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:275 3.23 3:c499e2d5:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed6150 con 0x563ed9e975a0 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_4 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:276 3.13 3:ca325b7a:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x563ed9e9c0b0 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_5 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:277 3.f 3:f1a0819e:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9edaf80 con 0x7f6edc0f3040 2024-09-13T19:36:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_6 2024-09-13T19:36:55.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:278 3.1b 3:da201cc8:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x563ed9e9c0b0 2024-09-13T19:36:55.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_7 2024-09-13T19:36:55.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.733+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:279 3.25 3:a49899dd:::c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9edfd20 con 0x563ed9e92d20 2024-09-13T19:36:55.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.741+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 65 ==== osd_op_reply(275 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_3 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.741+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 54 ==== osd_op_reply(277 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_5 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.745+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 92 ==== osd_op_reply(274 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_2 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.745+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 65 ==== osd_op_reply(279 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_7 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.745+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 93 ==== osd_op_reply(278 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_6 [call] v32'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.745+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 94 ==== osd_op_reply(273 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_1 [call] v32'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.745+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 95 ==== osd_op_reply(276 c35740e4-5d1f-401e-bba7-050c483b0bbd.4223.11__shadow_.C4UQOAIrqVBBlbx99J6sPMzys5g-XFo_4 [call] v32'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.745+0000 7f6eeba7f980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T19:36:55.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.745+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:280 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x563ed9e975a0 2024-09-13T19:36:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.749+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 66 ==== osd_op_reply(280 gc.7 [call] v32'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.749+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:281 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x563ed9e975a0 2024-09-13T19:36:55.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.753+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 67 ==== osd_op_reply(281 gc.7 [call] v32'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.753+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-13T19:36:55.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.753+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:282 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x7f6edc0f3040 2024-09-13T19:36:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 55 ==== osd_op_reply(282 gc.8 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:283 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x7f6edc0f3040 2024-09-13T19:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 56 ==== osd_op_reply(283 gc.8 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:284 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x7f6edc0f3040 2024-09-13T19:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 57 ==== osd_op_reply(284 gc.8 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:285 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x7f6edc0f3040 2024-09-13T19:36:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 58 ==== osd_op_reply(285 gc.8 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.757+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:286 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x7f6edc0f3040 2024-09-13T19:36:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.761+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 59 ==== osd_op_reply(286 gc.8 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.761+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.761+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:287 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x7f6edc0f3040 2024-09-13T19:36:55.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.761+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 60 ==== osd_op_reply(287 gc.8 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.761+0000 7f6eeba7f980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-13T19:36:55.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.761+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:288 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x563ed9e9c0b0 2024-09-13T19:36:55.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 96 ==== osd_op_reply(288 gc.9 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:289 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x563ed9e9c0b0 2024-09-13T19:36:55.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 97 ==== osd_op_reply(289 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:290 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed3540 con 0x563ed9e9c0b0 2024-09-13T19:36:55.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 98 ==== osd_op_reply(290 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:291 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0e40 con 0x563ed9e9c0b0 2024-09-13T19:36:55.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 99 ==== osd_op_reply(291 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:36:55.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.765+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:292 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0e40 con 0x563ed9e9c0b0 2024-09-13T19:36:55.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.769+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 100 ==== osd_op_reply(292 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.769+0000 7f6eeba7f980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:36:55.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.769+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:293 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ed0e40 con 0x563ed9e9c0b0 2024-09-13T19:36:55.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.769+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 101 ==== osd_op_reply(293 gc.9 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.773+0000 7f6d9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:36:55.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.773+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94827943974192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9eae710 con 0x563ed9e92d20 2024-09-13T19:36:55.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.773+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94827943974192] v32'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.773+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94827943955744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea5530 con 0x7f6edc0f3040 2024-09-13T19:36:55.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.777+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94827943955744] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.777+0000 7f6eeba7f980 20 remove_watcher() i=0 2024-09-13T19:36:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.777+0000 7f6eeba7f980 2 removed watcher, disabling cache 2024-09-13T19:36:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.777+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94827943959888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea0d20 con 0x563ed9e92d20 2024-09-13T19:36:55.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.777+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94827943959888] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.781+0000 7f6eeba7f980 20 remove_watcher() i=1 2024-09-13T19:36:55.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.781+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94827943953264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea1d50 con 0x563ed9e9c0b0 2024-09-13T19:36:55.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.781+0000 7f6ee958f640 1 -- 172.21.15.144:0/1722093399 <== osd.3 v2:172.21.15.144:6800/1157716661 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94827943953264] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6edc0cf070 con 0x563ed9e9c0b0 2024-09-13T19:36:55.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.781+0000 7f6eeba7f980 20 remove_watcher() i=2 2024-09-13T19:36:55.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.781+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94827943965888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea1d50 con 0x7f6edc0f3040 2024-09-13T19:36:55.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.785+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.2 v2:172.21.15.144:6816/2341760841 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94827943965888] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x7f6edc0f3040 2024-09-13T19:36:55.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.785+0000 7f6eeba7f980 20 remove_watcher() i=3 2024-09-13T19:36:55.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.785+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94827943970656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea1d50 con 0x563ed9e92d20 2024-09-13T19:36:55.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.785+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 <== osd.1 v2:172.21.15.144:6808/3556169889 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94827943970656] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee002b040 con 0x563ed9e92d20 2024-09-13T19:36:55.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.785+0000 7f6eeba7f980 20 remove_watcher() i=4 2024-09-13T19:36:55.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.785+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94827943967984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea4760 con 0x563ed9e975a0 2024-09-13T19:36:55.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.789+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94827943967984] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.789+0000 7f6eeba7f980 20 remove_watcher() i=5 2024-09-13T19:36:55.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.789+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94827943973136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea1d50 con 0x563ed9e975a0 2024-09-13T19:36:55.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.793+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94827943973136] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.793+0000 7f6eeba7f980 20 remove_watcher() i=6 2024-09-13T19:36:55.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.793+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94827943977120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ed9ea55c0 con 0x563ed9e975a0 2024-09-13T19:36:55.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.793+0000 7f6ee9d90640 1 -- 172.21.15.144:0/1722093399 <== osd.0 v2:172.21.15.18:6800/2700511246 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94827943977120] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ee4052070 con 0x563ed9e975a0 2024-09-13T19:36:55.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.793+0000 7f6eeba7f980 20 remove_watcher() i=7 2024-09-13T19:36:55.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e975a0 msgr2=0x563ed9e999d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e975a0 0x563ed9e999d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9e92d20 msgr2=0x563ed9e951c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9e92d20 0x563ed9e951c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6edc0f3040 msgr2=0x7f6edc0bfa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f6edc0f3040 0x7f6edc0bfa20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563ed9e9c0b0 msgr2=0x563ed9e9e4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x563ed9e9c0b0 0x563ed9e9e4c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db4034650 msgr2=0x7f6db4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6db4034650 0x7f6db4036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x563ed9e65620 tx=0x7f6edc0c9000 comp rx=0 tx=0).stop 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 msgr2=0x563ed9e87860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6ee8d8e640 1 -- 172.21.15.144:0/1722093399 reap_dead start 2024-09-13T19:36:55.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e87860 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x563ed9e7cfe0 tx=0x7f6ee4049ed0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 shutdown_connections 2024-09-13T19:36:55.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1722093399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e80520 0x563ed9e87860 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 >> 172.21.15.144:0/1722093399 conn(0x563ed9e7c900 msgr2=0x563ed9e7a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:55.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 shutdown_connections 2024-09-13T19:36:55.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1722093399 wait complete. 2024-09-13T19:36:55.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/2416177221 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dc0034650 msgr2=0x7f6dc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/2416177221 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dc0034650 0x7f6dc0036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x563ed9e5d600 tx=0x7f6edc0e38e0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/2416177221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e73980 msgr2=0x563ed9e73da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/2416177221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e73980 0x563ed9e73da0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x563ed9e5d420 tx=0x7f6ee400aed0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/2416177221 shutdown_connections 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/2416177221 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dc0034650 0x7f6dc0036b10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/2416177221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9e73980 0x563ed9e73da0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/2416177221 >> 172.21.15.144:0/2416177221 conn(0x563ed9e68ad0 msgr2=0x563ed9e6b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/2416177221 shutdown_connections 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/2416177221 wait complete. 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e625f0 msgr2=0x563ed9e64a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e625f0 0x563ed9e64a90 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9d69ce0 msgr2=0x563ed9e5fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9d69ce0 0x563ed9e5fd90 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dd0034650 msgr2=0x7f6dd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dd0034650 0x7f6dd0036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0001e50 tx=0x7f6ee00013b0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 msgr2=0x563ed9e58e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e58e00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0b7040 tx=0x7f6edc017e30 comp rx=0 tx=0).stop 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 shutdown_connections 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x563ed9d69ce0 0x563ed9e5fd90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x563ed9e625f0 0x563ed9e64a90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6dd0034650 0x7f6dd0036b10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 --2- 172.21.15.144:0/1767657870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563ed9cd9290 0x563ed9e58e00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 >> 172.21.15.144:0/1767657870 conn(0x563ed9d5f090 msgr2=0x563ed9e4c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 shutdown_connections 2024-09-13T19:36:55.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-13T19:36:55.797+0000 7f6eeba7f980 1 -- 172.21.15.144:0/1767657870 wait complete. 2024-09-13T19:36:55.824 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T19:36:55.834 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T19:36:55.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:36:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845ca26640 1 Processor -- start 2024-09-13T19:36:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845ca26640 1 -- start start 2024-09-13T19:36:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845ca26640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f845812e760 0x7f845812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845ca26640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84580984f0 con 0x7f845812f1c0 2024-09-13T19:36:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845ca26640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8458098dc0 con 0x7f845812e760 2024-09-13T19:36:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f8455d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f845812f1c0 0x7f845812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41666/0 (socket says 172.21.15.18:41666) 2024-09-13T19:36:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f8455d9b640 1 -- 172.21.15.18:0/3842079342 learned_addr learned my addr 172.21.15.18:0/3842079342 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:55.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845659c640 1 --2- 172.21.15.18:0/3842079342 >> v2:172.21.15.18:3300/0 conn(0x7f845812e760 0x7f845812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845559a640 1 -- 172.21.15.18:0/3842079342 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605284194 0 0) 0x7f84580984f0 con 0x7f845812f1c0 2024-09-13T19:36:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845559a640 1 -- 172.21.15.18:0/3842079342 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8444003530 con 0x7f845812f1c0 2024-09-13T19:36:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845659c640 1 -- 172.21.15.18:0/3842079342 >> v1:172.21.15.18:6789/0 conn(0x7f845812f1c0 legacy=0x7f845812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.966+0000 7f845659c640 1 -- 172.21.15.18:0/3842079342 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845812f5a0 con 0x7f845812e760 2024-09-13T19:36:55.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.970+0000 7f845659c640 1 --2- 172.21.15.18:0/3842079342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f845812ec80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8440009740 tx=0x7f844001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41288a7494ca0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.970+0000 7f845559a640 1 -- 172.21.15.18:0/3842079342 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84400b0070 con 0x7f845812e760 2024-09-13T19:36:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.970+0000 7f845559a640 1 -- 172.21.15.18:0/3842079342 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84400ab530 con 0x7f845812e760 2024-09-13T19:36:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.970+0000 7f845559a640 1 -- 172.21.15.18:0/3842079342 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84400ab810 con 0x7f845812e760 2024-09-13T19:36:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.970+0000 7f845ca26640 1 -- 172.21.15.18:0/3842079342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 msgr2=0x7f845812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.970+0000 7f845ca26640 1 --2- 172.21.15.18:0/3842079342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f845812ec80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8440009740 tx=0x7f844001c400 comp rx=0 tx=0).stop 2024-09-13T19:36:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- 172.21.15.18:0/3842079342 shutdown_connections 2024-09-13T19:36:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 --2- 172.21.15.18:0/3842079342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f845812ec80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- 172.21.15.18:0/3842079342 >> 172.21.15.18:0/3842079342 conn(0x7f84580a10a0 msgr2=0x7f84580a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- 172.21.15.18:0/3842079342 shutdown_connections 2024-09-13T19:36:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- 172.21.15.18:0/3842079342 wait complete. 2024-09-13T19:36:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 Processor -- start 2024-09-13T19:36:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- start start 2024-09-13T19:36:55.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f84581c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8458136e30 con 0x7f845812e760 2024-09-13T19:36:55.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f84581c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f84581c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58324/0 (socket says 172.21.15.18:58324) 2024-09-13T19:36:55.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845659c640 1 -- 172.21.15.18:0/1716124435 learned_addr learned my addr 172.21.15.18:0/1716124435 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:55.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845659c640 1 -- 172.21.15.18:0/1716124435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845809e490 con 0x7f845812e760 2024-09-13T19:36:55.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845659c640 1 --2- 172.21.15.18:0/1716124435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f84581c64a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8440019010 tx=0x7f84400191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f844effd640 1 -- 172.21.15.18:0/1716124435 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84400b9020 con 0x7f845812e760 2024-09-13T19:36:55.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84581321a0 con 0x7f845812e760 2024-09-13T19:36:55.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f844effd640 1 -- 172.21.15.18:0/1716124435 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84400ab810 con 0x7f845812e760 2024-09-13T19:36:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845809dc00 con 0x7f845812e760 2024-09-13T19:36:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f844effd640 1 -- 172.21.15.18:0/1716124435 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84400b0040 con 0x7f845812e760 2024-09-13T19:36:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8458131550 con 0x7f845812e760 2024-09-13T19:36:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.974+0000 7f844effd640 1 -- 172.21.15.18:0/1716124435 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f84400bc020 con 0x7f845812e760 2024-09-13T19:36:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.978+0000 7f844effd640 1 --2- 172.21.15.18:0/1716124435 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8438035d60 0x7f8438038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.978+0000 7f844effd640 1 -- 172.21.15.18:0/1716124435 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f84400e2f50 con 0x7f845812e760 2024-09-13T19:36:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.978+0000 7f8455d9b640 1 --2- 172.21.15.18:0/1716124435 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8438035d60 0x7f8438038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.978+0000 7f8455d9b640 1 --2- 172.21.15.18:0/1716124435 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8438035d60 0x7f8438038220 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8448007fd0 tx=0x7f8448007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:55.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:55.982+0000 7f844effd640 1 -- 172.21.15.18:0/1716124435 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f84400c3030 con 0x7f845812e760 2024-09-13T19:36:56.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.142+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84581317f0 con 0x7f8438035d60 2024-09-13T19:36:56.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.206+0000 7f844effd640 1 -- 172.21.15.18:0/1716124435 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665560 (secure 0 0 0) 0x7f84480058c0 con 0x7f8438035d60 2024-09-13T19:36:56.217 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:36:56.224 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8438035d60 msgr2=0x7f8438038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 --2- 172.21.15.18:0/1716124435 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8438035d60 0x7f8438038220 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8448007fd0 tx=0x7f8448007980 comp rx=0 tx=0).stop 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 msgr2=0x7f84581c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 --2- 172.21.15.18:0/1716124435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f84581c64a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8440019010 tx=0x7f84400191a0 comp rx=0 tx=0).stop 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 shutdown_connections 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 --2- 172.21.15.18:0/1716124435 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8438035d60 0x7f8438038220 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 --2- 172.21.15.18:0/1716124435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f845812e760 0x7f84581c64a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 >> 172.21.15.18:0/1716124435 conn(0x7f84580a10a0 msgr2=0x7f845812c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 shutdown_connections 2024-09-13T19:36:56.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.214+0000 7f845ca26640 1 -- 172.21.15.18:0/1716124435 wait complete. 2024-09-13T19:36:56.237 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-13T19:36:54.512894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4887,"num_read_kb":4468,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186288,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377301072,"statfs":{"total":386547056640,"available":386356297728,"internally_reserved":0,"allocated":54509568,"data_stored":53337730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006417"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.686210+0000","last_change":"2024-09-13T19:33:08.351986+0000","last_active":"2024-09-13T19:33:52.686210+0000","last_peered":"2024-09-13T19:33:52.686210+0000","last_clean":"2024-09-13T19:33:52.686210+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:33:52.686210+0000","last_undegraded":"2024-09-13T19:33:52.686210+0000","last_fullsized":"2024-09-13T19:33:52.686210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278487+0000","last_change":"2024-09-13T19:33:10.354610+0000","last_active":"2024-09-13T19:36:24.278487+0000","last_peered":"2024-09-13T19:36:24.278487+0000","last_clean":"2024-09-13T19:36:24.278487+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:36:24.278487+0000","last_undegraded":"2024-09-13T19:36:24.278487+0000","last_fullsized":"2024-09-13T19:36:24.278487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:03.258150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.085377+0000","last_change":"2024-09-13T19:33:08.349789+0000","last_active":"2024-09-13T19:36:24.085377+0000","last_peered":"2024-09-13T19:36:24.085377+0000","last_clean":"2024-09-13T19:36:24.085377+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:36:24.085377+0000","last_undegraded":"2024-09-13T19:36:24.085377+0000","last_fullsized":"2024-09-13T19:36:24.085377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:33.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:19.508790+0000","last_change":"2024-09-13T19:33:49.508985+0000","last_active":"2024-09-13T19:36:19.508790+0000","last_peered":"2024-09-13T19:36:19.508790+0000","last_clean":"2024-09-13T19:36:19.508790+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:36:19.508790+0000","last_undegraded":"2024-09-13T19:36:19.508790+0000","last_fullsized":"2024-09-13T19:36:19.508790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:27.111192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515719+0000","last_change":"2024-09-13T19:33:08.354845+0000","last_active":"2024-09-13T19:33:49.515719+0000","last_peered":"2024-09-13T19:33:49.515719+0000","last_clean":"2024-09-13T19:33:49.515719+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:33:49.515719+0000","last_undegraded":"2024-09-13T19:33:49.515719+0000","last_fullsized":"2024-09-13T19:33:49.515719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:38.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.223614+0000","last_change":"2024-09-13T19:33:10.349694+0000","last_active":"2024-09-13T19:36:24.223614+0000","last_peered":"2024-09-13T19:36:24.223614+0000","last_clean":"2024-09-13T19:36:24.223614+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:36:24.223614+0000","last_undegraded":"2024-09-13T19:36:24.223614+0000","last_fullsized":"2024-09-13T19:36:24.223614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:06.072800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.518838+0000","last_change":"2024-09-13T19:33:08.348066+0000","last_active":"2024-09-13T19:33:49.518838+0000","last_peered":"2024-09-13T19:33:49.518838+0000","last_clean":"2024-09-13T19:33:49.518838+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:33:49.518838+0000","last_undegraded":"2024-09-13T19:33:49.518838+0000","last_fullsized":"2024-09-13T19:33:49.518838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:46.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.522657+0000","last_change":"2024-09-13T19:33:10.348236+0000","last_active":"2024-09-13T19:34:37.522657+0000","last_peered":"2024-09-13T19:34:37.522657+0000","last_clean":"2024-09-13T19:34:37.522657+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:34:37.522657+0000","last_undegraded":"2024-09-13T19:34:37.522657+0000","last_fullsized":"2024-09-13T19:34:37.522657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:14.920902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505426+0000","last_change":"2024-09-13T19:33:08.336355+0000","last_active":"2024-09-13T19:33:49.505426+0000","last_peered":"2024-09-13T19:33:49.505426+0000","last_clean":"2024-09-13T19:33:49.505426+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:33:49.505426+0000","last_undegraded":"2024-09-13T19:33:49.505426+0000","last_fullsized":"2024-09-13T19:33:49.505426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:21.610997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.872394+0000","last_change":"2024-09-13T19:33:10.353752+0000","last_active":"2024-09-13T19:33:54.872394+0000","last_peered":"2024-09-13T19:33:54.872394+0000","last_clean":"2024-09-13T19:33:54.872394+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:33:54.872394+0000","last_undegraded":"2024-09-13T19:33:54.872394+0000","last_fullsized":"2024-09-13T19:33:54.872394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:25.322287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.518463+0000","last_change":"2024-09-13T19:33:08.333243+0000","last_active":"2024-09-13T19:33:49.518463+0000","last_peered":"2024-09-13T19:33:49.518463+0000","last_clean":"2024-09-13T19:33:49.518463+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:33:49.518463+0000","last_undegraded":"2024-09-13T19:33:49.518463+0000","last_fullsized":"2024-09-13T19:33:49.518463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:38.936603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.916325+0000","last_change":"2024-09-13T19:33:10.357587+0000","last_active":"2024-09-13T19:35:22.916325+0000","last_peered":"2024-09-13T19:35:22.916325+0000","last_clean":"2024-09-13T19:35:22.916325+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:35:22.916325+0000","last_undegraded":"2024-09-13T19:35:22.916325+0000","last_fullsized":"2024-09-13T19:35:22.916325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:19.567235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507129+0000","last_change":"2024-09-13T19:33:08.338158+0000","last_active":"2024-09-13T19:33:49.507129+0000","last_peered":"2024-09-13T19:33:49.507129+0000","last_clean":"2024-09-13T19:33:49.507129+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:33:49.507129+0000","last_undegraded":"2024-09-13T19:33:49.507129+0000","last_fullsized":"2024-09-13T19:33:49.507129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:12.010604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.180096+0000","last_change":"2024-09-13T19:33:10.355178+0000","last_active":"2024-09-13T19:35:18.180096+0000","last_peered":"2024-09-13T19:35:18.180096+0000","last_clean":"2024-09-13T19:35:18.180096+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:35:18.180096+0000","last_undegraded":"2024-09-13T19:35:18.180096+0000","last_fullsized":"2024-09-13T19:35:18.180096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495952+0000","last_change":"2024-09-13T19:33:08.331646+0000","last_active":"2024-09-13T19:33:49.495952+0000","last_peered":"2024-09-13T19:33:49.495952+0000","last_clean":"2024-09-13T19:33:49.495952+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:33:49.495952+0000","last_undegraded":"2024-09-13T19:33:49.495952+0000","last_fullsized":"2024-09-13T19:33:49.495952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.521422+0000","last_change":"2024-09-13T19:33:10.332175+0000","last_active":"2024-09-13T19:34:37.521422+0000","last_peered":"2024-09-13T19:34:37.521422+0000","last_clean":"2024-09-13T19:34:37.521422+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:34:37.521422+0000","last_undegraded":"2024-09-13T19:34:37.521422+0000","last_fullsized":"2024-09-13T19:34:37.521422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.169782+0000","last_change":"2024-09-13T19:33:10.348601+0000","last_active":"2024-09-13T19:33:54.169782+0000","last_peered":"2024-09-13T19:33:54.169782+0000","last_clean":"2024-09-13T19:33:54.169782+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:33:54.169782+0000","last_undegraded":"2024-09-13T19:33:54.169782+0000","last_fullsized":"2024-09-13T19:33:54.169782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:18.388392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.176919+0000","last_change":"2024-09-13T19:33:08.338071+0000","last_active":"2024-09-13T19:35:18.176919+0000","last_peered":"2024-09-13T19:35:18.176919+0000","last_clean":"2024-09-13T19:35:18.176919+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:35:18.176919+0000","last_undegraded":"2024-09-13T19:35:18.176919+0000","last_fullsized":"2024-09-13T19:35:18.176919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.208248+0000","last_change":"2024-09-13T19:33:10.350836+0000","last_active":"2024-09-13T19:36:24.208248+0000","last_peered":"2024-09-13T19:36:24.208248+0000","last_clean":"2024-09-13T19:36:24.208248+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:36:24.208248+0000","last_undegraded":"2024-09-13T19:36:24.208248+0000","last_fullsized":"2024-09-13T19:36:24.208248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524586+0000","last_change":"2024-09-13T19:33:08.352861+0000","last_active":"2024-09-13T19:33:49.524586+0000","last_peered":"2024-09-13T19:33:49.524586+0000","last_clean":"2024-09-13T19:33:49.524586+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:33:49.524586+0000","last_undegraded":"2024-09-13T19:33:49.524586+0000","last_fullsized":"2024-09-13T19:33:49.524586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749546+0000","last_change":"2024-09-13T19:33:10.354940+0000","last_active":"2024-09-13T19:36:23.749546+0000","last_peered":"2024-09-13T19:36:23.749546+0000","last_clean":"2024-09-13T19:36:23.749546+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:36:23.749546+0000","last_undegraded":"2024-09-13T19:36:23.749546+0000","last_fullsized":"2024-09-13T19:36:23.749546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:32.796106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.813354+0000","last_change":"2024-09-13T19:33:08.337822+0000","last_active":"2024-09-13T19:35:22.813354+0000","last_peered":"2024-09-13T19:35:22.813354+0000","last_clean":"2024-09-13T19:35:22.813354+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:35:22.813354+0000","last_undegraded":"2024-09-13T19:35:22.813354+0000","last_fullsized":"2024-09-13T19:35:22.813354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:46.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.935906+0000","last_change":"2024-09-13T19:33:10.341134+0000","last_active":"2024-09-13T19:35:22.935906+0000","last_peered":"2024-09-13T19:35:22.935906+0000","last_clean":"2024-09-13T19:35:22.935906+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:35:22.935906+0000","last_undegraded":"2024-09-13T19:35:22.935906+0000","last_fullsized":"2024-09-13T19:35:22.935906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.682621+0000","last_change":"2024-09-13T19:33:08.335101+0000","last_active":"2024-09-13T19:33:52.682621+0000","last_peered":"2024-09-13T19:33:52.682621+0000","last_clean":"2024-09-13T19:33:52.682621+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:33:52.682621+0000","last_undegraded":"2024-09-13T19:33:52.682621+0000","last_fullsized":"2024-09-13T19:33:52.682621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207846+0000","last_change":"2024-09-13T19:33:10.346663+0000","last_active":"2024-09-13T19:36:24.207846+0000","last_peered":"2024-09-13T19:36:24.207846+0000","last_clean":"2024-09-13T19:36:24.207846+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:36:24.207846+0000","last_undegraded":"2024-09-13T19:36:24.207846+0000","last_fullsized":"2024-09-13T19:36:24.207846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:19.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498616+0000","last_change":"2024-09-13T19:33:08.345933+0000","last_active":"2024-09-13T19:33:49.498616+0000","last_peered":"2024-09-13T19:33:49.498616+0000","last_clean":"2024-09-13T19:33:49.498616+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:33:49.498616+0000","last_undegraded":"2024-09-13T19:33:49.498616+0000","last_fullsized":"2024-09-13T19:33:49.498616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:20.702363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278174+0000","last_change":"2024-09-13T19:33:10.352700+0000","last_active":"2024-09-13T19:36:24.278174+0000","last_peered":"2024-09-13T19:36:24.278174+0000","last_clean":"2024-09-13T19:36:24.278174+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:36:24.278174+0000","last_undegraded":"2024-09-13T19:36:24.278174+0000","last_fullsized":"2024-09-13T19:36:24.278174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:42.703374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506193+0000","last_change":"2024-09-13T19:33:08.341033+0000","last_active":"2024-09-13T19:33:49.506193+0000","last_peered":"2024-09-13T19:33:49.506193+0000","last_clean":"2024-09-13T19:33:49.506193+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:33:49.506193+0000","last_undegraded":"2024-09-13T19:33:49.506193+0000","last_fullsized":"2024-09-13T19:33:49.506193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:05.069489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.289296+0000","last_change":"2024-09-13T19:33:18.418602+0000","last_active":"2024-09-13T19:36:24.289296+0000","last_peered":"2024-09-13T19:36:24.289296+0000","last_clean":"2024-09-13T19:36:24.289296+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:36:24.289296+0000","last_undegraded":"2024-09-13T19:36:24.289296+0000","last_fullsized":"2024-09-13T19:36:24.289296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:10.880859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.887329+0000","last_change":"2024-09-13T19:33:10.354595+0000","last_active":"2024-09-13T19:36:23.887329+0000","last_peered":"2024-09-13T19:36:23.887329+0000","last_clean":"2024-09-13T19:36:23.887329+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:36:23.887329+0000","last_undegraded":"2024-09-13T19:36:23.887329+0000","last_fullsized":"2024-09-13T19:36:23.887329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:20.279342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.425021+0000","last_change":"2024-09-13T19:33:08.354352+0000","last_active":"2024-09-13T19:36:23.425021+0000","last_peered":"2024-09-13T19:36:23.425021+0000","last_clean":"2024-09-13T19:36:23.425021+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:36:23.425021+0000","last_undegraded":"2024-09-13T19:36:23.425021+0000","last_fullsized":"2024-09-13T19:36:23.425021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:13.750930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":12,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506011+0000","last_change":"2024-09-13T19:33:12.348066+0000","last_active":"2024-09-13T19:33:49.506011+0000","last_peered":"2024-09-13T19:33:49.506011+0000","last_clean":"2024-09-13T19:33:49.506011+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:33:49.506011+0000","last_undegraded":"2024-09-13T19:33:49.506011+0000","last_fullsized":"2024-09-13T19:33:49.506011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:08.587167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.495610+0000","last_change":"2024-09-13T19:33:14.385453+0000","last_active":"2024-09-13T19:35:20.495610+0000","last_peered":"2024-09-13T19:35:20.495610+0000","last_clean":"2024-09-13T19:35:20.495610+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:35:20.495610+0000","last_undegraded":"2024-09-13T19:35:20.495610+0000","last_fullsized":"2024-09-13T19:35:20.495610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:02.906563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510495+0000","last_change":"2024-09-13T19:33:16.394148+0000","last_active":"2024-09-13T19:33:49.510495+0000","last_peered":"2024-09-13T19:33:49.510495+0000","last_clean":"2024-09-13T19:33:49.510495+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:33:49.510495+0000","last_undegraded":"2024-09-13T19:33:49.510495+0000","last_fullsized":"2024-09-13T19:33:49.510495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:48.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.211547+0000","last_change":"2024-09-13T19:33:18.412565+0000","last_active":"2024-09-13T19:36:24.211547+0000","last_peered":"2024-09-13T19:36:24.211547+0000","last_clean":"2024-09-13T19:36:24.211547+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:36:24.211547+0000","last_undegraded":"2024-09-13T19:36:24.211547+0000","last_fullsized":"2024-09-13T19:36:24.211547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:17.846459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278687+0000","last_change":"2024-09-13T19:33:10.353417+0000","last_active":"2024-09-13T19:36:24.278687+0000","last_peered":"2024-09-13T19:36:24.278687+0000","last_clean":"2024-09-13T19:36:24.278687+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:36:24.278687+0000","last_undegraded":"2024-09-13T19:36:24.278687+0000","last_fullsized":"2024-09-13T19:36:24.278687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:18.375886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.344511+0000","last_change":"2024-09-13T19:33:08.348578+0000","last_active":"2024-09-13T19:33:53.344511+0000","last_peered":"2024-09-13T19:33:53.344511+0000","last_clean":"2024-09-13T19:33:53.344511+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:33:53.344511+0000","last_undegraded":"2024-09-13T19:33:53.344511+0000","last_fullsized":"2024-09-13T19:33:53.344511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.481580+0000","last_change":"2024-09-13T19:33:49.525696+0000","last_active":"2024-09-13T19:33:50.481580+0000","last_peered":"2024-09-13T19:33:50.481580+0000","last_clean":"2024-09-13T19:33:50.481580+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:33:50.481580+0000","last_undegraded":"2024-09-13T19:33:50.481580+0000","last_fullsized":"2024-09-13T19:33:50.481580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:29.119647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510753+0000","last_change":"2024-09-13T19:33:14.364101+0000","last_active":"2024-09-13T19:33:49.510753+0000","last_peered":"2024-09-13T19:33:49.510753+0000","last_clean":"2024-09-13T19:33:49.510753+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:33:49.510753+0000","last_undegraded":"2024-09-13T19:33:49.510753+0000","last_fullsized":"2024-09-13T19:33:49.510753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:18.964704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504881+0000","last_change":"2024-09-13T19:33:16.394670+0000","last_active":"2024-09-13T19:33:49.504881+0000","last_peered":"2024-09-13T19:33:49.504881+0000","last_clean":"2024-09-13T19:33:49.504881+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:33:49.504881+0000","last_undegraded":"2024-09-13T19:33:49.504881+0000","last_fullsized":"2024-09-13T19:33:49.504881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:21.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495915+0000","last_change":"2024-09-13T19:33:18.407303+0000","last_active":"2024-09-13T19:33:49.495915+0000","last_peered":"2024-09-13T19:33:49.495915+0000","last_clean":"2024-09-13T19:33:49.495915+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:33:49.495915+0000","last_undegraded":"2024-09-13T19:33:49.495915+0000","last_fullsized":"2024-09-13T19:33:49.495915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:43.261605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'11","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.299618+0000","last_change":"2024-09-13T19:33:10.350582+0000","last_active":"2024-09-13T19:36:24.299618+0000","last_peered":"2024-09-13T19:36:24.299618+0000","last_clean":"2024-09-13T19:36:24.299618+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:36:24.299618+0000","last_undegraded":"2024-09-13T19:36:24.299618+0000","last_fullsized":"2024-09-13T19:36:24.299618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:48.834947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505235+0000","last_change":"2024-09-13T19:33:08.355253+0000","last_active":"2024-09-13T19:33:49.505235+0000","last_peered":"2024-09-13T19:33:49.505235+0000","last_clean":"2024-09-13T19:33:49.505235+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:33:49.505235+0000","last_undegraded":"2024-09-13T19:33:49.505235+0000","last_fullsized":"2024-09-13T19:33:49.505235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:24.473523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.061670+0000","last_change":"2024-09-13T19:33:12.350183+0000","last_active":"2024-09-13T19:35:22.061670+0000","last_peered":"2024-09-13T19:35:22.061670+0000","last_clean":"2024-09-13T19:35:22.061670+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:35:22.061670+0000","last_undegraded":"2024-09-13T19:35:22.061670+0000","last_fullsized":"2024-09-13T19:35:22.061670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:20.396847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.245650+0000","last_change":"2024-09-13T19:33:14.373660+0000","last_active":"2024-09-13T19:34:37.245650+0000","last_peered":"2024-09-13T19:34:37.245650+0000","last_clean":"2024-09-13T19:34:37.245650+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:34:37.245650+0000","last_undegraded":"2024-09-13T19:34:37.245650+0000","last_fullsized":"2024-09-13T19:34:37.245650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:29.436165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":391,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.594796+0000","last_change":"2024-09-13T19:33:16.400903+0000","last_active":"2024-09-13T19:36:22.594796+0000","last_peered":"2024-09-13T19:36:22.594796+0000","last_clean":"2024-09-13T19:36:22.594796+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:36:22.594796+0000","last_undegraded":"2024-09-13T19:36:22.594796+0000","last_fullsized":"2024-09-13T19:36:22.594796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:31.714918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.826207+0000","last_change":"2024-09-13T19:33:18.416828+0000","last_active":"2024-09-13T19:33:53.826207+0000","last_peered":"2024-09-13T19:33:53.826207+0000","last_clean":"2024-09-13T19:33:53.826207+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:33:53.826207+0000","last_undegraded":"2024-09-13T19:33:53.826207+0000","last_fullsized":"2024-09-13T19:33:53.826207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:50.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.728071+0000","last_change":"2024-09-13T19:33:10.342044+0000","last_active":"2024-09-13T19:36:23.728071+0000","last_peered":"2024-09-13T19:36:23.728071+0000","last_clean":"2024-09-13T19:36:23.728071+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:36:23.728071+0000","last_undegraded":"2024-09-13T19:36:23.728071+0000","last_fullsized":"2024-09-13T19:36:23.728071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:43.220677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498238+0000","last_change":"2024-09-13T19:33:08.337394+0000","last_active":"2024-09-13T19:33:49.498238+0000","last_peered":"2024-09-13T19:33:49.498238+0000","last_clean":"2024-09-13T19:33:49.498238+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:33:49.498238+0000","last_undegraded":"2024-09-13T19:33:49.498238+0000","last_fullsized":"2024-09-13T19:33:49.498238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:13.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513312+0000","last_change":"2024-09-13T19:33:12.356265+0000","last_active":"2024-09-13T19:33:49.513312+0000","last_peered":"2024-09-13T19:33:49.513312+0000","last_clean":"2024-09-13T19:33:49.513312+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:33:49.513312+0000","last_undegraded":"2024-09-13T19:33:49.513312+0000","last_fullsized":"2024-09-13T19:33:49.513312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:52.279609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.486820+0000","last_change":"2024-09-13T19:33:14.371462+0000","last_active":"2024-09-13T19:35:20.486820+0000","last_peered":"2024-09-13T19:35:20.486820+0000","last_clean":"2024-09-13T19:35:20.486820+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:35:20.486820+0000","last_undegraded":"2024-09-13T19:35:20.486820+0000","last_fullsized":"2024-09-13T19:35:20.486820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:35.666084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.287443+0000","last_change":"2024-09-13T19:33:16.392294+0000","last_active":"2024-09-13T19:36:24.287443+0000","last_peered":"2024-09-13T19:36:24.287443+0000","last_clean":"2024-09-13T19:36:24.287443+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:36:24.287443+0000","last_undegraded":"2024-09-13T19:36:24.287443+0000","last_fullsized":"2024-09-13T19:36:24.287443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:21.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096128+0000","last_change":"2024-09-13T19:33:10.356414+0000","last_active":"2024-09-13T19:36:24.096128+0000","last_peered":"2024-09-13T19:36:24.096128+0000","last_clean":"2024-09-13T19:36:24.096128+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:36:24.096128+0000","last_undegraded":"2024-09-13T19:36:24.096128+0000","last_fullsized":"2024-09-13T19:36:24.096128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:05.759718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.500106+0000","last_change":"2024-09-13T19:33:08.347478+0000","last_active":"2024-09-13T19:35:25.500106+0000","last_peered":"2024-09-13T19:35:25.500106+0000","last_clean":"2024-09-13T19:35:25.500106+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:35:25.500106+0000","last_undegraded":"2024-09-13T19:35:25.500106+0000","last_fullsized":"2024-09-13T19:35:25.500106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499234+0000","last_change":"2024-09-13T19:33:12.362201+0000","last_active":"2024-09-13T19:33:49.499234+0000","last_peered":"2024-09-13T19:33:49.499234+0000","last_clean":"2024-09-13T19:33:49.499234+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:33:49.499234+0000","last_undegraded":"2024-09-13T19:33:49.499234+0000","last_fullsized":"2024-09-13T19:33:49.499234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:20.396847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.503328+0000","last_change":"2024-09-13T19:33:14.367131+0000","last_active":"2024-09-13T19:35:20.503328+0000","last_peered":"2024-09-13T19:35:20.503328+0000","last_clean":"2024-09-13T19:35:20.503328+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:35:20.503328+0000","last_undegraded":"2024-09-13T19:35:20.503328+0000","last_fullsized":"2024-09-13T19:35:20.503328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:41.769483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.496898+0000","last_change":"2024-09-13T19:33:16.372536+0000","last_active":"2024-09-13T19:33:49.496898+0000","last_peered":"2024-09-13T19:33:49.496898+0000","last_clean":"2024-09-13T19:33:49.496898+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:33:49.496898+0000","last_undegraded":"2024-09-13T19:33:49.496898+0000","last_fullsized":"2024-09-13T19:33:49.496898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:31.023125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.255184+0000","last_change":"2024-09-13T19:33:18.417415+0000","last_active":"2024-09-13T19:34:37.255184+0000","last_peered":"2024-09-13T19:34:37.255184+0000","last_clean":"2024-09-13T19:34:37.255184+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:34:37.255184+0000","last_undegraded":"2024-09-13T19:34:37.255184+0000","last_fullsized":"2024-09-13T19:34:37.255184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:08.824528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278394+0000","last_change":"2024-09-13T19:33:10.352105+0000","last_active":"2024-09-13T19:36:24.278394+0000","last_peered":"2024-09-13T19:36:24.278394+0000","last_clean":"2024-09-13T19:36:24.278394+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:36:24.278394+0000","last_undegraded":"2024-09-13T19:36:24.278394+0000","last_fullsized":"2024-09-13T19:36:24.278394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.525145+0000","last_change":"2024-09-13T19:33:08.351524+0000","last_active":"2024-09-13T19:33:49.525145+0000","last_peered":"2024-09-13T19:33:49.525145+0000","last_clean":"2024-09-13T19:33:49.525145+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:33:49.525145+0000","last_undegraded":"2024-09-13T19:33:49.525145+0000","last_fullsized":"2024-09-13T19:33:49.525145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:27.423338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497283+0000","last_change":"2024-09-13T19:33:12.346361+0000","last_active":"2024-09-13T19:33:49.497283+0000","last_peered":"2024-09-13T19:33:49.497283+0000","last_clean":"2024-09-13T19:33:49.497283+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:33:49.497283+0000","last_undegraded":"2024-09-13T19:33:49.497283+0000","last_fullsized":"2024-09-13T19:33:49.497283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:12.646509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'32","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504566+0000","last_change":"2024-09-13T19:33:14.391496+0000","last_active":"2024-09-13T19:35:30.504566+0000","last_peered":"2024-09-13T19:35:30.504566+0000","last_clean":"2024-09-13T19:35:30.504566+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:35:30.504566+0000","last_undegraded":"2024-09-13T19:35:30.504566+0000","last_fullsized":"2024-09-13T19:35:30.504566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:30.872095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.496182+0000","last_change":"2024-09-13T19:33:16.375752+0000","last_active":"2024-09-13T19:33:49.496182+0000","last_peered":"2024-09-13T19:33:49.496182+0000","last_clean":"2024-09-13T19:33:49.496182+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:33:49.496182+0000","last_undegraded":"2024-09-13T19:33:49.496182+0000","last_fullsized":"2024-09-13T19:33:49.496182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:57.894724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:31.549249+0000","last_change":"2024-09-13T19:33:18.420383+0000","last_active":"2024-09-13T19:34:31.549249+0000","last_peered":"2024-09-13T19:34:31.549249+0000","last_clean":"2024-09-13T19:34:31.549249+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:34:31.549249+0000","last_undegraded":"2024-09-13T19:34:31.549249+0000","last_fullsized":"2024-09-13T19:34:31.549249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:08.579627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207661+0000","last_change":"2024-09-13T19:33:10.330476+0000","last_active":"2024-09-13T19:36:24.207661+0000","last_peered":"2024-09-13T19:36:24.207661+0000","last_clean":"2024-09-13T19:36:24.207661+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:36:24.207661+0000","last_undegraded":"2024-09-13T19:36:24.207661+0000","last_fullsized":"2024-09-13T19:36:24.207661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:13.461248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507615+0000","last_change":"2024-09-13T19:33:08.341877+0000","last_active":"2024-09-13T19:33:49.507615+0000","last_peered":"2024-09-13T19:33:49.507615+0000","last_clean":"2024-09-13T19:33:49.507615+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:33:49.507615+0000","last_undegraded":"2024-09-13T19:33:49.507615+0000","last_fullsized":"2024-09-13T19:33:49.507615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.834092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501241+0000","last_change":"2024-09-13T19:33:12.348033+0000","last_active":"2024-09-13T19:33:49.501241+0000","last_peered":"2024-09-13T19:33:49.501241+0000","last_clean":"2024-09-13T19:33:49.501241+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:33:49.501241+0000","last_undegraded":"2024-09-13T19:33:49.501241+0000","last_fullsized":"2024-09-13T19:33:49.501241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:26.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.506753+0000","last_change":"2024-09-13T19:33:14.366093+0000","last_active":"2024-09-13T19:35:20.506753+0000","last_peered":"2024-09-13T19:35:20.506753+0000","last_clean":"2024-09-13T19:35:20.506753+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:35:20.506753+0000","last_undegraded":"2024-09-13T19:35:20.506753+0000","last_fullsized":"2024-09-13T19:35:20.506753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.379070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":355,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.654764+0000","last_change":"2024-09-13T19:33:16.377299+0000","last_active":"2024-09-13T19:36:24.654764+0000","last_peered":"2024-09-13T19:36:24.654764+0000","last_clean":"2024-09-13T19:36:24.654764+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:36:24.654764+0000","last_undegraded":"2024-09-13T19:36:24.654764+0000","last_fullsized":"2024-09-13T19:36:24.654764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:48.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.894043+0000","last_change":"2024-09-13T19:33:18.416155+0000","last_active":"2024-09-13T19:36:23.894043+0000","last_peered":"2024-09-13T19:36:23.894043+0000","last_clean":"2024-09-13T19:36:23.894043+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:36:23.894043+0000","last_undegraded":"2024-09-13T19:36:23.894043+0000","last_fullsized":"2024-09-13T19:36:23.894043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:28.419736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096247+0000","last_change":"2024-09-13T19:33:10.337441+0000","last_active":"2024-09-13T19:36:24.096247+0000","last_peered":"2024-09-13T19:36:24.096247+0000","last_clean":"2024-09-13T19:36:24.096247+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:36:24.096247+0000","last_undegraded":"2024-09-13T19:36:24.096247+0000","last_fullsized":"2024-09-13T19:36:24.096247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.481677+0000","last_change":"2024-09-13T19:33:49.524748+0000","last_active":"2024-09-13T19:33:50.481677+0000","last_peered":"2024-09-13T19:33:50.481677+0000","last_clean":"2024-09-13T19:33:50.481677+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:33:50.481677+0000","last_undegraded":"2024-09-13T19:33:50.481677+0000","last_fullsized":"2024-09-13T19:33:50.481677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:26.896197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498193+0000","last_change":"2024-09-13T19:33:12.346224+0000","last_active":"2024-09-13T19:33:49.498193+0000","last_peered":"2024-09-13T19:33:49.498193+0000","last_clean":"2024-09-13T19:33:49.498193+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:33:49.498193+0000","last_undegraded":"2024-09-13T19:33:49.498193+0000","last_fullsized":"2024-09-13T19:33:49.498193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:20.747600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'55","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.509782+0000","last_change":"2024-09-13T19:33:14.376236+0000","last_active":"2024-09-13T19:35:20.509782+0000","last_peered":"2024-09-13T19:35:20.509782+0000","last_clean":"2024-09-13T19:35:20.509782+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:35:20.509782+0000","last_undegraded":"2024-09-13T19:35:20.509782+0000","last_fullsized":"2024-09-13T19:35:20.509782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:08.849176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497015+0000","last_change":"2024-09-13T19:33:16.380438+0000","last_active":"2024-09-13T19:33:49.497015+0000","last_peered":"2024-09-13T19:33:49.497015+0000","last_clean":"2024-09-13T19:33:49.497015+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:33:49.497015+0000","last_undegraded":"2024-09-13T19:33:49.497015+0000","last_fullsized":"2024-09-13T19:33:49.497015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:21.949160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.577660+0000","last_change":"2024-09-13T19:33:18.397231+0000","last_active":"2024-09-13T19:36:24.577660+0000","last_peered":"2024-09-13T19:36:24.577660+0000","last_clean":"2024-09-13T19:36:24.577660+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:36:24.577660+0000","last_undegraded":"2024-09-13T19:36:24.577660+0000","last_fullsized":"2024-09-13T19:36:24.577660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:25.940195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749484+0000","last_change":"2024-09-13T19:33:49.534836+0000","last_active":"2024-09-13T19:36:23.749484+0000","last_peered":"2024-09-13T19:36:23.749484+0000","last_clean":"2024-09-13T19:36:23.749484+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:36:23.749484+0000","last_undegraded":"2024-09-13T19:36:23.749484+0000","last_fullsized":"2024-09-13T19:36:23.749484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:46.631431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.680205+0000","last_change":"2024-09-13T19:33:08.332135+0000","last_active":"2024-09-13T19:33:52.680205+0000","last_peered":"2024-09-13T19:33:52.680205+0000","last_clean":"2024-09-13T19:33:52.680205+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:33:52.680205+0000","last_undegraded":"2024-09-13T19:33:52.680205+0000","last_fullsized":"2024-09-13T19:33:52.680205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:27.423338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520294+0000","last_change":"2024-09-13T19:33:12.358273+0000","last_active":"2024-09-13T19:33:49.520294+0000","last_peered":"2024-09-13T19:33:49.520294+0000","last_clean":"2024-09-13T19:33:49.520294+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:33:49.520294+0000","last_undegraded":"2024-09-13T19:33:49.520294+0000","last_fullsized":"2024-09-13T19:33:49.520294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:36.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'33","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.475682+0000","last_change":"2024-09-13T19:33:14.364059+0000","last_active":"2024-09-13T19:35:20.475682+0000","last_peered":"2024-09-13T19:35:20.475682+0000","last_clean":"2024-09-13T19:35:20.475682+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:35:20.475682+0000","last_undegraded":"2024-09-13T19:35:20.475682+0000","last_fullsized":"2024-09-13T19:35:20.475682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:22.396286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512534+0000","last_change":"2024-09-13T19:33:16.403943+0000","last_active":"2024-09-13T19:33:49.512534+0000","last_peered":"2024-09-13T19:33:49.512534+0000","last_clean":"2024-09-13T19:33:49.512534+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:33:49.512534+0000","last_undegraded":"2024-09-13T19:33:49.512534+0000","last_fullsized":"2024-09-13T19:33:49.512534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:15.430735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.501955+0000","last_change":"2024-09-13T19:33:18.415707+0000","last_active":"2024-09-13T19:35:20.501955+0000","last_peered":"2024-09-13T19:35:20.501955+0000","last_clean":"2024-09-13T19:35:20.501955+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:35:20.501955+0000","last_undegraded":"2024-09-13T19:35:20.501955+0000","last_fullsized":"2024-09-13T19:35:20.501955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:34.463379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.279120+0000","last_change":"2024-09-13T19:33:10.359068+0000","last_active":"2024-09-13T19:36:24.279120+0000","last_peered":"2024-09-13T19:36:24.279120+0000","last_clean":"2024-09-13T19:36:24.279120+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:36:24.279120+0000","last_undegraded":"2024-09-13T19:36:24.279120+0000","last_fullsized":"2024-09-13T19:36:24.279120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:17.259191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507820+0000","last_change":"2024-09-13T19:33:08.342280+0000","last_active":"2024-09-13T19:33:49.507820+0000","last_peered":"2024-09-13T19:33:49.507820+0000","last_clean":"2024-09-13T19:33:49.507820+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:33:49.507820+0000","last_undegraded":"2024-09-13T19:33:49.507820+0000","last_fullsized":"2024-09-13T19:33:49.507820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:18.144107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501604+0000","last_change":"2024-09-13T19:33:12.348184+0000","last_active":"2024-09-13T19:33:49.501604+0000","last_peered":"2024-09-13T19:33:49.501604+0000","last_clean":"2024-09-13T19:33:49.501604+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:33:49.501604+0000","last_undegraded":"2024-09-13T19:33:49.501604+0000","last_fullsized":"2024-09-13T19:33:49.501604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:34.837586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.524983+0000","last_change":"2024-09-13T19:33:14.354520+0000","last_active":"2024-09-13T19:35:20.524983+0000","last_peered":"2024-09-13T19:35:20.524983+0000","last_clean":"2024-09-13T19:35:20.524983+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:35:20.524983+0000","last_undegraded":"2024-09-13T19:35:20.524983+0000","last_fullsized":"2024-09-13T19:35:20.524983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:18.105050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":431,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.623346+0000","last_change":"2024-09-13T19:33:16.390808+0000","last_active":"2024-09-13T19:36:24.623346+0000","last_peered":"2024-09-13T19:36:24.623346+0000","last_clean":"2024-09-13T19:36:24.623346+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:36:24.623346+0000","last_undegraded":"2024-09-13T19:36:24.623346+0000","last_fullsized":"2024-09-13T19:36:24.623346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:24.410292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.108546+0000","last_change":"2024-09-13T19:33:18.415690+0000","last_active":"2024-09-13T19:36:24.108546+0000","last_peered":"2024-09-13T19:36:24.108546+0000","last_clean":"2024-09-13T19:36:24.108546+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:36:24.108546+0000","last_undegraded":"2024-09-13T19:36:24.108546+0000","last_fullsized":"2024-09-13T19:36:24.108546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.646763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.528476+0000","last_change":"2024-09-13T19:33:10.333244+0000","last_active":"2024-09-13T19:33:49.528476+0000","last_peered":"2024-09-13T19:33:49.528476+0000","last_clean":"2024-09-13T19:33:49.528476+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:33:49.528476+0000","last_undegraded":"2024-09-13T19:33:49.528476+0000","last_fullsized":"2024-09-13T19:33:49.528476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.133553+0000","last_change":"2024-09-13T19:33:08.355262+0000","last_active":"2024-09-13T19:33:54.133553+0000","last_peered":"2024-09-13T19:33:54.133553+0000","last_clean":"2024-09-13T19:33:54.133553+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:33:54.133553+0000","last_undegraded":"2024-09-13T19:33:54.133553+0000","last_fullsized":"2024-09-13T19:33:54.133553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:41.635043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.074154+0000","last_change":"2024-09-13T19:33:12.355832+0000","last_active":"2024-09-13T19:35:22.074154+0000","last_peered":"2024-09-13T19:35:22.074154+0000","last_clean":"2024-09-13T19:35:22.074154+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:35:22.074154+0000","last_undegraded":"2024-09-13T19:35:22.074154+0000","last_fullsized":"2024-09-13T19:35:22.074154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:07.768173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509258+0000","last_change":"2024-09-13T19:33:14.392024+0000","last_active":"2024-09-13T19:33:49.509258+0000","last_peered":"2024-09-13T19:33:49.509258+0000","last_clean":"2024-09-13T19:33:49.509258+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:33:49.509258+0000","last_undegraded":"2024-09-13T19:33:49.509258+0000","last_fullsized":"2024-09-13T19:33:49.509258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:15.449504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":460,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.450229+0000","last_change":"2024-09-13T19:33:16.383487+0000","last_active":"2024-09-13T19:36:24.450229+0000","last_peered":"2024-09-13T19:36:24.450229+0000","last_clean":"2024-09-13T19:36:24.450229+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:36:24.450229+0000","last_undegraded":"2024-09-13T19:36:24.450229+0000","last_fullsized":"2024-09-13T19:36:24.450229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.397168+0000","last_change":"2024-09-13T19:33:18.405074+0000","last_active":"2024-09-13T19:35:22.397168+0000","last_peered":"2024-09-13T19:35:22.397168+0000","last_clean":"2024-09-13T19:35:22.397168+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:35:22.397168+0000","last_undegraded":"2024-09-13T19:35:22.397168+0000","last_fullsized":"2024-09-13T19:35:22.397168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:21.165425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278265+0000","last_change":"2024-09-13T19:33:10.351617+0000","last_active":"2024-09-13T19:36:24.278265+0000","last_peered":"2024-09-13T19:36:24.278265+0000","last_clean":"2024-09-13T19:36:24.278265+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:36:24.278265+0000","last_undegraded":"2024-09-13T19:36:24.278265+0000","last_fullsized":"2024-09-13T19:36:24.278265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:31.372401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.266908+0000","last_change":"2024-09-13T19:33:08.341993+0000","last_active":"2024-09-13T19:36:24.266908+0000","last_peered":"2024-09-13T19:36:24.266908+0000","last_clean":"2024-09-13T19:36:24.266908+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:36:24.266908+0000","last_undegraded":"2024-09-13T19:36:24.266908+0000","last_fullsized":"2024-09-13T19:36:24.266908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:50.411658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512635+0000","last_change":"2024-09-13T19:33:12.360435+0000","last_active":"2024-09-13T19:33:49.512635+0000","last_peered":"2024-09-13T19:33:49.512635+0000","last_clean":"2024-09-13T19:33:49.512635+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:33:49.512635+0000","last_undegraded":"2024-09-13T19:33:49.512635+0000","last_fullsized":"2024-09-13T19:33:49.512635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:06.192815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.497921+0000","last_change":"2024-09-13T19:33:14.363402+0000","last_active":"2024-09-13T19:35:20.497921+0000","last_peered":"2024-09-13T19:35:20.497921+0000","last_clean":"2024-09-13T19:35:20.497921+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:35:20.497921+0000","last_undegraded":"2024-09-13T19:35:20.497921+0000","last_fullsized":"2024-09-13T19:35:20.497921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.213821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.519148+0000","last_change":"2024-09-13T19:33:16.392497+0000","last_active":"2024-09-13T19:33:49.519148+0000","last_peered":"2024-09-13T19:33:49.519148+0000","last_clean":"2024-09-13T19:33:49.519148+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:33:49.519148+0000","last_undegraded":"2024-09-13T19:33:49.519148+0000","last_fullsized":"2024-09-13T19:33:49.519148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:08.307092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.381185+0000","last_change":"2024-09-13T19:33:18.409575+0000","last_active":"2024-09-13T19:36:24.381185+0000","last_peered":"2024-09-13T19:36:24.381185+0000","last_clean":"2024-09-13T19:36:24.381185+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:36:24.381185+0000","last_undegraded":"2024-09-13T19:36:24.381185+0000","last_fullsized":"2024-09-13T19:36:24.381185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:03.846914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507876+0000","last_change":"2024-09-13T19:33:10.358838+0000","last_active":"2024-09-13T19:33:49.507876+0000","last_peered":"2024-09-13T19:33:49.507876+0000","last_clean":"2024-09-13T19:33:49.507876+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:33:49.507876+0000","last_undegraded":"2024-09-13T19:33:49.507876+0000","last_fullsized":"2024-09-13T19:33:49.507876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:55.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497900+0000","last_change":"2024-09-13T19:32:57.877961+0000","last_active":"2024-09-13T19:33:49.497900+0000","last_peered":"2024-09-13T19:33:49.497900+0000","last_clean":"2024-09-13T19:33:49.497900+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:33:49.497900+0000","last_undegraded":"2024-09-13T19:33:49.497900+0000","last_fullsized":"2024-09-13T19:33:49.497900+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_clean_scrub_stamp":"2024-09-13T19:32:56.474648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504144+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:33:49.504144+0000","last_peered":"2024-09-13T19:33:49.504144+0000","last_clean":"2024-09-13T19:33:49.504144+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:33:49.504144+0000","last_undegraded":"2024-09-13T19:33:49.504144+0000","last_fullsized":"2024-09-13T19:33:49.504144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:41.432070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505312+0000","last_change":"2024-09-13T19:33:08.353659+0000","last_active":"2024-09-13T19:33:49.505312+0000","last_peered":"2024-09-13T19:33:49.505312+0000","last_clean":"2024-09-13T19:33:49.505312+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:33:49.505312+0000","last_undegraded":"2024-09-13T19:33:49.505312+0000","last_fullsized":"2024-09-13T19:33:49.505312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:40.029223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.526320+0000","last_change":"2024-09-13T19:33:49.523626+0000","last_active":"2024-09-13T19:33:49.526320+0000","last_peered":"2024-09-13T19:33:49.526320+0000","last_clean":"2024-09-13T19:33:49.526320+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:33:49.526320+0000","last_undegraded":"2024-09-13T19:33:49.526320+0000","last_fullsized":"2024-09-13T19:33:49.526320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:00.894619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":145,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.519920+0000","last_change":"2024-09-13T19:33:14.384076+0000","last_active":"2024-09-13T19:35:20.519920+0000","last_peered":"2024-09-13T19:35:20.519920+0000","last_clean":"2024-09-13T19:35:20.519920+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:35:20.519920+0000","last_undegraded":"2024-09-13T19:35:20.519920+0000","last_fullsized":"2024-09-13T19:35:20.519920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:28.403671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502313+0000","last_change":"2024-09-13T19:33:16.378379+0000","last_active":"2024-09-13T19:33:49.502313+0000","last_peered":"2024-09-13T19:33:49.502313+0000","last_clean":"2024-09-13T19:33:49.502313+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:33:49.502313+0000","last_undegraded":"2024-09-13T19:33:49.502313+0000","last_fullsized":"2024-09-13T19:33:49.502313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:10.218765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.306871+0000","last_change":"2024-09-13T19:33:18.410177+0000","last_active":"2024-09-13T19:36:24.306871+0000","last_peered":"2024-09-13T19:36:24.306871+0000","last_clean":"2024-09-13T19:36:24.306871+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:36:24.306871+0000","last_undegraded":"2024-09-13T19:36:24.306871+0000","last_fullsized":"2024-09-13T19:36:24.306871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:27.219574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097115+0000","last_change":"2024-09-13T19:33:49.529179+0000","last_active":"2024-09-13T19:36:24.097115+0000","last_peered":"2024-09-13T19:36:24.097115+0000","last_clean":"2024-09-13T19:36:24.097115+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:36:24.097115+0000","last_undegraded":"2024-09-13T19:36:24.097115+0000","last_fullsized":"2024-09-13T19:36:24.097115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:00.531797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502217+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:33:49.502217+0000","last_peered":"2024-09-13T19:33:49.502217+0000","last_clean":"2024-09-13T19:33:49.502217+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:33:49.502217+0000","last_undegraded":"2024-09-13T19:33:49.502217+0000","last_fullsized":"2024-09-13T19:33:49.502217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.679995+0000","last_change":"2024-09-13T19:33:08.349400+0000","last_active":"2024-09-13T19:33:52.679995+0000","last_peered":"2024-09-13T19:33:52.679995+0000","last_clean":"2024-09-13T19:33:52.679995+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:33:52.679995+0000","last_undegraded":"2024-09-13T19:33:52.679995+0000","last_fullsized":"2024-09-13T19:33:52.679995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517380+0000","last_change":"2024-09-13T19:33:12.348082+0000","last_active":"2024-09-13T19:33:49.517380+0000","last_peered":"2024-09-13T19:33:49.517380+0000","last_clean":"2024-09-13T19:33:49.517380+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:33:49.517380+0000","last_undegraded":"2024-09-13T19:33:49.517380+0000","last_fullsized":"2024-09-13T19:33:49.517380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:26.997175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'273","reported_seq":477,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.594985+0000","last_change":"2024-09-13T19:33:14.367931+0000","last_active":"2024-09-13T19:36:22.594985+0000","last_peered":"2024-09-13T19:36:22.594985+0000","last_clean":"2024-09-13T19:36:22.594985+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:36:22.594985+0000","last_undegraded":"2024-09-13T19:36:22.594985+0000","last_fullsized":"2024-09-13T19:36:22.594985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:56.984417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505001+0000","last_change":"2024-09-13T19:33:16.401894+0000","last_active":"2024-09-13T19:33:49.505001+0000","last_peered":"2024-09-13T19:33:49.505001+0000","last_clean":"2024-09-13T19:33:49.505001+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:33:49.505001+0000","last_undegraded":"2024-09-13T19:33:49.505001+0000","last_fullsized":"2024-09-13T19:33:49.505001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.888292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.248196+0000","last_change":"2024-09-13T19:33:18.424198+0000","last_active":"2024-09-13T19:34:37.248196+0000","last_peered":"2024-09-13T19:34:37.248196+0000","last_clean":"2024-09-13T19:34:37.248196+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:34:37.248196+0000","last_undegraded":"2024-09-13T19:34:37.248196+0000","last_fullsized":"2024-09-13T19:34:37.248196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:43.261605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.917935+0000","last_change":"2024-09-13T19:33:10.340098+0000","last_active":"2024-09-13T19:35:22.917935+0000","last_peered":"2024-09-13T19:35:22.917935+0000","last_clean":"2024-09-13T19:35:22.917935+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:35:22.917935+0000","last_undegraded":"2024-09-13T19:35:22.917935+0000","last_fullsized":"2024-09-13T19:35:22.917935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:42.703374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517014+0000","last_change":"2024-09-13T19:33:02.801369+0000","last_active":"2024-09-13T19:33:49.517014+0000","last_peered":"2024-09-13T19:33:49.517014+0000","last_clean":"2024-09-13T19:33:49.517014+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:33:49.517014+0000","last_undegraded":"2024-09-13T19:33:49.517014+0000","last_fullsized":"2024-09-13T19:33:49.517014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:34.016598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.055669+0000","last_change":"2024-09-13T19:33:08.346175+0000","last_active":"2024-09-13T19:36:24.055669+0000","last_peered":"2024-09-13T19:36:24.055669+0000","last_clean":"2024-09-13T19:36:24.055669+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:36:24.055669+0000","last_undegraded":"2024-09-13T19:36:24.055669+0000","last_fullsized":"2024-09-13T19:36:24.055669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.525531+0000","last_change":"2024-09-13T19:33:12.354984+0000","last_active":"2024-09-13T19:33:49.525531+0000","last_peered":"2024-09-13T19:33:49.525531+0000","last_clean":"2024-09-13T19:33:49.525531+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:33:49.525531+0000","last_undegraded":"2024-09-13T19:33:49.525531+0000","last_fullsized":"2024-09-13T19:33:49.525531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:33.380857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.595253+0000","last_change":"2024-09-13T19:33:14.366942+0000","last_active":"2024-09-13T19:36:22.595253+0000","last_peered":"2024-09-13T19:36:22.595253+0000","last_clean":"2024-09-13T19:36:22.595253+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:36:22.595253+0000","last_undegraded":"2024-09-13T19:36:22.595253+0000","last_fullsized":"2024-09-13T19:36:22.595253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:22.408791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498516+0000","last_change":"2024-09-13T19:33:16.375344+0000","last_active":"2024-09-13T19:33:49.498516+0000","last_peered":"2024-09-13T19:33:49.498516+0000","last_clean":"2024-09-13T19:33:49.498516+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:33:49.498516+0000","last_undegraded":"2024-09-13T19:33:49.498516+0000","last_fullsized":"2024-09-13T19:33:49.498516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:03.086305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502961+0000","last_change":"2024-09-13T19:33:18.414878+0000","last_active":"2024-09-13T19:33:49.502961+0000","last_peered":"2024-09-13T19:33:49.502961+0000","last_clean":"2024-09-13T19:33:49.502961+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:33:49.502961+0000","last_undegraded":"2024-09-13T19:33:49.502961+0000","last_fullsized":"2024-09-13T19:33:49.502961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:55.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494504+0000","last_change":"2024-09-13T19:33:10.346530+0000","last_active":"2024-09-13T19:35:14.494504+0000","last_peered":"2024-09-13T19:35:14.494504+0000","last_clean":"2024-09-13T19:35:14.494504+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:35:14.494504+0000","last_undegraded":"2024-09-13T19:35:14.494504+0000","last_fullsized":"2024-09-13T19:35:14.494504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505061+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:33:49.505061+0000","last_peered":"2024-09-13T19:33:49.505061+0000","last_clean":"2024-09-13T19:33:49.505061+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:33:49.505061+0000","last_undegraded":"2024-09-13T19:33:49.505061+0000","last_fullsized":"2024-09-13T19:33:49.505061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:14.144438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.519543+0000","last_change":"2024-09-13T19:33:08.333264+0000","last_active":"2024-09-13T19:33:49.519543+0000","last_peered":"2024-09-13T19:33:49.519543+0000","last_clean":"2024-09-13T19:33:49.519543+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:33:49.519543+0000","last_undegraded":"2024-09-13T19:33:49.519543+0000","last_fullsized":"2024-09-13T19:33:49.519543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:49.017180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501407+0000","last_change":"2024-09-13T19:33:12.353699+0000","last_active":"2024-09-13T19:33:49.501407+0000","last_peered":"2024-09-13T19:33:49.501407+0000","last_clean":"2024-09-13T19:33:49.501407+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:33:49.501407+0000","last_undegraded":"2024-09-13T19:33:49.501407+0000","last_fullsized":"2024-09-13T19:33:49.501407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.424221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.961527+0000","last_change":"2024-09-13T19:33:14.392626+0000","last_active":"2024-09-13T19:36:22.961527+0000","last_peered":"2024-09-13T19:36:22.961527+0000","last_clean":"2024-09-13T19:36:22.961527+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:36:22.961527+0000","last_undegraded":"2024-09-13T19:36:22.961527+0000","last_fullsized":"2024-09-13T19:36:22.961527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:39.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512753+0000","last_change":"2024-09-13T19:33:16.402476+0000","last_active":"2024-09-13T19:33:49.512753+0000","last_peered":"2024-09-13T19:33:49.512753+0000","last_clean":"2024-09-13T19:33:49.512753+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:33:49.512753+0000","last_undegraded":"2024-09-13T19:33:49.512753+0000","last_fullsized":"2024-09-13T19:33:49.512753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:05.574640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.443488+0000","last_change":"2024-09-13T19:33:18.418222+0000","last_active":"2024-09-13T19:36:24.443488+0000","last_peered":"2024-09-13T19:36:24.443488+0000","last_clean":"2024-09-13T19:36:24.443488+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:36:24.443488+0000","last_undegraded":"2024-09-13T19:36:24.443488+0000","last_fullsized":"2024-09-13T19:36:24.443488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:20.302502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096257+0000","last_change":"2024-09-13T19:33:10.357857+0000","last_active":"2024-09-13T19:36:24.096257+0000","last_peered":"2024-09-13T19:36:24.096257+0000","last_clean":"2024-09-13T19:36:24.096257+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:36:24.096257+0000","last_undegraded":"2024-09-13T19:36:24.096257+0000","last_fullsized":"2024-09-13T19:36:24.096257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:17.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521202+0000","last_change":"2024-09-13T19:33:08.332236+0000","last_active":"2024-09-13T19:33:49.521202+0000","last_peered":"2024-09-13T19:33:49.521202+0000","last_clean":"2024-09-13T19:33:49.521202+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:33:49.521202+0000","last_undegraded":"2024-09-13T19:33:49.521202+0000","last_fullsized":"2024-09-13T19:33:49.521202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498362+0000","last_change":"2024-09-13T19:33:02.523552+0000","last_active":"2024-09-13T19:33:49.498362+0000","last_peered":"2024-09-13T19:33:49.498362+0000","last_clean":"2024-09-13T19:33:49.498362+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:33:49.498362+0000","last_undegraded":"2024-09-13T19:33:49.498362+0000","last_fullsized":"2024-09-13T19:33:49.498362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:43.683067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495504+0000","last_change":"2024-09-13T19:33:12.354235+0000","last_active":"2024-09-13T19:35:19.495504+0000","last_peered":"2024-09-13T19:35:19.495504+0000","last_clean":"2024-09-13T19:35:19.495504+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:35:19.495504+0000","last_undegraded":"2024-09-13T19:35:19.495504+0000","last_fullsized":"2024-09-13T19:35:19.495504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:16.801145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.522986+0000","last_change":"2024-09-13T19:33:14.353733+0000","last_active":"2024-09-13T19:35:20.522986+0000","last_peered":"2024-09-13T19:35:20.522986+0000","last_clean":"2024-09-13T19:35:20.522986+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:35:20.522986+0000","last_undegraded":"2024-09-13T19:35:20.522986+0000","last_fullsized":"2024-09-13T19:35:20.522986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:18.941301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517438+0000","last_change":"2024-09-13T19:33:16.390734+0000","last_active":"2024-09-13T19:33:49.517438+0000","last_peered":"2024-09-13T19:33:49.517438+0000","last_clean":"2024-09-13T19:33:49.517438+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:33:49.517438+0000","last_undegraded":"2024-09-13T19:33:49.517438+0000","last_fullsized":"2024-09-13T19:33:49.517438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:54.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.771290+0000","last_change":"2024-09-13T19:33:18.401696+0000","last_active":"2024-09-13T19:35:22.771290+0000","last_peered":"2024-09-13T19:35:22.771290+0000","last_clean":"2024-09-13T19:35:22.771290+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:35:22.771290+0000","last_undegraded":"2024-09-13T19:35:22.771290+0000","last_fullsized":"2024-09-13T19:35:22.771290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:36.732554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.904012+0000","last_change":"2024-09-13T19:33:10.356809+0000","last_active":"2024-09-13T19:36:23.904012+0000","last_peered":"2024-09-13T19:36:23.904012+0000","last_clean":"2024-09-13T19:36:23.904012+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:36:23.904012+0000","last_undegraded":"2024-09-13T19:36:23.904012+0000","last_fullsized":"2024-09-13T19:36:23.904012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:44.333778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498820+0000","last_change":"2024-09-13T19:33:08.345805+0000","last_active":"2024-09-13T19:33:49.498820+0000","last_peered":"2024-09-13T19:33:49.498820+0000","last_clean":"2024-09-13T19:33:49.498820+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:33:49.498820+0000","last_undegraded":"2024-09-13T19:33:49.498820+0000","last_fullsized":"2024-09-13T19:33:49.498820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:59.536117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506699+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:33:49.506699+0000","last_peered":"2024-09-13T19:33:49.506699+0000","last_clean":"2024-09-13T19:33:49.506699+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:33:49.506699+0000","last_undegraded":"2024-09-13T19:33:49.506699+0000","last_fullsized":"2024-09-13T19:33:49.506699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:56.316476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505857+0000","last_change":"2024-09-13T19:33:12.356344+0000","last_active":"2024-09-13T19:33:49.505857+0000","last_peered":"2024-09-13T19:33:49.505857+0000","last_clean":"2024-09-13T19:33:49.505857+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:33:49.505857+0000","last_undegraded":"2024-09-13T19:33:49.505857+0000","last_fullsized":"2024-09-13T19:33:49.505857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:55.513441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500452+0000","last_change":"2024-09-13T19:33:14.368032+0000","last_active":"2024-09-13T19:35:20.500452+0000","last_peered":"2024-09-13T19:35:20.500452+0000","last_clean":"2024-09-13T19:35:20.500452+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:35:20.500452+0000","last_undegraded":"2024-09-13T19:35:20.500452+0000","last_fullsized":"2024-09-13T19:35:20.500452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:52.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":375,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.290714+0000","last_change":"2024-09-13T19:33:16.386778+0000","last_active":"2024-09-13T19:36:24.290714+0000","last_peered":"2024-09-13T19:36:24.290714+0000","last_clean":"2024-09-13T19:36:24.290714+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:24.290714+0000","last_undegraded":"2024-09-13T19:36:24.290714+0000","last_fullsized":"2024-09-13T19:36:24.290714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:06.811103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.518471+0000","last_change":"2024-09-13T19:33:18.410958+0000","last_active":"2024-09-13T19:34:37.518471+0000","last_peered":"2024-09-13T19:34:37.518471+0000","last_clean":"2024-09-13T19:34:37.518471+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:34:37.518471+0000","last_undegraded":"2024-09-13T19:34:37.518471+0000","last_fullsized":"2024-09-13T19:34:37.518471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:58.474286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.169685+0000","last_change":"2024-09-13T19:33:10.352017+0000","last_active":"2024-09-13T19:33:54.169685+0000","last_peered":"2024-09-13T19:33:54.169685+0000","last_clean":"2024-09-13T19:33:54.169685+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:33:54.169685+0000","last_undegraded":"2024-09-13T19:33:54.169685+0000","last_fullsized":"2024-09-13T19:33:54.169685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:06.912280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515639+0000","last_change":"2024-09-13T19:33:08.335852+0000","last_active":"2024-09-13T19:33:49.515639+0000","last_peered":"2024-09-13T19:33:49.515639+0000","last_clean":"2024-09-13T19:33:49.515639+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:33:49.515639+0000","last_undegraded":"2024-09-13T19:33:49.515639+0000","last_fullsized":"2024-09-13T19:33:49.515639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:15.529632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500973+0000","last_change":"2024-09-13T19:33:02.523653+0000","last_active":"2024-09-13T19:33:49.500973+0000","last_peered":"2024-09-13T19:33:49.500973+0000","last_clean":"2024-09-13T19:33:49.500973+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:33:49.500973+0000","last_undegraded":"2024-09-13T19:33:49.500973+0000","last_fullsized":"2024-09-13T19:33:49.500973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:42.749511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508088+0000","last_change":"2024-09-13T19:33:12.358233+0000","last_active":"2024-09-13T19:33:49.508088+0000","last_peered":"2024-09-13T19:33:49.508088+0000","last_clean":"2024-09-13T19:33:49.508088+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:33:49.508088+0000","last_undegraded":"2024-09-13T19:33:49.508088+0000","last_fullsized":"2024-09-13T19:33:49.508088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:59.060355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507097+0000","last_change":"2024-09-13T19:33:14.384476+0000","last_active":"2024-09-13T19:33:49.507097+0000","last_peered":"2024-09-13T19:33:49.507097+0000","last_clean":"2024-09-13T19:33:49.507097+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:33:49.507097+0000","last_undegraded":"2024-09-13T19:33:49.507097+0000","last_fullsized":"2024-09-13T19:33:49.507097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:32.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.579499+0000","last_change":"2024-09-13T19:33:16.372856+0000","last_active":"2024-09-13T19:36:24.579499+0000","last_peered":"2024-09-13T19:36:24.579499+0000","last_clean":"2024-09-13T19:36:24.579499+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:36:24.579499+0000","last_undegraded":"2024-09-13T19:36:24.579499+0000","last_fullsized":"2024-09-13T19:36:24.579499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:12.613117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508863+0000","last_change":"2024-09-13T19:33:18.412059+0000","last_active":"2024-09-13T19:33:49.508863+0000","last_peered":"2024-09-13T19:33:49.508863+0000","last_clean":"2024-09-13T19:33:49.508863+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:33:49.508863+0000","last_undegraded":"2024-09-13T19:33:49.508863+0000","last_fullsized":"2024-09-13T19:33:49.508863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:52.237012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278402+0000","last_change":"2024-09-13T19:33:10.344169+0000","last_active":"2024-09-13T19:36:24.278402+0000","last_peered":"2024-09-13T19:36:24.278402+0000","last_clean":"2024-09-13T19:36:24.278402+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:36:24.278402+0000","last_undegraded":"2024-09-13T19:36:24.278402+0000","last_fullsized":"2024-09-13T19:36:24.278402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.076994+0000","last_change":"2024-09-13T19:33:08.354348+0000","last_active":"2024-09-13T19:36:24.076994+0000","last_peered":"2024-09-13T19:36:24.076994+0000","last_clean":"2024-09-13T19:36:24.076994+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:36:24.076994+0000","last_undegraded":"2024-09-13T19:36:24.076994+0000","last_fullsized":"2024-09-13T19:36:24.076994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512982+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:33:49.512982+0000","last_peered":"2024-09-13T19:33:49.512982+0000","last_clean":"2024-09-13T19:33:49.512982+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:33:49.512982+0000","last_undegraded":"2024-09-13T19:33:49.512982+0000","last_fullsized":"2024-09-13T19:33:49.512982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:46.024868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506376+0000","last_change":"2024-09-13T19:33:12.347595+0000","last_active":"2024-09-13T19:33:49.506376+0000","last_peered":"2024-09-13T19:33:49.506376+0000","last_clean":"2024-09-13T19:33:49.506376+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:33:49.506376+0000","last_undegraded":"2024-09-13T19:33:49.506376+0000","last_fullsized":"2024-09-13T19:33:49.506376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:04.841484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'83","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.498650+0000","last_change":"2024-09-13T19:33:14.370958+0000","last_active":"2024-09-13T19:35:20.498650+0000","last_peered":"2024-09-13T19:35:20.498650+0000","last_clean":"2024-09-13T19:35:20.498650+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:35:20.498650+0000","last_undegraded":"2024-09-13T19:35:20.498650+0000","last_fullsized":"2024-09-13T19:35:20.498650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:28.457253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497560+0000","last_change":"2024-09-13T19:33:16.370368+0000","last_active":"2024-09-13T19:33:49.497560+0000","last_peered":"2024-09-13T19:33:49.497560+0000","last_clean":"2024-09-13T19:33:49.497560+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:33:49.497560+0000","last_undegraded":"2024-09-13T19:33:49.497560+0000","last_fullsized":"2024-09-13T19:33:49.497560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:59.539391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.238791+0000","last_change":"2024-09-13T19:33:18.418007+0000","last_active":"2024-09-13T19:34:37.238791+0000","last_peered":"2024-09-13T19:34:37.238791+0000","last_clean":"2024-09-13T19:34:37.238791+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:34:37.238791+0000","last_undegraded":"2024-09-13T19:34:37.238791+0000","last_fullsized":"2024-09-13T19:34:37.238791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:26.651502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523204+0000","last_change":"2024-09-13T19:33:18.416636+0000","last_active":"2024-09-13T19:33:49.523204+0000","last_peered":"2024-09-13T19:33:49.523204+0000","last_clean":"2024-09-13T19:33:49.523204+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:33:49.523204+0000","last_undegraded":"2024-09-13T19:33:49.523204+0000","last_fullsized":"2024-09-13T19:33:49.523204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.954769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207651+0000","last_change":"2024-09-13T19:33:10.337290+0000","last_active":"2024-09-13T19:36:24.207651+0000","last_peered":"2024-09-13T19:36:24.207651+0000","last_clean":"2024-09-13T19:36:24.207651+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:36:24.207651+0000","last_undegraded":"2024-09-13T19:36:24.207651+0000","last_fullsized":"2024-09-13T19:36:24.207651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:03.258150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.069994+0000","last_change":"2024-09-13T19:33:08.354023+0000","last_active":"2024-09-13T19:36:24.069994+0000","last_peered":"2024-09-13T19:36:24.069994+0000","last_clean":"2024-09-13T19:36:24.069994+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:36:24.069994+0000","last_undegraded":"2024-09-13T19:36:24.069994+0000","last_fullsized":"2024-09-13T19:36:24.069994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:12.440984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500090+0000","last_change":"2024-09-13T19:33:12.349684+0000","last_active":"2024-09-13T19:33:49.500090+0000","last_peered":"2024-09-13T19:33:49.500090+0000","last_clean":"2024-09-13T19:33:49.500090+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:33:49.500090+0000","last_undegraded":"2024-09-13T19:33:49.500090+0000","last_fullsized":"2024-09-13T19:33:49.500090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:33.654140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.504975+0000","last_change":"2024-09-13T19:33:14.379538+0000","last_active":"2024-09-13T19:35:20.504975+0000","last_peered":"2024-09-13T19:35:20.504975+0000","last_clean":"2024-09-13T19:35:20.504975+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:35:20.504975+0000","last_undegraded":"2024-09-13T19:35:20.504975+0000","last_fullsized":"2024-09-13T19:35:20.504975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:57.484464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505865+0000","last_change":"2024-09-13T19:33:16.403644+0000","last_active":"2024-09-13T19:33:49.505865+0000","last_peered":"2024-09-13T19:33:49.505865+0000","last_clean":"2024-09-13T19:33:49.505865+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:33:49.505865+0000","last_undegraded":"2024-09-13T19:33:49.505865+0000","last_fullsized":"2024-09-13T19:33:49.505865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:05.807775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.182480+0000","last_change":"2024-09-13T19:33:18.396968+0000","last_active":"2024-09-13T19:36:23.182480+0000","last_peered":"2024-09-13T19:36:23.182480+0000","last_clean":"2024-09-13T19:36:23.182480+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:36:23.182480+0000","last_undegraded":"2024-09-13T19:36:23.182480+0000","last_fullsized":"2024-09-13T19:36:23.182480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:01.306267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.193661+0000","last_change":"2024-09-13T19:33:10.357927+0000","last_active":"2024-09-13T19:35:18.193661+0000","last_peered":"2024-09-13T19:35:18.193661+0000","last_clean":"2024-09-13T19:35:18.193661+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:35:18.193661+0000","last_undegraded":"2024-09-13T19:35:18.193661+0000","last_fullsized":"2024-09-13T19:35:18.193661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:43.220677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520659+0000","last_change":"2024-09-13T19:33:08.353099+0000","last_active":"2024-09-13T19:33:49.520659+0000","last_peered":"2024-09-13T19:33:49.520659+0000","last_clean":"2024-09-13T19:33:49.520659+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:33:49.520659+0000","last_undegraded":"2024-09-13T19:33:49.520659+0000","last_fullsized":"2024-09-13T19:33:49.520659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.532442+0000","last_change":"2024-09-13T19:33:49.530881+0000","last_active":"2024-09-13T19:33:49.532442+0000","last_peered":"2024-09-13T19:33:49.532442+0000","last_clean":"2024-09-13T19:33:49.532442+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:33:49.532442+0000","last_undegraded":"2024-09-13T19:33:49.532442+0000","last_fullsized":"2024-09-13T19:33:49.532442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:24.807153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.971351+0000","last_change":"2024-09-13T19:33:14.354248+0000","last_active":"2024-09-13T19:36:22.971351+0000","last_peered":"2024-09-13T19:36:22.971351+0000","last_clean":"2024-09-13T19:36:22.971351+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:36:22.971351+0000","last_undegraded":"2024-09-13T19:36:22.971351+0000","last_fullsized":"2024-09-13T19:36:22.971351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:10.093199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517061+0000","last_change":"2024-09-13T19:33:16.382753+0000","last_active":"2024-09-13T19:33:49.517061+0000","last_peered":"2024-09-13T19:33:49.517061+0000","last_clean":"2024-09-13T19:33:49.517061+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:33:49.517061+0000","last_undegraded":"2024-09-13T19:33:49.517061+0000","last_fullsized":"2024-09-13T19:33:49.517061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:25.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498717+0000","last_change":"2024-09-13T19:33:18.415711+0000","last_active":"2024-09-13T19:33:49.498717+0000","last_peered":"2024-09-13T19:33:49.498717+0000","last_clean":"2024-09-13T19:33:49.498717+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:33:49.498717+0000","last_undegraded":"2024-09-13T19:33:49.498717+0000","last_fullsized":"2024-09-13T19:33:49.498717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:51.214164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097438+0000","last_change":"2024-09-13T19:33:10.340323+0000","last_active":"2024-09-13T19:36:24.097438+0000","last_peered":"2024-09-13T19:36:24.097438+0000","last_clean":"2024-09-13T19:36:24.097438+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:36:24.097438+0000","last_undegraded":"2024-09-13T19:36:24.097438+0000","last_fullsized":"2024-09-13T19:36:24.097438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.062661+0000","last_change":"2024-09-13T19:33:08.350962+0000","last_active":"2024-09-13T19:36:24.062661+0000","last_peered":"2024-09-13T19:36:24.062661+0000","last_clean":"2024-09-13T19:36:24.062661+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:36:24.062661+0000","last_undegraded":"2024-09-13T19:36:24.062661+0000","last_fullsized":"2024-09-13T19:36:24.062661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:33.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509563+0000","last_change":"2024-09-13T19:33:12.355722+0000","last_active":"2024-09-13T19:33:49.509563+0000","last_peered":"2024-09-13T19:33:49.509563+0000","last_clean":"2024-09-13T19:33:49.509563+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:33:49.509563+0000","last_undegraded":"2024-09-13T19:33:49.509563+0000","last_fullsized":"2024-09-13T19:33:49.509563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:44.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.126165+0000","last_change":"2024-09-13T19:33:14.361694+0000","last_active":"2024-09-13T19:36:23.126165+0000","last_peered":"2024-09-13T19:36:23.126165+0000","last_clean":"2024-09-13T19:36:23.126165+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:36:23.126165+0000","last_undegraded":"2024-09-13T19:36:23.126165+0000","last_fullsized":"2024-09-13T19:36:23.126165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:23.587634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499270+0000","last_change":"2024-09-13T19:33:16.374728+0000","last_active":"2024-09-13T19:33:49.499270+0000","last_peered":"2024-09-13T19:33:49.499270+0000","last_clean":"2024-09-13T19:33:49.499270+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:33:49.499270+0000","last_undegraded":"2024-09-13T19:33:49.499270+0000","last_fullsized":"2024-09-13T19:33:49.499270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:25.206149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508285+0000","last_change":"2024-09-13T19:33:18.420341+0000","last_active":"2024-09-13T19:33:49.508285+0000","last_peered":"2024-09-13T19:33:49.508285+0000","last_clean":"2024-09-13T19:33:49.508285+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:33:49.508285+0000","last_undegraded":"2024-09-13T19:33:49.508285+0000","last_fullsized":"2024-09-13T19:33:49.508285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:37.478476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278224+0000","last_change":"2024-09-13T19:33:10.348981+0000","last_active":"2024-09-13T19:36:24.278224+0000","last_peered":"2024-09-13T19:36:24.278224+0000","last_clean":"2024-09-13T19:36:24.278224+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:36:24.278224+0000","last_undegraded":"2024-09-13T19:36:24.278224+0000","last_fullsized":"2024-09-13T19:36:24.278224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:31.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.141217+0000","last_change":"2024-09-13T19:33:49.519345+0000","last_active":"2024-09-13T19:33:54.141217+0000","last_peered":"2024-09-13T19:33:54.141217+0000","last_clean":"2024-09-13T19:33:54.141217+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:33:54.141217+0000","last_undegraded":"2024-09-13T19:33:54.141217+0000","last_fullsized":"2024-09-13T19:33:54.141217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:09.643503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508299+0000","last_change":"2024-09-13T19:33:12.363653+0000","last_active":"2024-09-13T19:33:49.508299+0000","last_peered":"2024-09-13T19:33:49.508299+0000","last_clean":"2024-09-13T19:33:49.508299+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:33:49.508299+0000","last_undegraded":"2024-09-13T19:33:49.508299+0000","last_fullsized":"2024-09-13T19:33:49.508299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:53.868774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'32","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.480029+0000","last_change":"2024-09-13T19:33:14.358901+0000","last_active":"2024-09-13T19:35:20.480029+0000","last_peered":"2024-09-13T19:35:20.480029+0000","last_clean":"2024-09-13T19:35:20.480029+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:35:20.480029+0000","last_undegraded":"2024-09-13T19:35:20.480029+0000","last_fullsized":"2024-09-13T19:35:20.480029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.849530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521295+0000","last_change":"2024-09-13T19:33:16.384121+0000","last_active":"2024-09-13T19:33:49.521295+0000","last_peered":"2024-09-13T19:33:49.521295+0000","last_clean":"2024-09-13T19:33:49.521295+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:33:49.521295+0000","last_undegraded":"2024-09-13T19:33:49.521295+0000","last_fullsized":"2024-09-13T19:33:49.521295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:31.796586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207342+0000","last_change":"2024-09-13T19:33:10.355217+0000","last_active":"2024-09-13T19:36:24.207342+0000","last_peered":"2024-09-13T19:36:24.207342+0000","last_clean":"2024-09-13T19:36:24.207342+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:36:24.207342+0000","last_undegraded":"2024-09-13T19:36:24.207342+0000","last_fullsized":"2024-09-13T19:36:24.207342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:25.762180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.136723+0000","last_change":"2024-09-13T19:33:08.338446+0000","last_active":"2024-09-13T19:33:54.136723+0000","last_peered":"2024-09-13T19:33:54.136723+0000","last_clean":"2024-09-13T19:33:54.136723+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:33:54.136723+0000","last_undegraded":"2024-09-13T19:33:54.136723+0000","last_fullsized":"2024-09-13T19:33:54.136723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502145+0000","last_change":"2024-09-13T19:33:12.353907+0000","last_active":"2024-09-13T19:33:49.502145+0000","last_peered":"2024-09-13T19:33:49.502145+0000","last_clean":"2024-09-13T19:33:49.502145+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:33:49.502145+0000","last_undegraded":"2024-09-13T19:33:49.502145+0000","last_fullsized":"2024-09-13T19:33:49.502145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.757540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'56","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:44.501765+0000","last_change":"2024-09-13T19:33:14.353619+0000","last_active":"2024-09-13T19:35:44.501765+0000","last_peered":"2024-09-13T19:35:44.501765+0000","last_clean":"2024-09-13T19:35:44.501765+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:35:44.501765+0000","last_undegraded":"2024-09-13T19:35:44.501765+0000","last_fullsized":"2024-09-13T19:35:44.501765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:06.293086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5917,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523366+0000","last_change":"2024-09-13T19:33:16.391786+0000","last_active":"2024-09-13T19:33:49.523366+0000","last_peered":"2024-09-13T19:33:49.523366+0000","last_clean":"2024-09-13T19:33:49.523366+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:33:49.523366+0000","last_undegraded":"2024-09-13T19:33:49.523366+0000","last_fullsized":"2024-09-13T19:33:49.523366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:58.998423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.761517+0000","last_change":"2024-09-13T19:33:18.415632+0000","last_active":"2024-09-13T19:35:22.761517+0000","last_peered":"2024-09-13T19:35:22.761517+0000","last_clean":"2024-09-13T19:35:22.761517+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:35:22.761517+0000","last_undegraded":"2024-09-13T19:35:22.761517+0000","last_fullsized":"2024-09-13T19:35:22.761517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:21.406501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:09.493298+0000","last_change":"2024-09-13T19:33:10.348428+0000","last_active":"2024-09-13T19:35:09.493298+0000","last_peered":"2024-09-13T19:35:09.493298+0000","last_clean":"2024-09-13T19:35:09.493298+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:35:09.493298+0000","last_undegraded":"2024-09-13T19:35:09.493298+0000","last_fullsized":"2024-09-13T19:35:09.493298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498512+0000","last_change":"2024-09-13T19:33:08.337364+0000","last_active":"2024-09-13T19:33:49.498512+0000","last_peered":"2024-09-13T19:33:49.498512+0000","last_clean":"2024-09-13T19:33:49.498512+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:33:49.498512+0000","last_undegraded":"2024-09-13T19:33:49.498512+0000","last_fullsized":"2024-09-13T19:33:49.498512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:58.350998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524310+0000","last_change":"2024-09-13T19:33:12.351793+0000","last_active":"2024-09-13T19:33:49.524310+0000","last_peered":"2024-09-13T19:33:49.524310+0000","last_clean":"2024-09-13T19:33:49.524310+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:33:49.524310+0000","last_undegraded":"2024-09-13T19:33:49.524310+0000","last_fullsized":"2024-09-13T19:33:49.524310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:00.497212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.481319+0000","last_change":"2024-09-13T19:33:14.386801+0000","last_active":"2024-09-13T19:35:20.481319+0000","last_peered":"2024-09-13T19:35:20.481319+0000","last_clean":"2024-09-13T19:35:20.481319+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:35:20.481319+0000","last_undegraded":"2024-09-13T19:35:20.481319+0000","last_fullsized":"2024-09-13T19:35:20.481319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:50.651830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507072+0000","last_change":"2024-09-13T19:33:16.382777+0000","last_active":"2024-09-13T19:33:49.507072+0000","last_peered":"2024-09-13T19:33:49.507072+0000","last_clean":"2024-09-13T19:33:49.507072+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:33:49.507072+0000","last_undegraded":"2024-09-13T19:33:49.507072+0000","last_fullsized":"2024-09-13T19:33:49.507072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:40.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504119+0000","last_change":"2024-09-13T19:33:18.415435+0000","last_active":"2024-09-13T19:33:49.504119+0000","last_peered":"2024-09-13T19:33:49.504119+0000","last_clean":"2024-09-13T19:33:49.504119+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:33:49.504119+0000","last_undegraded":"2024-09-13T19:33:49.504119+0000","last_fullsized":"2024-09-13T19:33:49.504119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:23.857746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278836+0000","last_change":"2024-09-13T19:33:10.358856+0000","last_active":"2024-09-13T19:36:24.278836+0000","last_peered":"2024-09-13T19:36:24.278836+0000","last_clean":"2024-09-13T19:36:24.278836+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:36:24.278836+0000","last_undegraded":"2024-09-13T19:36:24.278836+0000","last_fullsized":"2024-09-13T19:36:24.278836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:44.732919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.685544+0000","last_change":"2024-09-13T19:33:08.335612+0000","last_active":"2024-09-13T19:33:52.685544+0000","last_peered":"2024-09-13T19:33:52.685544+0000","last_clean":"2024-09-13T19:33:52.685544+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:33:52.685544+0000","last_undegraded":"2024-09-13T19:33:52.685544+0000","last_fullsized":"2024-09-13T19:33:52.685544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:38.936603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520491+0000","last_change":"2024-09-13T19:33:12.352113+0000","last_active":"2024-09-13T19:33:49.520491+0000","last_peered":"2024-09-13T19:33:49.520491+0000","last_clean":"2024-09-13T19:33:49.520491+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:33:49.520491+0000","last_undegraded":"2024-09-13T19:33:49.520491+0000","last_fullsized":"2024-09-13T19:33:49.520491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:17.673522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.066179+0000","last_change":"2024-09-13T19:33:14.356847+0000","last_active":"2024-09-13T19:35:20.066179+0000","last_peered":"2024-09-13T19:35:20.066179+0000","last_clean":"2024-09-13T19:35:20.066179+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:35:20.066179+0000","last_undegraded":"2024-09-13T19:35:20.066179+0000","last_fullsized":"2024-09-13T19:35:20.066179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:52.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500909+0000","last_change":"2024-09-13T19:33:16.391926+0000","last_active":"2024-09-13T19:33:49.500909+0000","last_peered":"2024-09-13T19:33:49.500909+0000","last_clean":"2024-09-13T19:33:49.500909+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:33:49.500909+0000","last_undegraded":"2024-09-13T19:33:49.500909+0000","last_fullsized":"2024-09-13T19:33:49.500909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:40.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.922899+0000","last_change":"2024-09-13T19:33:18.414176+0000","last_active":"2024-09-13T19:35:22.922899+0000","last_peered":"2024-09-13T19:35:22.922899+0000","last_clean":"2024-09-13T19:35:22.922899+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:35:22.922899+0000","last_undegraded":"2024-09-13T19:35:22.922899+0000","last_fullsized":"2024-09-13T19:35:22.922899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:28.941440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.887347+0000","last_change":"2024-09-13T19:33:10.347270+0000","last_active":"2024-09-13T19:36:23.887347+0000","last_peered":"2024-09-13T19:36:23.887347+0000","last_clean":"2024-09-13T19:36:23.887347+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:36:23.887347+0000","last_undegraded":"2024-09-13T19:36:23.887347+0000","last_fullsized":"2024-09-13T19:36:23.887347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:44.333778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507379+0000","last_change":"2024-09-13T19:33:08.340688+0000","last_active":"2024-09-13T19:35:40.507379+0000","last_peered":"2024-09-13T19:35:40.507379+0000","last_clean":"2024-09-13T19:35:40.507379+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:35:40.507379+0000","last_undegraded":"2024-09-13T19:35:40.507379+0000","last_fullsized":"2024-09-13T19:35:40.507379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:11.675646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":13,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506437+0000","last_change":"2024-09-13T19:33:12.349199+0000","last_active":"2024-09-13T19:33:49.506437+0000","last_peered":"2024-09-13T19:33:49.506437+0000","last_clean":"2024-09-13T19:33:49.506437+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:33:49.506437+0000","last_undegraded":"2024-09-13T19:33:49.506437+0000","last_fullsized":"2024-09-13T19:33:49.506437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:52.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513690+0000","last_change":"2024-09-13T19:33:14.391400+0000","last_active":"2024-09-13T19:33:49.513690+0000","last_peered":"2024-09-13T19:33:49.513690+0000","last_clean":"2024-09-13T19:33:49.513690+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:33:49.513690+0000","last_undegraded":"2024-09-13T19:33:49.513690+0000","last_fullsized":"2024-09-13T19:33:49.513690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:31.131591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":407,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.594970+0000","last_change":"2024-09-13T19:33:16.382339+0000","last_active":"2024-09-13T19:36:22.594970+0000","last_peered":"2024-09-13T19:36:22.594970+0000","last_clean":"2024-09-13T19:36:22.594970+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:36:22.594970+0000","last_undegraded":"2024-09-13T19:36:22.594970+0000","last_fullsized":"2024-09-13T19:36:22.594970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:01.227827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503374+0000","last_change":"2024-09-13T19:33:18.419381+0000","last_active":"2024-09-13T19:33:49.503374+0000","last_peered":"2024-09-13T19:33:49.503374+0000","last_clean":"2024-09-13T19:33:49.503374+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:33:49.503374+0000","last_undegraded":"2024-09-13T19:33:49.503374+0000","last_fullsized":"2024-09-13T19:33:49.503374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:08.781086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207878+0000","last_change":"2024-09-13T19:33:10.336681+0000","last_active":"2024-09-13T19:36:24.207878+0000","last_peered":"2024-09-13T19:36:24.207878+0000","last_clean":"2024-09-13T19:36:24.207878+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:36:24.207878+0000","last_undegraded":"2024-09-13T19:36:24.207878+0000","last_fullsized":"2024-09-13T19:36:24.207878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:14.226586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509233+0000","last_change":"2024-09-13T19:33:08.338096+0000","last_active":"2024-09-13T19:33:49.509233+0000","last_peered":"2024-09-13T19:33:49.509233+0000","last_clean":"2024-09-13T19:33:49.509233+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:33:49.509233+0000","last_undegraded":"2024-09-13T19:33:49.509233+0000","last_fullsized":"2024-09-13T19:33:49.509233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502590+0000","last_change":"2024-09-13T19:33:12.353110+0000","last_active":"2024-09-13T19:33:49.502590+0000","last_peered":"2024-09-13T19:33:49.502590+0000","last_clean":"2024-09-13T19:33:49.502590+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:33:49.502590+0000","last_undegraded":"2024-09-13T19:33:49.502590+0000","last_fullsized":"2024-09-13T19:33:49.502590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.757540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.465599+0000","last_change":"2024-09-13T19:33:14.366141+0000","last_active":"2024-09-13T19:35:20.465599+0000","last_peered":"2024-09-13T19:35:20.465599+0000","last_clean":"2024-09-13T19:35:20.465599+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:35:20.465599+0000","last_undegraded":"2024-09-13T19:35:20.465599+0000","last_fullsized":"2024-09-13T19:35:20.465599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:29.782580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495241+0000","last_change":"2024-09-13T19:33:16.375274+0000","last_active":"2024-09-13T19:33:49.495241+0000","last_peered":"2024-09-13T19:33:49.495241+0000","last_clean":"2024-09-13T19:33:49.495241+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:33:49.495241+0000","last_undegraded":"2024-09-13T19:33:49.495241+0000","last_fullsized":"2024-09-13T19:33:49.495241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510248+0000","last_change":"2024-09-13T19:33:18.425299+0000","last_active":"2024-09-13T19:33:49.510248+0000","last_peered":"2024-09-13T19:33:49.510248+0000","last_clean":"2024-09-13T19:33:49.510248+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:33:49.510248+0000","last_undegraded":"2024-09-13T19:33:49.510248+0000","last_fullsized":"2024-09-13T19:33:49.510248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:13:57.374815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503532+0000","last_change":"2024-09-13T19:33:10.344066+0000","last_active":"2024-09-13T19:35:40.503532+0000","last_peered":"2024-09-13T19:35:40.503532+0000","last_clean":"2024-09-13T19:35:40.503532+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:35:40.503532+0000","last_undegraded":"2024-09-13T19:35:40.503532+0000","last_fullsized":"2024-09-13T19:35:40.503532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:23.396598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508140+0000","last_change":"2024-09-13T19:33:08.358155+0000","last_active":"2024-09-13T19:33:49.508140+0000","last_peered":"2024-09-13T19:33:49.508140+0000","last_clean":"2024-09-13T19:33:49.508140+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:33:49.508140+0000","last_undegraded":"2024-09-13T19:33:49.508140+0000","last_fullsized":"2024-09-13T19:33:49.508140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:23.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521057+0000","last_change":"2024-09-13T19:33:12.358770+0000","last_active":"2024-09-13T19:33:49.521057+0000","last_peered":"2024-09-13T19:33:49.521057+0000","last_clean":"2024-09-13T19:33:49.521057+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:33:49.521057+0000","last_undegraded":"2024-09-13T19:33:49.521057+0000","last_fullsized":"2024-09-13T19:33:49.521057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:34.804561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.468789+0000","last_change":"2024-09-13T19:33:14.352918+0000","last_active":"2024-09-13T19:35:20.468789+0000","last_peered":"2024-09-13T19:35:20.468789+0000","last_clean":"2024-09-13T19:35:20.468789+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:35:20.468789+0000","last_undegraded":"2024-09-13T19:35:20.468789+0000","last_fullsized":"2024-09-13T19:35:20.468789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:24.299742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504142+0000","last_change":"2024-09-13T19:33:16.400962+0000","last_active":"2024-09-13T19:33:49.504142+0000","last_peered":"2024-09-13T19:33:49.504142+0000","last_clean":"2024-09-13T19:33:49.504142+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:33:49.504142+0000","last_undegraded":"2024-09-13T19:33:49.504142+0000","last_fullsized":"2024-09-13T19:33:49.504142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:43.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513374+0000","last_change":"2024-09-13T19:33:18.424633+0000","last_active":"2024-09-13T19:33:49.513374+0000","last_peered":"2024-09-13T19:33:49.513374+0000","last_clean":"2024-09-13T19:33:49.513374+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:33:49.513374+0000","last_undegraded":"2024-09-13T19:33:49.513374+0000","last_fullsized":"2024-09-13T19:33:49.513374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:44.258539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.115279+0000","last_change":"2024-09-13T19:33:10.346685+0000","last_active":"2024-09-13T19:36:24.115279+0000","last_peered":"2024-09-13T19:36:24.115279+0000","last_clean":"2024-09-13T19:36:24.115279+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:36:24.115279+0000","last_undegraded":"2024-09-13T19:36:24.115279+0000","last_fullsized":"2024-09-13T19:36:24.115279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:50.896604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.676763+0000","last_change":"2024-09-13T19:33:08.349745+0000","last_active":"2024-09-13T19:36:23.676763+0000","last_peered":"2024-09-13T19:36:23.676763+0000","last_clean":"2024-09-13T19:36:23.676763+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:36:23.676763+0000","last_undegraded":"2024-09-13T19:36:23.676763+0000","last_fullsized":"2024-09-13T19:36:23.676763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:49.017180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.074427+0000","last_change":"2024-09-13T19:33:12.360592+0000","last_active":"2024-09-13T19:35:22.074427+0000","last_peered":"2024-09-13T19:35:22.074427+0000","last_clean":"2024-09-13T19:35:22.074427+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:35:22.074427+0000","last_undegraded":"2024-09-13T19:35:22.074427+0000","last_fullsized":"2024-09-13T19:35:22.074427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:26.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.508223+0000","last_change":"2024-09-13T19:33:14.380786+0000","last_active":"2024-09-13T19:35:20.508223+0000","last_peered":"2024-09-13T19:35:20.508223+0000","last_clean":"2024-09-13T19:35:20.508223+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:35:20.508223+0000","last_undegraded":"2024-09-13T19:35:20.508223+0000","last_fullsized":"2024-09-13T19:35:20.508223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:37.500328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504812+0000","last_change":"2024-09-13T19:33:16.403395+0000","last_active":"2024-09-13T19:33:49.504812+0000","last_peered":"2024-09-13T19:33:49.504812+0000","last_clean":"2024-09-13T19:33:49.504812+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:33:49.504812+0000","last_undegraded":"2024-09-13T19:33:49.504812+0000","last_fullsized":"2024-09-13T19:33:49.504812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:06.844982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.528359+0000","last_change":"2024-09-13T19:33:18.420238+0000","last_active":"2024-09-13T19:35:20.528359+0000","last_peered":"2024-09-13T19:35:20.528359+0000","last_clean":"2024-09-13T19:35:20.528359+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:35:20.528359+0000","last_undegraded":"2024-09-13T19:35:20.528359+0000","last_fullsized":"2024-09-13T19:35:20.528359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:39.541908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.725970+0000","last_change":"2024-09-13T19:33:10.336837+0000","last_active":"2024-09-13T19:36:23.725970+0000","last_peered":"2024-09-13T19:36:23.725970+0000","last_clean":"2024-09-13T19:36:23.725970+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:36:23.725970+0000","last_undegraded":"2024-09-13T19:36:23.725970+0000","last_fullsized":"2024-09-13T19:36:23.725970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:17.640715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513903+0000","last_change":"2024-09-13T19:33:08.329255+0000","last_active":"2024-09-13T19:33:49.513903+0000","last_peered":"2024-09-13T19:33:49.513903+0000","last_clean":"2024-09-13T19:33:49.513903+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:33:49.513903+0000","last_undegraded":"2024-09-13T19:33:49.513903+0000","last_fullsized":"2024-09-13T19:33:49.513903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.693342+0000","last_change":"2024-09-13T19:33:12.362162+0000","last_active":"2024-09-13T19:35:18.693342+0000","last_peered":"2024-09-13T19:35:18.693342+0000","last_clean":"2024-09-13T19:35:18.693342+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:35:18.693342+0000","last_undegraded":"2024-09-13T19:35:18.693342+0000","last_fullsized":"2024-09-13T19:35:18.693342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.424221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'33","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.972085+0000","last_change":"2024-09-13T19:33:14.372731+0000","last_active":"2024-09-13T19:36:22.972085+0000","last_peered":"2024-09-13T19:36:22.972085+0000","last_clean":"2024-09-13T19:36:22.972085+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:36:22.972085+0000","last_undegraded":"2024-09-13T19:36:22.972085+0000","last_fullsized":"2024-09-13T19:36:22.972085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:28.203288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497588+0000","last_change":"2024-09-13T19:33:16.375705+0000","last_active":"2024-09-13T19:33:49.497588+0000","last_peered":"2024-09-13T19:33:49.497588+0000","last_clean":"2024-09-13T19:33:49.497588+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:33:49.497588+0000","last_undegraded":"2024-09-13T19:33:49.497588+0000","last_fullsized":"2024-09-13T19:33:49.497588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:17.171140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.533635+0000","last_change":"2024-09-13T19:33:18.420946+0000","last_active":"2024-09-13T19:35:20.533635+0000","last_peered":"2024-09-13T19:35:20.533635+0000","last_clean":"2024-09-13T19:35:20.533635+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:35:20.533635+0000","last_undegraded":"2024-09-13T19:35:20.533635+0000","last_fullsized":"2024-09-13T19:35:20.533635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:33.812134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.480170+0000","last_change":"2024-09-13T19:33:49.534946+0000","last_active":"2024-09-13T19:33:50.480170+0000","last_peered":"2024-09-13T19:33:50.480170+0000","last_clean":"2024-09-13T19:33:50.480170+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:33:50.480170+0000","last_undegraded":"2024-09-13T19:33:50.480170+0000","last_fullsized":"2024-09-13T19:33:50.480170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:55.799083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.582657+0000","last_change":"2024-09-13T19:33:08.332706+0000","last_active":"2024-09-13T19:36:23.582657+0000","last_peered":"2024-09-13T19:36:23.582657+0000","last_clean":"2024-09-13T19:36:23.582657+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:36:23.582657+0000","last_undegraded":"2024-09-13T19:36:23.582657+0000","last_fullsized":"2024-09-13T19:36:23.582657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:03.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207867+0000","last_change":"2024-09-13T19:33:10.332473+0000","last_active":"2024-09-13T19:36:24.207867+0000","last_peered":"2024-09-13T19:36:24.207867+0000","last_clean":"2024-09-13T19:36:24.207867+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:36:24.207867+0000","last_undegraded":"2024-09-13T19:36:24.207867+0000","last_fullsized":"2024-09-13T19:36:24.207867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:17.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495977+0000","last_change":"2024-09-13T19:33:08.325598+0000","last_active":"2024-09-13T19:33:49.495977+0000","last_peered":"2024-09-13T19:33:49.495977+0000","last_clean":"2024-09-13T19:33:49.495977+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:33:49.495977+0000","last_undegraded":"2024-09-13T19:33:49.495977+0000","last_fullsized":"2024-09-13T19:33:49.495977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513363+0000","last_change":"2024-09-13T19:33:10.353700+0000","last_active":"2024-09-13T19:33:49.513363+0000","last_peered":"2024-09-13T19:33:49.513363+0000","last_clean":"2024-09-13T19:33:49.513363+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:33:49.513363+0000","last_undegraded":"2024-09-13T19:33:49.513363+0000","last_fullsized":"2024-09-13T19:33:49.513363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:14.944305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.152054+0000","last_change":"2024-09-13T19:33:08.334993+0000","last_active":"2024-09-13T19:33:54.152054+0000","last_peered":"2024-09-13T19:33:54.152054+0000","last_clean":"2024-09-13T19:33:54.152054+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:33:54.152054+0000","last_undegraded":"2024-09-13T19:33:54.152054+0000","last_fullsized":"2024-09-13T19:33:54.152054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:15.855113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.520893+0000","last_change":"2024-09-13T19:33:10.332930+0000","last_active":"2024-09-13T19:34:37.520893+0000","last_peered":"2024-09-13T19:34:37.520893+0000","last_clean":"2024-09-13T19:34:37.520893+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:34:37.520893+0000","last_undegraded":"2024-09-13T19:34:37.520893+0000","last_fullsized":"2024-09-13T19:34:37.520893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.567975+0000","last_change":"2024-09-13T19:33:08.345558+0000","last_active":"2024-09-13T19:35:22.567975+0000","last_peered":"2024-09-13T19:35:22.567975+0000","last_clean":"2024-09-13T19:35:22.567975+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:35:22.567975+0000","last_undegraded":"2024-09-13T19:35:22.567975+0000","last_fullsized":"2024-09-13T19:35:22.567975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:14.487188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.888082+0000","last_change":"2024-09-13T19:33:10.339115+0000","last_active":"2024-09-13T19:36:23.888082+0000","last_peered":"2024-09-13T19:36:23.888082+0000","last_clean":"2024-09-13T19:36:23.888082+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:36:23.888082+0000","last_undegraded":"2024-09-13T19:36:23.888082+0000","last_fullsized":"2024-09-13T19:36:23.888082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:25.322287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.630046+0000","last_change":"2024-09-13T19:33:08.325496+0000","last_active":"2024-09-13T19:35:22.630046+0000","last_peered":"2024-09-13T19:35:22.630046+0000","last_clean":"2024-09-13T19:35:22.630046+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:35:22.630046+0000","last_undegraded":"2024-09-13T19:35:22.630046+0000","last_fullsized":"2024-09-13T19:35:22.630046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:39.965420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.933809+0000","last_change":"2024-09-13T19:33:10.353514+0000","last_active":"2024-09-13T19:35:22.933809+0000","last_peered":"2024-09-13T19:35:22.933809+0000","last_clean":"2024-09-13T19:35:22.933809+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:35:22.933809+0000","last_undegraded":"2024-09-13T19:35:22.933809+0000","last_fullsized":"2024-09-13T19:35:22.933809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:34.718501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500558+0000","last_change":"2024-09-13T19:33:08.338958+0000","last_active":"2024-09-13T19:35:20.500558+0000","last_peered":"2024-09-13T19:35:20.500558+0000","last_clean":"2024-09-13T19:35:20.500558+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:35:20.500558+0000","last_undegraded":"2024-09-13T19:35:20.500558+0000","last_fullsized":"2024-09-13T19:35:20.500558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494324+0000","last_change":"2024-09-13T19:33:10.339492+0000","last_active":"2024-09-13T19:35:14.494324+0000","last_peered":"2024-09-13T19:35:14.494324+0000","last_clean":"2024-09-13T19:35:14.494324+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:35:14.494324+0000","last_undegraded":"2024-09-13T19:35:14.494324+0000","last_fullsized":"2024-09-13T19:35:14.494324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523956+0000","last_change":"2024-09-13T19:33:08.352331+0000","last_active":"2024-09-13T19:33:49.523956+0000","last_peered":"2024-09-13T19:33:49.523956+0000","last_clean":"2024-09-13T19:33:49.523956+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:33:49.523956+0000","last_undegraded":"2024-09-13T19:33:49.523956+0000","last_fullsized":"2024-09-13T19:33:49.523956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:14.487188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.206679+0000","last_change":"2024-09-13T19:33:10.340020+0000","last_active":"2024-09-13T19:36:24.206679+0000","last_peered":"2024-09-13T19:36:24.206679+0000","last_clean":"2024-09-13T19:36:24.206679+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:36:24.206679+0000","last_undegraded":"2024-09-13T19:36:24.206679+0000","last_fullsized":"2024-09-13T19:36:24.206679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501022+0000","last_change":"2024-09-13T19:33:08.325702+0000","last_active":"2024-09-13T19:33:49.501022+0000","last_peered":"2024-09-13T19:33:49.501022+0000","last_clean":"2024-09-13T19:33:49.501022+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:33:49.501022+0000","last_undegraded":"2024-09-13T19:33:49.501022+0000","last_fullsized":"2024-09-13T19:33:49.501022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:33.213641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.521893+0000","last_change":"2024-09-13T19:33:10.347711+0000","last_active":"2024-09-13T19:34:37.521893+0000","last_peered":"2024-09-13T19:34:37.521893+0000","last_clean":"2024-09-13T19:34:37.521893+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:34:37.521893+0000","last_undegraded":"2024-09-13T19:34:37.521893+0000","last_fullsized":"2024-09-13T19:34:37.521893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:35.663644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503292+0000","last_change":"2024-09-13T19:33:08.332434+0000","last_active":"2024-09-13T19:33:49.503292+0000","last_peered":"2024-09-13T19:33:49.503292+0000","last_clean":"2024-09-13T19:33:49.503292+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:33:49.503292+0000","last_undegraded":"2024-09-13T19:33:49.503292+0000","last_fullsized":"2024-09-13T19:33:49.503292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:37.935261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'13","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.748902+0000","last_change":"2024-09-13T19:33:10.357624+0000","last_active":"2024-09-13T19:36:23.748902+0000","last_peered":"2024-09-13T19:36:23.748902+0000","last_clean":"2024-09-13T19:36:23.748902+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:36:23.748902+0000","last_undegraded":"2024-09-13T19:36:23.748902+0000","last_fullsized":"2024-09-13T19:36:23.748902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:02.272686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497193+0000","last_change":"2024-09-13T19:33:08.346231+0000","last_active":"2024-09-13T19:33:49.497193+0000","last_peered":"2024-09-13T19:33:49.497193+0000","last_clean":"2024-09-13T19:33:49.497193+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:33:49.497193+0000","last_undegraded":"2024-09-13T19:33:49.497193+0000","last_fullsized":"2024-09-13T19:33:49.497193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278985+0000","last_change":"2024-09-13T19:33:10.344691+0000","last_active":"2024-09-13T19:36:24.278985+0000","last_peered":"2024-09-13T19:36:24.278985+0000","last_clean":"2024-09-13T19:36:24.278985+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:36:24.278985+0000","last_undegraded":"2024-09-13T19:36:24.278985+0000","last_fullsized":"2024-09-13T19:36:24.278985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:09.619694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499748+0000","last_change":"2024-09-13T19:33:08.349717+0000","last_active":"2024-09-13T19:33:49.499748+0000","last_peered":"2024-09-13T19:33:49.499748+0000","last_clean":"2024-09-13T19:33:49.499748+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:33:49.499748+0000","last_undegraded":"2024-09-13T19:33:49.499748+0000","last_fullsized":"2024-09-13T19:33:49.499748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:53.138445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507430+0000","last_change":"2024-09-13T19:33:10.343686+0000","last_active":"2024-09-13T19:33:49.507430+0000","last_peered":"2024-09-13T19:33:49.507430+0000","last_clean":"2024-09-13T19:33:49.507430+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:33:49.507430+0000","last_undegraded":"2024-09-13T19:33:49.507430+0000","last_fullsized":"2024-09-13T19:33:49.507430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503320+0000","last_change":"2024-09-13T19:33:08.349915+0000","last_active":"2024-09-13T19:33:49.503320+0000","last_peered":"2024-09-13T19:33:49.503320+0000","last_clean":"2024-09-13T19:33:49.503320+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:33:49.503320+0000","last_undegraded":"2024-09-13T19:33:49.503320+0000","last_fullsized":"2024-09-13T19:33:49.503320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:03.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097014+0000","last_change":"2024-09-13T19:33:10.356426+0000","last_active":"2024-09-13T19:36:24.097014+0000","last_peered":"2024-09-13T19:36:24.097014+0000","last_clean":"2024-09-13T19:36:24.097014+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:36:24.097014+0000","last_undegraded":"2024-09-13T19:36:24.097014+0000","last_fullsized":"2024-09-13T19:36:24.097014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509661+0000","last_change":"2024-09-13T19:33:08.342035+0000","last_active":"2024-09-13T19:33:49.509661+0000","last_peered":"2024-09-13T19:33:49.509661+0000","last_clean":"2024-09-13T19:33:49.509661+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:33:49.509661+0000","last_undegraded":"2024-09-13T19:33:49.509661+0000","last_fullsized":"2024-09-13T19:33:49.509661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:01.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.379678+0000","last_change":"2024-09-13T19:33:10.350348+0000","last_active":"2024-09-13T19:33:53.379678+0000","last_peered":"2024-09-13T19:33:53.379678+0000","last_clean":"2024-09-13T19:33:53.379678+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:33:53.379678+0000","last_undegraded":"2024-09-13T19:33:53.379678+0000","last_fullsized":"2024-09-13T19:33:53.379678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:09.619694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.685036+0000","last_change":"2024-09-13T19:33:08.335544+0000","last_active":"2024-09-13T19:33:52.685036+0000","last_peered":"2024-09-13T19:33:52.685036+0000","last_clean":"2024-09-13T19:33:52.685036+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:33:52.685036+0000","last_undegraded":"2024-09-13T19:33:52.685036+0000","last_fullsized":"2024-09-13T19:33:52.685036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:42.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.194003+0000","last_change":"2024-09-13T19:33:10.353586+0000","last_active":"2024-09-13T19:35:18.194003+0000","last_peered":"2024-09-13T19:35:18.194003+0000","last_clean":"2024-09-13T19:35:18.194003+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:35:18.194003+0000","last_undegraded":"2024-09-13T19:35:18.194003+0000","last_fullsized":"2024-09-13T19:35:18.194003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:45.252176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524187+0000","last_change":"2024-09-13T19:33:08.351999+0000","last_active":"2024-09-13T19:33:49.524187+0000","last_peered":"2024-09-13T19:33:49.524187+0000","last_clean":"2024-09-13T19:33:49.524187+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:33:49.524187+0000","last_undegraded":"2024-09-13T19:33:49.524187+0000","last_fullsized":"2024-09-13T19:33:49.524187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:20.702363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096154+0000","last_change":"2024-09-13T19:33:10.343404+0000","last_active":"2024-09-13T19:36:24.096154+0000","last_peered":"2024-09-13T19:36:24.096154+0000","last_clean":"2024-09-13T19:36:24.096154+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:36:24.096154+0000","last_undegraded":"2024-09-13T19:36:24.096154+0000","last_fullsized":"2024-09-13T19:36:24.096154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515399+0000","last_change":"2024-09-13T19:33:08.354921+0000","last_active":"2024-09-13T19:33:49.515399+0000","last_peered":"2024-09-13T19:33:49.515399+0000","last_clean":"2024-09-13T19:33:49.515399+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:33:49.515399+0000","last_undegraded":"2024-09-13T19:33:49.515399+0000","last_fullsized":"2024-09-13T19:33:49.515399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:21.015465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503594+0000","last_change":"2024-09-13T19:33:08.354409+0000","last_active":"2024-09-13T19:33:49.503594+0000","last_peered":"2024-09-13T19:33:49.503594+0000","last_clean":"2024-09-13T19:33:49.503594+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:33:49.503594+0000","last_undegraded":"2024-09-13T19:33:49.503594+0000","last_fullsized":"2024-09-13T19:33:49.503594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:08.466174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097156+0000","last_change":"2024-09-13T19:33:10.340978+0000","last_active":"2024-09-13T19:36:24.097156+0000","last_peered":"2024-09-13T19:36:24.097156+0000","last_clean":"2024-09-13T19:36:24.097156+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:36:24.097156+0000","last_undegraded":"2024-09-13T19:36:24.097156+0000","last_fullsized":"2024-09-13T19:36:24.097156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:22.801067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497705+0000","last_change":"2024-09-13T19:33:08.349038+0000","last_active":"2024-09-13T19:33:49.497705+0000","last_peered":"2024-09-13T19:33:49.497705+0000","last_clean":"2024-09-13T19:33:49.497705+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:33:49.497705+0000","last_undegraded":"2024-09-13T19:33:49.497705+0000","last_fullsized":"2024-09-13T19:33:49.497705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.871653+0000","last_change":"2024-09-13T19:33:10.357819+0000","last_active":"2024-09-13T19:33:54.871653+0000","last_peered":"2024-09-13T19:33:54.871653+0000","last_clean":"2024-09-13T19:33:54.871653+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:33:54.871653+0000","last_undegraded":"2024-09-13T19:33:54.871653+0000","last_fullsized":"2024-09-13T19:33:54.871653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:15.665066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673010,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52808,"kb_used_data":17464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":17883136,"data_stored":17553871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52688,"kb_used_data":17344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319152,"statfs":{"total":96636764160,"available":96582811648,"internally_reserved":0,"allocated":17760256,"data_stored":17502939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673010,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49252,"kb_used_data":13908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322588,"statfs":{"total":96636764160,"available":96586330112,"internally_reserved":0,"allocated":14241792,"data_stored":13948982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":4516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":4624384,"data_stored":4331938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:36:56.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:36:56.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8ffff5640 1 Processor -- start 2024-09-13T19:36:56.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8ffff5640 1 -- start start 2024-09-13T19:36:56.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8ffff5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd8f812e760 0x7fd8f812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:56.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8ffff5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f80984f0 con 0x7fd8f812f1c0 2024-09-13T19:36:56.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8ffff5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f8098dc0 con 0x7fd8f812e760 2024-09-13T19:36:56.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8fdd91640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd8f812e760 0x7fd8f812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8fd590640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd8f812f1c0 0x7fd8f812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41670/0 (socket says 172.21.15.18:41670) 2024-09-13T19:36:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8fd590640 1 -- 172.21.15.18:0/3936831765 learned_addr learned my addr 172.21.15.18:0/3936831765 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8fdd91640 1 -- 172.21.15.18:0/3936831765 >> v1:172.21.15.18:6789/0 conn(0x7fd8f812f1c0 legacy=0x7fd8f812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.406+0000 7fd8fdd91640 1 -- 172.21.15.18:0/3936831765 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f812f5a0 con 0x7fd8f812e760 2024-09-13T19:36:56.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fdd91640 1 --2- 172.21.15.18:0/3936831765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f812ec80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009740 tx=0x7fd8f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221be9e624c3782 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:56.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fcd8f640 1 -- 172.21.15.18:0/3936831765 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8f40b0070 con 0x7fd8f812e760 2024-09-13T19:36:56.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fcd8f640 1 -- 172.21.15.18:0/3936831765 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f40ab530 con 0x7fd8f812e760 2024-09-13T19:36:56.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fcd8f640 1 -- 172.21.15.18:0/3936831765 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8f40ab830 con 0x7fd8f812e760 2024-09-13T19:36:56.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 -- 172.21.15.18:0/3936831765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 msgr2=0x7fd8f812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:56.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 --2- 172.21.15.18:0/3936831765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f812ec80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009740 tx=0x7fd8f401c400 comp rx=0 tx=0).stop 2024-09-13T19:36:56.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 -- 172.21.15.18:0/3936831765 shutdown_connections 2024-09-13T19:36:56.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 --2- 172.21.15.18:0/3936831765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f812ec80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:56.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 -- 172.21.15.18:0/3936831765 >> 172.21.15.18:0/3936831765 conn(0x7fd8f80a10a0 msgr2=0x7fd8f80a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:56.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 -- 172.21.15.18:0/3936831765 shutdown_connections 2024-09-13T19:36:56.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 -- 172.21.15.18:0/3936831765 wait complete. 2024-09-13T19:36:56.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 Processor -- start 2024-09-13T19:36:56.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 -- start start 2024-09-13T19:36:56.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f809c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:56.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ffff5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8136e30 con 0x7fd8f812e760 2024-09-13T19:36:56.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fdd91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:56.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fdd91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f809c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58342/0 (socket says 172.21.15.18:58342) 2024-09-13T19:36:56.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fdd91640 1 -- 172.21.15.18:0/4050984170 learned_addr learned my addr 172.21.15.18:0/4050984170 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:56.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fdd91640 1 -- 172.21.15.18:0/4050984170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f8130510 con 0x7fd8f812e760 2024-09-13T19:36:56.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8fdd91640 1 --2- 172.21.15.18:0/4050984170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f809c920 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd8f401a030 tx=0x7fd8f401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:56.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ee7fc640 1 -- 172.21.15.18:0/4050984170 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8f40b0050 con 0x7fd8f812e760 2024-09-13T19:36:56.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ee7fc640 1 -- 172.21.15.18:0/4050984170 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f40b1040 con 0x7fd8f812e760 2024-09-13T19:36:56.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.410+0000 7fd8ee7fc640 1 -- 172.21.15.18:0/4050984170 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8f40b5740 con 0x7fd8f812e760 2024-09-13T19:36:56.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.414+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f8130c10 con 0x7fd8f812e760 2024-09-13T19:36:56.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.414+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f809ce60 con 0x7fd8f812e760 2024-09-13T19:36:56.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.414+0000 7fd8ee7fc640 1 -- 172.21.15.18:0/4050984170 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd8f40be030 con 0x7fd8f812e760 2024-09-13T19:36:56.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.414+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f809e3a0 con 0x7fd8f812e760 2024-09-13T19:36:56.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.414+0000 7fd8ee7fc640 1 --2- 172.21.15.18:0/4050984170 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd8dc035e00 0x7fd8dc0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:56.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.414+0000 7fd8ee7fc640 1 -- 172.21.15.18:0/4050984170 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd8f40bc070 con 0x7fd8f812e760 2024-09-13T19:36:56.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.414+0000 7fd8fd590640 1 --2- 172.21.15.18:0/4050984170 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd8dc035e00 0x7fd8dc0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:56.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.414+0000 7fd8fd590640 1 --2- 172.21.15.18:0/4050984170 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd8dc035e00 0x7fd8dc0382c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8005890 tx=0x7fd8e8007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:56.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.418+0000 7fd8ee7fc640 1 -- 172.21.15.18:0/4050984170 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd8f40c5020 con 0x7fd8f812e760 2024-09-13T19:36:56.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.578+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8f8130780 con 0x7fd8dc035e00 2024-09-13T19:36:56.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.622+0000 7fd8ee7fc640 1 -- 172.21.15.18:0/4050984170 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665562 (secure 0 0 0) 0x7fd8e8001c00 con 0x7fd8dc035e00 2024-09-13T19:36:56.631 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:36:56.637 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:36:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd8dc035e00 msgr2=0x7fd8dc0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 --2- 172.21.15.18:0/4050984170 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd8dc035e00 0x7fd8dc0382c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8005890 tx=0x7fd8e8007a90 comp rx=0 tx=0).stop 2024-09-13T19:36:56.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 msgr2=0x7fd8f809c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:56.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 --2- 172.21.15.18:0/4050984170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f809c920 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd8f401a030 tx=0x7fd8f401ac40 comp rx=0 tx=0).stop 2024-09-13T19:36:56.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 shutdown_connections 2024-09-13T19:36:56.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 --2- 172.21.15.18:0/4050984170 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd8dc035e00 0x7fd8dc0382c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:56.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 --2- 172.21.15.18:0/4050984170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8f812e760 0x7fd8f809c920 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:56.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 >> 172.21.15.18:0/4050984170 conn(0x7fd8f80a10a0 msgr2=0x7fd8f8095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:56.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 shutdown_connections 2024-09-13T19:36:56.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.626+0000 7fd8ffff5640 1 -- 172.21.15.18:0/4050984170 wait complete. 2024-09-13T19:36:56.654 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-13T19:36:56.513532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4897,"num_read_kb":4478,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4515,"ondisk_log_size":4515,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186288,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377301072,"statfs":{"total":386547056640,"available":386356297728,"internally_reserved":0,"allocated":54509568,"data_stored":53337730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005678"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.686210+0000","last_change":"2024-09-13T19:33:08.351986+0000","last_active":"2024-09-13T19:33:52.686210+0000","last_peered":"2024-09-13T19:33:52.686210+0000","last_clean":"2024-09-13T19:33:52.686210+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:33:52.686210+0000","last_undegraded":"2024-09-13T19:33:52.686210+0000","last_fullsized":"2024-09-13T19:33:52.686210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278487+0000","last_change":"2024-09-13T19:33:10.354610+0000","last_active":"2024-09-13T19:36:24.278487+0000","last_peered":"2024-09-13T19:36:24.278487+0000","last_clean":"2024-09-13T19:36:24.278487+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:36:24.278487+0000","last_undegraded":"2024-09-13T19:36:24.278487+0000","last_fullsized":"2024-09-13T19:36:24.278487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:03.258150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.085377+0000","last_change":"2024-09-13T19:33:08.349789+0000","last_active":"2024-09-13T19:36:24.085377+0000","last_peered":"2024-09-13T19:36:24.085377+0000","last_clean":"2024-09-13T19:36:24.085377+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:36:24.085377+0000","last_undegraded":"2024-09-13T19:36:24.085377+0000","last_fullsized":"2024-09-13T19:36:24.085377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:33.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:19.508790+0000","last_change":"2024-09-13T19:33:49.508985+0000","last_active":"2024-09-13T19:36:19.508790+0000","last_peered":"2024-09-13T19:36:19.508790+0000","last_clean":"2024-09-13T19:36:19.508790+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:36:19.508790+0000","last_undegraded":"2024-09-13T19:36:19.508790+0000","last_fullsized":"2024-09-13T19:36:19.508790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:27.111192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515719+0000","last_change":"2024-09-13T19:33:08.354845+0000","last_active":"2024-09-13T19:33:49.515719+0000","last_peered":"2024-09-13T19:33:49.515719+0000","last_clean":"2024-09-13T19:33:49.515719+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:33:49.515719+0000","last_undegraded":"2024-09-13T19:33:49.515719+0000","last_fullsized":"2024-09-13T19:33:49.515719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:38.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.223614+0000","last_change":"2024-09-13T19:33:10.349694+0000","last_active":"2024-09-13T19:36:24.223614+0000","last_peered":"2024-09-13T19:36:24.223614+0000","last_clean":"2024-09-13T19:36:24.223614+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:36:24.223614+0000","last_undegraded":"2024-09-13T19:36:24.223614+0000","last_fullsized":"2024-09-13T19:36:24.223614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:06.072800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.518838+0000","last_change":"2024-09-13T19:33:08.348066+0000","last_active":"2024-09-13T19:33:49.518838+0000","last_peered":"2024-09-13T19:33:49.518838+0000","last_clean":"2024-09-13T19:33:49.518838+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:33:49.518838+0000","last_undegraded":"2024-09-13T19:33:49.518838+0000","last_fullsized":"2024-09-13T19:33:49.518838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:46.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.522657+0000","last_change":"2024-09-13T19:33:10.348236+0000","last_active":"2024-09-13T19:34:37.522657+0000","last_peered":"2024-09-13T19:34:37.522657+0000","last_clean":"2024-09-13T19:34:37.522657+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:34:37.522657+0000","last_undegraded":"2024-09-13T19:34:37.522657+0000","last_fullsized":"2024-09-13T19:34:37.522657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:14.920902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505426+0000","last_change":"2024-09-13T19:33:08.336355+0000","last_active":"2024-09-13T19:33:49.505426+0000","last_peered":"2024-09-13T19:33:49.505426+0000","last_clean":"2024-09-13T19:33:49.505426+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:33:49.505426+0000","last_undegraded":"2024-09-13T19:33:49.505426+0000","last_fullsized":"2024-09-13T19:33:49.505426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:21.610997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.872394+0000","last_change":"2024-09-13T19:33:10.353752+0000","last_active":"2024-09-13T19:33:54.872394+0000","last_peered":"2024-09-13T19:33:54.872394+0000","last_clean":"2024-09-13T19:33:54.872394+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:33:54.872394+0000","last_undegraded":"2024-09-13T19:33:54.872394+0000","last_fullsized":"2024-09-13T19:33:54.872394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:25.322287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.518463+0000","last_change":"2024-09-13T19:33:08.333243+0000","last_active":"2024-09-13T19:33:49.518463+0000","last_peered":"2024-09-13T19:33:49.518463+0000","last_clean":"2024-09-13T19:33:49.518463+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:33:49.518463+0000","last_undegraded":"2024-09-13T19:33:49.518463+0000","last_fullsized":"2024-09-13T19:33:49.518463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:38.936603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.916325+0000","last_change":"2024-09-13T19:33:10.357587+0000","last_active":"2024-09-13T19:35:22.916325+0000","last_peered":"2024-09-13T19:35:22.916325+0000","last_clean":"2024-09-13T19:35:22.916325+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:35:22.916325+0000","last_undegraded":"2024-09-13T19:35:22.916325+0000","last_fullsized":"2024-09-13T19:35:22.916325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:19.567235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507129+0000","last_change":"2024-09-13T19:33:08.338158+0000","last_active":"2024-09-13T19:33:49.507129+0000","last_peered":"2024-09-13T19:33:49.507129+0000","last_clean":"2024-09-13T19:33:49.507129+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:33:49.507129+0000","last_undegraded":"2024-09-13T19:33:49.507129+0000","last_fullsized":"2024-09-13T19:33:49.507129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:12.010604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.180096+0000","last_change":"2024-09-13T19:33:10.355178+0000","last_active":"2024-09-13T19:35:18.180096+0000","last_peered":"2024-09-13T19:35:18.180096+0000","last_clean":"2024-09-13T19:35:18.180096+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:35:18.180096+0000","last_undegraded":"2024-09-13T19:35:18.180096+0000","last_fullsized":"2024-09-13T19:35:18.180096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495952+0000","last_change":"2024-09-13T19:33:08.331646+0000","last_active":"2024-09-13T19:33:49.495952+0000","last_peered":"2024-09-13T19:33:49.495952+0000","last_clean":"2024-09-13T19:33:49.495952+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:33:49.495952+0000","last_undegraded":"2024-09-13T19:33:49.495952+0000","last_fullsized":"2024-09-13T19:33:49.495952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.521422+0000","last_change":"2024-09-13T19:33:10.332175+0000","last_active":"2024-09-13T19:34:37.521422+0000","last_peered":"2024-09-13T19:34:37.521422+0000","last_clean":"2024-09-13T19:34:37.521422+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:34:37.521422+0000","last_undegraded":"2024-09-13T19:34:37.521422+0000","last_fullsized":"2024-09-13T19:34:37.521422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.169782+0000","last_change":"2024-09-13T19:33:10.348601+0000","last_active":"2024-09-13T19:33:54.169782+0000","last_peered":"2024-09-13T19:33:54.169782+0000","last_clean":"2024-09-13T19:33:54.169782+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:33:54.169782+0000","last_undegraded":"2024-09-13T19:33:54.169782+0000","last_fullsized":"2024-09-13T19:33:54.169782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:18.388392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.176919+0000","last_change":"2024-09-13T19:33:08.338071+0000","last_active":"2024-09-13T19:35:18.176919+0000","last_peered":"2024-09-13T19:35:18.176919+0000","last_clean":"2024-09-13T19:35:18.176919+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:35:18.176919+0000","last_undegraded":"2024-09-13T19:35:18.176919+0000","last_fullsized":"2024-09-13T19:35:18.176919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.208248+0000","last_change":"2024-09-13T19:33:10.350836+0000","last_active":"2024-09-13T19:36:24.208248+0000","last_peered":"2024-09-13T19:36:24.208248+0000","last_clean":"2024-09-13T19:36:24.208248+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:36:24.208248+0000","last_undegraded":"2024-09-13T19:36:24.208248+0000","last_fullsized":"2024-09-13T19:36:24.208248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524586+0000","last_change":"2024-09-13T19:33:08.352861+0000","last_active":"2024-09-13T19:33:49.524586+0000","last_peered":"2024-09-13T19:33:49.524586+0000","last_clean":"2024-09-13T19:33:49.524586+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:33:49.524586+0000","last_undegraded":"2024-09-13T19:33:49.524586+0000","last_fullsized":"2024-09-13T19:33:49.524586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749546+0000","last_change":"2024-09-13T19:33:10.354940+0000","last_active":"2024-09-13T19:36:23.749546+0000","last_peered":"2024-09-13T19:36:23.749546+0000","last_clean":"2024-09-13T19:36:23.749546+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:36:23.749546+0000","last_undegraded":"2024-09-13T19:36:23.749546+0000","last_fullsized":"2024-09-13T19:36:23.749546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:32.796106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.813354+0000","last_change":"2024-09-13T19:33:08.337822+0000","last_active":"2024-09-13T19:35:22.813354+0000","last_peered":"2024-09-13T19:35:22.813354+0000","last_clean":"2024-09-13T19:35:22.813354+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:35:22.813354+0000","last_undegraded":"2024-09-13T19:35:22.813354+0000","last_fullsized":"2024-09-13T19:35:22.813354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:46.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.935906+0000","last_change":"2024-09-13T19:33:10.341134+0000","last_active":"2024-09-13T19:35:22.935906+0000","last_peered":"2024-09-13T19:35:22.935906+0000","last_clean":"2024-09-13T19:35:22.935906+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:35:22.935906+0000","last_undegraded":"2024-09-13T19:35:22.935906+0000","last_fullsized":"2024-09-13T19:35:22.935906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.682621+0000","last_change":"2024-09-13T19:33:08.335101+0000","last_active":"2024-09-13T19:33:52.682621+0000","last_peered":"2024-09-13T19:33:52.682621+0000","last_clean":"2024-09-13T19:33:52.682621+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:33:52.682621+0000","last_undegraded":"2024-09-13T19:33:52.682621+0000","last_fullsized":"2024-09-13T19:33:52.682621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207846+0000","last_change":"2024-09-13T19:33:10.346663+0000","last_active":"2024-09-13T19:36:24.207846+0000","last_peered":"2024-09-13T19:36:24.207846+0000","last_clean":"2024-09-13T19:36:24.207846+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:36:24.207846+0000","last_undegraded":"2024-09-13T19:36:24.207846+0000","last_fullsized":"2024-09-13T19:36:24.207846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:19.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498616+0000","last_change":"2024-09-13T19:33:08.345933+0000","last_active":"2024-09-13T19:33:49.498616+0000","last_peered":"2024-09-13T19:33:49.498616+0000","last_clean":"2024-09-13T19:33:49.498616+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:33:49.498616+0000","last_undegraded":"2024-09-13T19:33:49.498616+0000","last_fullsized":"2024-09-13T19:33:49.498616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:20.702363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278174+0000","last_change":"2024-09-13T19:33:10.352700+0000","last_active":"2024-09-13T19:36:24.278174+0000","last_peered":"2024-09-13T19:36:24.278174+0000","last_clean":"2024-09-13T19:36:24.278174+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:36:24.278174+0000","last_undegraded":"2024-09-13T19:36:24.278174+0000","last_fullsized":"2024-09-13T19:36:24.278174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:42.703374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506193+0000","last_change":"2024-09-13T19:33:08.341033+0000","last_active":"2024-09-13T19:33:49.506193+0000","last_peered":"2024-09-13T19:33:49.506193+0000","last_clean":"2024-09-13T19:33:49.506193+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:33:49.506193+0000","last_undegraded":"2024-09-13T19:33:49.506193+0000","last_fullsized":"2024-09-13T19:33:49.506193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:05.069489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.289296+0000","last_change":"2024-09-13T19:33:18.418602+0000","last_active":"2024-09-13T19:36:24.289296+0000","last_peered":"2024-09-13T19:36:24.289296+0000","last_clean":"2024-09-13T19:36:24.289296+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:36:24.289296+0000","last_undegraded":"2024-09-13T19:36:24.289296+0000","last_fullsized":"2024-09-13T19:36:24.289296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:10.880859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.887329+0000","last_change":"2024-09-13T19:33:10.354595+0000","last_active":"2024-09-13T19:36:23.887329+0000","last_peered":"2024-09-13T19:36:23.887329+0000","last_clean":"2024-09-13T19:36:23.887329+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:36:23.887329+0000","last_undegraded":"2024-09-13T19:36:23.887329+0000","last_fullsized":"2024-09-13T19:36:23.887329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:20.279342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.425021+0000","last_change":"2024-09-13T19:33:08.354352+0000","last_active":"2024-09-13T19:36:23.425021+0000","last_peered":"2024-09-13T19:36:23.425021+0000","last_clean":"2024-09-13T19:36:23.425021+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:36:23.425021+0000","last_undegraded":"2024-09-13T19:36:23.425021+0000","last_fullsized":"2024-09-13T19:36:23.425021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:13.750930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":12,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506011+0000","last_change":"2024-09-13T19:33:12.348066+0000","last_active":"2024-09-13T19:33:49.506011+0000","last_peered":"2024-09-13T19:33:49.506011+0000","last_clean":"2024-09-13T19:33:49.506011+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:33:49.506011+0000","last_undegraded":"2024-09-13T19:33:49.506011+0000","last_fullsized":"2024-09-13T19:33:49.506011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:08.587167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507782+0000","last_change":"2024-09-13T19:33:14.385453+0000","last_active":"2024-09-13T19:35:40.507782+0000","last_peered":"2024-09-13T19:35:40.507782+0000","last_clean":"2024-09-13T19:35:40.507782+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:35:40.507782+0000","last_undegraded":"2024-09-13T19:35:40.507782+0000","last_fullsized":"2024-09-13T19:35:40.507782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:02.906563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510495+0000","last_change":"2024-09-13T19:33:16.394148+0000","last_active":"2024-09-13T19:33:49.510495+0000","last_peered":"2024-09-13T19:33:49.510495+0000","last_clean":"2024-09-13T19:33:49.510495+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:33:49.510495+0000","last_undegraded":"2024-09-13T19:33:49.510495+0000","last_fullsized":"2024-09-13T19:33:49.510495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:48.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.211547+0000","last_change":"2024-09-13T19:33:18.412565+0000","last_active":"2024-09-13T19:36:24.211547+0000","last_peered":"2024-09-13T19:36:24.211547+0000","last_clean":"2024-09-13T19:36:24.211547+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:36:24.211547+0000","last_undegraded":"2024-09-13T19:36:24.211547+0000","last_fullsized":"2024-09-13T19:36:24.211547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:17.846459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278687+0000","last_change":"2024-09-13T19:33:10.353417+0000","last_active":"2024-09-13T19:36:24.278687+0000","last_peered":"2024-09-13T19:36:24.278687+0000","last_clean":"2024-09-13T19:36:24.278687+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:36:24.278687+0000","last_undegraded":"2024-09-13T19:36:24.278687+0000","last_fullsized":"2024-09-13T19:36:24.278687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:18.375886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.344511+0000","last_change":"2024-09-13T19:33:08.348578+0000","last_active":"2024-09-13T19:33:53.344511+0000","last_peered":"2024-09-13T19:33:53.344511+0000","last_clean":"2024-09-13T19:33:53.344511+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:33:53.344511+0000","last_undegraded":"2024-09-13T19:33:53.344511+0000","last_fullsized":"2024-09-13T19:33:53.344511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.481580+0000","last_change":"2024-09-13T19:33:49.525696+0000","last_active":"2024-09-13T19:33:50.481580+0000","last_peered":"2024-09-13T19:33:50.481580+0000","last_clean":"2024-09-13T19:33:50.481580+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:33:50.481580+0000","last_undegraded":"2024-09-13T19:33:50.481580+0000","last_fullsized":"2024-09-13T19:33:50.481580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:29.119647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510753+0000","last_change":"2024-09-13T19:33:14.364101+0000","last_active":"2024-09-13T19:33:49.510753+0000","last_peered":"2024-09-13T19:33:49.510753+0000","last_clean":"2024-09-13T19:33:49.510753+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:33:49.510753+0000","last_undegraded":"2024-09-13T19:33:49.510753+0000","last_fullsized":"2024-09-13T19:33:49.510753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:18.964704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504881+0000","last_change":"2024-09-13T19:33:16.394670+0000","last_active":"2024-09-13T19:33:49.504881+0000","last_peered":"2024-09-13T19:33:49.504881+0000","last_clean":"2024-09-13T19:33:49.504881+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:33:49.504881+0000","last_undegraded":"2024-09-13T19:33:49.504881+0000","last_fullsized":"2024-09-13T19:33:49.504881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:21.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495915+0000","last_change":"2024-09-13T19:33:18.407303+0000","last_active":"2024-09-13T19:33:49.495915+0000","last_peered":"2024-09-13T19:33:49.495915+0000","last_clean":"2024-09-13T19:33:49.495915+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:33:49.495915+0000","last_undegraded":"2024-09-13T19:33:49.495915+0000","last_fullsized":"2024-09-13T19:33:49.495915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:43.261605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'11","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.299618+0000","last_change":"2024-09-13T19:33:10.350582+0000","last_active":"2024-09-13T19:36:24.299618+0000","last_peered":"2024-09-13T19:36:24.299618+0000","last_clean":"2024-09-13T19:36:24.299618+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:36:24.299618+0000","last_undegraded":"2024-09-13T19:36:24.299618+0000","last_fullsized":"2024-09-13T19:36:24.299618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:48.834947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505235+0000","last_change":"2024-09-13T19:33:08.355253+0000","last_active":"2024-09-13T19:33:49.505235+0000","last_peered":"2024-09-13T19:33:49.505235+0000","last_clean":"2024-09-13T19:33:49.505235+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:33:49.505235+0000","last_undegraded":"2024-09-13T19:33:49.505235+0000","last_fullsized":"2024-09-13T19:33:49.505235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:24.473523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.061670+0000","last_change":"2024-09-13T19:33:12.350183+0000","last_active":"2024-09-13T19:35:22.061670+0000","last_peered":"2024-09-13T19:35:22.061670+0000","last_clean":"2024-09-13T19:35:22.061670+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:35:22.061670+0000","last_undegraded":"2024-09-13T19:35:22.061670+0000","last_fullsized":"2024-09-13T19:35:22.061670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:20.396847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.245650+0000","last_change":"2024-09-13T19:33:14.373660+0000","last_active":"2024-09-13T19:34:37.245650+0000","last_peered":"2024-09-13T19:34:37.245650+0000","last_clean":"2024-09-13T19:34:37.245650+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:34:37.245650+0000","last_undegraded":"2024-09-13T19:34:37.245650+0000","last_fullsized":"2024-09-13T19:34:37.245650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:29.436165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'284","reported_seq":393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.444937+0000","last_change":"2024-09-13T19:33:16.400903+0000","last_active":"2024-09-13T19:36:55.444937+0000","last_peered":"2024-09-13T19:36:55.444937+0000","last_clean":"2024-09-13T19:36:55.444937+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:36:55.444937+0000","last_undegraded":"2024-09-13T19:36:55.444937+0000","last_fullsized":"2024-09-13T19:36:55.444937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:31.714918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.826207+0000","last_change":"2024-09-13T19:33:18.416828+0000","last_active":"2024-09-13T19:33:53.826207+0000","last_peered":"2024-09-13T19:33:53.826207+0000","last_clean":"2024-09-13T19:33:53.826207+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:33:53.826207+0000","last_undegraded":"2024-09-13T19:33:53.826207+0000","last_fullsized":"2024-09-13T19:33:53.826207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:50.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.728071+0000","last_change":"2024-09-13T19:33:10.342044+0000","last_active":"2024-09-13T19:36:23.728071+0000","last_peered":"2024-09-13T19:36:23.728071+0000","last_clean":"2024-09-13T19:36:23.728071+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:36:23.728071+0000","last_undegraded":"2024-09-13T19:36:23.728071+0000","last_fullsized":"2024-09-13T19:36:23.728071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:43.220677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498238+0000","last_change":"2024-09-13T19:33:08.337394+0000","last_active":"2024-09-13T19:33:49.498238+0000","last_peered":"2024-09-13T19:33:49.498238+0000","last_clean":"2024-09-13T19:33:49.498238+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:33:49.498238+0000","last_undegraded":"2024-09-13T19:33:49.498238+0000","last_fullsized":"2024-09-13T19:33:49.498238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:13.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513312+0000","last_change":"2024-09-13T19:33:12.356265+0000","last_active":"2024-09-13T19:33:49.513312+0000","last_peered":"2024-09-13T19:33:49.513312+0000","last_clean":"2024-09-13T19:33:49.513312+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:33:49.513312+0000","last_undegraded":"2024-09-13T19:33:49.513312+0000","last_fullsized":"2024-09-13T19:33:49.513312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:52.279609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'32","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503719+0000","last_change":"2024-09-13T19:33:14.371462+0000","last_active":"2024-09-13T19:35:40.503719+0000","last_peered":"2024-09-13T19:35:40.503719+0000","last_clean":"2024-09-13T19:35:40.503719+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:35:40.503719+0000","last_undegraded":"2024-09-13T19:35:40.503719+0000","last_fullsized":"2024-09-13T19:35:40.503719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:35.666084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.287443+0000","last_change":"2024-09-13T19:33:16.392294+0000","last_active":"2024-09-13T19:36:24.287443+0000","last_peered":"2024-09-13T19:36:24.287443+0000","last_clean":"2024-09-13T19:36:24.287443+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:36:24.287443+0000","last_undegraded":"2024-09-13T19:36:24.287443+0000","last_fullsized":"2024-09-13T19:36:24.287443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:21.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096128+0000","last_change":"2024-09-13T19:33:10.356414+0000","last_active":"2024-09-13T19:36:24.096128+0000","last_peered":"2024-09-13T19:36:24.096128+0000","last_clean":"2024-09-13T19:36:24.096128+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:36:24.096128+0000","last_undegraded":"2024-09-13T19:36:24.096128+0000","last_fullsized":"2024-09-13T19:36:24.096128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:05.759718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.500106+0000","last_change":"2024-09-13T19:33:08.347478+0000","last_active":"2024-09-13T19:35:25.500106+0000","last_peered":"2024-09-13T19:35:25.500106+0000","last_clean":"2024-09-13T19:35:25.500106+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:35:25.500106+0000","last_undegraded":"2024-09-13T19:35:25.500106+0000","last_fullsized":"2024-09-13T19:35:25.500106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499234+0000","last_change":"2024-09-13T19:33:12.362201+0000","last_active":"2024-09-13T19:33:49.499234+0000","last_peered":"2024-09-13T19:33:49.499234+0000","last_clean":"2024-09-13T19:33:49.499234+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:33:49.499234+0000","last_undegraded":"2024-09-13T19:33:49.499234+0000","last_fullsized":"2024-09-13T19:33:49.499234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:20.396847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'41","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.499748+0000","last_change":"2024-09-13T19:33:14.367131+0000","last_active":"2024-09-13T19:35:25.499748+0000","last_peered":"2024-09-13T19:35:25.499748+0000","last_clean":"2024-09-13T19:35:25.499748+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:35:25.499748+0000","last_undegraded":"2024-09-13T19:35:25.499748+0000","last_fullsized":"2024-09-13T19:35:25.499748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:41.769483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.496898+0000","last_change":"2024-09-13T19:33:16.372536+0000","last_active":"2024-09-13T19:33:49.496898+0000","last_peered":"2024-09-13T19:33:49.496898+0000","last_clean":"2024-09-13T19:33:49.496898+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:33:49.496898+0000","last_undegraded":"2024-09-13T19:33:49.496898+0000","last_fullsized":"2024-09-13T19:33:49.496898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:31.023125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.255184+0000","last_change":"2024-09-13T19:33:18.417415+0000","last_active":"2024-09-13T19:34:37.255184+0000","last_peered":"2024-09-13T19:34:37.255184+0000","last_clean":"2024-09-13T19:34:37.255184+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:34:37.255184+0000","last_undegraded":"2024-09-13T19:34:37.255184+0000","last_fullsized":"2024-09-13T19:34:37.255184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:08.824528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278394+0000","last_change":"2024-09-13T19:33:10.352105+0000","last_active":"2024-09-13T19:36:24.278394+0000","last_peered":"2024-09-13T19:36:24.278394+0000","last_clean":"2024-09-13T19:36:24.278394+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:36:24.278394+0000","last_undegraded":"2024-09-13T19:36:24.278394+0000","last_fullsized":"2024-09-13T19:36:24.278394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.525145+0000","last_change":"2024-09-13T19:33:08.351524+0000","last_active":"2024-09-13T19:33:49.525145+0000","last_peered":"2024-09-13T19:33:49.525145+0000","last_clean":"2024-09-13T19:33:49.525145+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:33:49.525145+0000","last_undegraded":"2024-09-13T19:33:49.525145+0000","last_fullsized":"2024-09-13T19:33:49.525145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:27.423338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497283+0000","last_change":"2024-09-13T19:33:12.346361+0000","last_active":"2024-09-13T19:33:49.497283+0000","last_peered":"2024-09-13T19:33:49.497283+0000","last_clean":"2024-09-13T19:33:49.497283+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:33:49.497283+0000","last_undegraded":"2024-09-13T19:33:49.497283+0000","last_fullsized":"2024-09-13T19:33:49.497283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:12.646509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.753674+0000","last_change":"2024-09-13T19:33:14.391496+0000","last_active":"2024-09-13T19:36:23.753674+0000","last_peered":"2024-09-13T19:36:23.753674+0000","last_clean":"2024-09-13T19:36:23.753674+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:36:23.753674+0000","last_undegraded":"2024-09-13T19:36:23.753674+0000","last_fullsized":"2024-09-13T19:36:23.753674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:30.872095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.496182+0000","last_change":"2024-09-13T19:33:16.375752+0000","last_active":"2024-09-13T19:33:49.496182+0000","last_peered":"2024-09-13T19:33:49.496182+0000","last_clean":"2024-09-13T19:33:49.496182+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:33:49.496182+0000","last_undegraded":"2024-09-13T19:33:49.496182+0000","last_fullsized":"2024-09-13T19:33:49.496182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:57.894724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:31.549249+0000","last_change":"2024-09-13T19:33:18.420383+0000","last_active":"2024-09-13T19:34:31.549249+0000","last_peered":"2024-09-13T19:34:31.549249+0000","last_clean":"2024-09-13T19:34:31.549249+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:34:31.549249+0000","last_undegraded":"2024-09-13T19:34:31.549249+0000","last_fullsized":"2024-09-13T19:34:31.549249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:08.579627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207661+0000","last_change":"2024-09-13T19:33:10.330476+0000","last_active":"2024-09-13T19:36:24.207661+0000","last_peered":"2024-09-13T19:36:24.207661+0000","last_clean":"2024-09-13T19:36:24.207661+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:36:24.207661+0000","last_undegraded":"2024-09-13T19:36:24.207661+0000","last_fullsized":"2024-09-13T19:36:24.207661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:13.461248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507615+0000","last_change":"2024-09-13T19:33:08.341877+0000","last_active":"2024-09-13T19:33:49.507615+0000","last_peered":"2024-09-13T19:33:49.507615+0000","last_clean":"2024-09-13T19:33:49.507615+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:33:49.507615+0000","last_undegraded":"2024-09-13T19:33:49.507615+0000","last_fullsized":"2024-09-13T19:33:49.507615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.834092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501241+0000","last_change":"2024-09-13T19:33:12.348033+0000","last_active":"2024-09-13T19:33:49.501241+0000","last_peered":"2024-09-13T19:33:49.501241+0000","last_clean":"2024-09-13T19:33:49.501241+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:33:49.501241+0000","last_undegraded":"2024-09-13T19:33:49.501241+0000","last_fullsized":"2024-09-13T19:33:49.501241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:26.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'38","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.503049+0000","last_change":"2024-09-13T19:33:14.366093+0000","last_active":"2024-09-13T19:35:25.503049+0000","last_peered":"2024-09-13T19:35:25.503049+0000","last_clean":"2024-09-13T19:35:25.503049+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:35:25.503049+0000","last_undegraded":"2024-09-13T19:35:25.503049+0000","last_fullsized":"2024-09-13T19:35:25.503049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.379070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":355,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.654764+0000","last_change":"2024-09-13T19:33:16.377299+0000","last_active":"2024-09-13T19:36:24.654764+0000","last_peered":"2024-09-13T19:36:24.654764+0000","last_clean":"2024-09-13T19:36:24.654764+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:36:24.654764+0000","last_undegraded":"2024-09-13T19:36:24.654764+0000","last_fullsized":"2024-09-13T19:36:24.654764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:48.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.894043+0000","last_change":"2024-09-13T19:33:18.416155+0000","last_active":"2024-09-13T19:36:23.894043+0000","last_peered":"2024-09-13T19:36:23.894043+0000","last_clean":"2024-09-13T19:36:23.894043+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:36:23.894043+0000","last_undegraded":"2024-09-13T19:36:23.894043+0000","last_fullsized":"2024-09-13T19:36:23.894043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:28.419736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096247+0000","last_change":"2024-09-13T19:33:10.337441+0000","last_active":"2024-09-13T19:36:24.096247+0000","last_peered":"2024-09-13T19:36:24.096247+0000","last_clean":"2024-09-13T19:36:24.096247+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:36:24.096247+0000","last_undegraded":"2024-09-13T19:36:24.096247+0000","last_fullsized":"2024-09-13T19:36:24.096247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.481677+0000","last_change":"2024-09-13T19:33:49.524748+0000","last_active":"2024-09-13T19:33:50.481677+0000","last_peered":"2024-09-13T19:33:50.481677+0000","last_clean":"2024-09-13T19:33:50.481677+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:33:50.481677+0000","last_undegraded":"2024-09-13T19:33:50.481677+0000","last_fullsized":"2024-09-13T19:33:50.481677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:26.896197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498193+0000","last_change":"2024-09-13T19:33:12.346224+0000","last_active":"2024-09-13T19:33:49.498193+0000","last_peered":"2024-09-13T19:33:49.498193+0000","last_clean":"2024-09-13T19:33:49.498193+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:33:49.498193+0000","last_undegraded":"2024-09-13T19:33:49.498193+0000","last_fullsized":"2024-09-13T19:33:49.498193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:20.747600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'57","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.471175+0000","last_change":"2024-09-13T19:33:14.376236+0000","last_active":"2024-09-13T19:36:55.471175+0000","last_peered":"2024-09-13T19:36:55.471175+0000","last_clean":"2024-09-13T19:36:55.471175+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:36:55.471175+0000","last_undegraded":"2024-09-13T19:36:55.471175+0000","last_fullsized":"2024-09-13T19:36:55.471175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:08.849176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497015+0000","last_change":"2024-09-13T19:33:16.380438+0000","last_active":"2024-09-13T19:33:49.497015+0000","last_peered":"2024-09-13T19:33:49.497015+0000","last_clean":"2024-09-13T19:33:49.497015+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:33:49.497015+0000","last_undegraded":"2024-09-13T19:33:49.497015+0000","last_fullsized":"2024-09-13T19:33:49.497015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:21.949160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.577660+0000","last_change":"2024-09-13T19:33:18.397231+0000","last_active":"2024-09-13T19:36:24.577660+0000","last_peered":"2024-09-13T19:36:24.577660+0000","last_clean":"2024-09-13T19:36:24.577660+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:36:24.577660+0000","last_undegraded":"2024-09-13T19:36:24.577660+0000","last_fullsized":"2024-09-13T19:36:24.577660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:25.940195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749484+0000","last_change":"2024-09-13T19:33:49.534836+0000","last_active":"2024-09-13T19:36:23.749484+0000","last_peered":"2024-09-13T19:36:23.749484+0000","last_clean":"2024-09-13T19:36:23.749484+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:36:23.749484+0000","last_undegraded":"2024-09-13T19:36:23.749484+0000","last_fullsized":"2024-09-13T19:36:23.749484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:46.631431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.680205+0000","last_change":"2024-09-13T19:33:08.332135+0000","last_active":"2024-09-13T19:33:52.680205+0000","last_peered":"2024-09-13T19:33:52.680205+0000","last_clean":"2024-09-13T19:33:52.680205+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:33:52.680205+0000","last_undegraded":"2024-09-13T19:33:52.680205+0000","last_fullsized":"2024-09-13T19:33:52.680205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:27.423338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520294+0000","last_change":"2024-09-13T19:33:12.358273+0000","last_active":"2024-09-13T19:33:49.520294+0000","last_peered":"2024-09-13T19:33:49.520294+0000","last_clean":"2024-09-13T19:33:49.520294+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:33:49.520294+0000","last_undegraded":"2024-09-13T19:33:49.520294+0000","last_fullsized":"2024-09-13T19:33:49.520294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:36.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'34","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503373+0000","last_change":"2024-09-13T19:33:14.364059+0000","last_active":"2024-09-13T19:35:30.503373+0000","last_peered":"2024-09-13T19:35:30.503373+0000","last_clean":"2024-09-13T19:35:30.503373+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:35:30.503373+0000","last_undegraded":"2024-09-13T19:35:30.503373+0000","last_fullsized":"2024-09-13T19:35:30.503373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:22.396286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512534+0000","last_change":"2024-09-13T19:33:16.403943+0000","last_active":"2024-09-13T19:33:49.512534+0000","last_peered":"2024-09-13T19:33:49.512534+0000","last_clean":"2024-09-13T19:33:49.512534+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:33:49.512534+0000","last_undegraded":"2024-09-13T19:33:49.512534+0000","last_fullsized":"2024-09-13T19:33:49.512534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:15.430735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.501955+0000","last_change":"2024-09-13T19:33:18.415707+0000","last_active":"2024-09-13T19:35:20.501955+0000","last_peered":"2024-09-13T19:35:20.501955+0000","last_clean":"2024-09-13T19:35:20.501955+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:35:20.501955+0000","last_undegraded":"2024-09-13T19:35:20.501955+0000","last_fullsized":"2024-09-13T19:35:20.501955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:34.463379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.279120+0000","last_change":"2024-09-13T19:33:10.359068+0000","last_active":"2024-09-13T19:36:24.279120+0000","last_peered":"2024-09-13T19:36:24.279120+0000","last_clean":"2024-09-13T19:36:24.279120+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:36:24.279120+0000","last_undegraded":"2024-09-13T19:36:24.279120+0000","last_fullsized":"2024-09-13T19:36:24.279120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:17.259191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507820+0000","last_change":"2024-09-13T19:33:08.342280+0000","last_active":"2024-09-13T19:33:49.507820+0000","last_peered":"2024-09-13T19:33:49.507820+0000","last_clean":"2024-09-13T19:33:49.507820+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:33:49.507820+0000","last_undegraded":"2024-09-13T19:33:49.507820+0000","last_fullsized":"2024-09-13T19:33:49.507820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:18.144107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501604+0000","last_change":"2024-09-13T19:33:12.348184+0000","last_active":"2024-09-13T19:33:49.501604+0000","last_peered":"2024-09-13T19:33:49.501604+0000","last_clean":"2024-09-13T19:33:49.501604+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:33:49.501604+0000","last_undegraded":"2024-09-13T19:33:49.501604+0000","last_fullsized":"2024-09-13T19:33:49.501604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:34.837586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.524983+0000","last_change":"2024-09-13T19:33:14.354520+0000","last_active":"2024-09-13T19:35:20.524983+0000","last_peered":"2024-09-13T19:35:20.524983+0000","last_clean":"2024-09-13T19:35:20.524983+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:35:20.524983+0000","last_undegraded":"2024-09-13T19:35:20.524983+0000","last_fullsized":"2024-09-13T19:35:20.524983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:18.105050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'284","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.446533+0000","last_change":"2024-09-13T19:33:16.390808+0000","last_active":"2024-09-13T19:36:55.446533+0000","last_peered":"2024-09-13T19:36:55.446533+0000","last_clean":"2024-09-13T19:36:55.446533+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:36:55.446533+0000","last_undegraded":"2024-09-13T19:36:55.446533+0000","last_fullsized":"2024-09-13T19:36:55.446533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:24.410292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.108546+0000","last_change":"2024-09-13T19:33:18.415690+0000","last_active":"2024-09-13T19:36:24.108546+0000","last_peered":"2024-09-13T19:36:24.108546+0000","last_clean":"2024-09-13T19:36:24.108546+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:36:24.108546+0000","last_undegraded":"2024-09-13T19:36:24.108546+0000","last_fullsized":"2024-09-13T19:36:24.108546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.646763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.528476+0000","last_change":"2024-09-13T19:33:10.333244+0000","last_active":"2024-09-13T19:33:49.528476+0000","last_peered":"2024-09-13T19:33:49.528476+0000","last_clean":"2024-09-13T19:33:49.528476+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:33:49.528476+0000","last_undegraded":"2024-09-13T19:33:49.528476+0000","last_fullsized":"2024-09-13T19:33:49.528476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.133553+0000","last_change":"2024-09-13T19:33:08.355262+0000","last_active":"2024-09-13T19:33:54.133553+0000","last_peered":"2024-09-13T19:33:54.133553+0000","last_clean":"2024-09-13T19:33:54.133553+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:33:54.133553+0000","last_undegraded":"2024-09-13T19:33:54.133553+0000","last_fullsized":"2024-09-13T19:33:54.133553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:41.635043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.418808+0000","last_change":"2024-09-13T19:33:12.355832+0000","last_active":"2024-09-13T19:36:55.418808+0000","last_peered":"2024-09-13T19:36:55.418808+0000","last_clean":"2024-09-13T19:36:55.418808+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:36:55.418808+0000","last_undegraded":"2024-09-13T19:36:55.418808+0000","last_fullsized":"2024-09-13T19:36:55.418808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:07.768173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509258+0000","last_change":"2024-09-13T19:33:14.392024+0000","last_active":"2024-09-13T19:33:49.509258+0000","last_peered":"2024-09-13T19:33:49.509258+0000","last_clean":"2024-09-13T19:33:49.509258+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:33:49.509258+0000","last_undegraded":"2024-09-13T19:33:49.509258+0000","last_fullsized":"2024-09-13T19:33:49.509258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:15.449504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'284","reported_seq":462,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.448687+0000","last_change":"2024-09-13T19:33:16.383487+0000","last_active":"2024-09-13T19:36:55.448687+0000","last_peered":"2024-09-13T19:36:55.448687+0000","last_clean":"2024-09-13T19:36:55.448687+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:36:55.448687+0000","last_undegraded":"2024-09-13T19:36:55.448687+0000","last_fullsized":"2024-09-13T19:36:55.448687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.397168+0000","last_change":"2024-09-13T19:33:18.405074+0000","last_active":"2024-09-13T19:35:22.397168+0000","last_peered":"2024-09-13T19:35:22.397168+0000","last_clean":"2024-09-13T19:35:22.397168+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:35:22.397168+0000","last_undegraded":"2024-09-13T19:35:22.397168+0000","last_fullsized":"2024-09-13T19:35:22.397168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:21.165425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278265+0000","last_change":"2024-09-13T19:33:10.351617+0000","last_active":"2024-09-13T19:36:24.278265+0000","last_peered":"2024-09-13T19:36:24.278265+0000","last_clean":"2024-09-13T19:36:24.278265+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:36:24.278265+0000","last_undegraded":"2024-09-13T19:36:24.278265+0000","last_fullsized":"2024-09-13T19:36:24.278265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:31.372401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.266908+0000","last_change":"2024-09-13T19:33:08.341993+0000","last_active":"2024-09-13T19:36:24.266908+0000","last_peered":"2024-09-13T19:36:24.266908+0000","last_clean":"2024-09-13T19:36:24.266908+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:36:24.266908+0000","last_undegraded":"2024-09-13T19:36:24.266908+0000","last_fullsized":"2024-09-13T19:36:24.266908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:50.411658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512635+0000","last_change":"2024-09-13T19:33:12.360435+0000","last_active":"2024-09-13T19:33:49.512635+0000","last_peered":"2024-09-13T19:33:49.512635+0000","last_clean":"2024-09-13T19:33:49.512635+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:33:49.512635+0000","last_undegraded":"2024-09-13T19:33:49.512635+0000","last_fullsized":"2024-09-13T19:33:49.512635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:06.192815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'39","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503321+0000","last_change":"2024-09-13T19:33:14.363402+0000","last_active":"2024-09-13T19:35:30.503321+0000","last_peered":"2024-09-13T19:35:30.503321+0000","last_clean":"2024-09-13T19:35:30.503321+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:35:30.503321+0000","last_undegraded":"2024-09-13T19:35:30.503321+0000","last_fullsized":"2024-09-13T19:35:30.503321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.213821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.519148+0000","last_change":"2024-09-13T19:33:16.392497+0000","last_active":"2024-09-13T19:33:49.519148+0000","last_peered":"2024-09-13T19:33:49.519148+0000","last_clean":"2024-09-13T19:33:49.519148+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:33:49.519148+0000","last_undegraded":"2024-09-13T19:33:49.519148+0000","last_fullsized":"2024-09-13T19:33:49.519148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:08.307092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.381185+0000","last_change":"2024-09-13T19:33:18.409575+0000","last_active":"2024-09-13T19:36:24.381185+0000","last_peered":"2024-09-13T19:36:24.381185+0000","last_clean":"2024-09-13T19:36:24.381185+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:36:24.381185+0000","last_undegraded":"2024-09-13T19:36:24.381185+0000","last_fullsized":"2024-09-13T19:36:24.381185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:03.846914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507876+0000","last_change":"2024-09-13T19:33:10.358838+0000","last_active":"2024-09-13T19:33:49.507876+0000","last_peered":"2024-09-13T19:33:49.507876+0000","last_clean":"2024-09-13T19:33:49.507876+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:33:49.507876+0000","last_undegraded":"2024-09-13T19:33:49.507876+0000","last_fullsized":"2024-09-13T19:33:49.507876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:55.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497900+0000","last_change":"2024-09-13T19:32:57.877961+0000","last_active":"2024-09-13T19:33:49.497900+0000","last_peered":"2024-09-13T19:33:49.497900+0000","last_clean":"2024-09-13T19:33:49.497900+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:33:49.497900+0000","last_undegraded":"2024-09-13T19:33:49.497900+0000","last_fullsized":"2024-09-13T19:33:49.497900+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_clean_scrub_stamp":"2024-09-13T19:32:56.474648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504144+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:33:49.504144+0000","last_peered":"2024-09-13T19:33:49.504144+0000","last_clean":"2024-09-13T19:33:49.504144+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:33:49.504144+0000","last_undegraded":"2024-09-13T19:33:49.504144+0000","last_fullsized":"2024-09-13T19:33:49.504144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:41.432070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505312+0000","last_change":"2024-09-13T19:33:08.353659+0000","last_active":"2024-09-13T19:33:49.505312+0000","last_peered":"2024-09-13T19:33:49.505312+0000","last_clean":"2024-09-13T19:33:49.505312+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:33:49.505312+0000","last_undegraded":"2024-09-13T19:33:49.505312+0000","last_fullsized":"2024-09-13T19:33:49.505312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:40.029223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.526320+0000","last_change":"2024-09-13T19:33:49.523626+0000","last_active":"2024-09-13T19:33:49.526320+0000","last_peered":"2024-09-13T19:33:49.526320+0000","last_clean":"2024-09-13T19:33:49.526320+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:33:49.526320+0000","last_undegraded":"2024-09-13T19:33:49.526320+0000","last_fullsized":"2024-09-13T19:33:49.526320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:00.894619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'79","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.500417+0000","last_change":"2024-09-13T19:33:14.384076+0000","last_active":"2024-09-13T19:36:55.500417+0000","last_peered":"2024-09-13T19:36:55.500417+0000","last_clean":"2024-09-13T19:36:55.500417+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:36:55.500417+0000","last_undegraded":"2024-09-13T19:36:55.500417+0000","last_fullsized":"2024-09-13T19:36:55.500417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:28.403671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502313+0000","last_change":"2024-09-13T19:33:16.378379+0000","last_active":"2024-09-13T19:33:49.502313+0000","last_peered":"2024-09-13T19:33:49.502313+0000","last_clean":"2024-09-13T19:33:49.502313+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:33:49.502313+0000","last_undegraded":"2024-09-13T19:33:49.502313+0000","last_fullsized":"2024-09-13T19:33:49.502313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:10.218765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.306871+0000","last_change":"2024-09-13T19:33:18.410177+0000","last_active":"2024-09-13T19:36:24.306871+0000","last_peered":"2024-09-13T19:36:24.306871+0000","last_clean":"2024-09-13T19:36:24.306871+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:36:24.306871+0000","last_undegraded":"2024-09-13T19:36:24.306871+0000","last_fullsized":"2024-09-13T19:36:24.306871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:27.219574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097115+0000","last_change":"2024-09-13T19:33:49.529179+0000","last_active":"2024-09-13T19:36:24.097115+0000","last_peered":"2024-09-13T19:36:24.097115+0000","last_clean":"2024-09-13T19:36:24.097115+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:36:24.097115+0000","last_undegraded":"2024-09-13T19:36:24.097115+0000","last_fullsized":"2024-09-13T19:36:24.097115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:00.531797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502217+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:33:49.502217+0000","last_peered":"2024-09-13T19:33:49.502217+0000","last_clean":"2024-09-13T19:33:49.502217+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:33:49.502217+0000","last_undegraded":"2024-09-13T19:33:49.502217+0000","last_fullsized":"2024-09-13T19:33:49.502217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.679995+0000","last_change":"2024-09-13T19:33:08.349400+0000","last_active":"2024-09-13T19:33:52.679995+0000","last_peered":"2024-09-13T19:33:52.679995+0000","last_clean":"2024-09-13T19:33:52.679995+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:33:52.679995+0000","last_undegraded":"2024-09-13T19:33:52.679995+0000","last_fullsized":"2024-09-13T19:33:52.679995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517380+0000","last_change":"2024-09-13T19:33:12.348082+0000","last_active":"2024-09-13T19:33:49.517380+0000","last_peered":"2024-09-13T19:33:49.517380+0000","last_clean":"2024-09-13T19:33:49.517380+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:33:49.517380+0000","last_undegraded":"2024-09-13T19:33:49.517380+0000","last_fullsized":"2024-09-13T19:33:49.517380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:26.997175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'277","reported_seq":482,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.488944+0000","last_change":"2024-09-13T19:33:14.367931+0000","last_active":"2024-09-13T19:36:55.488944+0000","last_peered":"2024-09-13T19:36:55.488944+0000","last_clean":"2024-09-13T19:36:55.488944+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:36:55.488944+0000","last_undegraded":"2024-09-13T19:36:55.488944+0000","last_fullsized":"2024-09-13T19:36:55.488944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:56.984417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":360,"num_read_kb":345,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505001+0000","last_change":"2024-09-13T19:33:16.401894+0000","last_active":"2024-09-13T19:33:49.505001+0000","last_peered":"2024-09-13T19:33:49.505001+0000","last_clean":"2024-09-13T19:33:49.505001+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:33:49.505001+0000","last_undegraded":"2024-09-13T19:33:49.505001+0000","last_fullsized":"2024-09-13T19:33:49.505001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.888292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.248196+0000","last_change":"2024-09-13T19:33:18.424198+0000","last_active":"2024-09-13T19:34:37.248196+0000","last_peered":"2024-09-13T19:34:37.248196+0000","last_clean":"2024-09-13T19:34:37.248196+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:34:37.248196+0000","last_undegraded":"2024-09-13T19:34:37.248196+0000","last_fullsized":"2024-09-13T19:34:37.248196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:43.261605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.917935+0000","last_change":"2024-09-13T19:33:10.340098+0000","last_active":"2024-09-13T19:35:22.917935+0000","last_peered":"2024-09-13T19:35:22.917935+0000","last_clean":"2024-09-13T19:35:22.917935+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:35:22.917935+0000","last_undegraded":"2024-09-13T19:35:22.917935+0000","last_fullsized":"2024-09-13T19:35:22.917935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:42.703374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517014+0000","last_change":"2024-09-13T19:33:02.801369+0000","last_active":"2024-09-13T19:33:49.517014+0000","last_peered":"2024-09-13T19:33:49.517014+0000","last_clean":"2024-09-13T19:33:49.517014+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:33:49.517014+0000","last_undegraded":"2024-09-13T19:33:49.517014+0000","last_fullsized":"2024-09-13T19:33:49.517014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:34.016598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.055669+0000","last_change":"2024-09-13T19:33:08.346175+0000","last_active":"2024-09-13T19:36:24.055669+0000","last_peered":"2024-09-13T19:36:24.055669+0000","last_clean":"2024-09-13T19:36:24.055669+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:36:24.055669+0000","last_undegraded":"2024-09-13T19:36:24.055669+0000","last_fullsized":"2024-09-13T19:36:24.055669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.525531+0000","last_change":"2024-09-13T19:33:12.354984+0000","last_active":"2024-09-13T19:33:49.525531+0000","last_peered":"2024-09-13T19:33:49.525531+0000","last_clean":"2024-09-13T19:33:49.525531+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:33:49.525531+0000","last_undegraded":"2024-09-13T19:33:49.525531+0000","last_fullsized":"2024-09-13T19:33:49.525531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:33.380857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.595253+0000","last_change":"2024-09-13T19:33:14.366942+0000","last_active":"2024-09-13T19:36:22.595253+0000","last_peered":"2024-09-13T19:36:22.595253+0000","last_clean":"2024-09-13T19:36:22.595253+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:36:22.595253+0000","last_undegraded":"2024-09-13T19:36:22.595253+0000","last_fullsized":"2024-09-13T19:36:22.595253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:22.408791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498516+0000","last_change":"2024-09-13T19:33:16.375344+0000","last_active":"2024-09-13T19:33:49.498516+0000","last_peered":"2024-09-13T19:33:49.498516+0000","last_clean":"2024-09-13T19:33:49.498516+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:33:49.498516+0000","last_undegraded":"2024-09-13T19:33:49.498516+0000","last_fullsized":"2024-09-13T19:33:49.498516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:03.086305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502961+0000","last_change":"2024-09-13T19:33:18.414878+0000","last_active":"2024-09-13T19:33:49.502961+0000","last_peered":"2024-09-13T19:33:49.502961+0000","last_clean":"2024-09-13T19:33:49.502961+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:33:49.502961+0000","last_undegraded":"2024-09-13T19:33:49.502961+0000","last_fullsized":"2024-09-13T19:33:49.502961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:55.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494504+0000","last_change":"2024-09-13T19:33:10.346530+0000","last_active":"2024-09-13T19:35:14.494504+0000","last_peered":"2024-09-13T19:35:14.494504+0000","last_clean":"2024-09-13T19:35:14.494504+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:35:14.494504+0000","last_undegraded":"2024-09-13T19:35:14.494504+0000","last_fullsized":"2024-09-13T19:35:14.494504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505061+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:33:49.505061+0000","last_peered":"2024-09-13T19:33:49.505061+0000","last_clean":"2024-09-13T19:33:49.505061+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:33:49.505061+0000","last_undegraded":"2024-09-13T19:33:49.505061+0000","last_fullsized":"2024-09-13T19:33:49.505061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:14.144438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.519543+0000","last_change":"2024-09-13T19:33:08.333264+0000","last_active":"2024-09-13T19:33:49.519543+0000","last_peered":"2024-09-13T19:33:49.519543+0000","last_clean":"2024-09-13T19:33:49.519543+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:33:49.519543+0000","last_undegraded":"2024-09-13T19:33:49.519543+0000","last_fullsized":"2024-09-13T19:33:49.519543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:49.017180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501407+0000","last_change":"2024-09-13T19:33:12.353699+0000","last_active":"2024-09-13T19:33:49.501407+0000","last_peered":"2024-09-13T19:33:49.501407+0000","last_clean":"2024-09-13T19:33:49.501407+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:33:49.501407+0000","last_undegraded":"2024-09-13T19:33:49.501407+0000","last_fullsized":"2024-09-13T19:33:49.501407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.424221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.961527+0000","last_change":"2024-09-13T19:33:14.392626+0000","last_active":"2024-09-13T19:36:22.961527+0000","last_peered":"2024-09-13T19:36:22.961527+0000","last_clean":"2024-09-13T19:36:22.961527+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:36:22.961527+0000","last_undegraded":"2024-09-13T19:36:22.961527+0000","last_fullsized":"2024-09-13T19:36:22.961527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:39.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512753+0000","last_change":"2024-09-13T19:33:16.402476+0000","last_active":"2024-09-13T19:33:49.512753+0000","last_peered":"2024-09-13T19:33:49.512753+0000","last_clean":"2024-09-13T19:33:49.512753+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:33:49.512753+0000","last_undegraded":"2024-09-13T19:33:49.512753+0000","last_fullsized":"2024-09-13T19:33:49.512753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:05.574640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.443488+0000","last_change":"2024-09-13T19:33:18.418222+0000","last_active":"2024-09-13T19:36:24.443488+0000","last_peered":"2024-09-13T19:36:24.443488+0000","last_clean":"2024-09-13T19:36:24.443488+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:36:24.443488+0000","last_undegraded":"2024-09-13T19:36:24.443488+0000","last_fullsized":"2024-09-13T19:36:24.443488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:20.302502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096257+0000","last_change":"2024-09-13T19:33:10.357857+0000","last_active":"2024-09-13T19:36:24.096257+0000","last_peered":"2024-09-13T19:36:24.096257+0000","last_clean":"2024-09-13T19:36:24.096257+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:36:24.096257+0000","last_undegraded":"2024-09-13T19:36:24.096257+0000","last_fullsized":"2024-09-13T19:36:24.096257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:17.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521202+0000","last_change":"2024-09-13T19:33:08.332236+0000","last_active":"2024-09-13T19:33:49.521202+0000","last_peered":"2024-09-13T19:33:49.521202+0000","last_clean":"2024-09-13T19:33:49.521202+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:33:49.521202+0000","last_undegraded":"2024-09-13T19:33:49.521202+0000","last_fullsized":"2024-09-13T19:33:49.521202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498362+0000","last_change":"2024-09-13T19:33:02.523552+0000","last_active":"2024-09-13T19:33:49.498362+0000","last_peered":"2024-09-13T19:33:49.498362+0000","last_clean":"2024-09-13T19:33:49.498362+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:33:49.498362+0000","last_undegraded":"2024-09-13T19:33:49.498362+0000","last_fullsized":"2024-09-13T19:33:49.498362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:43.683067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495504+0000","last_change":"2024-09-13T19:33:12.354235+0000","last_active":"2024-09-13T19:35:19.495504+0000","last_peered":"2024-09-13T19:35:19.495504+0000","last_clean":"2024-09-13T19:35:19.495504+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:35:19.495504+0000","last_undegraded":"2024-09-13T19:35:19.495504+0000","last_fullsized":"2024-09-13T19:35:19.495504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:16.801145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.522986+0000","last_change":"2024-09-13T19:33:14.353733+0000","last_active":"2024-09-13T19:35:20.522986+0000","last_peered":"2024-09-13T19:35:20.522986+0000","last_clean":"2024-09-13T19:35:20.522986+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:35:20.522986+0000","last_undegraded":"2024-09-13T19:35:20.522986+0000","last_fullsized":"2024-09-13T19:35:20.522986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:18.941301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517438+0000","last_change":"2024-09-13T19:33:16.390734+0000","last_active":"2024-09-13T19:33:49.517438+0000","last_peered":"2024-09-13T19:33:49.517438+0000","last_clean":"2024-09-13T19:33:49.517438+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:33:49.517438+0000","last_undegraded":"2024-09-13T19:33:49.517438+0000","last_fullsized":"2024-09-13T19:33:49.517438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:54.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.771290+0000","last_change":"2024-09-13T19:33:18.401696+0000","last_active":"2024-09-13T19:35:22.771290+0000","last_peered":"2024-09-13T19:35:22.771290+0000","last_clean":"2024-09-13T19:35:22.771290+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:35:22.771290+0000","last_undegraded":"2024-09-13T19:35:22.771290+0000","last_fullsized":"2024-09-13T19:35:22.771290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:36.732554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.904012+0000","last_change":"2024-09-13T19:33:10.356809+0000","last_active":"2024-09-13T19:36:23.904012+0000","last_peered":"2024-09-13T19:36:23.904012+0000","last_clean":"2024-09-13T19:36:23.904012+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:36:23.904012+0000","last_undegraded":"2024-09-13T19:36:23.904012+0000","last_fullsized":"2024-09-13T19:36:23.904012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:44.333778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498820+0000","last_change":"2024-09-13T19:33:08.345805+0000","last_active":"2024-09-13T19:33:49.498820+0000","last_peered":"2024-09-13T19:33:49.498820+0000","last_clean":"2024-09-13T19:33:49.498820+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:33:49.498820+0000","last_undegraded":"2024-09-13T19:33:49.498820+0000","last_fullsized":"2024-09-13T19:33:49.498820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:59.536117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506699+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:33:49.506699+0000","last_peered":"2024-09-13T19:33:49.506699+0000","last_clean":"2024-09-13T19:33:49.506699+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:33:49.506699+0000","last_undegraded":"2024-09-13T19:33:49.506699+0000","last_fullsized":"2024-09-13T19:33:49.506699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:56.316476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505857+0000","last_change":"2024-09-13T19:33:12.356344+0000","last_active":"2024-09-13T19:33:49.505857+0000","last_peered":"2024-09-13T19:33:49.505857+0000","last_clean":"2024-09-13T19:33:49.505857+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:33:49.505857+0000","last_undegraded":"2024-09-13T19:33:49.505857+0000","last_fullsized":"2024-09-13T19:33:49.505857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:55.513441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500452+0000","last_change":"2024-09-13T19:33:14.368032+0000","last_active":"2024-09-13T19:35:20.500452+0000","last_peered":"2024-09-13T19:35:20.500452+0000","last_clean":"2024-09-13T19:35:20.500452+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:35:20.500452+0000","last_undegraded":"2024-09-13T19:35:20.500452+0000","last_fullsized":"2024-09-13T19:35:20.500452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:52.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'284","reported_seq":377,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.442134+0000","last_change":"2024-09-13T19:33:16.386778+0000","last_active":"2024-09-13T19:36:55.442134+0000","last_peered":"2024-09-13T19:36:55.442134+0000","last_clean":"2024-09-13T19:36:55.442134+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:55.442134+0000","last_undegraded":"2024-09-13T19:36:55.442134+0000","last_fullsized":"2024-09-13T19:36:55.442134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:06.811103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.518471+0000","last_change":"2024-09-13T19:33:18.410958+0000","last_active":"2024-09-13T19:34:37.518471+0000","last_peered":"2024-09-13T19:34:37.518471+0000","last_clean":"2024-09-13T19:34:37.518471+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:34:37.518471+0000","last_undegraded":"2024-09-13T19:34:37.518471+0000","last_fullsized":"2024-09-13T19:34:37.518471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:58.474286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.169685+0000","last_change":"2024-09-13T19:33:10.352017+0000","last_active":"2024-09-13T19:33:54.169685+0000","last_peered":"2024-09-13T19:33:54.169685+0000","last_clean":"2024-09-13T19:33:54.169685+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:33:54.169685+0000","last_undegraded":"2024-09-13T19:33:54.169685+0000","last_fullsized":"2024-09-13T19:33:54.169685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:06.912280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515639+0000","last_change":"2024-09-13T19:33:08.335852+0000","last_active":"2024-09-13T19:33:49.515639+0000","last_peered":"2024-09-13T19:33:49.515639+0000","last_clean":"2024-09-13T19:33:49.515639+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:33:49.515639+0000","last_undegraded":"2024-09-13T19:33:49.515639+0000","last_fullsized":"2024-09-13T19:33:49.515639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:15.529632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500973+0000","last_change":"2024-09-13T19:33:02.523653+0000","last_active":"2024-09-13T19:33:49.500973+0000","last_peered":"2024-09-13T19:33:49.500973+0000","last_clean":"2024-09-13T19:33:49.500973+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:33:49.500973+0000","last_undegraded":"2024-09-13T19:33:49.500973+0000","last_fullsized":"2024-09-13T19:33:49.500973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:42.749511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508088+0000","last_change":"2024-09-13T19:33:12.358233+0000","last_active":"2024-09-13T19:33:49.508088+0000","last_peered":"2024-09-13T19:33:49.508088+0000","last_clean":"2024-09-13T19:33:49.508088+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:33:49.508088+0000","last_undegraded":"2024-09-13T19:33:49.508088+0000","last_fullsized":"2024-09-13T19:33:49.508088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:59.060355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507097+0000","last_change":"2024-09-13T19:33:14.384476+0000","last_active":"2024-09-13T19:33:49.507097+0000","last_peered":"2024-09-13T19:33:49.507097+0000","last_clean":"2024-09-13T19:33:49.507097+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:33:49.507097+0000","last_undegraded":"2024-09-13T19:33:49.507097+0000","last_fullsized":"2024-09-13T19:33:49.507097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:32.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.579499+0000","last_change":"2024-09-13T19:33:16.372856+0000","last_active":"2024-09-13T19:36:24.579499+0000","last_peered":"2024-09-13T19:36:24.579499+0000","last_clean":"2024-09-13T19:36:24.579499+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:36:24.579499+0000","last_undegraded":"2024-09-13T19:36:24.579499+0000","last_fullsized":"2024-09-13T19:36:24.579499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:12.613117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508863+0000","last_change":"2024-09-13T19:33:18.412059+0000","last_active":"2024-09-13T19:33:49.508863+0000","last_peered":"2024-09-13T19:33:49.508863+0000","last_clean":"2024-09-13T19:33:49.508863+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:33:49.508863+0000","last_undegraded":"2024-09-13T19:33:49.508863+0000","last_fullsized":"2024-09-13T19:33:49.508863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:52.237012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278402+0000","last_change":"2024-09-13T19:33:10.344169+0000","last_active":"2024-09-13T19:36:24.278402+0000","last_peered":"2024-09-13T19:36:24.278402+0000","last_clean":"2024-09-13T19:36:24.278402+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:36:24.278402+0000","last_undegraded":"2024-09-13T19:36:24.278402+0000","last_fullsized":"2024-09-13T19:36:24.278402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.076994+0000","last_change":"2024-09-13T19:33:08.354348+0000","last_active":"2024-09-13T19:36:24.076994+0000","last_peered":"2024-09-13T19:36:24.076994+0000","last_clean":"2024-09-13T19:36:24.076994+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:36:24.076994+0000","last_undegraded":"2024-09-13T19:36:24.076994+0000","last_fullsized":"2024-09-13T19:36:24.076994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512982+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:33:49.512982+0000","last_peered":"2024-09-13T19:33:49.512982+0000","last_clean":"2024-09-13T19:33:49.512982+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:33:49.512982+0000","last_undegraded":"2024-09-13T19:33:49.512982+0000","last_fullsized":"2024-09-13T19:33:49.512982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:46.024868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506376+0000","last_change":"2024-09-13T19:33:12.347595+0000","last_active":"2024-09-13T19:33:49.506376+0000","last_peered":"2024-09-13T19:33:49.506376+0000","last_clean":"2024-09-13T19:33:49.506376+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:33:49.506376+0000","last_undegraded":"2024-09-13T19:33:49.506376+0000","last_fullsized":"2024-09-13T19:33:49.506376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:04.841484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'86","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.480947+0000","last_change":"2024-09-13T19:33:14.370958+0000","last_active":"2024-09-13T19:36:55.480947+0000","last_peered":"2024-09-13T19:36:55.480947+0000","last_clean":"2024-09-13T19:36:55.480947+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:36:55.480947+0000","last_undegraded":"2024-09-13T19:36:55.480947+0000","last_fullsized":"2024-09-13T19:36:55.480947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:28.457253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497560+0000","last_change":"2024-09-13T19:33:16.370368+0000","last_active":"2024-09-13T19:33:49.497560+0000","last_peered":"2024-09-13T19:33:49.497560+0000","last_clean":"2024-09-13T19:33:49.497560+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:33:49.497560+0000","last_undegraded":"2024-09-13T19:33:49.497560+0000","last_fullsized":"2024-09-13T19:33:49.497560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:59.539391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.238791+0000","last_change":"2024-09-13T19:33:18.418007+0000","last_active":"2024-09-13T19:34:37.238791+0000","last_peered":"2024-09-13T19:34:37.238791+0000","last_clean":"2024-09-13T19:34:37.238791+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:34:37.238791+0000","last_undegraded":"2024-09-13T19:34:37.238791+0000","last_fullsized":"2024-09-13T19:34:37.238791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:26.651502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523204+0000","last_change":"2024-09-13T19:33:18.416636+0000","last_active":"2024-09-13T19:33:49.523204+0000","last_peered":"2024-09-13T19:33:49.523204+0000","last_clean":"2024-09-13T19:33:49.523204+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:33:49.523204+0000","last_undegraded":"2024-09-13T19:33:49.523204+0000","last_fullsized":"2024-09-13T19:33:49.523204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.954769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207651+0000","last_change":"2024-09-13T19:33:10.337290+0000","last_active":"2024-09-13T19:36:24.207651+0000","last_peered":"2024-09-13T19:36:24.207651+0000","last_clean":"2024-09-13T19:36:24.207651+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:36:24.207651+0000","last_undegraded":"2024-09-13T19:36:24.207651+0000","last_fullsized":"2024-09-13T19:36:24.207651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:03.258150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.069994+0000","last_change":"2024-09-13T19:33:08.354023+0000","last_active":"2024-09-13T19:36:24.069994+0000","last_peered":"2024-09-13T19:36:24.069994+0000","last_clean":"2024-09-13T19:36:24.069994+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:36:24.069994+0000","last_undegraded":"2024-09-13T19:36:24.069994+0000","last_fullsized":"2024-09-13T19:36:24.069994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:12.440984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500090+0000","last_change":"2024-09-13T19:33:12.349684+0000","last_active":"2024-09-13T19:33:49.500090+0000","last_peered":"2024-09-13T19:33:49.500090+0000","last_clean":"2024-09-13T19:33:49.500090+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:33:49.500090+0000","last_undegraded":"2024-09-13T19:33:49.500090+0000","last_fullsized":"2024-09-13T19:33:49.500090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:33.654140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505771+0000","last_change":"2024-09-13T19:33:14.379538+0000","last_active":"2024-09-13T19:35:35.505771+0000","last_peered":"2024-09-13T19:35:35.505771+0000","last_clean":"2024-09-13T19:35:35.505771+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:35:35.505771+0000","last_undegraded":"2024-09-13T19:35:35.505771+0000","last_fullsized":"2024-09-13T19:35:35.505771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:57.484464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505865+0000","last_change":"2024-09-13T19:33:16.403644+0000","last_active":"2024-09-13T19:33:49.505865+0000","last_peered":"2024-09-13T19:33:49.505865+0000","last_clean":"2024-09-13T19:33:49.505865+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:33:49.505865+0000","last_undegraded":"2024-09-13T19:33:49.505865+0000","last_fullsized":"2024-09-13T19:33:49.505865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:05.807775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.182480+0000","last_change":"2024-09-13T19:33:18.396968+0000","last_active":"2024-09-13T19:36:23.182480+0000","last_peered":"2024-09-13T19:36:23.182480+0000","last_clean":"2024-09-13T19:36:23.182480+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:36:23.182480+0000","last_undegraded":"2024-09-13T19:36:23.182480+0000","last_fullsized":"2024-09-13T19:36:23.182480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:01.306267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.193661+0000","last_change":"2024-09-13T19:33:10.357927+0000","last_active":"2024-09-13T19:35:18.193661+0000","last_peered":"2024-09-13T19:35:18.193661+0000","last_clean":"2024-09-13T19:35:18.193661+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:35:18.193661+0000","last_undegraded":"2024-09-13T19:35:18.193661+0000","last_fullsized":"2024-09-13T19:35:18.193661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:43.220677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520659+0000","last_change":"2024-09-13T19:33:08.353099+0000","last_active":"2024-09-13T19:33:49.520659+0000","last_peered":"2024-09-13T19:33:49.520659+0000","last_clean":"2024-09-13T19:33:49.520659+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:33:49.520659+0000","last_undegraded":"2024-09-13T19:33:49.520659+0000","last_fullsized":"2024-09-13T19:33:49.520659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.532442+0000","last_change":"2024-09-13T19:33:49.530881+0000","last_active":"2024-09-13T19:33:49.532442+0000","last_peered":"2024-09-13T19:33:49.532442+0000","last_clean":"2024-09-13T19:33:49.532442+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:33:49.532442+0000","last_undegraded":"2024-09-13T19:33:49.532442+0000","last_fullsized":"2024-09-13T19:33:49.532442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:24.807153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.971351+0000","last_change":"2024-09-13T19:33:14.354248+0000","last_active":"2024-09-13T19:36:22.971351+0000","last_peered":"2024-09-13T19:36:22.971351+0000","last_clean":"2024-09-13T19:36:22.971351+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:36:22.971351+0000","last_undegraded":"2024-09-13T19:36:22.971351+0000","last_fullsized":"2024-09-13T19:36:22.971351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:10.093199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517061+0000","last_change":"2024-09-13T19:33:16.382753+0000","last_active":"2024-09-13T19:33:49.517061+0000","last_peered":"2024-09-13T19:33:49.517061+0000","last_clean":"2024-09-13T19:33:49.517061+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:33:49.517061+0000","last_undegraded":"2024-09-13T19:33:49.517061+0000","last_fullsized":"2024-09-13T19:33:49.517061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:25.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498717+0000","last_change":"2024-09-13T19:33:18.415711+0000","last_active":"2024-09-13T19:33:49.498717+0000","last_peered":"2024-09-13T19:33:49.498717+0000","last_clean":"2024-09-13T19:33:49.498717+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:33:49.498717+0000","last_undegraded":"2024-09-13T19:33:49.498717+0000","last_fullsized":"2024-09-13T19:33:49.498717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:51.214164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097438+0000","last_change":"2024-09-13T19:33:10.340323+0000","last_active":"2024-09-13T19:36:24.097438+0000","last_peered":"2024-09-13T19:36:24.097438+0000","last_clean":"2024-09-13T19:36:24.097438+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:36:24.097438+0000","last_undegraded":"2024-09-13T19:36:24.097438+0000","last_fullsized":"2024-09-13T19:36:24.097438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.062661+0000","last_change":"2024-09-13T19:33:08.350962+0000","last_active":"2024-09-13T19:36:24.062661+0000","last_peered":"2024-09-13T19:36:24.062661+0000","last_clean":"2024-09-13T19:36:24.062661+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:36:24.062661+0000","last_undegraded":"2024-09-13T19:36:24.062661+0000","last_fullsized":"2024-09-13T19:36:24.062661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:33.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509563+0000","last_change":"2024-09-13T19:33:12.355722+0000","last_active":"2024-09-13T19:33:49.509563+0000","last_peered":"2024-09-13T19:33:49.509563+0000","last_clean":"2024-09-13T19:33:49.509563+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:33:49.509563+0000","last_undegraded":"2024-09-13T19:33:49.509563+0000","last_fullsized":"2024-09-13T19:33:49.509563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:44.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.126165+0000","last_change":"2024-09-13T19:33:14.361694+0000","last_active":"2024-09-13T19:36:23.126165+0000","last_peered":"2024-09-13T19:36:23.126165+0000","last_clean":"2024-09-13T19:36:23.126165+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:36:23.126165+0000","last_undegraded":"2024-09-13T19:36:23.126165+0000","last_fullsized":"2024-09-13T19:36:23.126165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:23.587634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499270+0000","last_change":"2024-09-13T19:33:16.374728+0000","last_active":"2024-09-13T19:33:49.499270+0000","last_peered":"2024-09-13T19:33:49.499270+0000","last_clean":"2024-09-13T19:33:49.499270+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:33:49.499270+0000","last_undegraded":"2024-09-13T19:33:49.499270+0000","last_fullsized":"2024-09-13T19:33:49.499270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:25.206149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508285+0000","last_change":"2024-09-13T19:33:18.420341+0000","last_active":"2024-09-13T19:33:49.508285+0000","last_peered":"2024-09-13T19:33:49.508285+0000","last_clean":"2024-09-13T19:33:49.508285+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:33:49.508285+0000","last_undegraded":"2024-09-13T19:33:49.508285+0000","last_fullsized":"2024-09-13T19:33:49.508285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:37.478476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278224+0000","last_change":"2024-09-13T19:33:10.348981+0000","last_active":"2024-09-13T19:36:24.278224+0000","last_peered":"2024-09-13T19:36:24.278224+0000","last_clean":"2024-09-13T19:36:24.278224+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:36:24.278224+0000","last_undegraded":"2024-09-13T19:36:24.278224+0000","last_fullsized":"2024-09-13T19:36:24.278224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:31.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.141217+0000","last_change":"2024-09-13T19:33:49.519345+0000","last_active":"2024-09-13T19:33:54.141217+0000","last_peered":"2024-09-13T19:33:54.141217+0000","last_clean":"2024-09-13T19:33:54.141217+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:33:54.141217+0000","last_undegraded":"2024-09-13T19:33:54.141217+0000","last_fullsized":"2024-09-13T19:33:54.141217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:09.643503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508299+0000","last_change":"2024-09-13T19:33:12.363653+0000","last_active":"2024-09-13T19:33:49.508299+0000","last_peered":"2024-09-13T19:33:49.508299+0000","last_clean":"2024-09-13T19:33:49.508299+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:33:49.508299+0000","last_undegraded":"2024-09-13T19:33:49.508299+0000","last_fullsized":"2024-09-13T19:33:49.508299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:53.868774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.502431+0000","last_change":"2024-09-13T19:33:14.358901+0000","last_active":"2024-09-13T19:35:35.502431+0000","last_peered":"2024-09-13T19:35:35.502431+0000","last_clean":"2024-09-13T19:35:35.502431+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:35:35.502431+0000","last_undegraded":"2024-09-13T19:35:35.502431+0000","last_fullsized":"2024-09-13T19:35:35.502431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.849530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521295+0000","last_change":"2024-09-13T19:33:16.384121+0000","last_active":"2024-09-13T19:33:49.521295+0000","last_peered":"2024-09-13T19:33:49.521295+0000","last_clean":"2024-09-13T19:33:49.521295+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:33:49.521295+0000","last_undegraded":"2024-09-13T19:33:49.521295+0000","last_fullsized":"2024-09-13T19:33:49.521295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:31.796586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207342+0000","last_change":"2024-09-13T19:33:10.355217+0000","last_active":"2024-09-13T19:36:24.207342+0000","last_peered":"2024-09-13T19:36:24.207342+0000","last_clean":"2024-09-13T19:36:24.207342+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:36:24.207342+0000","last_undegraded":"2024-09-13T19:36:24.207342+0000","last_fullsized":"2024-09-13T19:36:24.207342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:25.762180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.136723+0000","last_change":"2024-09-13T19:33:08.338446+0000","last_active":"2024-09-13T19:33:54.136723+0000","last_peered":"2024-09-13T19:33:54.136723+0000","last_clean":"2024-09-13T19:33:54.136723+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:33:54.136723+0000","last_undegraded":"2024-09-13T19:33:54.136723+0000","last_fullsized":"2024-09-13T19:33:54.136723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502145+0000","last_change":"2024-09-13T19:33:12.353907+0000","last_active":"2024-09-13T19:33:49.502145+0000","last_peered":"2024-09-13T19:33:49.502145+0000","last_clean":"2024-09-13T19:33:49.502145+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:33:49.502145+0000","last_undegraded":"2024-09-13T19:33:49.502145+0000","last_fullsized":"2024-09-13T19:33:49.502145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.757540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'56","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:44.501765+0000","last_change":"2024-09-13T19:33:14.353619+0000","last_active":"2024-09-13T19:35:44.501765+0000","last_peered":"2024-09-13T19:35:44.501765+0000","last_clean":"2024-09-13T19:35:44.501765+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:35:44.501765+0000","last_undegraded":"2024-09-13T19:35:44.501765+0000","last_fullsized":"2024-09-13T19:35:44.501765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:06.293086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5917,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523366+0000","last_change":"2024-09-13T19:33:16.391786+0000","last_active":"2024-09-13T19:33:49.523366+0000","last_peered":"2024-09-13T19:33:49.523366+0000","last_clean":"2024-09-13T19:33:49.523366+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:33:49.523366+0000","last_undegraded":"2024-09-13T19:33:49.523366+0000","last_fullsized":"2024-09-13T19:33:49.523366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:58.998423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.761517+0000","last_change":"2024-09-13T19:33:18.415632+0000","last_active":"2024-09-13T19:35:22.761517+0000","last_peered":"2024-09-13T19:35:22.761517+0000","last_clean":"2024-09-13T19:35:22.761517+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:35:22.761517+0000","last_undegraded":"2024-09-13T19:35:22.761517+0000","last_fullsized":"2024-09-13T19:35:22.761517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:21.406501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:09.493298+0000","last_change":"2024-09-13T19:33:10.348428+0000","last_active":"2024-09-13T19:35:09.493298+0000","last_peered":"2024-09-13T19:35:09.493298+0000","last_clean":"2024-09-13T19:35:09.493298+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:35:09.493298+0000","last_undegraded":"2024-09-13T19:35:09.493298+0000","last_fullsized":"2024-09-13T19:35:09.493298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498512+0000","last_change":"2024-09-13T19:33:08.337364+0000","last_active":"2024-09-13T19:33:49.498512+0000","last_peered":"2024-09-13T19:33:49.498512+0000","last_clean":"2024-09-13T19:33:49.498512+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:33:49.498512+0000","last_undegraded":"2024-09-13T19:33:49.498512+0000","last_fullsized":"2024-09-13T19:33:49.498512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:58.350998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524310+0000","last_change":"2024-09-13T19:33:12.351793+0000","last_active":"2024-09-13T19:33:49.524310+0000","last_peered":"2024-09-13T19:33:49.524310+0000","last_clean":"2024-09-13T19:33:49.524310+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:33:49.524310+0000","last_undegraded":"2024-09-13T19:33:49.524310+0000","last_fullsized":"2024-09-13T19:33:49.524310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:00.497212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509046+0000","last_change":"2024-09-13T19:33:14.386801+0000","last_active":"2024-09-13T19:35:45.509046+0000","last_peered":"2024-09-13T19:35:45.509046+0000","last_clean":"2024-09-13T19:35:45.509046+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:35:45.509046+0000","last_undegraded":"2024-09-13T19:35:45.509046+0000","last_fullsized":"2024-09-13T19:35:45.509046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:50.651830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507072+0000","last_change":"2024-09-13T19:33:16.382777+0000","last_active":"2024-09-13T19:33:49.507072+0000","last_peered":"2024-09-13T19:33:49.507072+0000","last_clean":"2024-09-13T19:33:49.507072+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:33:49.507072+0000","last_undegraded":"2024-09-13T19:33:49.507072+0000","last_fullsized":"2024-09-13T19:33:49.507072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:40.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504119+0000","last_change":"2024-09-13T19:33:18.415435+0000","last_active":"2024-09-13T19:33:49.504119+0000","last_peered":"2024-09-13T19:33:49.504119+0000","last_clean":"2024-09-13T19:33:49.504119+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:33:49.504119+0000","last_undegraded":"2024-09-13T19:33:49.504119+0000","last_fullsized":"2024-09-13T19:33:49.504119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:23.857746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278836+0000","last_change":"2024-09-13T19:33:10.358856+0000","last_active":"2024-09-13T19:36:24.278836+0000","last_peered":"2024-09-13T19:36:24.278836+0000","last_clean":"2024-09-13T19:36:24.278836+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:36:24.278836+0000","last_undegraded":"2024-09-13T19:36:24.278836+0000","last_fullsized":"2024-09-13T19:36:24.278836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:44.732919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.685544+0000","last_change":"2024-09-13T19:33:08.335612+0000","last_active":"2024-09-13T19:33:52.685544+0000","last_peered":"2024-09-13T19:33:52.685544+0000","last_clean":"2024-09-13T19:33:52.685544+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:33:52.685544+0000","last_undegraded":"2024-09-13T19:33:52.685544+0000","last_fullsized":"2024-09-13T19:33:52.685544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:38.936603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520491+0000","last_change":"2024-09-13T19:33:12.352113+0000","last_active":"2024-09-13T19:33:49.520491+0000","last_peered":"2024-09-13T19:33:49.520491+0000","last_clean":"2024-09-13T19:33:49.520491+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:33:49.520491+0000","last_undegraded":"2024-09-13T19:33:49.520491+0000","last_fullsized":"2024-09-13T19:33:49.520491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:17.673522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.066179+0000","last_change":"2024-09-13T19:33:14.356847+0000","last_active":"2024-09-13T19:35:20.066179+0000","last_peered":"2024-09-13T19:35:20.066179+0000","last_clean":"2024-09-13T19:35:20.066179+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:35:20.066179+0000","last_undegraded":"2024-09-13T19:35:20.066179+0000","last_fullsized":"2024-09-13T19:35:20.066179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:52.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500909+0000","last_change":"2024-09-13T19:33:16.391926+0000","last_active":"2024-09-13T19:33:49.500909+0000","last_peered":"2024-09-13T19:33:49.500909+0000","last_clean":"2024-09-13T19:33:49.500909+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:33:49.500909+0000","last_undegraded":"2024-09-13T19:33:49.500909+0000","last_fullsized":"2024-09-13T19:33:49.500909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:40.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.922899+0000","last_change":"2024-09-13T19:33:18.414176+0000","last_active":"2024-09-13T19:35:22.922899+0000","last_peered":"2024-09-13T19:35:22.922899+0000","last_clean":"2024-09-13T19:35:22.922899+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:35:22.922899+0000","last_undegraded":"2024-09-13T19:35:22.922899+0000","last_fullsized":"2024-09-13T19:35:22.922899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:28.941440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.887347+0000","last_change":"2024-09-13T19:33:10.347270+0000","last_active":"2024-09-13T19:36:23.887347+0000","last_peered":"2024-09-13T19:36:23.887347+0000","last_clean":"2024-09-13T19:36:23.887347+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:36:23.887347+0000","last_undegraded":"2024-09-13T19:36:23.887347+0000","last_fullsized":"2024-09-13T19:36:23.887347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:44.333778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507379+0000","last_change":"2024-09-13T19:33:08.340688+0000","last_active":"2024-09-13T19:35:40.507379+0000","last_peered":"2024-09-13T19:35:40.507379+0000","last_clean":"2024-09-13T19:35:40.507379+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:35:40.507379+0000","last_undegraded":"2024-09-13T19:35:40.507379+0000","last_fullsized":"2024-09-13T19:35:40.507379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:11.675646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":13,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506437+0000","last_change":"2024-09-13T19:33:12.349199+0000","last_active":"2024-09-13T19:33:49.506437+0000","last_peered":"2024-09-13T19:33:49.506437+0000","last_clean":"2024-09-13T19:33:49.506437+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:33:49.506437+0000","last_undegraded":"2024-09-13T19:33:49.506437+0000","last_fullsized":"2024-09-13T19:33:49.506437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:52.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513690+0000","last_change":"2024-09-13T19:33:14.391400+0000","last_active":"2024-09-13T19:33:49.513690+0000","last_peered":"2024-09-13T19:33:49.513690+0000","last_clean":"2024-09-13T19:33:49.513690+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:33:49.513690+0000","last_undegraded":"2024-09-13T19:33:49.513690+0000","last_fullsized":"2024-09-13T19:33:49.513690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:31.131591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'284","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.439828+0000","last_change":"2024-09-13T19:33:16.382339+0000","last_active":"2024-09-13T19:36:55.439828+0000","last_peered":"2024-09-13T19:36:55.439828+0000","last_clean":"2024-09-13T19:36:55.439828+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:36:55.439828+0000","last_undegraded":"2024-09-13T19:36:55.439828+0000","last_fullsized":"2024-09-13T19:36:55.439828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:01.227827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503374+0000","last_change":"2024-09-13T19:33:18.419381+0000","last_active":"2024-09-13T19:33:49.503374+0000","last_peered":"2024-09-13T19:33:49.503374+0000","last_clean":"2024-09-13T19:33:49.503374+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:33:49.503374+0000","last_undegraded":"2024-09-13T19:33:49.503374+0000","last_fullsized":"2024-09-13T19:33:49.503374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:08.781086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207878+0000","last_change":"2024-09-13T19:33:10.336681+0000","last_active":"2024-09-13T19:36:24.207878+0000","last_peered":"2024-09-13T19:36:24.207878+0000","last_clean":"2024-09-13T19:36:24.207878+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:36:24.207878+0000","last_undegraded":"2024-09-13T19:36:24.207878+0000","last_fullsized":"2024-09-13T19:36:24.207878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:14.226586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509233+0000","last_change":"2024-09-13T19:33:08.338096+0000","last_active":"2024-09-13T19:33:49.509233+0000","last_peered":"2024-09-13T19:33:49.509233+0000","last_clean":"2024-09-13T19:33:49.509233+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:33:49.509233+0000","last_undegraded":"2024-09-13T19:33:49.509233+0000","last_fullsized":"2024-09-13T19:33:49.509233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502590+0000","last_change":"2024-09-13T19:33:12.353110+0000","last_active":"2024-09-13T19:33:49.502590+0000","last_peered":"2024-09-13T19:33:49.502590+0000","last_clean":"2024-09-13T19:33:49.502590+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:33:49.502590+0000","last_undegraded":"2024-09-13T19:33:49.502590+0000","last_fullsized":"2024-09-13T19:33:49.502590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.757540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.505665+0000","last_change":"2024-09-13T19:33:14.366141+0000","last_active":"2024-09-13T19:35:40.505665+0000","last_peered":"2024-09-13T19:35:40.505665+0000","last_clean":"2024-09-13T19:35:40.505665+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:35:40.505665+0000","last_undegraded":"2024-09-13T19:35:40.505665+0000","last_fullsized":"2024-09-13T19:35:40.505665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:29.782580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495241+0000","last_change":"2024-09-13T19:33:16.375274+0000","last_active":"2024-09-13T19:33:49.495241+0000","last_peered":"2024-09-13T19:33:49.495241+0000","last_clean":"2024-09-13T19:33:49.495241+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:33:49.495241+0000","last_undegraded":"2024-09-13T19:33:49.495241+0000","last_fullsized":"2024-09-13T19:33:49.495241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510248+0000","last_change":"2024-09-13T19:33:18.425299+0000","last_active":"2024-09-13T19:33:49.510248+0000","last_peered":"2024-09-13T19:33:49.510248+0000","last_clean":"2024-09-13T19:33:49.510248+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:33:49.510248+0000","last_undegraded":"2024-09-13T19:33:49.510248+0000","last_fullsized":"2024-09-13T19:33:49.510248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:13:57.374815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503532+0000","last_change":"2024-09-13T19:33:10.344066+0000","last_active":"2024-09-13T19:35:40.503532+0000","last_peered":"2024-09-13T19:35:40.503532+0000","last_clean":"2024-09-13T19:35:40.503532+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:35:40.503532+0000","last_undegraded":"2024-09-13T19:35:40.503532+0000","last_fullsized":"2024-09-13T19:35:40.503532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:23.396598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508140+0000","last_change":"2024-09-13T19:33:08.358155+0000","last_active":"2024-09-13T19:33:49.508140+0000","last_peered":"2024-09-13T19:33:49.508140+0000","last_clean":"2024-09-13T19:33:49.508140+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:33:49.508140+0000","last_undegraded":"2024-09-13T19:33:49.508140+0000","last_fullsized":"2024-09-13T19:33:49.508140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:23.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521057+0000","last_change":"2024-09-13T19:33:12.358770+0000","last_active":"2024-09-13T19:33:49.521057+0000","last_peered":"2024-09-13T19:33:49.521057+0000","last_clean":"2024-09-13T19:33:49.521057+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:33:49.521057+0000","last_undegraded":"2024-09-13T19:33:49.521057+0000","last_fullsized":"2024-09-13T19:33:49.521057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:34.804561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.468789+0000","last_change":"2024-09-13T19:33:14.352918+0000","last_active":"2024-09-13T19:35:20.468789+0000","last_peered":"2024-09-13T19:35:20.468789+0000","last_clean":"2024-09-13T19:35:20.468789+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:35:20.468789+0000","last_undegraded":"2024-09-13T19:35:20.468789+0000","last_fullsized":"2024-09-13T19:35:20.468789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:24.299742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504142+0000","last_change":"2024-09-13T19:33:16.400962+0000","last_active":"2024-09-13T19:33:49.504142+0000","last_peered":"2024-09-13T19:33:49.504142+0000","last_clean":"2024-09-13T19:33:49.504142+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:33:49.504142+0000","last_undegraded":"2024-09-13T19:33:49.504142+0000","last_fullsized":"2024-09-13T19:33:49.504142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:43.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513374+0000","last_change":"2024-09-13T19:33:18.424633+0000","last_active":"2024-09-13T19:33:49.513374+0000","last_peered":"2024-09-13T19:33:49.513374+0000","last_clean":"2024-09-13T19:33:49.513374+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:33:49.513374+0000","last_undegraded":"2024-09-13T19:33:49.513374+0000","last_fullsized":"2024-09-13T19:33:49.513374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:44.258539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.115279+0000","last_change":"2024-09-13T19:33:10.346685+0000","last_active":"2024-09-13T19:36:24.115279+0000","last_peered":"2024-09-13T19:36:24.115279+0000","last_clean":"2024-09-13T19:36:24.115279+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:36:24.115279+0000","last_undegraded":"2024-09-13T19:36:24.115279+0000","last_fullsized":"2024-09-13T19:36:24.115279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:50.896604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.676763+0000","last_change":"2024-09-13T19:33:08.349745+0000","last_active":"2024-09-13T19:36:23.676763+0000","last_peered":"2024-09-13T19:36:23.676763+0000","last_clean":"2024-09-13T19:36:23.676763+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:36:23.676763+0000","last_undegraded":"2024-09-13T19:36:23.676763+0000","last_fullsized":"2024-09-13T19:36:23.676763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:49.017180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"23'1","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.405946+0000","last_change":"2024-09-13T19:33:12.360592+0000","last_active":"2024-09-13T19:36:55.405946+0000","last_peered":"2024-09-13T19:36:55.405946+0000","last_clean":"2024-09-13T19:36:55.405946+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:36:55.405946+0000","last_undegraded":"2024-09-13T19:36:55.405946+0000","last_fullsized":"2024-09-13T19:36:55.405946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:26.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'27","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.508946+0000","last_change":"2024-09-13T19:33:14.380786+0000","last_active":"2024-09-13T19:35:45.508946+0000","last_peered":"2024-09-13T19:35:45.508946+0000","last_clean":"2024-09-13T19:35:45.508946+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:35:45.508946+0000","last_undegraded":"2024-09-13T19:35:45.508946+0000","last_fullsized":"2024-09-13T19:35:45.508946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:37.500328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504812+0000","last_change":"2024-09-13T19:33:16.403395+0000","last_active":"2024-09-13T19:33:49.504812+0000","last_peered":"2024-09-13T19:33:49.504812+0000","last_clean":"2024-09-13T19:33:49.504812+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:33:49.504812+0000","last_undegraded":"2024-09-13T19:33:49.504812+0000","last_fullsized":"2024-09-13T19:33:49.504812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:06.844982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.528359+0000","last_change":"2024-09-13T19:33:18.420238+0000","last_active":"2024-09-13T19:35:20.528359+0000","last_peered":"2024-09-13T19:35:20.528359+0000","last_clean":"2024-09-13T19:35:20.528359+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:35:20.528359+0000","last_undegraded":"2024-09-13T19:35:20.528359+0000","last_fullsized":"2024-09-13T19:35:20.528359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:39.541908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.725970+0000","last_change":"2024-09-13T19:33:10.336837+0000","last_active":"2024-09-13T19:36:23.725970+0000","last_peered":"2024-09-13T19:36:23.725970+0000","last_clean":"2024-09-13T19:36:23.725970+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:36:23.725970+0000","last_undegraded":"2024-09-13T19:36:23.725970+0000","last_fullsized":"2024-09-13T19:36:23.725970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:17.640715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513903+0000","last_change":"2024-09-13T19:33:08.329255+0000","last_active":"2024-09-13T19:33:49.513903+0000","last_peered":"2024-09-13T19:33:49.513903+0000","last_clean":"2024-09-13T19:33:49.513903+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:33:49.513903+0000","last_undegraded":"2024-09-13T19:33:49.513903+0000","last_fullsized":"2024-09-13T19:33:49.513903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.693342+0000","last_change":"2024-09-13T19:33:12.362162+0000","last_active":"2024-09-13T19:35:18.693342+0000","last_peered":"2024-09-13T19:35:18.693342+0000","last_clean":"2024-09-13T19:35:18.693342+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:35:18.693342+0000","last_undegraded":"2024-09-13T19:35:18.693342+0000","last_fullsized":"2024-09-13T19:35:18.693342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.424221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.010387+0000","last_change":"2024-09-13T19:33:14.372731+0000","last_active":"2024-09-13T19:36:23.010387+0000","last_peered":"2024-09-13T19:36:23.010387+0000","last_clean":"2024-09-13T19:36:23.010387+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:36:23.010387+0000","last_undegraded":"2024-09-13T19:36:23.010387+0000","last_fullsized":"2024-09-13T19:36:23.010387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:28.203288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497588+0000","last_change":"2024-09-13T19:33:16.375705+0000","last_active":"2024-09-13T19:33:49.497588+0000","last_peered":"2024-09-13T19:33:49.497588+0000","last_clean":"2024-09-13T19:33:49.497588+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:33:49.497588+0000","last_undegraded":"2024-09-13T19:33:49.497588+0000","last_fullsized":"2024-09-13T19:33:49.497588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:17.171140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.533635+0000","last_change":"2024-09-13T19:33:18.420946+0000","last_active":"2024-09-13T19:35:20.533635+0000","last_peered":"2024-09-13T19:35:20.533635+0000","last_clean":"2024-09-13T19:35:20.533635+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:35:20.533635+0000","last_undegraded":"2024-09-13T19:35:20.533635+0000","last_fullsized":"2024-09-13T19:35:20.533635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:33.812134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.480170+0000","last_change":"2024-09-13T19:33:49.534946+0000","last_active":"2024-09-13T19:33:50.480170+0000","last_peered":"2024-09-13T19:33:50.480170+0000","last_clean":"2024-09-13T19:33:50.480170+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:33:50.480170+0000","last_undegraded":"2024-09-13T19:33:50.480170+0000","last_fullsized":"2024-09-13T19:33:50.480170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:55.799083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.582657+0000","last_change":"2024-09-13T19:33:08.332706+0000","last_active":"2024-09-13T19:36:23.582657+0000","last_peered":"2024-09-13T19:36:23.582657+0000","last_clean":"2024-09-13T19:36:23.582657+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:36:23.582657+0000","last_undegraded":"2024-09-13T19:36:23.582657+0000","last_fullsized":"2024-09-13T19:36:23.582657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:03.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207867+0000","last_change":"2024-09-13T19:33:10.332473+0000","last_active":"2024-09-13T19:36:24.207867+0000","last_peered":"2024-09-13T19:36:24.207867+0000","last_clean":"2024-09-13T19:36:24.207867+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:36:24.207867+0000","last_undegraded":"2024-09-13T19:36:24.207867+0000","last_fullsized":"2024-09-13T19:36:24.207867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:17.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495977+0000","last_change":"2024-09-13T19:33:08.325598+0000","last_active":"2024-09-13T19:33:49.495977+0000","last_peered":"2024-09-13T19:33:49.495977+0000","last_clean":"2024-09-13T19:33:49.495977+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:33:49.495977+0000","last_undegraded":"2024-09-13T19:33:49.495977+0000","last_fullsized":"2024-09-13T19:33:49.495977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513363+0000","last_change":"2024-09-13T19:33:10.353700+0000","last_active":"2024-09-13T19:33:49.513363+0000","last_peered":"2024-09-13T19:33:49.513363+0000","last_clean":"2024-09-13T19:33:49.513363+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:33:49.513363+0000","last_undegraded":"2024-09-13T19:33:49.513363+0000","last_fullsized":"2024-09-13T19:33:49.513363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:14.944305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.152054+0000","last_change":"2024-09-13T19:33:08.334993+0000","last_active":"2024-09-13T19:33:54.152054+0000","last_peered":"2024-09-13T19:33:54.152054+0000","last_clean":"2024-09-13T19:33:54.152054+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:33:54.152054+0000","last_undegraded":"2024-09-13T19:33:54.152054+0000","last_fullsized":"2024-09-13T19:33:54.152054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:15.855113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.520893+0000","last_change":"2024-09-13T19:33:10.332930+0000","last_active":"2024-09-13T19:34:37.520893+0000","last_peered":"2024-09-13T19:34:37.520893+0000","last_clean":"2024-09-13T19:34:37.520893+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:34:37.520893+0000","last_undegraded":"2024-09-13T19:34:37.520893+0000","last_fullsized":"2024-09-13T19:34:37.520893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.567975+0000","last_change":"2024-09-13T19:33:08.345558+0000","last_active":"2024-09-13T19:35:22.567975+0000","last_peered":"2024-09-13T19:35:22.567975+0000","last_clean":"2024-09-13T19:35:22.567975+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:35:22.567975+0000","last_undegraded":"2024-09-13T19:35:22.567975+0000","last_fullsized":"2024-09-13T19:35:22.567975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:14.487188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.888082+0000","last_change":"2024-09-13T19:33:10.339115+0000","last_active":"2024-09-13T19:36:23.888082+0000","last_peered":"2024-09-13T19:36:23.888082+0000","last_clean":"2024-09-13T19:36:23.888082+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:36:23.888082+0000","last_undegraded":"2024-09-13T19:36:23.888082+0000","last_fullsized":"2024-09-13T19:36:23.888082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:25.322287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.630046+0000","last_change":"2024-09-13T19:33:08.325496+0000","last_active":"2024-09-13T19:35:22.630046+0000","last_peered":"2024-09-13T19:35:22.630046+0000","last_clean":"2024-09-13T19:35:22.630046+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:35:22.630046+0000","last_undegraded":"2024-09-13T19:35:22.630046+0000","last_fullsized":"2024-09-13T19:35:22.630046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:39.965420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.933809+0000","last_change":"2024-09-13T19:33:10.353514+0000","last_active":"2024-09-13T19:35:22.933809+0000","last_peered":"2024-09-13T19:35:22.933809+0000","last_clean":"2024-09-13T19:35:22.933809+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:35:22.933809+0000","last_undegraded":"2024-09-13T19:35:22.933809+0000","last_fullsized":"2024-09-13T19:35:22.933809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:34.718501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500558+0000","last_change":"2024-09-13T19:33:08.338958+0000","last_active":"2024-09-13T19:35:20.500558+0000","last_peered":"2024-09-13T19:35:20.500558+0000","last_clean":"2024-09-13T19:35:20.500558+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:35:20.500558+0000","last_undegraded":"2024-09-13T19:35:20.500558+0000","last_fullsized":"2024-09-13T19:35:20.500558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494324+0000","last_change":"2024-09-13T19:33:10.339492+0000","last_active":"2024-09-13T19:35:14.494324+0000","last_peered":"2024-09-13T19:35:14.494324+0000","last_clean":"2024-09-13T19:35:14.494324+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:35:14.494324+0000","last_undegraded":"2024-09-13T19:35:14.494324+0000","last_fullsized":"2024-09-13T19:35:14.494324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523956+0000","last_change":"2024-09-13T19:33:08.352331+0000","last_active":"2024-09-13T19:33:49.523956+0000","last_peered":"2024-09-13T19:33:49.523956+0000","last_clean":"2024-09-13T19:33:49.523956+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:33:49.523956+0000","last_undegraded":"2024-09-13T19:33:49.523956+0000","last_fullsized":"2024-09-13T19:33:49.523956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:14.487188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.206679+0000","last_change":"2024-09-13T19:33:10.340020+0000","last_active":"2024-09-13T19:36:24.206679+0000","last_peered":"2024-09-13T19:36:24.206679+0000","last_clean":"2024-09-13T19:36:24.206679+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:36:24.206679+0000","last_undegraded":"2024-09-13T19:36:24.206679+0000","last_fullsized":"2024-09-13T19:36:24.206679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501022+0000","last_change":"2024-09-13T19:33:08.325702+0000","last_active":"2024-09-13T19:33:49.501022+0000","last_peered":"2024-09-13T19:33:49.501022+0000","last_clean":"2024-09-13T19:33:49.501022+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:33:49.501022+0000","last_undegraded":"2024-09-13T19:33:49.501022+0000","last_fullsized":"2024-09-13T19:33:49.501022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:33.213641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.521893+0000","last_change":"2024-09-13T19:33:10.347711+0000","last_active":"2024-09-13T19:34:37.521893+0000","last_peered":"2024-09-13T19:34:37.521893+0000","last_clean":"2024-09-13T19:34:37.521893+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:34:37.521893+0000","last_undegraded":"2024-09-13T19:34:37.521893+0000","last_fullsized":"2024-09-13T19:34:37.521893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:35.663644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503292+0000","last_change":"2024-09-13T19:33:08.332434+0000","last_active":"2024-09-13T19:33:49.503292+0000","last_peered":"2024-09-13T19:33:49.503292+0000","last_clean":"2024-09-13T19:33:49.503292+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:33:49.503292+0000","last_undegraded":"2024-09-13T19:33:49.503292+0000","last_fullsized":"2024-09-13T19:33:49.503292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:37.935261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'13","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.748902+0000","last_change":"2024-09-13T19:33:10.357624+0000","last_active":"2024-09-13T19:36:23.748902+0000","last_peered":"2024-09-13T19:36:23.748902+0000","last_clean":"2024-09-13T19:36:23.748902+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:36:23.748902+0000","last_undegraded":"2024-09-13T19:36:23.748902+0000","last_fullsized":"2024-09-13T19:36:23.748902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:02.272686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497193+0000","last_change":"2024-09-13T19:33:08.346231+0000","last_active":"2024-09-13T19:33:49.497193+0000","last_peered":"2024-09-13T19:33:49.497193+0000","last_clean":"2024-09-13T19:33:49.497193+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:33:49.497193+0000","last_undegraded":"2024-09-13T19:33:49.497193+0000","last_fullsized":"2024-09-13T19:33:49.497193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278985+0000","last_change":"2024-09-13T19:33:10.344691+0000","last_active":"2024-09-13T19:36:24.278985+0000","last_peered":"2024-09-13T19:36:24.278985+0000","last_clean":"2024-09-13T19:36:24.278985+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:36:24.278985+0000","last_undegraded":"2024-09-13T19:36:24.278985+0000","last_fullsized":"2024-09-13T19:36:24.278985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:09.619694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499748+0000","last_change":"2024-09-13T19:33:08.349717+0000","last_active":"2024-09-13T19:33:49.499748+0000","last_peered":"2024-09-13T19:33:49.499748+0000","last_clean":"2024-09-13T19:33:49.499748+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:33:49.499748+0000","last_undegraded":"2024-09-13T19:33:49.499748+0000","last_fullsized":"2024-09-13T19:33:49.499748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:53.138445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507430+0000","last_change":"2024-09-13T19:33:10.343686+0000","last_active":"2024-09-13T19:33:49.507430+0000","last_peered":"2024-09-13T19:33:49.507430+0000","last_clean":"2024-09-13T19:33:49.507430+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:33:49.507430+0000","last_undegraded":"2024-09-13T19:33:49.507430+0000","last_fullsized":"2024-09-13T19:33:49.507430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503320+0000","last_change":"2024-09-13T19:33:08.349915+0000","last_active":"2024-09-13T19:33:49.503320+0000","last_peered":"2024-09-13T19:33:49.503320+0000","last_clean":"2024-09-13T19:33:49.503320+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:33:49.503320+0000","last_undegraded":"2024-09-13T19:33:49.503320+0000","last_fullsized":"2024-09-13T19:33:49.503320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:03.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097014+0000","last_change":"2024-09-13T19:33:10.356426+0000","last_active":"2024-09-13T19:36:24.097014+0000","last_peered":"2024-09-13T19:36:24.097014+0000","last_clean":"2024-09-13T19:36:24.097014+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:36:24.097014+0000","last_undegraded":"2024-09-13T19:36:24.097014+0000","last_fullsized":"2024-09-13T19:36:24.097014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509661+0000","last_change":"2024-09-13T19:33:08.342035+0000","last_active":"2024-09-13T19:33:49.509661+0000","last_peered":"2024-09-13T19:33:49.509661+0000","last_clean":"2024-09-13T19:33:49.509661+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:33:49.509661+0000","last_undegraded":"2024-09-13T19:33:49.509661+0000","last_fullsized":"2024-09-13T19:33:49.509661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:01.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.379678+0000","last_change":"2024-09-13T19:33:10.350348+0000","last_active":"2024-09-13T19:33:53.379678+0000","last_peered":"2024-09-13T19:33:53.379678+0000","last_clean":"2024-09-13T19:33:53.379678+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:33:53.379678+0000","last_undegraded":"2024-09-13T19:33:53.379678+0000","last_fullsized":"2024-09-13T19:33:53.379678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:09.619694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.685036+0000","last_change":"2024-09-13T19:33:08.335544+0000","last_active":"2024-09-13T19:33:52.685036+0000","last_peered":"2024-09-13T19:33:52.685036+0000","last_clean":"2024-09-13T19:33:52.685036+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:33:52.685036+0000","last_undegraded":"2024-09-13T19:33:52.685036+0000","last_fullsized":"2024-09-13T19:33:52.685036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:42.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.194003+0000","last_change":"2024-09-13T19:33:10.353586+0000","last_active":"2024-09-13T19:35:18.194003+0000","last_peered":"2024-09-13T19:35:18.194003+0000","last_clean":"2024-09-13T19:35:18.194003+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:35:18.194003+0000","last_undegraded":"2024-09-13T19:35:18.194003+0000","last_fullsized":"2024-09-13T19:35:18.194003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:45.252176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524187+0000","last_change":"2024-09-13T19:33:08.351999+0000","last_active":"2024-09-13T19:33:49.524187+0000","last_peered":"2024-09-13T19:33:49.524187+0000","last_clean":"2024-09-13T19:33:49.524187+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:33:49.524187+0000","last_undegraded":"2024-09-13T19:33:49.524187+0000","last_fullsized":"2024-09-13T19:33:49.524187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:20.702363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096154+0000","last_change":"2024-09-13T19:33:10.343404+0000","last_active":"2024-09-13T19:36:24.096154+0000","last_peered":"2024-09-13T19:36:24.096154+0000","last_clean":"2024-09-13T19:36:24.096154+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:36:24.096154+0000","last_undegraded":"2024-09-13T19:36:24.096154+0000","last_fullsized":"2024-09-13T19:36:24.096154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515399+0000","last_change":"2024-09-13T19:33:08.354921+0000","last_active":"2024-09-13T19:33:49.515399+0000","last_peered":"2024-09-13T19:33:49.515399+0000","last_clean":"2024-09-13T19:33:49.515399+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:33:49.515399+0000","last_undegraded":"2024-09-13T19:33:49.515399+0000","last_fullsized":"2024-09-13T19:33:49.515399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:21.015465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503594+0000","last_change":"2024-09-13T19:33:08.354409+0000","last_active":"2024-09-13T19:33:49.503594+0000","last_peered":"2024-09-13T19:33:49.503594+0000","last_clean":"2024-09-13T19:33:49.503594+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:33:49.503594+0000","last_undegraded":"2024-09-13T19:33:49.503594+0000","last_fullsized":"2024-09-13T19:33:49.503594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:08.466174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097156+0000","last_change":"2024-09-13T19:33:10.340978+0000","last_active":"2024-09-13T19:36:24.097156+0000","last_peered":"2024-09-13T19:36:24.097156+0000","last_clean":"2024-09-13T19:36:24.097156+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:36:24.097156+0000","last_undegraded":"2024-09-13T19:36:24.097156+0000","last_fullsized":"2024-09-13T19:36:24.097156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:22.801067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497705+0000","last_change":"2024-09-13T19:33:08.349038+0000","last_active":"2024-09-13T19:33:49.497705+0000","last_peered":"2024-09-13T19:33:49.497705+0000","last_clean":"2024-09-13T19:33:49.497705+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:33:49.497705+0000","last_undegraded":"2024-09-13T19:33:49.497705+0000","last_fullsized":"2024-09-13T19:33:49.497705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.871653+0000","last_change":"2024-09-13T19:33:10.357819+0000","last_active":"2024-09-13T19:33:54.871653+0000","last_peered":"2024-09-13T19:33:54.871653+0000","last_clean":"2024-09-13T19:33:54.871653+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:33:54.871653+0000","last_undegraded":"2024-09-13T19:33:54.871653+0000","last_fullsized":"2024-09-13T19:33:54.871653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:15.665066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2266,"ondisk_log_size":2266,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1405,"num_read_kb":1191,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1300,"ondisk_log_size":1300,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":968,"num_read_kb":968,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52808,"kb_used_data":17464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":17883136,"data_stored":17553871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52688,"kb_used_data":17344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319152,"statfs":{"total":96636764160,"available":96582811648,"internally_reserved":0,"allocated":17760256,"data_stored":17502939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49252,"kb_used_data":13908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322588,"statfs":{"total":96636764160,"available":96586330112,"internally_reserved":0,"allocated":14241792,"data_stored":13948982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":4516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":4624384,"data_stored":4331938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:36:56.663 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T19:36:56.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:36:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a62ed0640 1 Processor -- start 2024-09-13T19:36:56.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a62ed0640 1 -- start start 2024-09-13T19:36:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a62ed0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6a5c06dbd0 0x7f6a5c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a62ed0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5c071c10 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a62ed0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5c072230 con 0x7f6a5c06dbd0 2024-09-13T19:36:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a5bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6a5c06dbd0 0x7f6a5c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:56.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a60c6c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6a5c06d0e0 0x7f6a5c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41678/0 (socket says 172.21.15.18:41678) 2024-09-13T19:36:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a60c6c640 1 -- 172.21.15.18:0/3172399547 learned_addr learned my addr 172.21.15.18:0/3172399547 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a5bfff640 1 -- 172.21.15.18:0/3172399547 >> v1:172.21.15.18:6789/0 conn(0x7f6a5c06d0e0 legacy=0x7f6a5c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a5bfff640 1 -- 172.21.15.18:0/3172399547 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c0709e0 con 0x7f6a5c06dbd0 2024-09-13T19:36:56.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.814+0000 7f6a5b7fe640 1 -- 172.21.15.18:0/3172399547 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808214827 0 0) 0x7f6a5c071c10 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a5bfff640 1 --2- 172.21.15.18:0/3172399547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06dbd0 0x7f6a5c131e60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009740 tx=0x7f6a4c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b680dd35b2755c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a5b7fe640 1 -- 172.21.15.18:0/3172399547 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a4c0b0070 con 0x7f6a5c06dbd0 2024-09-13T19:36:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a5b7fe640 1 -- 172.21.15.18:0/3172399547 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c0ab530 con 0x7f6a5c06dbd0 2024-09-13T19:36:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a5b7fe640 1 -- 172.21.15.18:0/3172399547 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a4c0ab830 con 0x7f6a5c06dbd0 2024-09-13T19:36:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 -- 172.21.15.18:0/3172399547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06dbd0 msgr2=0x7f6a5c131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 --2- 172.21.15.18:0/3172399547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06dbd0 0x7f6a5c131e60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009740 tx=0x7f6a4c01c370 comp rx=0 tx=0).stop 2024-09-13T19:36:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 -- 172.21.15.18:0/3172399547 shutdown_connections 2024-09-13T19:36:56.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 --2- 172.21.15.18:0/3172399547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06dbd0 0x7f6a5c131e60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 -- 172.21.15.18:0/3172399547 >> 172.21.15.18:0/3172399547 conn(0x7f6a5c099a50 msgr2=0x7f6a5c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 -- 172.21.15.18:0/3172399547 shutdown_connections 2024-09-13T19:36:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 -- 172.21.15.18:0/3172399547 wait complete. 2024-09-13T19:36:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 Processor -- start 2024-09-13T19:36:56.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 -- start start 2024-09-13T19:36:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06d0e0 0x7f6a5c095de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a62ed0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c134d40 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a60c6c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06d0e0 0x7f6a5c095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a60c6c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06d0e0 0x7f6a5c095de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58360/0 (socket says 172.21.15.18:58360) 2024-09-13T19:36:56.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.818+0000 7f6a60c6c640 1 -- 172.21.15.18:0/1091421256 learned_addr learned my addr 172.21.15.18:0/1091421256 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a60c6c640 1 -- 172.21.15.18:0/1091421256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c093b90 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a60c6c640 1 --2- 172.21.15.18:0/1091421256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06d0e0 0x7f6a5c095de0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c420 tx=0x7f6a4400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a597fa640 1 -- 172.21.15.18:0/1091421256 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a44018070 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a597fa640 1 -- 172.21.15.18:0/1091421256 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a440074d0 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5c096320 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a597fa640 1 -- 172.21.15.18:0/1091421256 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a44004960 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5c0967e0 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a5c095970 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a597fa640 1 -- 172.21.15.18:0/1091421256 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a4401b070 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a597fa640 1 --2- 172.21.15.18:0/1091421256 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a3c035db0 0x7f6a3c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:56.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a597fa640 1 -- 172.21.15.18:0/1091421256 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6a440483c0 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a5bfff640 1 --2- 172.21.15.18:0/1091421256 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a3c035db0 0x7f6a3c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:56.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.822+0000 7f6a5bfff640 1 --2- 172.21.15.18:0/1091421256 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a3c035db0 0x7f6a3c038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0ad000 tx=0x7f6a4c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.826+0000 7f6a597fa640 1 -- 172.21.15.18:0/1091421256 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6a4401c9d0 con 0x7f6a5c06d0e0 2024-09-13T19:36:56.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-13T19:36:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:56.986+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a5c06d4c0 con 0x7f6a3c035db0 2024-09-13T19:36:57.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.030+0000 7f6a597fa640 1 -- 172.21.15.18:0/1091421256 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665562 (secure 0 0 0) 0x7f6a5c06d4c0 con 0x7f6a3c035db0 2024-09-13T19:36:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:36:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a3c035db0 msgr2=0x7f6a3c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 --2- 172.21.15.18:0/1091421256 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a3c035db0 0x7f6a3c038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0ad000 tx=0x7f6a4c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06d0e0 msgr2=0x7f6a5c095de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 --2- 172.21.15.18:0/1091421256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06d0e0 0x7f6a5c095de0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c420 tx=0x7f6a4400c8e0 comp rx=0 tx=0).stop 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 shutdown_connections 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 --2- 172.21.15.18:0/1091421256 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f6a3c035db0 0x7f6a3c038270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 --2- 172.21.15.18:0/1091421256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a5c06d0e0 0x7f6a5c095de0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 >> 172.21.15.18:0/1091421256 conn(0x7f6a5c099a50 msgr2=0x7f6a5c08afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 shutdown_connections 2024-09-13T19:36:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.038+0000 7f6a62ed0640 1 -- 172.21.15.18:0/1091421256 wait complete. 2024-09-13T19:36:57.059 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-13T19:36:56.513532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4897,"num_read_kb":4478,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4515,"ondisk_log_size":4515,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186288,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377301072,"statfs":{"total":386547056640,"available":386356297728,"internally_reserved":0,"allocated":54509568,"data_stored":53337730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005678"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.686210+0000","last_change":"2024-09-13T19:33:08.351986+0000","last_active":"2024-09-13T19:33:52.686210+0000","last_peered":"2024-09-13T19:33:52.686210+0000","last_clean":"2024-09-13T19:33:52.686210+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:33:52.686210+0000","last_undegraded":"2024-09-13T19:33:52.686210+0000","last_fullsized":"2024-09-13T19:33:52.686210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278487+0000","last_change":"2024-09-13T19:33:10.354610+0000","last_active":"2024-09-13T19:36:24.278487+0000","last_peered":"2024-09-13T19:36:24.278487+0000","last_clean":"2024-09-13T19:36:24.278487+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:36:24.278487+0000","last_undegraded":"2024-09-13T19:36:24.278487+0000","last_fullsized":"2024-09-13T19:36:24.278487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:03.258150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.085377+0000","last_change":"2024-09-13T19:33:08.349789+0000","last_active":"2024-09-13T19:36:24.085377+0000","last_peered":"2024-09-13T19:36:24.085377+0000","last_clean":"2024-09-13T19:36:24.085377+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:36:24.085377+0000","last_undegraded":"2024-09-13T19:36:24.085377+0000","last_fullsized":"2024-09-13T19:36:24.085377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:33.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:19.508790+0000","last_change":"2024-09-13T19:33:49.508985+0000","last_active":"2024-09-13T19:36:19.508790+0000","last_peered":"2024-09-13T19:36:19.508790+0000","last_clean":"2024-09-13T19:36:19.508790+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:36:19.508790+0000","last_undegraded":"2024-09-13T19:36:19.508790+0000","last_fullsized":"2024-09-13T19:36:19.508790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:27.111192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515719+0000","last_change":"2024-09-13T19:33:08.354845+0000","last_active":"2024-09-13T19:33:49.515719+0000","last_peered":"2024-09-13T19:33:49.515719+0000","last_clean":"2024-09-13T19:33:49.515719+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:33:49.515719+0000","last_undegraded":"2024-09-13T19:33:49.515719+0000","last_fullsized":"2024-09-13T19:33:49.515719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:38.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.223614+0000","last_change":"2024-09-13T19:33:10.349694+0000","last_active":"2024-09-13T19:36:24.223614+0000","last_peered":"2024-09-13T19:36:24.223614+0000","last_clean":"2024-09-13T19:36:24.223614+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:36:24.223614+0000","last_undegraded":"2024-09-13T19:36:24.223614+0000","last_fullsized":"2024-09-13T19:36:24.223614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:06.072800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.518838+0000","last_change":"2024-09-13T19:33:08.348066+0000","last_active":"2024-09-13T19:33:49.518838+0000","last_peered":"2024-09-13T19:33:49.518838+0000","last_clean":"2024-09-13T19:33:49.518838+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:33:49.518838+0000","last_undegraded":"2024-09-13T19:33:49.518838+0000","last_fullsized":"2024-09-13T19:33:49.518838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:46.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.522657+0000","last_change":"2024-09-13T19:33:10.348236+0000","last_active":"2024-09-13T19:34:37.522657+0000","last_peered":"2024-09-13T19:34:37.522657+0000","last_clean":"2024-09-13T19:34:37.522657+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:34:37.522657+0000","last_undegraded":"2024-09-13T19:34:37.522657+0000","last_fullsized":"2024-09-13T19:34:37.522657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:14.920902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505426+0000","last_change":"2024-09-13T19:33:08.336355+0000","last_active":"2024-09-13T19:33:49.505426+0000","last_peered":"2024-09-13T19:33:49.505426+0000","last_clean":"2024-09-13T19:33:49.505426+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:33:49.505426+0000","last_undegraded":"2024-09-13T19:33:49.505426+0000","last_fullsized":"2024-09-13T19:33:49.505426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:21.610997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.872394+0000","last_change":"2024-09-13T19:33:10.353752+0000","last_active":"2024-09-13T19:33:54.872394+0000","last_peered":"2024-09-13T19:33:54.872394+0000","last_clean":"2024-09-13T19:33:54.872394+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:33:54.872394+0000","last_undegraded":"2024-09-13T19:33:54.872394+0000","last_fullsized":"2024-09-13T19:33:54.872394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:25.322287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.518463+0000","last_change":"2024-09-13T19:33:08.333243+0000","last_active":"2024-09-13T19:33:49.518463+0000","last_peered":"2024-09-13T19:33:49.518463+0000","last_clean":"2024-09-13T19:33:49.518463+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:33:49.518463+0000","last_undegraded":"2024-09-13T19:33:49.518463+0000","last_fullsized":"2024-09-13T19:33:49.518463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:38.936603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.916325+0000","last_change":"2024-09-13T19:33:10.357587+0000","last_active":"2024-09-13T19:35:22.916325+0000","last_peered":"2024-09-13T19:35:22.916325+0000","last_clean":"2024-09-13T19:35:22.916325+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:35:22.916325+0000","last_undegraded":"2024-09-13T19:35:22.916325+0000","last_fullsized":"2024-09-13T19:35:22.916325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:19.567235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507129+0000","last_change":"2024-09-13T19:33:08.338158+0000","last_active":"2024-09-13T19:33:49.507129+0000","last_peered":"2024-09-13T19:33:49.507129+0000","last_clean":"2024-09-13T19:33:49.507129+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:33:49.507129+0000","last_undegraded":"2024-09-13T19:33:49.507129+0000","last_fullsized":"2024-09-13T19:33:49.507129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:12.010604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.180096+0000","last_change":"2024-09-13T19:33:10.355178+0000","last_active":"2024-09-13T19:35:18.180096+0000","last_peered":"2024-09-13T19:35:18.180096+0000","last_clean":"2024-09-13T19:35:18.180096+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:35:18.180096+0000","last_undegraded":"2024-09-13T19:35:18.180096+0000","last_fullsized":"2024-09-13T19:35:18.180096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495952+0000","last_change":"2024-09-13T19:33:08.331646+0000","last_active":"2024-09-13T19:33:49.495952+0000","last_peered":"2024-09-13T19:33:49.495952+0000","last_clean":"2024-09-13T19:33:49.495952+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:33:49.495952+0000","last_undegraded":"2024-09-13T19:33:49.495952+0000","last_fullsized":"2024-09-13T19:33:49.495952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.521422+0000","last_change":"2024-09-13T19:33:10.332175+0000","last_active":"2024-09-13T19:34:37.521422+0000","last_peered":"2024-09-13T19:34:37.521422+0000","last_clean":"2024-09-13T19:34:37.521422+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:34:37.521422+0000","last_undegraded":"2024-09-13T19:34:37.521422+0000","last_fullsized":"2024-09-13T19:34:37.521422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.169782+0000","last_change":"2024-09-13T19:33:10.348601+0000","last_active":"2024-09-13T19:33:54.169782+0000","last_peered":"2024-09-13T19:33:54.169782+0000","last_clean":"2024-09-13T19:33:54.169782+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:33:54.169782+0000","last_undegraded":"2024-09-13T19:33:54.169782+0000","last_fullsized":"2024-09-13T19:33:54.169782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:18.388392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.176919+0000","last_change":"2024-09-13T19:33:08.338071+0000","last_active":"2024-09-13T19:35:18.176919+0000","last_peered":"2024-09-13T19:35:18.176919+0000","last_clean":"2024-09-13T19:35:18.176919+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:35:18.176919+0000","last_undegraded":"2024-09-13T19:35:18.176919+0000","last_fullsized":"2024-09-13T19:35:18.176919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.208248+0000","last_change":"2024-09-13T19:33:10.350836+0000","last_active":"2024-09-13T19:36:24.208248+0000","last_peered":"2024-09-13T19:36:24.208248+0000","last_clean":"2024-09-13T19:36:24.208248+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:36:24.208248+0000","last_undegraded":"2024-09-13T19:36:24.208248+0000","last_fullsized":"2024-09-13T19:36:24.208248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524586+0000","last_change":"2024-09-13T19:33:08.352861+0000","last_active":"2024-09-13T19:33:49.524586+0000","last_peered":"2024-09-13T19:33:49.524586+0000","last_clean":"2024-09-13T19:33:49.524586+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:33:49.524586+0000","last_undegraded":"2024-09-13T19:33:49.524586+0000","last_fullsized":"2024-09-13T19:33:49.524586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749546+0000","last_change":"2024-09-13T19:33:10.354940+0000","last_active":"2024-09-13T19:36:23.749546+0000","last_peered":"2024-09-13T19:36:23.749546+0000","last_clean":"2024-09-13T19:36:23.749546+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:36:23.749546+0000","last_undegraded":"2024-09-13T19:36:23.749546+0000","last_fullsized":"2024-09-13T19:36:23.749546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:32.796106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.813354+0000","last_change":"2024-09-13T19:33:08.337822+0000","last_active":"2024-09-13T19:35:22.813354+0000","last_peered":"2024-09-13T19:35:22.813354+0000","last_clean":"2024-09-13T19:35:22.813354+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:35:22.813354+0000","last_undegraded":"2024-09-13T19:35:22.813354+0000","last_fullsized":"2024-09-13T19:35:22.813354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:46.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.935906+0000","last_change":"2024-09-13T19:33:10.341134+0000","last_active":"2024-09-13T19:35:22.935906+0000","last_peered":"2024-09-13T19:35:22.935906+0000","last_clean":"2024-09-13T19:35:22.935906+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:35:22.935906+0000","last_undegraded":"2024-09-13T19:35:22.935906+0000","last_fullsized":"2024-09-13T19:35:22.935906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.682621+0000","last_change":"2024-09-13T19:33:08.335101+0000","last_active":"2024-09-13T19:33:52.682621+0000","last_peered":"2024-09-13T19:33:52.682621+0000","last_clean":"2024-09-13T19:33:52.682621+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:33:52.682621+0000","last_undegraded":"2024-09-13T19:33:52.682621+0000","last_fullsized":"2024-09-13T19:33:52.682621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207846+0000","last_change":"2024-09-13T19:33:10.346663+0000","last_active":"2024-09-13T19:36:24.207846+0000","last_peered":"2024-09-13T19:36:24.207846+0000","last_clean":"2024-09-13T19:36:24.207846+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:36:24.207846+0000","last_undegraded":"2024-09-13T19:36:24.207846+0000","last_fullsized":"2024-09-13T19:36:24.207846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:19.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498616+0000","last_change":"2024-09-13T19:33:08.345933+0000","last_active":"2024-09-13T19:33:49.498616+0000","last_peered":"2024-09-13T19:33:49.498616+0000","last_clean":"2024-09-13T19:33:49.498616+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:33:49.498616+0000","last_undegraded":"2024-09-13T19:33:49.498616+0000","last_fullsized":"2024-09-13T19:33:49.498616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:20.702363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278174+0000","last_change":"2024-09-13T19:33:10.352700+0000","last_active":"2024-09-13T19:36:24.278174+0000","last_peered":"2024-09-13T19:36:24.278174+0000","last_clean":"2024-09-13T19:36:24.278174+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:36:24.278174+0000","last_undegraded":"2024-09-13T19:36:24.278174+0000","last_fullsized":"2024-09-13T19:36:24.278174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:42.703374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506193+0000","last_change":"2024-09-13T19:33:08.341033+0000","last_active":"2024-09-13T19:33:49.506193+0000","last_peered":"2024-09-13T19:33:49.506193+0000","last_clean":"2024-09-13T19:33:49.506193+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:33:49.506193+0000","last_undegraded":"2024-09-13T19:33:49.506193+0000","last_fullsized":"2024-09-13T19:33:49.506193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:05.069489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.289296+0000","last_change":"2024-09-13T19:33:18.418602+0000","last_active":"2024-09-13T19:36:24.289296+0000","last_peered":"2024-09-13T19:36:24.289296+0000","last_clean":"2024-09-13T19:36:24.289296+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:36:24.289296+0000","last_undegraded":"2024-09-13T19:36:24.289296+0000","last_fullsized":"2024-09-13T19:36:24.289296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:10.880859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.887329+0000","last_change":"2024-09-13T19:33:10.354595+0000","last_active":"2024-09-13T19:36:23.887329+0000","last_peered":"2024-09-13T19:36:23.887329+0000","last_clean":"2024-09-13T19:36:23.887329+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:36:23.887329+0000","last_undegraded":"2024-09-13T19:36:23.887329+0000","last_fullsized":"2024-09-13T19:36:23.887329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:20.279342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.425021+0000","last_change":"2024-09-13T19:33:08.354352+0000","last_active":"2024-09-13T19:36:23.425021+0000","last_peered":"2024-09-13T19:36:23.425021+0000","last_clean":"2024-09-13T19:36:23.425021+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:36:23.425021+0000","last_undegraded":"2024-09-13T19:36:23.425021+0000","last_fullsized":"2024-09-13T19:36:23.425021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:13.750930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":12,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506011+0000","last_change":"2024-09-13T19:33:12.348066+0000","last_active":"2024-09-13T19:33:49.506011+0000","last_peered":"2024-09-13T19:33:49.506011+0000","last_clean":"2024-09-13T19:33:49.506011+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:33:49.506011+0000","last_undegraded":"2024-09-13T19:33:49.506011+0000","last_fullsized":"2024-09-13T19:33:49.506011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:08.587167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507782+0000","last_change":"2024-09-13T19:33:14.385453+0000","last_active":"2024-09-13T19:35:40.507782+0000","last_peered":"2024-09-13T19:35:40.507782+0000","last_clean":"2024-09-13T19:35:40.507782+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:35:40.507782+0000","last_undegraded":"2024-09-13T19:35:40.507782+0000","last_fullsized":"2024-09-13T19:35:40.507782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:02.906563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510495+0000","last_change":"2024-09-13T19:33:16.394148+0000","last_active":"2024-09-13T19:33:49.510495+0000","last_peered":"2024-09-13T19:33:49.510495+0000","last_clean":"2024-09-13T19:33:49.510495+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:33:49.510495+0000","last_undegraded":"2024-09-13T19:33:49.510495+0000","last_fullsized":"2024-09-13T19:33:49.510495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:48.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.211547+0000","last_change":"2024-09-13T19:33:18.412565+0000","last_active":"2024-09-13T19:36:24.211547+0000","last_peered":"2024-09-13T19:36:24.211547+0000","last_clean":"2024-09-13T19:36:24.211547+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:36:24.211547+0000","last_undegraded":"2024-09-13T19:36:24.211547+0000","last_fullsized":"2024-09-13T19:36:24.211547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:17.846459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278687+0000","last_change":"2024-09-13T19:33:10.353417+0000","last_active":"2024-09-13T19:36:24.278687+0000","last_peered":"2024-09-13T19:36:24.278687+0000","last_clean":"2024-09-13T19:36:24.278687+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:36:24.278687+0000","last_undegraded":"2024-09-13T19:36:24.278687+0000","last_fullsized":"2024-09-13T19:36:24.278687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:18.375886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.344511+0000","last_change":"2024-09-13T19:33:08.348578+0000","last_active":"2024-09-13T19:33:53.344511+0000","last_peered":"2024-09-13T19:33:53.344511+0000","last_clean":"2024-09-13T19:33:53.344511+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:33:53.344511+0000","last_undegraded":"2024-09-13T19:33:53.344511+0000","last_fullsized":"2024-09-13T19:33:53.344511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.481580+0000","last_change":"2024-09-13T19:33:49.525696+0000","last_active":"2024-09-13T19:33:50.481580+0000","last_peered":"2024-09-13T19:33:50.481580+0000","last_clean":"2024-09-13T19:33:50.481580+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:33:50.481580+0000","last_undegraded":"2024-09-13T19:33:50.481580+0000","last_fullsized":"2024-09-13T19:33:50.481580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:29.119647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510753+0000","last_change":"2024-09-13T19:33:14.364101+0000","last_active":"2024-09-13T19:33:49.510753+0000","last_peered":"2024-09-13T19:33:49.510753+0000","last_clean":"2024-09-13T19:33:49.510753+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:33:49.510753+0000","last_undegraded":"2024-09-13T19:33:49.510753+0000","last_fullsized":"2024-09-13T19:33:49.510753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:18.964704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504881+0000","last_change":"2024-09-13T19:33:16.394670+0000","last_active":"2024-09-13T19:33:49.504881+0000","last_peered":"2024-09-13T19:33:49.504881+0000","last_clean":"2024-09-13T19:33:49.504881+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:33:49.504881+0000","last_undegraded":"2024-09-13T19:33:49.504881+0000","last_fullsized":"2024-09-13T19:33:49.504881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:21.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495915+0000","last_change":"2024-09-13T19:33:18.407303+0000","last_active":"2024-09-13T19:33:49.495915+0000","last_peered":"2024-09-13T19:33:49.495915+0000","last_clean":"2024-09-13T19:33:49.495915+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:33:49.495915+0000","last_undegraded":"2024-09-13T19:33:49.495915+0000","last_fullsized":"2024-09-13T19:33:49.495915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:43.261605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'11","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.299618+0000","last_change":"2024-09-13T19:33:10.350582+0000","last_active":"2024-09-13T19:36:24.299618+0000","last_peered":"2024-09-13T19:36:24.299618+0000","last_clean":"2024-09-13T19:36:24.299618+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:36:24.299618+0000","last_undegraded":"2024-09-13T19:36:24.299618+0000","last_fullsized":"2024-09-13T19:36:24.299618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:48.834947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505235+0000","last_change":"2024-09-13T19:33:08.355253+0000","last_active":"2024-09-13T19:33:49.505235+0000","last_peered":"2024-09-13T19:33:49.505235+0000","last_clean":"2024-09-13T19:33:49.505235+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:33:49.505235+0000","last_undegraded":"2024-09-13T19:33:49.505235+0000","last_fullsized":"2024-09-13T19:33:49.505235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:24.473523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.061670+0000","last_change":"2024-09-13T19:33:12.350183+0000","last_active":"2024-09-13T19:35:22.061670+0000","last_peered":"2024-09-13T19:35:22.061670+0000","last_clean":"2024-09-13T19:35:22.061670+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:35:22.061670+0000","last_undegraded":"2024-09-13T19:35:22.061670+0000","last_fullsized":"2024-09-13T19:35:22.061670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:20.396847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.245650+0000","last_change":"2024-09-13T19:33:14.373660+0000","last_active":"2024-09-13T19:34:37.245650+0000","last_peered":"2024-09-13T19:34:37.245650+0000","last_clean":"2024-09-13T19:34:37.245650+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:34:37.245650+0000","last_undegraded":"2024-09-13T19:34:37.245650+0000","last_fullsized":"2024-09-13T19:34:37.245650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:29.436165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'284","reported_seq":393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.444937+0000","last_change":"2024-09-13T19:33:16.400903+0000","last_active":"2024-09-13T19:36:55.444937+0000","last_peered":"2024-09-13T19:36:55.444937+0000","last_clean":"2024-09-13T19:36:55.444937+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:36:55.444937+0000","last_undegraded":"2024-09-13T19:36:55.444937+0000","last_fullsized":"2024-09-13T19:36:55.444937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:31.714918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.826207+0000","last_change":"2024-09-13T19:33:18.416828+0000","last_active":"2024-09-13T19:33:53.826207+0000","last_peered":"2024-09-13T19:33:53.826207+0000","last_clean":"2024-09-13T19:33:53.826207+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:33:53.826207+0000","last_undegraded":"2024-09-13T19:33:53.826207+0000","last_fullsized":"2024-09-13T19:33:53.826207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:50.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.728071+0000","last_change":"2024-09-13T19:33:10.342044+0000","last_active":"2024-09-13T19:36:23.728071+0000","last_peered":"2024-09-13T19:36:23.728071+0000","last_clean":"2024-09-13T19:36:23.728071+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:36:23.728071+0000","last_undegraded":"2024-09-13T19:36:23.728071+0000","last_fullsized":"2024-09-13T19:36:23.728071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:43.220677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498238+0000","last_change":"2024-09-13T19:33:08.337394+0000","last_active":"2024-09-13T19:33:49.498238+0000","last_peered":"2024-09-13T19:33:49.498238+0000","last_clean":"2024-09-13T19:33:49.498238+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:33:49.498238+0000","last_undegraded":"2024-09-13T19:33:49.498238+0000","last_fullsized":"2024-09-13T19:33:49.498238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:13.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513312+0000","last_change":"2024-09-13T19:33:12.356265+0000","last_active":"2024-09-13T19:33:49.513312+0000","last_peered":"2024-09-13T19:33:49.513312+0000","last_clean":"2024-09-13T19:33:49.513312+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:33:49.513312+0000","last_undegraded":"2024-09-13T19:33:49.513312+0000","last_fullsized":"2024-09-13T19:33:49.513312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:52.279609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'32","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503719+0000","last_change":"2024-09-13T19:33:14.371462+0000","last_active":"2024-09-13T19:35:40.503719+0000","last_peered":"2024-09-13T19:35:40.503719+0000","last_clean":"2024-09-13T19:35:40.503719+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:35:40.503719+0000","last_undegraded":"2024-09-13T19:35:40.503719+0000","last_fullsized":"2024-09-13T19:35:40.503719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:35.666084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.287443+0000","last_change":"2024-09-13T19:33:16.392294+0000","last_active":"2024-09-13T19:36:24.287443+0000","last_peered":"2024-09-13T19:36:24.287443+0000","last_clean":"2024-09-13T19:36:24.287443+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:36:24.287443+0000","last_undegraded":"2024-09-13T19:36:24.287443+0000","last_fullsized":"2024-09-13T19:36:24.287443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:21.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096128+0000","last_change":"2024-09-13T19:33:10.356414+0000","last_active":"2024-09-13T19:36:24.096128+0000","last_peered":"2024-09-13T19:36:24.096128+0000","last_clean":"2024-09-13T19:36:24.096128+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:36:24.096128+0000","last_undegraded":"2024-09-13T19:36:24.096128+0000","last_fullsized":"2024-09-13T19:36:24.096128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:05.759718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.500106+0000","last_change":"2024-09-13T19:33:08.347478+0000","last_active":"2024-09-13T19:35:25.500106+0000","last_peered":"2024-09-13T19:35:25.500106+0000","last_clean":"2024-09-13T19:35:25.500106+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:35:25.500106+0000","last_undegraded":"2024-09-13T19:35:25.500106+0000","last_fullsized":"2024-09-13T19:35:25.500106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499234+0000","last_change":"2024-09-13T19:33:12.362201+0000","last_active":"2024-09-13T19:33:49.499234+0000","last_peered":"2024-09-13T19:33:49.499234+0000","last_clean":"2024-09-13T19:33:49.499234+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:33:49.499234+0000","last_undegraded":"2024-09-13T19:33:49.499234+0000","last_fullsized":"2024-09-13T19:33:49.499234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:20.396847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'41","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.499748+0000","last_change":"2024-09-13T19:33:14.367131+0000","last_active":"2024-09-13T19:35:25.499748+0000","last_peered":"2024-09-13T19:35:25.499748+0000","last_clean":"2024-09-13T19:35:25.499748+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:35:25.499748+0000","last_undegraded":"2024-09-13T19:35:25.499748+0000","last_fullsized":"2024-09-13T19:35:25.499748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:41.769483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.496898+0000","last_change":"2024-09-13T19:33:16.372536+0000","last_active":"2024-09-13T19:33:49.496898+0000","last_peered":"2024-09-13T19:33:49.496898+0000","last_clean":"2024-09-13T19:33:49.496898+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:33:49.496898+0000","last_undegraded":"2024-09-13T19:33:49.496898+0000","last_fullsized":"2024-09-13T19:33:49.496898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:31.023125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.255184+0000","last_change":"2024-09-13T19:33:18.417415+0000","last_active":"2024-09-13T19:34:37.255184+0000","last_peered":"2024-09-13T19:34:37.255184+0000","last_clean":"2024-09-13T19:34:37.255184+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:34:37.255184+0000","last_undegraded":"2024-09-13T19:34:37.255184+0000","last_fullsized":"2024-09-13T19:34:37.255184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:08.824528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278394+0000","last_change":"2024-09-13T19:33:10.352105+0000","last_active":"2024-09-13T19:36:24.278394+0000","last_peered":"2024-09-13T19:36:24.278394+0000","last_clean":"2024-09-13T19:36:24.278394+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:36:24.278394+0000","last_undegraded":"2024-09-13T19:36:24.278394+0000","last_fullsized":"2024-09-13T19:36:24.278394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.525145+0000","last_change":"2024-09-13T19:33:08.351524+0000","last_active":"2024-09-13T19:33:49.525145+0000","last_peered":"2024-09-13T19:33:49.525145+0000","last_clean":"2024-09-13T19:33:49.525145+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:33:49.525145+0000","last_undegraded":"2024-09-13T19:33:49.525145+0000","last_fullsized":"2024-09-13T19:33:49.525145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:27.423338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497283+0000","last_change":"2024-09-13T19:33:12.346361+0000","last_active":"2024-09-13T19:33:49.497283+0000","last_peered":"2024-09-13T19:33:49.497283+0000","last_clean":"2024-09-13T19:33:49.497283+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:33:49.497283+0000","last_undegraded":"2024-09-13T19:33:49.497283+0000","last_fullsized":"2024-09-13T19:33:49.497283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:12.646509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.753674+0000","last_change":"2024-09-13T19:33:14.391496+0000","last_active":"2024-09-13T19:36:23.753674+0000","last_peered":"2024-09-13T19:36:23.753674+0000","last_clean":"2024-09-13T19:36:23.753674+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:36:23.753674+0000","last_undegraded":"2024-09-13T19:36:23.753674+0000","last_fullsized":"2024-09-13T19:36:23.753674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:30.872095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.496182+0000","last_change":"2024-09-13T19:33:16.375752+0000","last_active":"2024-09-13T19:33:49.496182+0000","last_peered":"2024-09-13T19:33:49.496182+0000","last_clean":"2024-09-13T19:33:49.496182+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:33:49.496182+0000","last_undegraded":"2024-09-13T19:33:49.496182+0000","last_fullsized":"2024-09-13T19:33:49.496182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:57.894724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:31.549249+0000","last_change":"2024-09-13T19:33:18.420383+0000","last_active":"2024-09-13T19:34:31.549249+0000","last_peered":"2024-09-13T19:34:31.549249+0000","last_clean":"2024-09-13T19:34:31.549249+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:34:31.549249+0000","last_undegraded":"2024-09-13T19:34:31.549249+0000","last_fullsized":"2024-09-13T19:34:31.549249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:08.579627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207661+0000","last_change":"2024-09-13T19:33:10.330476+0000","last_active":"2024-09-13T19:36:24.207661+0000","last_peered":"2024-09-13T19:36:24.207661+0000","last_clean":"2024-09-13T19:36:24.207661+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:36:24.207661+0000","last_undegraded":"2024-09-13T19:36:24.207661+0000","last_fullsized":"2024-09-13T19:36:24.207661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:13.461248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507615+0000","last_change":"2024-09-13T19:33:08.341877+0000","last_active":"2024-09-13T19:33:49.507615+0000","last_peered":"2024-09-13T19:33:49.507615+0000","last_clean":"2024-09-13T19:33:49.507615+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:33:49.507615+0000","last_undegraded":"2024-09-13T19:33:49.507615+0000","last_fullsized":"2024-09-13T19:33:49.507615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.834092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501241+0000","last_change":"2024-09-13T19:33:12.348033+0000","last_active":"2024-09-13T19:33:49.501241+0000","last_peered":"2024-09-13T19:33:49.501241+0000","last_clean":"2024-09-13T19:33:49.501241+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:33:49.501241+0000","last_undegraded":"2024-09-13T19:33:49.501241+0000","last_fullsized":"2024-09-13T19:33:49.501241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:26.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'38","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.503049+0000","last_change":"2024-09-13T19:33:14.366093+0000","last_active":"2024-09-13T19:35:25.503049+0000","last_peered":"2024-09-13T19:35:25.503049+0000","last_clean":"2024-09-13T19:35:25.503049+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:35:25.503049+0000","last_undegraded":"2024-09-13T19:35:25.503049+0000","last_fullsized":"2024-09-13T19:35:25.503049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.379070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":355,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.654764+0000","last_change":"2024-09-13T19:33:16.377299+0000","last_active":"2024-09-13T19:36:24.654764+0000","last_peered":"2024-09-13T19:36:24.654764+0000","last_clean":"2024-09-13T19:36:24.654764+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:36:24.654764+0000","last_undegraded":"2024-09-13T19:36:24.654764+0000","last_fullsized":"2024-09-13T19:36:24.654764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:48.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.894043+0000","last_change":"2024-09-13T19:33:18.416155+0000","last_active":"2024-09-13T19:36:23.894043+0000","last_peered":"2024-09-13T19:36:23.894043+0000","last_clean":"2024-09-13T19:36:23.894043+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:36:23.894043+0000","last_undegraded":"2024-09-13T19:36:23.894043+0000","last_fullsized":"2024-09-13T19:36:23.894043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:28.419736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096247+0000","last_change":"2024-09-13T19:33:10.337441+0000","last_active":"2024-09-13T19:36:24.096247+0000","last_peered":"2024-09-13T19:36:24.096247+0000","last_clean":"2024-09-13T19:36:24.096247+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:36:24.096247+0000","last_undegraded":"2024-09-13T19:36:24.096247+0000","last_fullsized":"2024-09-13T19:36:24.096247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.481677+0000","last_change":"2024-09-13T19:33:49.524748+0000","last_active":"2024-09-13T19:33:50.481677+0000","last_peered":"2024-09-13T19:33:50.481677+0000","last_clean":"2024-09-13T19:33:50.481677+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:33:50.481677+0000","last_undegraded":"2024-09-13T19:33:50.481677+0000","last_fullsized":"2024-09-13T19:33:50.481677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:26.896197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498193+0000","last_change":"2024-09-13T19:33:12.346224+0000","last_active":"2024-09-13T19:33:49.498193+0000","last_peered":"2024-09-13T19:33:49.498193+0000","last_clean":"2024-09-13T19:33:49.498193+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:33:49.498193+0000","last_undegraded":"2024-09-13T19:33:49.498193+0000","last_fullsized":"2024-09-13T19:33:49.498193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:20.747600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'57","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.471175+0000","last_change":"2024-09-13T19:33:14.376236+0000","last_active":"2024-09-13T19:36:55.471175+0000","last_peered":"2024-09-13T19:36:55.471175+0000","last_clean":"2024-09-13T19:36:55.471175+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:36:55.471175+0000","last_undegraded":"2024-09-13T19:36:55.471175+0000","last_fullsized":"2024-09-13T19:36:55.471175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:08.849176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497015+0000","last_change":"2024-09-13T19:33:16.380438+0000","last_active":"2024-09-13T19:33:49.497015+0000","last_peered":"2024-09-13T19:33:49.497015+0000","last_clean":"2024-09-13T19:33:49.497015+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:33:49.497015+0000","last_undegraded":"2024-09-13T19:33:49.497015+0000","last_fullsized":"2024-09-13T19:33:49.497015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:21.949160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.577660+0000","last_change":"2024-09-13T19:33:18.397231+0000","last_active":"2024-09-13T19:36:24.577660+0000","last_peered":"2024-09-13T19:36:24.577660+0000","last_clean":"2024-09-13T19:36:24.577660+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:36:24.577660+0000","last_undegraded":"2024-09-13T19:36:24.577660+0000","last_fullsized":"2024-09-13T19:36:24.577660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:25.940195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749484+0000","last_change":"2024-09-13T19:33:49.534836+0000","last_active":"2024-09-13T19:36:23.749484+0000","last_peered":"2024-09-13T19:36:23.749484+0000","last_clean":"2024-09-13T19:36:23.749484+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:36:23.749484+0000","last_undegraded":"2024-09-13T19:36:23.749484+0000","last_fullsized":"2024-09-13T19:36:23.749484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:46.631431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.680205+0000","last_change":"2024-09-13T19:33:08.332135+0000","last_active":"2024-09-13T19:33:52.680205+0000","last_peered":"2024-09-13T19:33:52.680205+0000","last_clean":"2024-09-13T19:33:52.680205+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:33:52.680205+0000","last_undegraded":"2024-09-13T19:33:52.680205+0000","last_fullsized":"2024-09-13T19:33:52.680205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:27.423338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520294+0000","last_change":"2024-09-13T19:33:12.358273+0000","last_active":"2024-09-13T19:33:49.520294+0000","last_peered":"2024-09-13T19:33:49.520294+0000","last_clean":"2024-09-13T19:33:49.520294+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:33:49.520294+0000","last_undegraded":"2024-09-13T19:33:49.520294+0000","last_fullsized":"2024-09-13T19:33:49.520294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:36.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'34","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503373+0000","last_change":"2024-09-13T19:33:14.364059+0000","last_active":"2024-09-13T19:35:30.503373+0000","last_peered":"2024-09-13T19:35:30.503373+0000","last_clean":"2024-09-13T19:35:30.503373+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:35:30.503373+0000","last_undegraded":"2024-09-13T19:35:30.503373+0000","last_fullsized":"2024-09-13T19:35:30.503373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:22.396286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512534+0000","last_change":"2024-09-13T19:33:16.403943+0000","last_active":"2024-09-13T19:33:49.512534+0000","last_peered":"2024-09-13T19:33:49.512534+0000","last_clean":"2024-09-13T19:33:49.512534+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:33:49.512534+0000","last_undegraded":"2024-09-13T19:33:49.512534+0000","last_fullsized":"2024-09-13T19:33:49.512534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:15.430735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.501955+0000","last_change":"2024-09-13T19:33:18.415707+0000","last_active":"2024-09-13T19:35:20.501955+0000","last_peered":"2024-09-13T19:35:20.501955+0000","last_clean":"2024-09-13T19:35:20.501955+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:35:20.501955+0000","last_undegraded":"2024-09-13T19:35:20.501955+0000","last_fullsized":"2024-09-13T19:35:20.501955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:34.463379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.279120+0000","last_change":"2024-09-13T19:33:10.359068+0000","last_active":"2024-09-13T19:36:24.279120+0000","last_peered":"2024-09-13T19:36:24.279120+0000","last_clean":"2024-09-13T19:36:24.279120+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:36:24.279120+0000","last_undegraded":"2024-09-13T19:36:24.279120+0000","last_fullsized":"2024-09-13T19:36:24.279120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:17.259191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507820+0000","last_change":"2024-09-13T19:33:08.342280+0000","last_active":"2024-09-13T19:33:49.507820+0000","last_peered":"2024-09-13T19:33:49.507820+0000","last_clean":"2024-09-13T19:33:49.507820+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:33:49.507820+0000","last_undegraded":"2024-09-13T19:33:49.507820+0000","last_fullsized":"2024-09-13T19:33:49.507820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:18.144107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501604+0000","last_change":"2024-09-13T19:33:12.348184+0000","last_active":"2024-09-13T19:33:49.501604+0000","last_peered":"2024-09-13T19:33:49.501604+0000","last_clean":"2024-09-13T19:33:49.501604+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:33:49.501604+0000","last_undegraded":"2024-09-13T19:33:49.501604+0000","last_fullsized":"2024-09-13T19:33:49.501604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:34.837586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.524983+0000","last_change":"2024-09-13T19:33:14.354520+0000","last_active":"2024-09-13T19:35:20.524983+0000","last_peered":"2024-09-13T19:35:20.524983+0000","last_clean":"2024-09-13T19:35:20.524983+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:35:20.524983+0000","last_undegraded":"2024-09-13T19:35:20.524983+0000","last_fullsized":"2024-09-13T19:35:20.524983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:18.105050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'284","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.446533+0000","last_change":"2024-09-13T19:33:16.390808+0000","last_active":"2024-09-13T19:36:55.446533+0000","last_peered":"2024-09-13T19:36:55.446533+0000","last_clean":"2024-09-13T19:36:55.446533+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:36:55.446533+0000","last_undegraded":"2024-09-13T19:36:55.446533+0000","last_fullsized":"2024-09-13T19:36:55.446533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:24.410292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.108546+0000","last_change":"2024-09-13T19:33:18.415690+0000","last_active":"2024-09-13T19:36:24.108546+0000","last_peered":"2024-09-13T19:36:24.108546+0000","last_clean":"2024-09-13T19:36:24.108546+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:36:24.108546+0000","last_undegraded":"2024-09-13T19:36:24.108546+0000","last_fullsized":"2024-09-13T19:36:24.108546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.646763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.528476+0000","last_change":"2024-09-13T19:33:10.333244+0000","last_active":"2024-09-13T19:33:49.528476+0000","last_peered":"2024-09-13T19:33:49.528476+0000","last_clean":"2024-09-13T19:33:49.528476+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:33:49.528476+0000","last_undegraded":"2024-09-13T19:33:49.528476+0000","last_fullsized":"2024-09-13T19:33:49.528476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.133553+0000","last_change":"2024-09-13T19:33:08.355262+0000","last_active":"2024-09-13T19:33:54.133553+0000","last_peered":"2024-09-13T19:33:54.133553+0000","last_clean":"2024-09-13T19:33:54.133553+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:33:54.133553+0000","last_undegraded":"2024-09-13T19:33:54.133553+0000","last_fullsized":"2024-09-13T19:33:54.133553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:41.635043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.418808+0000","last_change":"2024-09-13T19:33:12.355832+0000","last_active":"2024-09-13T19:36:55.418808+0000","last_peered":"2024-09-13T19:36:55.418808+0000","last_clean":"2024-09-13T19:36:55.418808+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:36:55.418808+0000","last_undegraded":"2024-09-13T19:36:55.418808+0000","last_fullsized":"2024-09-13T19:36:55.418808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:07.768173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509258+0000","last_change":"2024-09-13T19:33:14.392024+0000","last_active":"2024-09-13T19:33:49.509258+0000","last_peered":"2024-09-13T19:33:49.509258+0000","last_clean":"2024-09-13T19:33:49.509258+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:33:49.509258+0000","last_undegraded":"2024-09-13T19:33:49.509258+0000","last_fullsized":"2024-09-13T19:33:49.509258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:15.449504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'284","reported_seq":462,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.448687+0000","last_change":"2024-09-13T19:33:16.383487+0000","last_active":"2024-09-13T19:36:55.448687+0000","last_peered":"2024-09-13T19:36:55.448687+0000","last_clean":"2024-09-13T19:36:55.448687+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:36:55.448687+0000","last_undegraded":"2024-09-13T19:36:55.448687+0000","last_fullsized":"2024-09-13T19:36:55.448687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.397168+0000","last_change":"2024-09-13T19:33:18.405074+0000","last_active":"2024-09-13T19:35:22.397168+0000","last_peered":"2024-09-13T19:35:22.397168+0000","last_clean":"2024-09-13T19:35:22.397168+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:35:22.397168+0000","last_undegraded":"2024-09-13T19:35:22.397168+0000","last_fullsized":"2024-09-13T19:35:22.397168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:21.165425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278265+0000","last_change":"2024-09-13T19:33:10.351617+0000","last_active":"2024-09-13T19:36:24.278265+0000","last_peered":"2024-09-13T19:36:24.278265+0000","last_clean":"2024-09-13T19:36:24.278265+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:36:24.278265+0000","last_undegraded":"2024-09-13T19:36:24.278265+0000","last_fullsized":"2024-09-13T19:36:24.278265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:31.372401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.266908+0000","last_change":"2024-09-13T19:33:08.341993+0000","last_active":"2024-09-13T19:36:24.266908+0000","last_peered":"2024-09-13T19:36:24.266908+0000","last_clean":"2024-09-13T19:36:24.266908+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:36:24.266908+0000","last_undegraded":"2024-09-13T19:36:24.266908+0000","last_fullsized":"2024-09-13T19:36:24.266908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:50.411658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512635+0000","last_change":"2024-09-13T19:33:12.360435+0000","last_active":"2024-09-13T19:33:49.512635+0000","last_peered":"2024-09-13T19:33:49.512635+0000","last_clean":"2024-09-13T19:33:49.512635+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:33:49.512635+0000","last_undegraded":"2024-09-13T19:33:49.512635+0000","last_fullsized":"2024-09-13T19:33:49.512635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:06.192815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'39","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503321+0000","last_change":"2024-09-13T19:33:14.363402+0000","last_active":"2024-09-13T19:35:30.503321+0000","last_peered":"2024-09-13T19:35:30.503321+0000","last_clean":"2024-09-13T19:35:30.503321+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:35:30.503321+0000","last_undegraded":"2024-09-13T19:35:30.503321+0000","last_fullsized":"2024-09-13T19:35:30.503321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.213821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.519148+0000","last_change":"2024-09-13T19:33:16.392497+0000","last_active":"2024-09-13T19:33:49.519148+0000","last_peered":"2024-09-13T19:33:49.519148+0000","last_clean":"2024-09-13T19:33:49.519148+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:33:49.519148+0000","last_undegraded":"2024-09-13T19:33:49.519148+0000","last_fullsized":"2024-09-13T19:33:49.519148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:08.307092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.381185+0000","last_change":"2024-09-13T19:33:18.409575+0000","last_active":"2024-09-13T19:36:24.381185+0000","last_peered":"2024-09-13T19:36:24.381185+0000","last_clean":"2024-09-13T19:36:24.381185+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:36:24.381185+0000","last_undegraded":"2024-09-13T19:36:24.381185+0000","last_fullsized":"2024-09-13T19:36:24.381185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:03.846914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507876+0000","last_change":"2024-09-13T19:33:10.358838+0000","last_active":"2024-09-13T19:33:49.507876+0000","last_peered":"2024-09-13T19:33:49.507876+0000","last_clean":"2024-09-13T19:33:49.507876+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:33:49.507876+0000","last_undegraded":"2024-09-13T19:33:49.507876+0000","last_fullsized":"2024-09-13T19:33:49.507876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:55.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497900+0000","last_change":"2024-09-13T19:32:57.877961+0000","last_active":"2024-09-13T19:33:49.497900+0000","last_peered":"2024-09-13T19:33:49.497900+0000","last_clean":"2024-09-13T19:33:49.497900+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:33:49.497900+0000","last_undegraded":"2024-09-13T19:33:49.497900+0000","last_fullsized":"2024-09-13T19:33:49.497900+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_clean_scrub_stamp":"2024-09-13T19:32:56.474648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504144+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:33:49.504144+0000","last_peered":"2024-09-13T19:33:49.504144+0000","last_clean":"2024-09-13T19:33:49.504144+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:33:49.504144+0000","last_undegraded":"2024-09-13T19:33:49.504144+0000","last_fullsized":"2024-09-13T19:33:49.504144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:41.432070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505312+0000","last_change":"2024-09-13T19:33:08.353659+0000","last_active":"2024-09-13T19:33:49.505312+0000","last_peered":"2024-09-13T19:33:49.505312+0000","last_clean":"2024-09-13T19:33:49.505312+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:33:49.505312+0000","last_undegraded":"2024-09-13T19:33:49.505312+0000","last_fullsized":"2024-09-13T19:33:49.505312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:40.029223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.526320+0000","last_change":"2024-09-13T19:33:49.523626+0000","last_active":"2024-09-13T19:33:49.526320+0000","last_peered":"2024-09-13T19:33:49.526320+0000","last_clean":"2024-09-13T19:33:49.526320+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:33:49.526320+0000","last_undegraded":"2024-09-13T19:33:49.526320+0000","last_fullsized":"2024-09-13T19:33:49.526320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:00.894619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'79","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.500417+0000","last_change":"2024-09-13T19:33:14.384076+0000","last_active":"2024-09-13T19:36:55.500417+0000","last_peered":"2024-09-13T19:36:55.500417+0000","last_clean":"2024-09-13T19:36:55.500417+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:36:55.500417+0000","last_undegraded":"2024-09-13T19:36:55.500417+0000","last_fullsized":"2024-09-13T19:36:55.500417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:28.403671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502313+0000","last_change":"2024-09-13T19:33:16.378379+0000","last_active":"2024-09-13T19:33:49.502313+0000","last_peered":"2024-09-13T19:33:49.502313+0000","last_clean":"2024-09-13T19:33:49.502313+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:33:49.502313+0000","last_undegraded":"2024-09-13T19:33:49.502313+0000","last_fullsized":"2024-09-13T19:33:49.502313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:10.218765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.306871+0000","last_change":"2024-09-13T19:33:18.410177+0000","last_active":"2024-09-13T19:36:24.306871+0000","last_peered":"2024-09-13T19:36:24.306871+0000","last_clean":"2024-09-13T19:36:24.306871+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:36:24.306871+0000","last_undegraded":"2024-09-13T19:36:24.306871+0000","last_fullsized":"2024-09-13T19:36:24.306871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:27.219574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097115+0000","last_change":"2024-09-13T19:33:49.529179+0000","last_active":"2024-09-13T19:36:24.097115+0000","last_peered":"2024-09-13T19:36:24.097115+0000","last_clean":"2024-09-13T19:36:24.097115+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:36:24.097115+0000","last_undegraded":"2024-09-13T19:36:24.097115+0000","last_fullsized":"2024-09-13T19:36:24.097115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:00.531797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502217+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:33:49.502217+0000","last_peered":"2024-09-13T19:33:49.502217+0000","last_clean":"2024-09-13T19:33:49.502217+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:33:49.502217+0000","last_undegraded":"2024-09-13T19:33:49.502217+0000","last_fullsized":"2024-09-13T19:33:49.502217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.679995+0000","last_change":"2024-09-13T19:33:08.349400+0000","last_active":"2024-09-13T19:33:52.679995+0000","last_peered":"2024-09-13T19:33:52.679995+0000","last_clean":"2024-09-13T19:33:52.679995+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:33:52.679995+0000","last_undegraded":"2024-09-13T19:33:52.679995+0000","last_fullsized":"2024-09-13T19:33:52.679995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517380+0000","last_change":"2024-09-13T19:33:12.348082+0000","last_active":"2024-09-13T19:33:49.517380+0000","last_peered":"2024-09-13T19:33:49.517380+0000","last_clean":"2024-09-13T19:33:49.517380+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:33:49.517380+0000","last_undegraded":"2024-09-13T19:33:49.517380+0000","last_fullsized":"2024-09-13T19:33:49.517380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:26.997175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'277","reported_seq":482,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.488944+0000","last_change":"2024-09-13T19:33:14.367931+0000","last_active":"2024-09-13T19:36:55.488944+0000","last_peered":"2024-09-13T19:36:55.488944+0000","last_clean":"2024-09-13T19:36:55.488944+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:36:55.488944+0000","last_undegraded":"2024-09-13T19:36:55.488944+0000","last_fullsized":"2024-09-13T19:36:55.488944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:56.984417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":360,"num_read_kb":345,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505001+0000","last_change":"2024-09-13T19:33:16.401894+0000","last_active":"2024-09-13T19:33:49.505001+0000","last_peered":"2024-09-13T19:33:49.505001+0000","last_clean":"2024-09-13T19:33:49.505001+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:33:49.505001+0000","last_undegraded":"2024-09-13T19:33:49.505001+0000","last_fullsized":"2024-09-13T19:33:49.505001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.888292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.248196+0000","last_change":"2024-09-13T19:33:18.424198+0000","last_active":"2024-09-13T19:34:37.248196+0000","last_peered":"2024-09-13T19:34:37.248196+0000","last_clean":"2024-09-13T19:34:37.248196+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:34:37.248196+0000","last_undegraded":"2024-09-13T19:34:37.248196+0000","last_fullsized":"2024-09-13T19:34:37.248196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:43.261605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.917935+0000","last_change":"2024-09-13T19:33:10.340098+0000","last_active":"2024-09-13T19:35:22.917935+0000","last_peered":"2024-09-13T19:35:22.917935+0000","last_clean":"2024-09-13T19:35:22.917935+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:35:22.917935+0000","last_undegraded":"2024-09-13T19:35:22.917935+0000","last_fullsized":"2024-09-13T19:35:22.917935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:42.703374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517014+0000","last_change":"2024-09-13T19:33:02.801369+0000","last_active":"2024-09-13T19:33:49.517014+0000","last_peered":"2024-09-13T19:33:49.517014+0000","last_clean":"2024-09-13T19:33:49.517014+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:33:49.517014+0000","last_undegraded":"2024-09-13T19:33:49.517014+0000","last_fullsized":"2024-09-13T19:33:49.517014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:34.016598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.055669+0000","last_change":"2024-09-13T19:33:08.346175+0000","last_active":"2024-09-13T19:36:24.055669+0000","last_peered":"2024-09-13T19:36:24.055669+0000","last_clean":"2024-09-13T19:36:24.055669+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:36:24.055669+0000","last_undegraded":"2024-09-13T19:36:24.055669+0000","last_fullsized":"2024-09-13T19:36:24.055669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.525531+0000","last_change":"2024-09-13T19:33:12.354984+0000","last_active":"2024-09-13T19:33:49.525531+0000","last_peered":"2024-09-13T19:33:49.525531+0000","last_clean":"2024-09-13T19:33:49.525531+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:33:49.525531+0000","last_undegraded":"2024-09-13T19:33:49.525531+0000","last_fullsized":"2024-09-13T19:33:49.525531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:33.380857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.595253+0000","last_change":"2024-09-13T19:33:14.366942+0000","last_active":"2024-09-13T19:36:22.595253+0000","last_peered":"2024-09-13T19:36:22.595253+0000","last_clean":"2024-09-13T19:36:22.595253+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:36:22.595253+0000","last_undegraded":"2024-09-13T19:36:22.595253+0000","last_fullsized":"2024-09-13T19:36:22.595253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:22.408791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498516+0000","last_change":"2024-09-13T19:33:16.375344+0000","last_active":"2024-09-13T19:33:49.498516+0000","last_peered":"2024-09-13T19:33:49.498516+0000","last_clean":"2024-09-13T19:33:49.498516+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:33:49.498516+0000","last_undegraded":"2024-09-13T19:33:49.498516+0000","last_fullsized":"2024-09-13T19:33:49.498516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:03.086305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502961+0000","last_change":"2024-09-13T19:33:18.414878+0000","last_active":"2024-09-13T19:33:49.502961+0000","last_peered":"2024-09-13T19:33:49.502961+0000","last_clean":"2024-09-13T19:33:49.502961+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:33:49.502961+0000","last_undegraded":"2024-09-13T19:33:49.502961+0000","last_fullsized":"2024-09-13T19:33:49.502961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:55.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494504+0000","last_change":"2024-09-13T19:33:10.346530+0000","last_active":"2024-09-13T19:35:14.494504+0000","last_peered":"2024-09-13T19:35:14.494504+0000","last_clean":"2024-09-13T19:35:14.494504+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:35:14.494504+0000","last_undegraded":"2024-09-13T19:35:14.494504+0000","last_fullsized":"2024-09-13T19:35:14.494504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505061+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:33:49.505061+0000","last_peered":"2024-09-13T19:33:49.505061+0000","last_clean":"2024-09-13T19:33:49.505061+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:33:49.505061+0000","last_undegraded":"2024-09-13T19:33:49.505061+0000","last_fullsized":"2024-09-13T19:33:49.505061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:14.144438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.519543+0000","last_change":"2024-09-13T19:33:08.333264+0000","last_active":"2024-09-13T19:33:49.519543+0000","last_peered":"2024-09-13T19:33:49.519543+0000","last_clean":"2024-09-13T19:33:49.519543+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:33:49.519543+0000","last_undegraded":"2024-09-13T19:33:49.519543+0000","last_fullsized":"2024-09-13T19:33:49.519543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:49.017180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501407+0000","last_change":"2024-09-13T19:33:12.353699+0000","last_active":"2024-09-13T19:33:49.501407+0000","last_peered":"2024-09-13T19:33:49.501407+0000","last_clean":"2024-09-13T19:33:49.501407+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:33:49.501407+0000","last_undegraded":"2024-09-13T19:33:49.501407+0000","last_fullsized":"2024-09-13T19:33:49.501407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.424221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.961527+0000","last_change":"2024-09-13T19:33:14.392626+0000","last_active":"2024-09-13T19:36:22.961527+0000","last_peered":"2024-09-13T19:36:22.961527+0000","last_clean":"2024-09-13T19:36:22.961527+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:36:22.961527+0000","last_undegraded":"2024-09-13T19:36:22.961527+0000","last_fullsized":"2024-09-13T19:36:22.961527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:39.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512753+0000","last_change":"2024-09-13T19:33:16.402476+0000","last_active":"2024-09-13T19:33:49.512753+0000","last_peered":"2024-09-13T19:33:49.512753+0000","last_clean":"2024-09-13T19:33:49.512753+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:33:49.512753+0000","last_undegraded":"2024-09-13T19:33:49.512753+0000","last_fullsized":"2024-09-13T19:33:49.512753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:05.574640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.443488+0000","last_change":"2024-09-13T19:33:18.418222+0000","last_active":"2024-09-13T19:36:24.443488+0000","last_peered":"2024-09-13T19:36:24.443488+0000","last_clean":"2024-09-13T19:36:24.443488+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:36:24.443488+0000","last_undegraded":"2024-09-13T19:36:24.443488+0000","last_fullsized":"2024-09-13T19:36:24.443488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:20.302502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096257+0000","last_change":"2024-09-13T19:33:10.357857+0000","last_active":"2024-09-13T19:36:24.096257+0000","last_peered":"2024-09-13T19:36:24.096257+0000","last_clean":"2024-09-13T19:36:24.096257+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:36:24.096257+0000","last_undegraded":"2024-09-13T19:36:24.096257+0000","last_fullsized":"2024-09-13T19:36:24.096257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:17.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521202+0000","last_change":"2024-09-13T19:33:08.332236+0000","last_active":"2024-09-13T19:33:49.521202+0000","last_peered":"2024-09-13T19:33:49.521202+0000","last_clean":"2024-09-13T19:33:49.521202+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:33:49.521202+0000","last_undegraded":"2024-09-13T19:33:49.521202+0000","last_fullsized":"2024-09-13T19:33:49.521202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498362+0000","last_change":"2024-09-13T19:33:02.523552+0000","last_active":"2024-09-13T19:33:49.498362+0000","last_peered":"2024-09-13T19:33:49.498362+0000","last_clean":"2024-09-13T19:33:49.498362+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:33:49.498362+0000","last_undegraded":"2024-09-13T19:33:49.498362+0000","last_fullsized":"2024-09-13T19:33:49.498362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:43.683067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495504+0000","last_change":"2024-09-13T19:33:12.354235+0000","last_active":"2024-09-13T19:35:19.495504+0000","last_peered":"2024-09-13T19:35:19.495504+0000","last_clean":"2024-09-13T19:35:19.495504+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:35:19.495504+0000","last_undegraded":"2024-09-13T19:35:19.495504+0000","last_fullsized":"2024-09-13T19:35:19.495504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:16.801145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.522986+0000","last_change":"2024-09-13T19:33:14.353733+0000","last_active":"2024-09-13T19:35:20.522986+0000","last_peered":"2024-09-13T19:35:20.522986+0000","last_clean":"2024-09-13T19:35:20.522986+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:35:20.522986+0000","last_undegraded":"2024-09-13T19:35:20.522986+0000","last_fullsized":"2024-09-13T19:35:20.522986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:18.941301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517438+0000","last_change":"2024-09-13T19:33:16.390734+0000","last_active":"2024-09-13T19:33:49.517438+0000","last_peered":"2024-09-13T19:33:49.517438+0000","last_clean":"2024-09-13T19:33:49.517438+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:33:49.517438+0000","last_undegraded":"2024-09-13T19:33:49.517438+0000","last_fullsized":"2024-09-13T19:33:49.517438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:54.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.771290+0000","last_change":"2024-09-13T19:33:18.401696+0000","last_active":"2024-09-13T19:35:22.771290+0000","last_peered":"2024-09-13T19:35:22.771290+0000","last_clean":"2024-09-13T19:35:22.771290+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:35:22.771290+0000","last_undegraded":"2024-09-13T19:35:22.771290+0000","last_fullsized":"2024-09-13T19:35:22.771290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:36.732554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.904012+0000","last_change":"2024-09-13T19:33:10.356809+0000","last_active":"2024-09-13T19:36:23.904012+0000","last_peered":"2024-09-13T19:36:23.904012+0000","last_clean":"2024-09-13T19:36:23.904012+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:36:23.904012+0000","last_undegraded":"2024-09-13T19:36:23.904012+0000","last_fullsized":"2024-09-13T19:36:23.904012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:44.333778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498820+0000","last_change":"2024-09-13T19:33:08.345805+0000","last_active":"2024-09-13T19:33:49.498820+0000","last_peered":"2024-09-13T19:33:49.498820+0000","last_clean":"2024-09-13T19:33:49.498820+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:33:49.498820+0000","last_undegraded":"2024-09-13T19:33:49.498820+0000","last_fullsized":"2024-09-13T19:33:49.498820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:59.536117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506699+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:33:49.506699+0000","last_peered":"2024-09-13T19:33:49.506699+0000","last_clean":"2024-09-13T19:33:49.506699+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:33:49.506699+0000","last_undegraded":"2024-09-13T19:33:49.506699+0000","last_fullsized":"2024-09-13T19:33:49.506699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:56.316476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505857+0000","last_change":"2024-09-13T19:33:12.356344+0000","last_active":"2024-09-13T19:33:49.505857+0000","last_peered":"2024-09-13T19:33:49.505857+0000","last_clean":"2024-09-13T19:33:49.505857+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:33:49.505857+0000","last_undegraded":"2024-09-13T19:33:49.505857+0000","last_fullsized":"2024-09-13T19:33:49.505857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:55.513441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500452+0000","last_change":"2024-09-13T19:33:14.368032+0000","last_active":"2024-09-13T19:35:20.500452+0000","last_peered":"2024-09-13T19:35:20.500452+0000","last_clean":"2024-09-13T19:35:20.500452+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:35:20.500452+0000","last_undegraded":"2024-09-13T19:35:20.500452+0000","last_fullsized":"2024-09-13T19:35:20.500452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:52.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'284","reported_seq":377,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.442134+0000","last_change":"2024-09-13T19:33:16.386778+0000","last_active":"2024-09-13T19:36:55.442134+0000","last_peered":"2024-09-13T19:36:55.442134+0000","last_clean":"2024-09-13T19:36:55.442134+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:55.442134+0000","last_undegraded":"2024-09-13T19:36:55.442134+0000","last_fullsized":"2024-09-13T19:36:55.442134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:06.811103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.518471+0000","last_change":"2024-09-13T19:33:18.410958+0000","last_active":"2024-09-13T19:34:37.518471+0000","last_peered":"2024-09-13T19:34:37.518471+0000","last_clean":"2024-09-13T19:34:37.518471+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:34:37.518471+0000","last_undegraded":"2024-09-13T19:34:37.518471+0000","last_fullsized":"2024-09-13T19:34:37.518471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:58.474286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.169685+0000","last_change":"2024-09-13T19:33:10.352017+0000","last_active":"2024-09-13T19:33:54.169685+0000","last_peered":"2024-09-13T19:33:54.169685+0000","last_clean":"2024-09-13T19:33:54.169685+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:33:54.169685+0000","last_undegraded":"2024-09-13T19:33:54.169685+0000","last_fullsized":"2024-09-13T19:33:54.169685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:06.912280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515639+0000","last_change":"2024-09-13T19:33:08.335852+0000","last_active":"2024-09-13T19:33:49.515639+0000","last_peered":"2024-09-13T19:33:49.515639+0000","last_clean":"2024-09-13T19:33:49.515639+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:33:49.515639+0000","last_undegraded":"2024-09-13T19:33:49.515639+0000","last_fullsized":"2024-09-13T19:33:49.515639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:15.529632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500973+0000","last_change":"2024-09-13T19:33:02.523653+0000","last_active":"2024-09-13T19:33:49.500973+0000","last_peered":"2024-09-13T19:33:49.500973+0000","last_clean":"2024-09-13T19:33:49.500973+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:33:49.500973+0000","last_undegraded":"2024-09-13T19:33:49.500973+0000","last_fullsized":"2024-09-13T19:33:49.500973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:42.749511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508088+0000","last_change":"2024-09-13T19:33:12.358233+0000","last_active":"2024-09-13T19:33:49.508088+0000","last_peered":"2024-09-13T19:33:49.508088+0000","last_clean":"2024-09-13T19:33:49.508088+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:33:49.508088+0000","last_undegraded":"2024-09-13T19:33:49.508088+0000","last_fullsized":"2024-09-13T19:33:49.508088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:59.060355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507097+0000","last_change":"2024-09-13T19:33:14.384476+0000","last_active":"2024-09-13T19:33:49.507097+0000","last_peered":"2024-09-13T19:33:49.507097+0000","last_clean":"2024-09-13T19:33:49.507097+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:33:49.507097+0000","last_undegraded":"2024-09-13T19:33:49.507097+0000","last_fullsized":"2024-09-13T19:33:49.507097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:32.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.579499+0000","last_change":"2024-09-13T19:33:16.372856+0000","last_active":"2024-09-13T19:36:24.579499+0000","last_peered":"2024-09-13T19:36:24.579499+0000","last_clean":"2024-09-13T19:36:24.579499+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:36:24.579499+0000","last_undegraded":"2024-09-13T19:36:24.579499+0000","last_fullsized":"2024-09-13T19:36:24.579499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:12.613117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508863+0000","last_change":"2024-09-13T19:33:18.412059+0000","last_active":"2024-09-13T19:33:49.508863+0000","last_peered":"2024-09-13T19:33:49.508863+0000","last_clean":"2024-09-13T19:33:49.508863+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:33:49.508863+0000","last_undegraded":"2024-09-13T19:33:49.508863+0000","last_fullsized":"2024-09-13T19:33:49.508863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:52.237012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278402+0000","last_change":"2024-09-13T19:33:10.344169+0000","last_active":"2024-09-13T19:36:24.278402+0000","last_peered":"2024-09-13T19:36:24.278402+0000","last_clean":"2024-09-13T19:36:24.278402+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:36:24.278402+0000","last_undegraded":"2024-09-13T19:36:24.278402+0000","last_fullsized":"2024-09-13T19:36:24.278402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.076994+0000","last_change":"2024-09-13T19:33:08.354348+0000","last_active":"2024-09-13T19:36:24.076994+0000","last_peered":"2024-09-13T19:36:24.076994+0000","last_clean":"2024-09-13T19:36:24.076994+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:36:24.076994+0000","last_undegraded":"2024-09-13T19:36:24.076994+0000","last_fullsized":"2024-09-13T19:36:24.076994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512982+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:33:49.512982+0000","last_peered":"2024-09-13T19:33:49.512982+0000","last_clean":"2024-09-13T19:33:49.512982+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:33:49.512982+0000","last_undegraded":"2024-09-13T19:33:49.512982+0000","last_fullsized":"2024-09-13T19:33:49.512982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:46.024868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506376+0000","last_change":"2024-09-13T19:33:12.347595+0000","last_active":"2024-09-13T19:33:49.506376+0000","last_peered":"2024-09-13T19:33:49.506376+0000","last_clean":"2024-09-13T19:33:49.506376+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:33:49.506376+0000","last_undegraded":"2024-09-13T19:33:49.506376+0000","last_fullsized":"2024-09-13T19:33:49.506376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:04.841484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'86","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.480947+0000","last_change":"2024-09-13T19:33:14.370958+0000","last_active":"2024-09-13T19:36:55.480947+0000","last_peered":"2024-09-13T19:36:55.480947+0000","last_clean":"2024-09-13T19:36:55.480947+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:36:55.480947+0000","last_undegraded":"2024-09-13T19:36:55.480947+0000","last_fullsized":"2024-09-13T19:36:55.480947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:28.457253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497560+0000","last_change":"2024-09-13T19:33:16.370368+0000","last_active":"2024-09-13T19:33:49.497560+0000","last_peered":"2024-09-13T19:33:49.497560+0000","last_clean":"2024-09-13T19:33:49.497560+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:33:49.497560+0000","last_undegraded":"2024-09-13T19:33:49.497560+0000","last_fullsized":"2024-09-13T19:33:49.497560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:59.539391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.238791+0000","last_change":"2024-09-13T19:33:18.418007+0000","last_active":"2024-09-13T19:34:37.238791+0000","last_peered":"2024-09-13T19:34:37.238791+0000","last_clean":"2024-09-13T19:34:37.238791+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:34:37.238791+0000","last_undegraded":"2024-09-13T19:34:37.238791+0000","last_fullsized":"2024-09-13T19:34:37.238791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:26.651502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523204+0000","last_change":"2024-09-13T19:33:18.416636+0000","last_active":"2024-09-13T19:33:49.523204+0000","last_peered":"2024-09-13T19:33:49.523204+0000","last_clean":"2024-09-13T19:33:49.523204+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:33:49.523204+0000","last_undegraded":"2024-09-13T19:33:49.523204+0000","last_fullsized":"2024-09-13T19:33:49.523204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.954769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207651+0000","last_change":"2024-09-13T19:33:10.337290+0000","last_active":"2024-09-13T19:36:24.207651+0000","last_peered":"2024-09-13T19:36:24.207651+0000","last_clean":"2024-09-13T19:36:24.207651+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:36:24.207651+0000","last_undegraded":"2024-09-13T19:36:24.207651+0000","last_fullsized":"2024-09-13T19:36:24.207651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:03.258150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.069994+0000","last_change":"2024-09-13T19:33:08.354023+0000","last_active":"2024-09-13T19:36:24.069994+0000","last_peered":"2024-09-13T19:36:24.069994+0000","last_clean":"2024-09-13T19:36:24.069994+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:36:24.069994+0000","last_undegraded":"2024-09-13T19:36:24.069994+0000","last_fullsized":"2024-09-13T19:36:24.069994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:12.440984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500090+0000","last_change":"2024-09-13T19:33:12.349684+0000","last_active":"2024-09-13T19:33:49.500090+0000","last_peered":"2024-09-13T19:33:49.500090+0000","last_clean":"2024-09-13T19:33:49.500090+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:33:49.500090+0000","last_undegraded":"2024-09-13T19:33:49.500090+0000","last_fullsized":"2024-09-13T19:33:49.500090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:33.654140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505771+0000","last_change":"2024-09-13T19:33:14.379538+0000","last_active":"2024-09-13T19:35:35.505771+0000","last_peered":"2024-09-13T19:35:35.505771+0000","last_clean":"2024-09-13T19:35:35.505771+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:35:35.505771+0000","last_undegraded":"2024-09-13T19:35:35.505771+0000","last_fullsized":"2024-09-13T19:35:35.505771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:57.484464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505865+0000","last_change":"2024-09-13T19:33:16.403644+0000","last_active":"2024-09-13T19:33:49.505865+0000","last_peered":"2024-09-13T19:33:49.505865+0000","last_clean":"2024-09-13T19:33:49.505865+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:33:49.505865+0000","last_undegraded":"2024-09-13T19:33:49.505865+0000","last_fullsized":"2024-09-13T19:33:49.505865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:05.807775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.182480+0000","last_change":"2024-09-13T19:33:18.396968+0000","last_active":"2024-09-13T19:36:23.182480+0000","last_peered":"2024-09-13T19:36:23.182480+0000","last_clean":"2024-09-13T19:36:23.182480+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:36:23.182480+0000","last_undegraded":"2024-09-13T19:36:23.182480+0000","last_fullsized":"2024-09-13T19:36:23.182480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:01.306267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.193661+0000","last_change":"2024-09-13T19:33:10.357927+0000","last_active":"2024-09-13T19:35:18.193661+0000","last_peered":"2024-09-13T19:35:18.193661+0000","last_clean":"2024-09-13T19:35:18.193661+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:35:18.193661+0000","last_undegraded":"2024-09-13T19:35:18.193661+0000","last_fullsized":"2024-09-13T19:35:18.193661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:43.220677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520659+0000","last_change":"2024-09-13T19:33:08.353099+0000","last_active":"2024-09-13T19:33:49.520659+0000","last_peered":"2024-09-13T19:33:49.520659+0000","last_clean":"2024-09-13T19:33:49.520659+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:33:49.520659+0000","last_undegraded":"2024-09-13T19:33:49.520659+0000","last_fullsized":"2024-09-13T19:33:49.520659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.532442+0000","last_change":"2024-09-13T19:33:49.530881+0000","last_active":"2024-09-13T19:33:49.532442+0000","last_peered":"2024-09-13T19:33:49.532442+0000","last_clean":"2024-09-13T19:33:49.532442+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:33:49.532442+0000","last_undegraded":"2024-09-13T19:33:49.532442+0000","last_fullsized":"2024-09-13T19:33:49.532442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:24.807153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.971351+0000","last_change":"2024-09-13T19:33:14.354248+0000","last_active":"2024-09-13T19:36:22.971351+0000","last_peered":"2024-09-13T19:36:22.971351+0000","last_clean":"2024-09-13T19:36:22.971351+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:36:22.971351+0000","last_undegraded":"2024-09-13T19:36:22.971351+0000","last_fullsized":"2024-09-13T19:36:22.971351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:10.093199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517061+0000","last_change":"2024-09-13T19:33:16.382753+0000","last_active":"2024-09-13T19:33:49.517061+0000","last_peered":"2024-09-13T19:33:49.517061+0000","last_clean":"2024-09-13T19:33:49.517061+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:33:49.517061+0000","last_undegraded":"2024-09-13T19:33:49.517061+0000","last_fullsized":"2024-09-13T19:33:49.517061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:25.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498717+0000","last_change":"2024-09-13T19:33:18.415711+0000","last_active":"2024-09-13T19:33:49.498717+0000","last_peered":"2024-09-13T19:33:49.498717+0000","last_clean":"2024-09-13T19:33:49.498717+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:33:49.498717+0000","last_undegraded":"2024-09-13T19:33:49.498717+0000","last_fullsized":"2024-09-13T19:33:49.498717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:51.214164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097438+0000","last_change":"2024-09-13T19:33:10.340323+0000","last_active":"2024-09-13T19:36:24.097438+0000","last_peered":"2024-09-13T19:36:24.097438+0000","last_clean":"2024-09-13T19:36:24.097438+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:36:24.097438+0000","last_undegraded":"2024-09-13T19:36:24.097438+0000","last_fullsized":"2024-09-13T19:36:24.097438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.062661+0000","last_change":"2024-09-13T19:33:08.350962+0000","last_active":"2024-09-13T19:36:24.062661+0000","last_peered":"2024-09-13T19:36:24.062661+0000","last_clean":"2024-09-13T19:36:24.062661+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:36:24.062661+0000","last_undegraded":"2024-09-13T19:36:24.062661+0000","last_fullsized":"2024-09-13T19:36:24.062661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:33.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509563+0000","last_change":"2024-09-13T19:33:12.355722+0000","last_active":"2024-09-13T19:33:49.509563+0000","last_peered":"2024-09-13T19:33:49.509563+0000","last_clean":"2024-09-13T19:33:49.509563+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:33:49.509563+0000","last_undegraded":"2024-09-13T19:33:49.509563+0000","last_fullsized":"2024-09-13T19:33:49.509563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:44.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.126165+0000","last_change":"2024-09-13T19:33:14.361694+0000","last_active":"2024-09-13T19:36:23.126165+0000","last_peered":"2024-09-13T19:36:23.126165+0000","last_clean":"2024-09-13T19:36:23.126165+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:36:23.126165+0000","last_undegraded":"2024-09-13T19:36:23.126165+0000","last_fullsized":"2024-09-13T19:36:23.126165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:23.587634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499270+0000","last_change":"2024-09-13T19:33:16.374728+0000","last_active":"2024-09-13T19:33:49.499270+0000","last_peered":"2024-09-13T19:33:49.499270+0000","last_clean":"2024-09-13T19:33:49.499270+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:33:49.499270+0000","last_undegraded":"2024-09-13T19:33:49.499270+0000","last_fullsized":"2024-09-13T19:33:49.499270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:25.206149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508285+0000","last_change":"2024-09-13T19:33:18.420341+0000","last_active":"2024-09-13T19:33:49.508285+0000","last_peered":"2024-09-13T19:33:49.508285+0000","last_clean":"2024-09-13T19:33:49.508285+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:33:49.508285+0000","last_undegraded":"2024-09-13T19:33:49.508285+0000","last_fullsized":"2024-09-13T19:33:49.508285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:37.478476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278224+0000","last_change":"2024-09-13T19:33:10.348981+0000","last_active":"2024-09-13T19:36:24.278224+0000","last_peered":"2024-09-13T19:36:24.278224+0000","last_clean":"2024-09-13T19:36:24.278224+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:36:24.278224+0000","last_undegraded":"2024-09-13T19:36:24.278224+0000","last_fullsized":"2024-09-13T19:36:24.278224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:31.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.141217+0000","last_change":"2024-09-13T19:33:49.519345+0000","last_active":"2024-09-13T19:33:54.141217+0000","last_peered":"2024-09-13T19:33:54.141217+0000","last_clean":"2024-09-13T19:33:54.141217+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:33:54.141217+0000","last_undegraded":"2024-09-13T19:33:54.141217+0000","last_fullsized":"2024-09-13T19:33:54.141217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:09.643503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508299+0000","last_change":"2024-09-13T19:33:12.363653+0000","last_active":"2024-09-13T19:33:49.508299+0000","last_peered":"2024-09-13T19:33:49.508299+0000","last_clean":"2024-09-13T19:33:49.508299+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:33:49.508299+0000","last_undegraded":"2024-09-13T19:33:49.508299+0000","last_fullsized":"2024-09-13T19:33:49.508299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:53.868774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.502431+0000","last_change":"2024-09-13T19:33:14.358901+0000","last_active":"2024-09-13T19:35:35.502431+0000","last_peered":"2024-09-13T19:35:35.502431+0000","last_clean":"2024-09-13T19:35:35.502431+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:35:35.502431+0000","last_undegraded":"2024-09-13T19:35:35.502431+0000","last_fullsized":"2024-09-13T19:35:35.502431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.849530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521295+0000","last_change":"2024-09-13T19:33:16.384121+0000","last_active":"2024-09-13T19:33:49.521295+0000","last_peered":"2024-09-13T19:33:49.521295+0000","last_clean":"2024-09-13T19:33:49.521295+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:33:49.521295+0000","last_undegraded":"2024-09-13T19:33:49.521295+0000","last_fullsized":"2024-09-13T19:33:49.521295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:31.796586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207342+0000","last_change":"2024-09-13T19:33:10.355217+0000","last_active":"2024-09-13T19:36:24.207342+0000","last_peered":"2024-09-13T19:36:24.207342+0000","last_clean":"2024-09-13T19:36:24.207342+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:36:24.207342+0000","last_undegraded":"2024-09-13T19:36:24.207342+0000","last_fullsized":"2024-09-13T19:36:24.207342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:25.762180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.136723+0000","last_change":"2024-09-13T19:33:08.338446+0000","last_active":"2024-09-13T19:33:54.136723+0000","last_peered":"2024-09-13T19:33:54.136723+0000","last_clean":"2024-09-13T19:33:54.136723+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:33:54.136723+0000","last_undegraded":"2024-09-13T19:33:54.136723+0000","last_fullsized":"2024-09-13T19:33:54.136723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502145+0000","last_change":"2024-09-13T19:33:12.353907+0000","last_active":"2024-09-13T19:33:49.502145+0000","last_peered":"2024-09-13T19:33:49.502145+0000","last_clean":"2024-09-13T19:33:49.502145+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:33:49.502145+0000","last_undegraded":"2024-09-13T19:33:49.502145+0000","last_fullsized":"2024-09-13T19:33:49.502145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.757540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'56","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:44.501765+0000","last_change":"2024-09-13T19:33:14.353619+0000","last_active":"2024-09-13T19:35:44.501765+0000","last_peered":"2024-09-13T19:35:44.501765+0000","last_clean":"2024-09-13T19:35:44.501765+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:35:44.501765+0000","last_undegraded":"2024-09-13T19:35:44.501765+0000","last_fullsized":"2024-09-13T19:35:44.501765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:06.293086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5917,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523366+0000","last_change":"2024-09-13T19:33:16.391786+0000","last_active":"2024-09-13T19:33:49.523366+0000","last_peered":"2024-09-13T19:33:49.523366+0000","last_clean":"2024-09-13T19:33:49.523366+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:33:49.523366+0000","last_undegraded":"2024-09-13T19:33:49.523366+0000","last_fullsized":"2024-09-13T19:33:49.523366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:58.998423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.761517+0000","last_change":"2024-09-13T19:33:18.415632+0000","last_active":"2024-09-13T19:35:22.761517+0000","last_peered":"2024-09-13T19:35:22.761517+0000","last_clean":"2024-09-13T19:35:22.761517+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:35:22.761517+0000","last_undegraded":"2024-09-13T19:35:22.761517+0000","last_fullsized":"2024-09-13T19:35:22.761517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:21.406501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:09.493298+0000","last_change":"2024-09-13T19:33:10.348428+0000","last_active":"2024-09-13T19:35:09.493298+0000","last_peered":"2024-09-13T19:35:09.493298+0000","last_clean":"2024-09-13T19:35:09.493298+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:35:09.493298+0000","last_undegraded":"2024-09-13T19:35:09.493298+0000","last_fullsized":"2024-09-13T19:35:09.493298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498512+0000","last_change":"2024-09-13T19:33:08.337364+0000","last_active":"2024-09-13T19:33:49.498512+0000","last_peered":"2024-09-13T19:33:49.498512+0000","last_clean":"2024-09-13T19:33:49.498512+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:33:49.498512+0000","last_undegraded":"2024-09-13T19:33:49.498512+0000","last_fullsized":"2024-09-13T19:33:49.498512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:58.350998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524310+0000","last_change":"2024-09-13T19:33:12.351793+0000","last_active":"2024-09-13T19:33:49.524310+0000","last_peered":"2024-09-13T19:33:49.524310+0000","last_clean":"2024-09-13T19:33:49.524310+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:33:49.524310+0000","last_undegraded":"2024-09-13T19:33:49.524310+0000","last_fullsized":"2024-09-13T19:33:49.524310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:00.497212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509046+0000","last_change":"2024-09-13T19:33:14.386801+0000","last_active":"2024-09-13T19:35:45.509046+0000","last_peered":"2024-09-13T19:35:45.509046+0000","last_clean":"2024-09-13T19:35:45.509046+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:35:45.509046+0000","last_undegraded":"2024-09-13T19:35:45.509046+0000","last_fullsized":"2024-09-13T19:35:45.509046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:50.651830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507072+0000","last_change":"2024-09-13T19:33:16.382777+0000","last_active":"2024-09-13T19:33:49.507072+0000","last_peered":"2024-09-13T19:33:49.507072+0000","last_clean":"2024-09-13T19:33:49.507072+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:33:49.507072+0000","last_undegraded":"2024-09-13T19:33:49.507072+0000","last_fullsized":"2024-09-13T19:33:49.507072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:40.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504119+0000","last_change":"2024-09-13T19:33:18.415435+0000","last_active":"2024-09-13T19:33:49.504119+0000","last_peered":"2024-09-13T19:33:49.504119+0000","last_clean":"2024-09-13T19:33:49.504119+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:33:49.504119+0000","last_undegraded":"2024-09-13T19:33:49.504119+0000","last_fullsized":"2024-09-13T19:33:49.504119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:23.857746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278836+0000","last_change":"2024-09-13T19:33:10.358856+0000","last_active":"2024-09-13T19:36:24.278836+0000","last_peered":"2024-09-13T19:36:24.278836+0000","last_clean":"2024-09-13T19:36:24.278836+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:36:24.278836+0000","last_undegraded":"2024-09-13T19:36:24.278836+0000","last_fullsized":"2024-09-13T19:36:24.278836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:44.732919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.685544+0000","last_change":"2024-09-13T19:33:08.335612+0000","last_active":"2024-09-13T19:33:52.685544+0000","last_peered":"2024-09-13T19:33:52.685544+0000","last_clean":"2024-09-13T19:33:52.685544+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:33:52.685544+0000","last_undegraded":"2024-09-13T19:33:52.685544+0000","last_fullsized":"2024-09-13T19:33:52.685544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:38.936603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520491+0000","last_change":"2024-09-13T19:33:12.352113+0000","last_active":"2024-09-13T19:33:49.520491+0000","last_peered":"2024-09-13T19:33:49.520491+0000","last_clean":"2024-09-13T19:33:49.520491+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:33:49.520491+0000","last_undegraded":"2024-09-13T19:33:49.520491+0000","last_fullsized":"2024-09-13T19:33:49.520491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:17.673522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.066179+0000","last_change":"2024-09-13T19:33:14.356847+0000","last_active":"2024-09-13T19:35:20.066179+0000","last_peered":"2024-09-13T19:35:20.066179+0000","last_clean":"2024-09-13T19:35:20.066179+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:35:20.066179+0000","last_undegraded":"2024-09-13T19:35:20.066179+0000","last_fullsized":"2024-09-13T19:35:20.066179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:52.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500909+0000","last_change":"2024-09-13T19:33:16.391926+0000","last_active":"2024-09-13T19:33:49.500909+0000","last_peered":"2024-09-13T19:33:49.500909+0000","last_clean":"2024-09-13T19:33:49.500909+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:33:49.500909+0000","last_undegraded":"2024-09-13T19:33:49.500909+0000","last_fullsized":"2024-09-13T19:33:49.500909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:40.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.922899+0000","last_change":"2024-09-13T19:33:18.414176+0000","last_active":"2024-09-13T19:35:22.922899+0000","last_peered":"2024-09-13T19:35:22.922899+0000","last_clean":"2024-09-13T19:35:22.922899+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:35:22.922899+0000","last_undegraded":"2024-09-13T19:35:22.922899+0000","last_fullsized":"2024-09-13T19:35:22.922899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:28.941440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.887347+0000","last_change":"2024-09-13T19:33:10.347270+0000","last_active":"2024-09-13T19:36:23.887347+0000","last_peered":"2024-09-13T19:36:23.887347+0000","last_clean":"2024-09-13T19:36:23.887347+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:36:23.887347+0000","last_undegraded":"2024-09-13T19:36:23.887347+0000","last_fullsized":"2024-09-13T19:36:23.887347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:44.333778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507379+0000","last_change":"2024-09-13T19:33:08.340688+0000","last_active":"2024-09-13T19:35:40.507379+0000","last_peered":"2024-09-13T19:35:40.507379+0000","last_clean":"2024-09-13T19:35:40.507379+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:35:40.507379+0000","last_undegraded":"2024-09-13T19:35:40.507379+0000","last_fullsized":"2024-09-13T19:35:40.507379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:11.675646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":13,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506437+0000","last_change":"2024-09-13T19:33:12.349199+0000","last_active":"2024-09-13T19:33:49.506437+0000","last_peered":"2024-09-13T19:33:49.506437+0000","last_clean":"2024-09-13T19:33:49.506437+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:33:49.506437+0000","last_undegraded":"2024-09-13T19:33:49.506437+0000","last_fullsized":"2024-09-13T19:33:49.506437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:52.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513690+0000","last_change":"2024-09-13T19:33:14.391400+0000","last_active":"2024-09-13T19:33:49.513690+0000","last_peered":"2024-09-13T19:33:49.513690+0000","last_clean":"2024-09-13T19:33:49.513690+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:33:49.513690+0000","last_undegraded":"2024-09-13T19:33:49.513690+0000","last_fullsized":"2024-09-13T19:33:49.513690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:31.131591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'284","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.439828+0000","last_change":"2024-09-13T19:33:16.382339+0000","last_active":"2024-09-13T19:36:55.439828+0000","last_peered":"2024-09-13T19:36:55.439828+0000","last_clean":"2024-09-13T19:36:55.439828+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:36:55.439828+0000","last_undegraded":"2024-09-13T19:36:55.439828+0000","last_fullsized":"2024-09-13T19:36:55.439828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:01.227827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503374+0000","last_change":"2024-09-13T19:33:18.419381+0000","last_active":"2024-09-13T19:33:49.503374+0000","last_peered":"2024-09-13T19:33:49.503374+0000","last_clean":"2024-09-13T19:33:49.503374+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:33:49.503374+0000","last_undegraded":"2024-09-13T19:33:49.503374+0000","last_fullsized":"2024-09-13T19:33:49.503374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:08.781086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207878+0000","last_change":"2024-09-13T19:33:10.336681+0000","last_active":"2024-09-13T19:36:24.207878+0000","last_peered":"2024-09-13T19:36:24.207878+0000","last_clean":"2024-09-13T19:36:24.207878+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:36:24.207878+0000","last_undegraded":"2024-09-13T19:36:24.207878+0000","last_fullsized":"2024-09-13T19:36:24.207878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:14.226586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509233+0000","last_change":"2024-09-13T19:33:08.338096+0000","last_active":"2024-09-13T19:33:49.509233+0000","last_peered":"2024-09-13T19:33:49.509233+0000","last_clean":"2024-09-13T19:33:49.509233+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:33:49.509233+0000","last_undegraded":"2024-09-13T19:33:49.509233+0000","last_fullsized":"2024-09-13T19:33:49.509233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502590+0000","last_change":"2024-09-13T19:33:12.353110+0000","last_active":"2024-09-13T19:33:49.502590+0000","last_peered":"2024-09-13T19:33:49.502590+0000","last_clean":"2024-09-13T19:33:49.502590+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:33:49.502590+0000","last_undegraded":"2024-09-13T19:33:49.502590+0000","last_fullsized":"2024-09-13T19:33:49.502590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.757540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.505665+0000","last_change":"2024-09-13T19:33:14.366141+0000","last_active":"2024-09-13T19:35:40.505665+0000","last_peered":"2024-09-13T19:35:40.505665+0000","last_clean":"2024-09-13T19:35:40.505665+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:35:40.505665+0000","last_undegraded":"2024-09-13T19:35:40.505665+0000","last_fullsized":"2024-09-13T19:35:40.505665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:29.782580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495241+0000","last_change":"2024-09-13T19:33:16.375274+0000","last_active":"2024-09-13T19:33:49.495241+0000","last_peered":"2024-09-13T19:33:49.495241+0000","last_clean":"2024-09-13T19:33:49.495241+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:33:49.495241+0000","last_undegraded":"2024-09-13T19:33:49.495241+0000","last_fullsized":"2024-09-13T19:33:49.495241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510248+0000","last_change":"2024-09-13T19:33:18.425299+0000","last_active":"2024-09-13T19:33:49.510248+0000","last_peered":"2024-09-13T19:33:49.510248+0000","last_clean":"2024-09-13T19:33:49.510248+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:33:49.510248+0000","last_undegraded":"2024-09-13T19:33:49.510248+0000","last_fullsized":"2024-09-13T19:33:49.510248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:13:57.374815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503532+0000","last_change":"2024-09-13T19:33:10.344066+0000","last_active":"2024-09-13T19:35:40.503532+0000","last_peered":"2024-09-13T19:35:40.503532+0000","last_clean":"2024-09-13T19:35:40.503532+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:35:40.503532+0000","last_undegraded":"2024-09-13T19:35:40.503532+0000","last_fullsized":"2024-09-13T19:35:40.503532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:23.396598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508140+0000","last_change":"2024-09-13T19:33:08.358155+0000","last_active":"2024-09-13T19:33:49.508140+0000","last_peered":"2024-09-13T19:33:49.508140+0000","last_clean":"2024-09-13T19:33:49.508140+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:33:49.508140+0000","last_undegraded":"2024-09-13T19:33:49.508140+0000","last_fullsized":"2024-09-13T19:33:49.508140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:23.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521057+0000","last_change":"2024-09-13T19:33:12.358770+0000","last_active":"2024-09-13T19:33:49.521057+0000","last_peered":"2024-09-13T19:33:49.521057+0000","last_clean":"2024-09-13T19:33:49.521057+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:33:49.521057+0000","last_undegraded":"2024-09-13T19:33:49.521057+0000","last_fullsized":"2024-09-13T19:33:49.521057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:34.804561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.468789+0000","last_change":"2024-09-13T19:33:14.352918+0000","last_active":"2024-09-13T19:35:20.468789+0000","last_peered":"2024-09-13T19:35:20.468789+0000","last_clean":"2024-09-13T19:35:20.468789+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:35:20.468789+0000","last_undegraded":"2024-09-13T19:35:20.468789+0000","last_fullsized":"2024-09-13T19:35:20.468789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:24.299742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504142+0000","last_change":"2024-09-13T19:33:16.400962+0000","last_active":"2024-09-13T19:33:49.504142+0000","last_peered":"2024-09-13T19:33:49.504142+0000","last_clean":"2024-09-13T19:33:49.504142+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:33:49.504142+0000","last_undegraded":"2024-09-13T19:33:49.504142+0000","last_fullsized":"2024-09-13T19:33:49.504142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:43.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513374+0000","last_change":"2024-09-13T19:33:18.424633+0000","last_active":"2024-09-13T19:33:49.513374+0000","last_peered":"2024-09-13T19:33:49.513374+0000","last_clean":"2024-09-13T19:33:49.513374+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:33:49.513374+0000","last_undegraded":"2024-09-13T19:33:49.513374+0000","last_fullsized":"2024-09-13T19:33:49.513374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:44.258539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.115279+0000","last_change":"2024-09-13T19:33:10.346685+0000","last_active":"2024-09-13T19:36:24.115279+0000","last_peered":"2024-09-13T19:36:24.115279+0000","last_clean":"2024-09-13T19:36:24.115279+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:36:24.115279+0000","last_undegraded":"2024-09-13T19:36:24.115279+0000","last_fullsized":"2024-09-13T19:36:24.115279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:50.896604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.676763+0000","last_change":"2024-09-13T19:33:08.349745+0000","last_active":"2024-09-13T19:36:23.676763+0000","last_peered":"2024-09-13T19:36:23.676763+0000","last_clean":"2024-09-13T19:36:23.676763+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:36:23.676763+0000","last_undegraded":"2024-09-13T19:36:23.676763+0000","last_fullsized":"2024-09-13T19:36:23.676763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:49.017180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"23'1","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.405946+0000","last_change":"2024-09-13T19:33:12.360592+0000","last_active":"2024-09-13T19:36:55.405946+0000","last_peered":"2024-09-13T19:36:55.405946+0000","last_clean":"2024-09-13T19:36:55.405946+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:36:55.405946+0000","last_undegraded":"2024-09-13T19:36:55.405946+0000","last_fullsized":"2024-09-13T19:36:55.405946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:26.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'27","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.508946+0000","last_change":"2024-09-13T19:33:14.380786+0000","last_active":"2024-09-13T19:35:45.508946+0000","last_peered":"2024-09-13T19:35:45.508946+0000","last_clean":"2024-09-13T19:35:45.508946+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:35:45.508946+0000","last_undegraded":"2024-09-13T19:35:45.508946+0000","last_fullsized":"2024-09-13T19:35:45.508946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:37.500328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504812+0000","last_change":"2024-09-13T19:33:16.403395+0000","last_active":"2024-09-13T19:33:49.504812+0000","last_peered":"2024-09-13T19:33:49.504812+0000","last_clean":"2024-09-13T19:33:49.504812+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:33:49.504812+0000","last_undegraded":"2024-09-13T19:33:49.504812+0000","last_fullsized":"2024-09-13T19:33:49.504812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:06.844982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.528359+0000","last_change":"2024-09-13T19:33:18.420238+0000","last_active":"2024-09-13T19:35:20.528359+0000","last_peered":"2024-09-13T19:35:20.528359+0000","last_clean":"2024-09-13T19:35:20.528359+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:35:20.528359+0000","last_undegraded":"2024-09-13T19:35:20.528359+0000","last_fullsized":"2024-09-13T19:35:20.528359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:39.541908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.725970+0000","last_change":"2024-09-13T19:33:10.336837+0000","last_active":"2024-09-13T19:36:23.725970+0000","last_peered":"2024-09-13T19:36:23.725970+0000","last_clean":"2024-09-13T19:36:23.725970+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:36:23.725970+0000","last_undegraded":"2024-09-13T19:36:23.725970+0000","last_fullsized":"2024-09-13T19:36:23.725970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:17.640715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513903+0000","last_change":"2024-09-13T19:33:08.329255+0000","last_active":"2024-09-13T19:33:49.513903+0000","last_peered":"2024-09-13T19:33:49.513903+0000","last_clean":"2024-09-13T19:33:49.513903+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:33:49.513903+0000","last_undegraded":"2024-09-13T19:33:49.513903+0000","last_fullsized":"2024-09-13T19:33:49.513903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.693342+0000","last_change":"2024-09-13T19:33:12.362162+0000","last_active":"2024-09-13T19:35:18.693342+0000","last_peered":"2024-09-13T19:35:18.693342+0000","last_clean":"2024-09-13T19:35:18.693342+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:35:18.693342+0000","last_undegraded":"2024-09-13T19:35:18.693342+0000","last_fullsized":"2024-09-13T19:35:18.693342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.424221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.010387+0000","last_change":"2024-09-13T19:33:14.372731+0000","last_active":"2024-09-13T19:36:23.010387+0000","last_peered":"2024-09-13T19:36:23.010387+0000","last_clean":"2024-09-13T19:36:23.010387+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:36:23.010387+0000","last_undegraded":"2024-09-13T19:36:23.010387+0000","last_fullsized":"2024-09-13T19:36:23.010387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:28.203288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497588+0000","last_change":"2024-09-13T19:33:16.375705+0000","last_active":"2024-09-13T19:33:49.497588+0000","last_peered":"2024-09-13T19:33:49.497588+0000","last_clean":"2024-09-13T19:33:49.497588+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:33:49.497588+0000","last_undegraded":"2024-09-13T19:33:49.497588+0000","last_fullsized":"2024-09-13T19:33:49.497588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:17.171140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.533635+0000","last_change":"2024-09-13T19:33:18.420946+0000","last_active":"2024-09-13T19:35:20.533635+0000","last_peered":"2024-09-13T19:35:20.533635+0000","last_clean":"2024-09-13T19:35:20.533635+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:35:20.533635+0000","last_undegraded":"2024-09-13T19:35:20.533635+0000","last_fullsized":"2024-09-13T19:35:20.533635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:33.812134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.480170+0000","last_change":"2024-09-13T19:33:49.534946+0000","last_active":"2024-09-13T19:33:50.480170+0000","last_peered":"2024-09-13T19:33:50.480170+0000","last_clean":"2024-09-13T19:33:50.480170+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:33:50.480170+0000","last_undegraded":"2024-09-13T19:33:50.480170+0000","last_fullsized":"2024-09-13T19:33:50.480170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:55.799083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.582657+0000","last_change":"2024-09-13T19:33:08.332706+0000","last_active":"2024-09-13T19:36:23.582657+0000","last_peered":"2024-09-13T19:36:23.582657+0000","last_clean":"2024-09-13T19:36:23.582657+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:36:23.582657+0000","last_undegraded":"2024-09-13T19:36:23.582657+0000","last_fullsized":"2024-09-13T19:36:23.582657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:03.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207867+0000","last_change":"2024-09-13T19:33:10.332473+0000","last_active":"2024-09-13T19:36:24.207867+0000","last_peered":"2024-09-13T19:36:24.207867+0000","last_clean":"2024-09-13T19:36:24.207867+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:36:24.207867+0000","last_undegraded":"2024-09-13T19:36:24.207867+0000","last_fullsized":"2024-09-13T19:36:24.207867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:17.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.495977+0000","last_change":"2024-09-13T19:33:08.325598+0000","last_active":"2024-09-13T19:33:49.495977+0000","last_peered":"2024-09-13T19:33:49.495977+0000","last_clean":"2024-09-13T19:33:49.495977+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:33:49.495977+0000","last_undegraded":"2024-09-13T19:33:49.495977+0000","last_fullsized":"2024-09-13T19:33:49.495977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513363+0000","last_change":"2024-09-13T19:33:10.353700+0000","last_active":"2024-09-13T19:33:49.513363+0000","last_peered":"2024-09-13T19:33:49.513363+0000","last_clean":"2024-09-13T19:33:49.513363+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:33:49.513363+0000","last_undegraded":"2024-09-13T19:33:49.513363+0000","last_fullsized":"2024-09-13T19:33:49.513363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:14.944305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.152054+0000","last_change":"2024-09-13T19:33:08.334993+0000","last_active":"2024-09-13T19:33:54.152054+0000","last_peered":"2024-09-13T19:33:54.152054+0000","last_clean":"2024-09-13T19:33:54.152054+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:33:54.152054+0000","last_undegraded":"2024-09-13T19:33:54.152054+0000","last_fullsized":"2024-09-13T19:33:54.152054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:15.855113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.520893+0000","last_change":"2024-09-13T19:33:10.332930+0000","last_active":"2024-09-13T19:34:37.520893+0000","last_peered":"2024-09-13T19:34:37.520893+0000","last_clean":"2024-09-13T19:34:37.520893+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:34:37.520893+0000","last_undegraded":"2024-09-13T19:34:37.520893+0000","last_fullsized":"2024-09-13T19:34:37.520893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.567975+0000","last_change":"2024-09-13T19:33:08.345558+0000","last_active":"2024-09-13T19:35:22.567975+0000","last_peered":"2024-09-13T19:35:22.567975+0000","last_clean":"2024-09-13T19:35:22.567975+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:35:22.567975+0000","last_undegraded":"2024-09-13T19:35:22.567975+0000","last_fullsized":"2024-09-13T19:35:22.567975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:14.487188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.888082+0000","last_change":"2024-09-13T19:33:10.339115+0000","last_active":"2024-09-13T19:36:23.888082+0000","last_peered":"2024-09-13T19:36:23.888082+0000","last_clean":"2024-09-13T19:36:23.888082+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:36:23.888082+0000","last_undegraded":"2024-09-13T19:36:23.888082+0000","last_fullsized":"2024-09-13T19:36:23.888082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:25.322287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.630046+0000","last_change":"2024-09-13T19:33:08.325496+0000","last_active":"2024-09-13T19:35:22.630046+0000","last_peered":"2024-09-13T19:35:22.630046+0000","last_clean":"2024-09-13T19:35:22.630046+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:35:22.630046+0000","last_undegraded":"2024-09-13T19:35:22.630046+0000","last_fullsized":"2024-09-13T19:35:22.630046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:39.965420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.933809+0000","last_change":"2024-09-13T19:33:10.353514+0000","last_active":"2024-09-13T19:35:22.933809+0000","last_peered":"2024-09-13T19:35:22.933809+0000","last_clean":"2024-09-13T19:35:22.933809+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:35:22.933809+0000","last_undegraded":"2024-09-13T19:35:22.933809+0000","last_fullsized":"2024-09-13T19:35:22.933809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:34.718501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500558+0000","last_change":"2024-09-13T19:33:08.338958+0000","last_active":"2024-09-13T19:35:20.500558+0000","last_peered":"2024-09-13T19:35:20.500558+0000","last_clean":"2024-09-13T19:35:20.500558+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:35:20.500558+0000","last_undegraded":"2024-09-13T19:35:20.500558+0000","last_fullsized":"2024-09-13T19:35:20.500558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494324+0000","last_change":"2024-09-13T19:33:10.339492+0000","last_active":"2024-09-13T19:35:14.494324+0000","last_peered":"2024-09-13T19:35:14.494324+0000","last_clean":"2024-09-13T19:35:14.494324+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:35:14.494324+0000","last_undegraded":"2024-09-13T19:35:14.494324+0000","last_fullsized":"2024-09-13T19:35:14.494324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523956+0000","last_change":"2024-09-13T19:33:08.352331+0000","last_active":"2024-09-13T19:33:49.523956+0000","last_peered":"2024-09-13T19:33:49.523956+0000","last_clean":"2024-09-13T19:33:49.523956+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:33:49.523956+0000","last_undegraded":"2024-09-13T19:33:49.523956+0000","last_fullsized":"2024-09-13T19:33:49.523956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:14.487188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.206679+0000","last_change":"2024-09-13T19:33:10.340020+0000","last_active":"2024-09-13T19:36:24.206679+0000","last_peered":"2024-09-13T19:36:24.206679+0000","last_clean":"2024-09-13T19:36:24.206679+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:36:24.206679+0000","last_undegraded":"2024-09-13T19:36:24.206679+0000","last_fullsized":"2024-09-13T19:36:24.206679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.501022+0000","last_change":"2024-09-13T19:33:08.325702+0000","last_active":"2024-09-13T19:33:49.501022+0000","last_peered":"2024-09-13T19:33:49.501022+0000","last_clean":"2024-09-13T19:33:49.501022+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:33:49.501022+0000","last_undegraded":"2024-09-13T19:33:49.501022+0000","last_fullsized":"2024-09-13T19:33:49.501022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:33.213641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.521893+0000","last_change":"2024-09-13T19:33:10.347711+0000","last_active":"2024-09-13T19:34:37.521893+0000","last_peered":"2024-09-13T19:34:37.521893+0000","last_clean":"2024-09-13T19:34:37.521893+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:34:37.521893+0000","last_undegraded":"2024-09-13T19:34:37.521893+0000","last_fullsized":"2024-09-13T19:34:37.521893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:35.663644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503292+0000","last_change":"2024-09-13T19:33:08.332434+0000","last_active":"2024-09-13T19:33:49.503292+0000","last_peered":"2024-09-13T19:33:49.503292+0000","last_clean":"2024-09-13T19:33:49.503292+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:33:49.503292+0000","last_undegraded":"2024-09-13T19:33:49.503292+0000","last_fullsized":"2024-09-13T19:33:49.503292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:37.935261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'13","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.748902+0000","last_change":"2024-09-13T19:33:10.357624+0000","last_active":"2024-09-13T19:36:23.748902+0000","last_peered":"2024-09-13T19:36:23.748902+0000","last_clean":"2024-09-13T19:36:23.748902+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:36:23.748902+0000","last_undegraded":"2024-09-13T19:36:23.748902+0000","last_fullsized":"2024-09-13T19:36:23.748902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:02.272686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497193+0000","last_change":"2024-09-13T19:33:08.346231+0000","last_active":"2024-09-13T19:33:49.497193+0000","last_peered":"2024-09-13T19:33:49.497193+0000","last_clean":"2024-09-13T19:33:49.497193+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:33:49.497193+0000","last_undegraded":"2024-09-13T19:33:49.497193+0000","last_fullsized":"2024-09-13T19:33:49.497193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278985+0000","last_change":"2024-09-13T19:33:10.344691+0000","last_active":"2024-09-13T19:36:24.278985+0000","last_peered":"2024-09-13T19:36:24.278985+0000","last_clean":"2024-09-13T19:36:24.278985+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:36:24.278985+0000","last_undegraded":"2024-09-13T19:36:24.278985+0000","last_fullsized":"2024-09-13T19:36:24.278985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:09.619694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499748+0000","last_change":"2024-09-13T19:33:08.349717+0000","last_active":"2024-09-13T19:33:49.499748+0000","last_peered":"2024-09-13T19:33:49.499748+0000","last_clean":"2024-09-13T19:33:49.499748+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:33:49.499748+0000","last_undegraded":"2024-09-13T19:33:49.499748+0000","last_fullsized":"2024-09-13T19:33:49.499748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:53.138445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507430+0000","last_change":"2024-09-13T19:33:10.343686+0000","last_active":"2024-09-13T19:33:49.507430+0000","last_peered":"2024-09-13T19:33:49.507430+0000","last_clean":"2024-09-13T19:33:49.507430+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:33:49.507430+0000","last_undegraded":"2024-09-13T19:33:49.507430+0000","last_fullsized":"2024-09-13T19:33:49.507430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503320+0000","last_change":"2024-09-13T19:33:08.349915+0000","last_active":"2024-09-13T19:33:49.503320+0000","last_peered":"2024-09-13T19:33:49.503320+0000","last_clean":"2024-09-13T19:33:49.503320+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:33:49.503320+0000","last_undegraded":"2024-09-13T19:33:49.503320+0000","last_fullsized":"2024-09-13T19:33:49.503320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:03.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097014+0000","last_change":"2024-09-13T19:33:10.356426+0000","last_active":"2024-09-13T19:36:24.097014+0000","last_peered":"2024-09-13T19:36:24.097014+0000","last_clean":"2024-09-13T19:36:24.097014+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:36:24.097014+0000","last_undegraded":"2024-09-13T19:36:24.097014+0000","last_fullsized":"2024-09-13T19:36:24.097014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509661+0000","last_change":"2024-09-13T19:33:08.342035+0000","last_active":"2024-09-13T19:33:49.509661+0000","last_peered":"2024-09-13T19:33:49.509661+0000","last_clean":"2024-09-13T19:33:49.509661+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:33:49.509661+0000","last_undegraded":"2024-09-13T19:33:49.509661+0000","last_fullsized":"2024-09-13T19:33:49.509661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:01.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.379678+0000","last_change":"2024-09-13T19:33:10.350348+0000","last_active":"2024-09-13T19:33:53.379678+0000","last_peered":"2024-09-13T19:33:53.379678+0000","last_clean":"2024-09-13T19:33:53.379678+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:33:53.379678+0000","last_undegraded":"2024-09-13T19:33:53.379678+0000","last_fullsized":"2024-09-13T19:33:53.379678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:09.619694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.685036+0000","last_change":"2024-09-13T19:33:08.335544+0000","last_active":"2024-09-13T19:33:52.685036+0000","last_peered":"2024-09-13T19:33:52.685036+0000","last_clean":"2024-09-13T19:33:52.685036+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:33:52.685036+0000","last_undegraded":"2024-09-13T19:33:52.685036+0000","last_fullsized":"2024-09-13T19:33:52.685036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:42.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.194003+0000","last_change":"2024-09-13T19:33:10.353586+0000","last_active":"2024-09-13T19:35:18.194003+0000","last_peered":"2024-09-13T19:35:18.194003+0000","last_clean":"2024-09-13T19:35:18.194003+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:35:18.194003+0000","last_undegraded":"2024-09-13T19:35:18.194003+0000","last_fullsized":"2024-09-13T19:35:18.194003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:45.252176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524187+0000","last_change":"2024-09-13T19:33:08.351999+0000","last_active":"2024-09-13T19:33:49.524187+0000","last_peered":"2024-09-13T19:33:49.524187+0000","last_clean":"2024-09-13T19:33:49.524187+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:33:49.524187+0000","last_undegraded":"2024-09-13T19:33:49.524187+0000","last_fullsized":"2024-09-13T19:33:49.524187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:20.702363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096154+0000","last_change":"2024-09-13T19:33:10.343404+0000","last_active":"2024-09-13T19:36:24.096154+0000","last_peered":"2024-09-13T19:36:24.096154+0000","last_clean":"2024-09-13T19:36:24.096154+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:36:24.096154+0000","last_undegraded":"2024-09-13T19:36:24.096154+0000","last_fullsized":"2024-09-13T19:36:24.096154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515399+0000","last_change":"2024-09-13T19:33:08.354921+0000","last_active":"2024-09-13T19:33:49.515399+0000","last_peered":"2024-09-13T19:33:49.515399+0000","last_clean":"2024-09-13T19:33:49.515399+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:33:49.515399+0000","last_undegraded":"2024-09-13T19:33:49.515399+0000","last_fullsized":"2024-09-13T19:33:49.515399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:21.015465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503594+0000","last_change":"2024-09-13T19:33:08.354409+0000","last_active":"2024-09-13T19:33:49.503594+0000","last_peered":"2024-09-13T19:33:49.503594+0000","last_clean":"2024-09-13T19:33:49.503594+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:33:49.503594+0000","last_undegraded":"2024-09-13T19:33:49.503594+0000","last_fullsized":"2024-09-13T19:33:49.503594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:08.466174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097156+0000","last_change":"2024-09-13T19:33:10.340978+0000","last_active":"2024-09-13T19:36:24.097156+0000","last_peered":"2024-09-13T19:36:24.097156+0000","last_clean":"2024-09-13T19:36:24.097156+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:36:24.097156+0000","last_undegraded":"2024-09-13T19:36:24.097156+0000","last_fullsized":"2024-09-13T19:36:24.097156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:22.801067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497705+0000","last_change":"2024-09-13T19:33:08.349038+0000","last_active":"2024-09-13T19:33:49.497705+0000","last_peered":"2024-09-13T19:33:49.497705+0000","last_clean":"2024-09-13T19:33:49.497705+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:33:49.497705+0000","last_undegraded":"2024-09-13T19:33:49.497705+0000","last_fullsized":"2024-09-13T19:33:49.497705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.871653+0000","last_change":"2024-09-13T19:33:10.357819+0000","last_active":"2024-09-13T19:33:54.871653+0000","last_peered":"2024-09-13T19:33:54.871653+0000","last_clean":"2024-09-13T19:33:54.871653+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:33:54.871653+0000","last_undegraded":"2024-09-13T19:33:54.871653+0000","last_fullsized":"2024-09-13T19:33:54.871653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:15.665066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2266,"ondisk_log_size":2266,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1405,"num_read_kb":1191,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1300,"ondisk_log_size":1300,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":968,"num_read_kb":968,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52808,"kb_used_data":17464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":17883136,"data_stored":17553871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52688,"kb_used_data":17344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319152,"statfs":{"total":96636764160,"available":96582811648,"internally_reserved":0,"allocated":17760256,"data_stored":17502939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49252,"kb_used_data":13908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322588,"statfs":{"total":96636764160,"available":96586330112,"internally_reserved":0,"allocated":14241792,"data_stored":13948982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":4516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":4624384,"data_stored":4331938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:36:57.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:36:57.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f0811d89640 1 Processor -- start 2024-09-13T19:36:57.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f0811d89640 1 -- start start 2024-09-13T19:36:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f0811d89640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f080c06d0e0 0x7f080c06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f0811d89640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080c071c10 con 0x7f080c06da00 2024-09-13T19:36:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f0811d89640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f080c072230 con 0x7f080c06d0e0 2024-09-13T19:36:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f080c06d0e0 0x7f080c06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f080c06da00 0x7f080c12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41688/0 (socket says 172.21.15.18:41688) 2024-09-13T19:36:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080affd640 1 -- 172.21.15.18:0/1816801353 learned_addr learned my addr 172.21.15.18:0/1816801353 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080b7fe640 1 -- 172.21.15.18:0/1816801353 >> v1:172.21.15.18:6789/0 conn(0x7f080c06da00 legacy=0x7f080c12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080b7fe640 1 -- 172.21.15.18:0/1816801353 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c0709e0 con 0x7f080c06d0e0 2024-09-13T19:36:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080b7fe640 1 --2- 172.21.15.18:0/1816801353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c06d4c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009740 tx=0x7f07fc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a57ad631b137cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080a7fc640 1 -- 172.21.15.18:0/1816801353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc0b0070 con 0x7f080c06d0e0 2024-09-13T19:36:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080a7fc640 1 -- 172.21.15.18:0/1816801353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07fc0ab530 con 0x7f080c06d0e0 2024-09-13T19:36:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.222+0000 7f080a7fc640 1 -- 172.21.15.18:0/1816801353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc0ab830 con 0x7f080c06d0e0 2024-09-13T19:36:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- 172.21.15.18:0/1816801353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 msgr2=0x7f080c06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 --2- 172.21.15.18:0/1816801353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c06d4c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009740 tx=0x7f07fc01c370 comp rx=0 tx=0).stop 2024-09-13T19:36:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- 172.21.15.18:0/1816801353 shutdown_connections 2024-09-13T19:36:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 --2- 172.21.15.18:0/1816801353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c06d4c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- 172.21.15.18:0/1816801353 >> 172.21.15.18:0/1816801353 conn(0x7f080c099a50 msgr2=0x7f080c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- 172.21.15.18:0/1816801353 shutdown_connections 2024-09-13T19:36:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- 172.21.15.18:0/1816801353 wait complete. 2024-09-13T19:36:57.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 Processor -- start 2024-09-13T19:36:57.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- start start 2024-09-13T19:36:57.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c12b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:57.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f080c134e80 con 0x7f080c06d0e0 2024-09-13T19:36:57.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c12b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:57.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c12b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58368/0 (socket says 172.21.15.18:58368) 2024-09-13T19:36:57.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f080b7fe640 1 -- 172.21.15.18:0/2977010954 learned_addr learned my addr 172.21.15.18:0/2977010954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f080b7fe640 1 -- 172.21.15.18:0/2977010954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c12b900 con 0x7f080c06d0e0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f080b7fe640 1 --2- 172.21.15.18:0/2977010954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c12b3c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0ae040 tx=0x7f07fc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f07f3fff640 1 -- 172.21.15.18:0/2977010954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc0b0050 con 0x7f080c06d0e0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f07f3fff640 1 -- 172.21.15.18:0/2977010954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07fc0b1040 con 0x7f080c06d0e0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080c12bad0 con 0x7f080c06d0e0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f07f3fff640 1 -- 172.21.15.18:0/2977010954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc0b5780 con 0x7f080c06d0e0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080c12bf90 con 0x7f080c06d0e0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f080c06d4c0 con 0x7f080c06d0e0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f07f3fff640 1 -- 172.21.15.18:0/2977010954 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07fc0be030 con 0x7f080c06d0e0 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f07f3fff640 1 --2- 172.21.15.18:0/2977010954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8035db0 0x7f07f8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.226+0000 7f07f3fff640 1 -- 172.21.15.18:0/2977010954 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f07fc0bc070 con 0x7f080c06d0e0 2024-09-13T19:36:57.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.230+0000 7f080affd640 1 --2- 172.21.15.18:0/2977010954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8035db0 0x7f07f8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:57.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.230+0000 7f080affd640 1 --2- 172.21.15.18:0/2977010954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8035db0 0x7f07f8038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0800001610 tx=0x7f0800007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.234+0000 7f07f3fff640 1 -- 172.21.15.18:0/2977010954 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f07fc0c5060 con 0x7f080c06d0e0 2024-09-13T19:36:57.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.398+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f080c12a740 con 0x7f080c06d0e0 2024-09-13T19:36:57.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f07f3fff640 1 -- 172.21.15.18:0/2977010954 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+21364 (secure 0 0 0) 0x7f07fc015ff0 con 0x7f080c06d0e0 2024-09-13T19:36:57.406 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:36:57.406 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":32,"fsid":"b2385e7c-a71a-4af5-b7af-4c90a204f1ea","created":"2024-09-13T19:32:43.365033+0000","modified":"2024-09-13T19:33:49.486586+0000","last_up_change":"2024-09-13T19:32:55.261550+0000","last_in_change":"2024-09-13T19:32:44.638174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:32:56.473851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:32:59.336083+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-13T19:33:06.793638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-13T19:33:08.698054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-13T19:33:10.609507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-13T19:33:12.510063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-13T19:33:14.428733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-13T19:33:16.550244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"feb640dc-8e82-4932-aff2-4b0b5448f785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6801","nonce":2700511246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6803","nonce":2700511246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6807","nonce":2700511246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2700511246},{"type":"v1","addr":"172.21.15.18:6805","nonce":2700511246}]},"public_addr":"172.21.15.18:6801/2700511246","cluster_addr":"172.21.15.18:6803/2700511246","heartbeat_back_addr":"172.21.15.18:6807/2700511246","heartbeat_front_addr":"172.21.15.18:6805/2700511246","state":["exists","up"]},{"osd":1,"uuid":"43d97a8c-e558-4aaf-8184-0c7b26a1fa50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6809","nonce":3556169889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6811","nonce":3556169889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6815","nonce":3556169889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":3556169889},{"type":"v1","addr":"172.21.15.144:6813","nonce":3556169889}]},"public_addr":"172.21.15.144:6809/3556169889","cluster_addr":"172.21.15.144:6811/3556169889","heartbeat_back_addr":"172.21.15.144:6815/3556169889","heartbeat_front_addr":"172.21.15.144:6813/3556169889","state":["exists","up"]},{"osd":2,"uuid":"a2b1ed4d-6f98-45a6-88b7-e7a345f7037f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6817","nonce":2341760841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6819","nonce":2341760841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6823","nonce":2341760841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2341760841},{"type":"v1","addr":"172.21.15.144:6821","nonce":2341760841}]},"public_addr":"172.21.15.144:6817/2341760841","cluster_addr":"172.21.15.144:6819/2341760841","heartbeat_back_addr":"172.21.15.144:6823/2341760841","heartbeat_front_addr":"172.21.15.144:6821/2341760841","state":["exists","up"]},{"osd":3,"uuid":"cab5ee78-fc3c-4b70-8dd5-028dc09b863f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6801","nonce":1157716661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6803","nonce":1157716661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6807","nonce":1157716661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1157716661},{"type":"v1","addr":"172.21.15.144:6805","nonce":1157716661}]},"public_addr":"172.21.15.144:6801/1157716661","cluster_addr":"172.21.15.144:6803/1157716661","heartbeat_back_addr":"172.21.15.144:6807/1157716661","heartbeat_front_addr":"172.21.15.144:6805/1157716661","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.557790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.952068+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.944160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:32:51.871505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":3,"to":0}]},{"pgid":"4.6","mappings":[{"from":3,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":0}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":0,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:36:57.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8035db0 msgr2=0x7f07f8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:57.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f0811d89640 1 --2- 172.21.15.18:0/2977010954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8035db0 0x7f07f8038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0800001610 tx=0x7f0800007ad0 comp rx=0 tx=0).stop 2024-09-13T19:36:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 msgr2=0x7f080c12b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f0811d89640 1 --2- 172.21.15.18:0/2977010954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c12b3c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0ae040 tx=0x7f07fc01abb0 comp rx=0 tx=0).stop 2024-09-13T19:36:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 shutdown_connections 2024-09-13T19:36:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f0811d89640 1 --2- 172.21.15.18:0/2977010954 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f07f8035db0 0x7f07f8038270 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f0811d89640 1 --2- 172.21.15.18:0/2977010954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f080c06d0e0 0x7f080c12b3c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.402+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 >> 172.21.15.18:0/2977010954 conn(0x7f080c099a50 msgr2=0x7f080c09b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.406+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 shutdown_connections 2024-09-13T19:36:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:57.406+0000 7f0811d89640 1 -- 172.21.15.18:0/2977010954 wait complete. 2024-09-13T19:36:58.426 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T19:36:58.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:36:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9977892640 1 Processor -- start 2024-09-13T19:36:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9977892640 1 -- start start 2024-09-13T19:36:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9977892640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9970132090 0x7f9970134480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9977892640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99700992b0 con 0x7f9970099c70 2024-09-13T19:36:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9977892640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f997009d270 con 0x7f9970132090 2024-09-13T19:36:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f997562e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9970099c70 0x7f997009a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41692/0 (socket says 172.21.15.18:41692) 2024-09-13T19:36:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f997562e640 1 -- 172.21.15.18:0/2685020284 learned_addr learned my addr 172.21.15.18:0/2685020284 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:58.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9974e2d640 1 --2- 172.21.15.18:0/2685020284 >> v2:172.21.15.18:3300/0 conn(0x7f9970132090 0x7f9970134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:58.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9963fff640 1 -- 172.21.15.18:0/2685020284 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370074736 0 0) 0x7f99700992b0 con 0x7f9970099c70 2024-09-13T19:36:58.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9963fff640 1 -- 172.21.15.18:0/2685020284 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f995c003530 con 0x7f9970099c70 2024-09-13T19:36:58.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9974e2d640 1 -- 172.21.15.18:0/2685020284 >> v1:172.21.15.18:6789/0 conn(0x7f9970099c70 legacy=0x7f997009a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.562+0000 7f9974e2d640 1 -- 172.21.15.18:0/2685020284 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997009a760 con 0x7f9970132090 2024-09-13T19:36:58.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9974e2d640 1 --2- 172.21.15.18:0/2685020284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970132090 0x7f9970134480 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f996c009740 tx=0x7f996c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814eedb2c4755d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:58.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9963fff640 1 -- 172.21.15.18:0/2685020284 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f996c0b1070 con 0x7f9970132090 2024-09-13T19:36:58.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9963fff640 1 -- 172.21.15.18:0/2685020284 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f996c0ac520 con 0x7f9970132090 2024-09-13T19:36:58.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9963fff640 1 -- 172.21.15.18:0/2685020284 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f996c0ac800 con 0x7f9970132090 2024-09-13T19:36:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 -- 172.21.15.18:0/2685020284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970132090 msgr2=0x7f9970134480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 --2- 172.21.15.18:0/2685020284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970132090 0x7f9970134480 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f996c009740 tx=0x7f996c01c370 comp rx=0 tx=0).stop 2024-09-13T19:36:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 -- 172.21.15.18:0/2685020284 shutdown_connections 2024-09-13T19:36:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 --2- 172.21.15.18:0/2685020284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970132090 0x7f9970134480 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 -- 172.21.15.18:0/2685020284 >> 172.21.15.18:0/2685020284 conn(0x7f997006d570 msgr2=0x7f997006d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 -- 172.21.15.18:0/2685020284 shutdown_connections 2024-09-13T19:36:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 -- 172.21.15.18:0/2685020284 wait complete. 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 Processor -- start 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 -- start start 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970099c70 0x7f99700972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f9977892640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f99701373f0 con 0x7f9970099c70 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f997562e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970099c70 0x7f99700972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f997562e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970099c70 0x7f99700972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58386/0 (socket says 172.21.15.18:58386) 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.566+0000 7f997562e640 1 -- 172.21.15.18:0/3227200557 learned_addr learned my addr 172.21.15.18:0/3227200557 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f997562e640 1 -- 172.21.15.18:0/3227200557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99701305b0 con 0x7f9970099c70 2024-09-13T19:36:58.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f997562e640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970099c70 0x7f99700972f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f996400c3d0 tx=0x7f996400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:58.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9964017070 con 0x7f9970099c70 2024-09-13T19:36:58.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9964005ce0 con 0x7f9970099c70 2024-09-13T19:36:58.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99640070d0 con 0x7f9970099c70 2024-09-13T19:36:58.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9970131900 con 0x7f9970099c70 2024-09-13T19:36:58.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9970130a40 con 0x7f9970099c70 2024-09-13T19:36:58.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f997009a050 con 0x7f9970099c70 2024-09-13T19:36:58.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f996401a070 con 0x7f9970099c70 2024-09-13T19:36:58.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9954035db0 0x7f9954038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:58.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9964048450 con 0x7f9970099c70 2024-09-13T19:36:58.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7f9954041b30 0x7f9954043fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:58.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9964016ec0 con 0x7f9954041b30 2024-09-13T19:36:58.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9975e2f640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7f9954041b30 0x7f9954043fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:58.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9974e2d640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9954035db0 0x7f9954038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:58.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9975e2f640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7f9954041b30 0x7f9954043fd0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:58.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9974e2d640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9954035db0 0x7f9954038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f996c009740 tx=0x7f996c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:58.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 <== osd.0 v2:172.21.15.18:6800/2700511246 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9964016ec0 con 0x7f9954041b30 2024-09-13T19:36:58.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.570+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f996404f050 con 0x7f9970099c70 2024-09-13T19:36:58.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 --> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9970130c70 con 0x7f9954041b30 2024-09-13T19:36:58.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9961ffb640 1 -- 172.21.15.18:0/3227200557 <== osd.0 v2:172.21.15.18:6800/2700511246 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9970130c70 con 0x7f9954041b30 2024-09-13T19:36:58.590 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T19:36:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:36:58.590 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T19:36:58.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7f9954041b30 msgr2=0x7f9954043fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7f9954041b30 0x7f9954043fd0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9954035db0 msgr2=0x7f9954038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9954035db0 0x7f9954038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f996c009740 tx=0x7f996c0a7000 comp rx=0 tx=0).stop 2024-09-13T19:36:58.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970099c70 msgr2=0x7f99700972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970099c70 0x7f99700972f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f996400c3d0 tx=0x7f996400c890 comp rx=0 tx=0).stop 2024-09-13T19:36:58.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 shutdown_connections 2024-09-13T19:36:58.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:6800/2700511246,v1:172.21.15.18:6801/2700511246] conn(0x7f9954041b30 0x7f9954043fd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f9954035db0 0x7f9954038270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 --2- 172.21.15.18:0/3227200557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9970099c70 0x7f99700972f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 >> 172.21.15.18:0/3227200557 conn(0x7f997006d570 msgr2=0x7f997009edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:58.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 shutdown_connections 2024-09-13T19:36:58.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.586+0000 7f9977892640 1 -- 172.21.15.18:0/3227200557 wait complete. 2024-09-13T19:36:58.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T19:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77accb3640 1 Processor -- start 2024-09-13T19:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77accb3640 1 -- start start 2024-09-13T19:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77accb3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77a812e760 0x7f77a812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77accb3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a80984f0 con 0x7f77a812f1c0 2024-09-13T19:36:58.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77accb3640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f77a8098dc0 con 0x7f77a812e760 2024-09-13T19:36:58.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77a659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77a812e760 0x7f77a812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:58.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77a5d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f77a812f1c0 0x7f77a812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41708/0 (socket says 172.21.15.18:41708) 2024-09-13T19:36:58.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77a5d9b640 1 -- 172.21.15.18:0/2646195633 learned_addr learned my addr 172.21.15.18:0/2646195633 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:58.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77a659c640 1 -- 172.21.15.18:0/2646195633 >> v1:172.21.15.18:6789/0 conn(0x7f77a812f1c0 legacy=0x7f77a812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.726+0000 7f77a659c640 1 -- 172.21.15.18:0/2646195633 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a812f5a0 con 0x7f77a812e760 2024-09-13T19:36:58.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77a659c640 1 --2- 172.21.15.18:0/2646195633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812e760 0x7f77a812ec80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009d90 tx=0x7f77a001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bb01fe3815e537 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:58.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77a559a640 1 -- 172.21.15.18:0/2646195633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a00b2070 con 0x7f77a812e760 2024-09-13T19:36:58.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77a559a640 1 -- 172.21.15.18:0/2646195633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a00a56f0 con 0x7f77a812e760 2024-09-13T19:36:58.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77a559a640 1 -- 172.21.15.18:0/2646195633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a00a59f0 con 0x7f77a812e760 2024-09-13T19:36:58.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 -- 172.21.15.18:0/2646195633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812e760 msgr2=0x7f77a812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 --2- 172.21.15.18:0/2646195633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812e760 0x7f77a812ec80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009d90 tx=0x7f77a001c950 comp rx=0 tx=0).stop 2024-09-13T19:36:58.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 -- 172.21.15.18:0/2646195633 shutdown_connections 2024-09-13T19:36:58.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 --2- 172.21.15.18:0/2646195633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812e760 0x7f77a812ec80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 -- 172.21.15.18:0/2646195633 >> 172.21.15.18:0/2646195633 conn(0x7f77a80a10a0 msgr2=0x7f77a80a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:58.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 -- 172.21.15.18:0/2646195633 shutdown_connections 2024-09-13T19:36:58.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 -- 172.21.15.18:0/2646195633 wait complete. 2024-09-13T19:36:58.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 Processor -- start 2024-09-13T19:36:58.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 -- start start 2024-09-13T19:36:58.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812f1c0 0x7f77a809caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:58.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77accb3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77a8136e30 con 0x7f77a812f1c0 2024-09-13T19:36:58.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77a659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812f1c0 0x7f77a809caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:58.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77a659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812f1c0 0x7f77a809caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58404/0 (socket says 172.21.15.18:58404) 2024-09-13T19:36:58.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77a659c640 1 -- 172.21.15.18:0/1138112801 learned_addr learned my addr 172.21.15.18:0/1138112801 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:58.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.730+0000 7f77a659c640 1 -- 172.21.15.18:0/1138112801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a809e590 con 0x7f77a812f1c0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f77a659c640 1 --2- 172.21.15.18:0/1138112801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812f1c0 0x7f77a809caf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f77a001a580 tx=0x7f77a00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f779effd640 1 -- 172.21.15.18:0/1138112801 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a00bd020 con 0x7f77a812f1c0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f779effd640 1 -- 172.21.15.18:0/1138112801 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a00b85a0 con 0x7f77a812f1c0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a8130ce0 con 0x7f77a812f1c0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f779effd640 1 -- 172.21.15.18:0/1138112801 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a00b2040 con 0x7f77a812f1c0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a809d200 con 0x7f77a812f1c0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a812ec80 con 0x7f77a812f1c0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f779effd640 1 -- 172.21.15.18:0/1138112801 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f77a00c0020 con 0x7f77a812f1c0 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f779effd640 1 --2- 172.21.15.18:0/1138112801 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f778c035db0 0x7f778c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:58.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f779effd640 1 -- 172.21.15.18:0/1138112801 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f77a00e3ef0 con 0x7f77a812f1c0 2024-09-13T19:36:58.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f77a5d9b640 1 --2- 172.21.15.18:0/1138112801 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f778c035db0 0x7f778c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:58.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.734+0000 7f77a5d9b640 1 --2- 172.21.15.18:0/1138112801 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f778c035db0 0x7f778c038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7790005890 tx=0x7f7790007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.738+0000 7f779effd640 1 -- 172.21.15.18:0/1138112801 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f77a00c7030 con 0x7f77a812f1c0 2024-09-13T19:36:58.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.902+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f77a8131200 con 0x7f778c035db0 2024-09-13T19:36:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f779effd640 1 -- 172.21.15.18:0/1138112801 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77a8131200 con 0x7f778c035db0 2024-09-13T19:36:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T19:36:58.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f778c035db0 msgr2=0x7f778c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 --2- 172.21.15.18:0/1138112801 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f778c035db0 0x7f778c038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7790005890 tx=0x7f7790007a90 comp rx=0 tx=0).stop 2024-09-13T19:36:58.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812f1c0 msgr2=0x7f77a809caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 --2- 172.21.15.18:0/1138112801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812f1c0 0x7f77a809caf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f77a001a580 tx=0x7f77a00196f0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 shutdown_connections 2024-09-13T19:36:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 --2- 172.21.15.18:0/1138112801 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f778c035db0 0x7f778c038270 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 --2- 172.21.15.18:0/1138112801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a812f1c0 0x7f77a809caf0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 >> 172.21.15.18:0/1138112801 conn(0x7f77a80a10a0 msgr2=0x7f77a8095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 shutdown_connections 2024-09-13T19:36:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:58.906+0000 7f77accb3640 1 -- 172.21.15.18:0/1138112801 wait complete. 2024-09-13T19:36:58.929 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T19:36:58.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:36:59.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe14072640 1 Processor -- start 2024-09-13T19:36:59.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe14072640 1 -- start start 2024-09-13T19:36:59.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe14072640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe0c06bc50 0x7fbe0c1293e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe14072640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c128fb0 con 0x7fbe0c129920 2024-09-13T19:36:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe14072640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0c129d70 con 0x7fbe0c06bc50 2024-09-13T19:36:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe11e0e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe0c06bc50 0x7fbe0c1293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe1160d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbe0c129920 0x7fbe0c12c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41724/0 (socket says 172.21.15.18:41724) 2024-09-13T19:36:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe11e0e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe0c06bc50 0x7fbe0c1293e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58412/0 (socket says 172.21.15.18:58412) 2024-09-13T19:36:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe1160d640 1 -- 172.21.15.18:0/2868107773 learned_addr learned my addr 172.21.15.18:0/2868107773 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe11e0e640 1 -- 172.21.15.18:0/2868107773 >> v1:172.21.15.18:6789/0 conn(0x7fbe0c129920 legacy=0x7fbe0c12c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.050+0000 7fbe11e0e640 1 -- 172.21.15.18:0/2868107773 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c071dc0 con 0x7fbe0c06bc50 2024-09-13T19:36:59.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe11e0e640 1 --2- 172.21.15.18:0/2868107773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c1293e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009740 tx=0x7fbe0801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c810ecd27e17cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe10e0c640 1 -- 172.21.15.18:0/2868107773 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe080b0070 con 0x7fbe0c06bc50 2024-09-13T19:36:59.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe10e0c640 1 -- 172.21.15.18:0/2868107773 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe080ab530 con 0x7fbe0c06bc50 2024-09-13T19:36:59.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe10e0c640 1 -- 172.21.15.18:0/2868107773 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe080ab830 con 0x7fbe0c06bc50 2024-09-13T19:36:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- 172.21.15.18:0/2868107773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 msgr2=0x7fbe0c1293e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 --2- 172.21.15.18:0/2868107773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c1293e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009740 tx=0x7fbe0801c400 comp rx=0 tx=0).stop 2024-09-13T19:36:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- 172.21.15.18:0/2868107773 shutdown_connections 2024-09-13T19:36:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 --2- 172.21.15.18:0/2868107773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c1293e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- 172.21.15.18:0/2868107773 >> 172.21.15.18:0/2868107773 conn(0x7fbe0c09ab20 msgr2=0x7fbe0c06d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- 172.21.15.18:0/2868107773 shutdown_connections 2024-09-13T19:36:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- 172.21.15.18:0/2868107773 wait complete. 2024-09-13T19:36:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 Processor -- start 2024-09-13T19:36:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- start start 2024-09-13T19:36:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c12e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c135280 con 0x7fbe0c06bc50 2024-09-13T19:36:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe11e0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c12e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe11e0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c12e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58416/0 (socket says 172.21.15.18:58416) 2024-09-13T19:36:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe11e0e640 1 -- 172.21.15.18:0/4000550819 learned_addr learned my addr 172.21.15.18:0/4000550819 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe11e0e640 1 -- 172.21.15.18:0/4000550819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c1308a0 con 0x7fbe0c06bc50 2024-09-13T19:36:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe11e0e640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c12e800 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbe0801a030 tx=0x7fbe0801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe027fc640 1 -- 172.21.15.18:0/4000550819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe080b0050 con 0x7fbe0c06bc50 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe027fc640 1 -- 172.21.15.18:0/4000550819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe080b1040 con 0x7fbe0c06bc50 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c131180 con 0x7fbe0c06bc50 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe027fc640 1 -- 172.21.15.18:0/4000550819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe080b5930 con 0x7fbe0c06bc50 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.054+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c12ef10 con 0x7fbe0c06bc50 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe027fc640 1 -- 172.21.15.18:0/4000550819 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe080be030 con 0x7fbe0c06bc50 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe027fc640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbdf0035e00 0x7fbdf00382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe027fc640 1 -- 172.21.15.18:0/4000550819 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fbe080bc070 con 0x7fbe0c06bc50 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe1160d640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbdf0035e00 0x7fbdf00382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe14072640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fbe0c129920 0x7fbe0c1c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe0c0686b0 con 0x7fbe0c129920 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe1260f640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fbe0c129920 0x7fbe0c1c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe1160d640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbdf0035e00 0x7fbdf00382c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc005890 tx=0x7fbdfc007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.058+0000 7fbe1260f640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fbe0c129920 0x7fbe0c1c4430 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.062+0000 7fbe027fc640 1 -- 172.21.15.18:0/4000550819 <== osd.1 v2:172.21.15.144:6808/3556169889 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe0c0686b0 con 0x7fbe0c129920 2024-09-13T19:36:59.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 --> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe0c1293e0 con 0x7fbe0c129920 2024-09-13T19:36:59.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe027fc640 1 -- 172.21.15.18:0/4000550819 <== osd.1 v2:172.21.15.144:6808/3556169889 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbe0c1293e0 con 0x7fbe0c129920 2024-09-13T19:36:59.078 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T19:36:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:36:59.079 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fbe0c129920 msgr2=0x7fbe0c1c4430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fbe0c129920 0x7fbe0c1c4430 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbdf0035e00 msgr2=0x7fbdf00382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbdf0035e00 0x7fbdf00382c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc005890 tx=0x7fbdfc007a90 comp rx=0 tx=0).stop 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 msgr2=0x7fbe0c12e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c12e800 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbe0801a030 tx=0x7fbe0801ac40 comp rx=0 tx=0).stop 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 shutdown_connections 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6808/3556169889,v1:172.21.15.144:6809/3556169889] conn(0x7fbe0c129920 0x7fbe0c1c4430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fbdf0035e00 0x7fbdf00382c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 --2- 172.21.15.18:0/4000550819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe0c06bc50 0x7fbe0c12e800 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 >> 172.21.15.18:0/4000550819 conn(0x7fbe0c09ab20 msgr2=0x7fbe0c127680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:59.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 shutdown_connections 2024-09-13T19:36:59.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.074+0000 7fbe14072640 1 -- 172.21.15.18:0/4000550819 wait complete. 2024-09-13T19:36:59.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T19:36:59.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4df5203640 1 Processor -- start 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4df5203640 1 -- start start 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4df5203640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4df0073290 0x7f4df0095600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4df5203640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df0096880 con 0x7f4df0095b40 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4df5203640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4df009df00 con 0x7f4df0073290 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4deed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4df0073290 0x7f4df0095600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4deed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4df0073290 0x7f4df0095600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58420/0 (socket says 172.21.15.18:58420) 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4deed9d640 1 -- 172.21.15.18:0/311523657 learned_addr learned my addr 172.21.15.18:0/311523657 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4dee59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4df0095b40 0x7f4df0131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41728/0 (socket says 172.21.15.18:41728) 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4deed9d640 1 -- 172.21.15.18:0/311523657 >> v1:172.21.15.18:6789/0 conn(0x7f4df0095b40 legacy=0x7f4df0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4deed9d640 1 -- 172.21.15.18:0/311523657 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df0096ca0 con 0x7f4df0073290 2024-09-13T19:36:59.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.206+0000 7f4dedd9b640 1 -- 172.21.15.18:0/311523657 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766261235 0 0) 0x7f4df0096880 con 0x7f4df0095b40 2024-09-13T19:36:59.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4deed9d640 1 --2- 172.21.15.18:0/311523657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df0095600 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097f0 tx=0x7f4de401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9c522f573e7148 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4dedd9b640 1 -- 172.21.15.18:0/311523657 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de40ab580 con 0x7f4df0073290 2024-09-13T19:36:59.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4dedd9b640 1 -- 172.21.15.18:0/311523657 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de40b0070 con 0x7f4df0073290 2024-09-13T19:36:59.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4dedd9b640 1 -- 172.21.15.18:0/311523657 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de40ab870 con 0x7f4df0073290 2024-09-13T19:36:59.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- 172.21.15.18:0/311523657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 msgr2=0x7f4df0095600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 --2- 172.21.15.18:0/311523657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df0095600 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097f0 tx=0x7f4de401c430 comp rx=0 tx=0).stop 2024-09-13T19:36:59.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- 172.21.15.18:0/311523657 shutdown_connections 2024-09-13T19:36:59.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 --2- 172.21.15.18:0/311523657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df0095600 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- 172.21.15.18:0/311523657 >> 172.21.15.18:0/311523657 conn(0x7f4df009d6f0 msgr2=0x7f4df0099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:59.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- 172.21.15.18:0/311523657 shutdown_connections 2024-09-13T19:36:59.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- 172.21.15.18:0/311523657 wait complete. 2024-09-13T19:36:59.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 Processor -- start 2024-09-13T19:36:59.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- start start 2024-09-13T19:36:59.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df012f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0074fe0 con 0x7f4df0073290 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4deed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df012f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4deed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df012f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58424/0 (socket says 172.21.15.18:58424) 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4deed9d640 1 -- 172.21.15.18:0/850383845 learned_addr learned my addr 172.21.15.18:0/850383845 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4deed9d640 1 -- 172.21.15.18:0/850383845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df0093ed0 con 0x7f4df0073290 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4deed9d640 1 --2- 172.21.15.18:0/850383845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df012f860 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4de401a060 tx=0x7f4de401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4dd77fe640 1 -- 172.21.15.18:0/850383845 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de40be3f0 con 0x7f4df0073290 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4dd77fe640 1 -- 172.21.15.18:0/850383845 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de40be590 con 0x7f4df0073290 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4dd77fe640 1 -- 172.21.15.18:0/850383845 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de40be890 con 0x7f4df0073290 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df006f2d0 con 0x7f4df0073290 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.210+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df0091240 con 0x7f4df0073290 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.214+0000 7f4dd77fe640 1 -- 172.21.15.18:0/850383845 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4de40c7440 con 0x7f4df0073290 2024-09-13T19:36:59.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.214+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df0095600 con 0x7f4df0073290 2024-09-13T19:36:59.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.214+0000 7f4dd77fe640 1 --2- 172.21.15.18:0/850383845 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ddc035db0 0x7f4ddc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.214+0000 7f4dd77fe640 1 -- 172.21.15.18:0/850383845 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4de40e3950 con 0x7f4df0073290 2024-09-13T19:36:59.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.214+0000 7f4dee59c640 1 --2- 172.21.15.18:0/850383845 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ddc035db0 0x7f4ddc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.214+0000 7f4dee59c640 1 --2- 172.21.15.18:0/850383845 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ddc035db0 0x7f4ddc038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4de0007fd0 tx=0x7f4de0007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.218+0000 7f4dd77fe640 1 -- 172.21.15.18:0/850383845 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4de40160b0 con 0x7f4df0073290 2024-09-13T19:36:59.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.378+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4df009a300 con 0x7f4ddc035db0 2024-09-13T19:36:59.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4dd77fe640 1 -- 172.21.15.18:0/850383845 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4df009a300 con 0x7f4ddc035db0 2024-09-13T19:36:59.384 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ddc035db0 msgr2=0x7f4ddc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 --2- 172.21.15.18:0/850383845 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ddc035db0 0x7f4ddc038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4de0007fd0 tx=0x7f4de0007960 comp rx=0 tx=0).stop 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 msgr2=0x7f4df012f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 --2- 172.21.15.18:0/850383845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df012f860 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4de401a060 tx=0x7f4de401ac70 comp rx=0 tx=0).stop 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 shutdown_connections 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 --2- 172.21.15.18:0/850383845 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f4ddc035db0 0x7f4ddc038270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 --2- 172.21.15.18:0/850383845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df0073290 0x7f4df012f860 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 >> 172.21.15.18:0/850383845 conn(0x7f4df009d6f0 msgr2=0x7f4df0098980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 shutdown_connections 2024-09-13T19:36:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.382+0000 7f4df5203640 1 -- 172.21.15.18:0/850383845 wait complete. 2024-09-13T19:36:59.402 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T19:36:59.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:36:59.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.526+0000 7f08b931c640 1 Processor -- start 2024-09-13T19:36:59.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.526+0000 7f08b931c640 1 -- start start 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.526+0000 7f08b931c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08b4131a60 0x7f08b4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.526+0000 7f08b931c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b412c0d0 con 0x7f08b412b5e0 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.526+0000 7f08b931c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f08b412b1b0 con 0x7f08b4131a60 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.526+0000 7f08b2ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f08b412b5e0 0x7f08b412b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41736/0 (socket says 172.21.15.18:41736) 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.526+0000 7f08b2ffd640 1 -- 172.21.15.18:0/2875609303 learned_addr learned my addr 172.21.15.18:0/2875609303 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.526+0000 7f08b27fc640 1 --2- 172.21.15.18:0/2875609303 >> v2:172.21.15.18:3300/0 conn(0x7f08b4131a60 0x7f08b4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b1ffb640 1 -- 172.21.15.18:0/2875609303 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021474653 0 0) 0x7f08b412c0d0 con 0x7f08b412b5e0 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b27fc640 1 -- 172.21.15.18:0/2875609303 >> v1:172.21.15.18:6789/0 conn(0x7f08b412b5e0 legacy=0x7f08b412b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b27fc640 1 -- 172.21.15.18:0/2875609303 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b412b3e0 con 0x7f08b4131a60 2024-09-13T19:36:59.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b27fc640 1 --2- 172.21.15.18:0/2875609303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b4131a60 0x7f08b4133e50 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009740 tx=0x7f08a801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a8e15822227b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b1ffb640 1 -- 172.21.15.18:0/2875609303 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a80b0070 con 0x7f08b4131a60 2024-09-13T19:36:59.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b1ffb640 1 -- 172.21.15.18:0/2875609303 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80ab530 con 0x7f08b4131a60 2024-09-13T19:36:59.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b1ffb640 1 -- 172.21.15.18:0/2875609303 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a80ab830 con 0x7f08b4131a60 2024-09-13T19:36:59.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b931c640 1 -- 172.21.15.18:0/2875609303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b4131a60 msgr2=0x7f08b4133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b931c640 1 --2- 172.21.15.18:0/2875609303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b4131a60 0x7f08b4133e50 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009740 tx=0x7f08a801c370 comp rx=0 tx=0).stop 2024-09-13T19:36:59.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b931c640 1 -- 172.21.15.18:0/2875609303 shutdown_connections 2024-09-13T19:36:59.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b931c640 1 --2- 172.21.15.18:0/2875609303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b4131a60 0x7f08b4133e50 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b931c640 1 -- 172.21.15.18:0/2875609303 >> 172.21.15.18:0/2875609303 conn(0x7f08b409dcb0 msgr2=0x7f08b409e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:59.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b931c640 1 -- 172.21.15.18:0/2875609303 shutdown_connections 2024-09-13T19:36:59.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.530+0000 7f08b931c640 1 -- 172.21.15.18:0/2875609303 wait complete. 2024-09-13T19:36:59.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b931c640 1 Processor -- start 2024-09-13T19:36:59.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b931c640 1 -- start start 2024-09-13T19:36:59.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b931c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b412b5e0 0x7f08b41c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b931c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4098980 con 0x7f08b412b5e0 2024-09-13T19:36:59.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b412b5e0 0x7f08b41c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b412b5e0 0x7f08b41c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58438/0 (socket says 172.21.15.18:58438) 2024-09-13T19:36:59.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b2ffd640 1 -- 172.21.15.18:0/1264205124 learned_addr learned my addr 172.21.15.18:0/1264205124 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:59.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b2ffd640 1 -- 172.21.15.18:0/1264205124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b4128ea0 con 0x7f08b412b5e0 2024-09-13T19:36:59.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b2ffd640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b412b5e0 0x7f08b41c5d00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f08a400c420 tx=0x7f08a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a4018070 con 0x7f08b412b5e0 2024-09-13T19:36:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a40074d0 con 0x7f08b412b5e0 2024-09-13T19:36:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b4127df0 con 0x7f08b412b5e0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a4004960 con 0x7f08b412b5e0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b412e160 con 0x7f08b412b5e0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08b412b9c0 con 0x7f08b412b5e0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f08a401b070 con 0x7f08b412b5e0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f08a0035db0 0x7f08a0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f08a4048380 con 0x7f08b412b5e0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f08a0041bb0 0x7f08a0044050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08a0044720 con 0x7f08a0041bb0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f08a404f050 con 0x7f08b412b5e0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b27fc640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f08a0035db0 0x7f08a0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.534+0000 7f08b37fe640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f08a0041bb0 0x7f08a0044050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.538+0000 7f08b37fe640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f08a0041bb0 0x7f08a0044050 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.538+0000 7f08b27fc640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f08a0035db0 0x7f08a0038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f08a80ad000 tx=0x7f08a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.538+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 <== osd.2 v2:172.21.15.144:6816/2341760841 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08a0044720 con 0x7f08a0041bb0 2024-09-13T19:36:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.550+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 --> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f08b4131a60 con 0x7f08a0041bb0 2024-09-13T19:36:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f089b7fe640 1 -- 172.21.15.18:0/1264205124 <== osd.2 v2:172.21.15.144:6816/2341760841 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f08b4131a60 con 0x7f08a0041bb0 2024-09-13T19:36:59.557 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T19:36:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:36:59.557 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T19:36:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f08a0041bb0 msgr2=0x7f08a0044050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f08a0041bb0 0x7f08a0044050 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f08a0035db0 msgr2=0x7f08a0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f08a0035db0 0x7f08a0038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f08a80ad000 tx=0x7f08a8008040 comp rx=0 tx=0).stop 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b412b5e0 msgr2=0x7f08b41c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b412b5e0 0x7f08b41c5d00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f08a400c420 tx=0x7f08a400c8e0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 shutdown_connections 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6816/2341760841,v1:172.21.15.144:6817/2341760841] conn(0x7f08a0041bb0 0x7f08a0044050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f08a0035db0 0x7f08a0038270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 --2- 172.21.15.18:0/1264205124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b412b5e0 0x7f08b41c5d00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 >> 172.21.15.18:0/1264205124 conn(0x7f08b409dcb0 msgr2=0x7f08b4098f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 shutdown_connections 2024-09-13T19:36:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.554+0000 7f08b931c640 1 -- 172.21.15.18:0/1264205124 wait complete. 2024-09-13T19:36:59.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc90268e640 1 Processor -- start 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc90268e640 1 -- start start 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc90268e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8fc12e760 0x7fc8fc12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc90268e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8fc0984f0 con 0x7fc8fc12f1c0 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc90268e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc8fc098dc0 con 0x7fc8fc12e760 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc8fbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8fc12e760 0x7fc8fc12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc8fb7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc8fc12f1c0 0x7fc8fc12b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41748/0 (socket says 172.21.15.18:41748) 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc8fb7fe640 1 -- 172.21.15.18:0/1086717286 learned_addr learned my addr 172.21.15.18:0/1086717286 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:36:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc8fbfff640 1 -- 172.21.15.18:0/1086717286 >> v1:172.21.15.18:6789/0 conn(0x7fc8fc12f1c0 legacy=0x7fc8fc12b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc8fbfff640 1 -- 172.21.15.18:0/1086717286 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8fc12f5a0 con 0x7fc8fc12e760 2024-09-13T19:36:59.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc8faffd640 1 -- 172.21.15.18:0/1086717286 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063392946 0 0) 0x7fc8fc0984f0 con 0x7fc8fc12f1c0 2024-09-13T19:36:59.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc8fbfff640 1 --2- 172.21.15.18:0/1086717286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc12ec80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009740 tx=0x7fc8ec01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6ddf67a7163072 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.694+0000 7fc8faffd640 1 -- 172.21.15.18:0/1086717286 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ec0b0070 con 0x7fc8fc12e760 2024-09-13T19:36:59.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8faffd640 1 -- 172.21.15.18:0/1086717286 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec0ab530 con 0x7fc8fc12e760 2024-09-13T19:36:59.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8faffd640 1 -- 172.21.15.18:0/1086717286 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ec0ab830 con 0x7fc8fc12e760 2024-09-13T19:36:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- 172.21.15.18:0/1086717286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 msgr2=0x7fc8fc12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 --2- 172.21.15.18:0/1086717286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc12ec80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009740 tx=0x7fc8ec01c400 comp rx=0 tx=0).stop 2024-09-13T19:36:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- 172.21.15.18:0/1086717286 shutdown_connections 2024-09-13T19:36:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 --2- 172.21.15.18:0/1086717286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc12ec80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- 172.21.15.18:0/1086717286 >> 172.21.15.18:0/1086717286 conn(0x7fc8fc0a10a0 msgr2=0x7fc8fc0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- 172.21.15.18:0/1086717286 shutdown_connections 2024-09-13T19:36:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- 172.21.15.18:0/1086717286 wait complete. 2024-09-13T19:36:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 Processor -- start 2024-09-13T19:36:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- start start 2024-09-13T19:36:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc130990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc136e30 con 0x7fc8fc12e760 2024-09-13T19:36:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8fbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8fbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc130990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58458/0 (socket says 172.21.15.18:58458) 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8fbfff640 1 -- 172.21.15.18:0/1479320406 learned_addr learned my addr 172.21.15.18:0/1479320406 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8fbfff640 1 -- 172.21.15.18:0/1479320406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8fc132f20 con 0x7fc8fc12e760 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8fbfff640 1 --2- 172.21.15.18:0/1479320406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc130990 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec01a030 tx=0x7fc8ec01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8f8ff9640 1 -- 172.21.15.18:0/1479320406 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ec0bb070 con 0x7fc8fc12e760 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8f8ff9640 1 -- 172.21.15.18:0/1479320406 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec0abe40 con 0x7fc8fc12e760 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc8f8ff9640 1 -- 172.21.15.18:0/1479320406 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ec0b0040 con 0x7fc8fc12e760 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8fc1333e0 con 0x7fc8fc12e760 2024-09-13T19:36:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.698+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8fc1310a0 con 0x7fc8fc12e760 2024-09-13T19:36:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.702+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8fc1322b0 con 0x7fc8fc12e760 2024-09-13T19:36:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.702+0000 7fc8f8ff9640 1 -- 172.21.15.18:0/1479320406 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8ec004150 con 0x7fc8fc12e760 2024-09-13T19:36:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.702+0000 7fc8f8ff9640 1 --2- 172.21.15.18:0/1479320406 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc8e8035db0 0x7fc8e8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:36:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.702+0000 7fc8f8ff9640 1 -- 172.21.15.18:0/1479320406 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc8ec0e3680 con 0x7fc8fc12e760 2024-09-13T19:36:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.702+0000 7fc8fb7fe640 1 --2- 172.21.15.18:0/1479320406 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc8e8035db0 0x7fc8e8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:36:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.702+0000 7fc8fb7fe640 1 --2- 172.21.15.18:0/1479320406 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc8e8035db0 0x7fc8e8038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0007fd0 tx=0x7fc8f0007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:36:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.706+0000 7fc8f8ff9640 1 -- 172.21.15.18:0/1479320406 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc8ec015ff0 con 0x7fc8fc12e760 2024-09-13T19:36:59.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.874+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc8fc12ec80 con 0x7fc8e8035db0 2024-09-13T19:36:59.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.874+0000 7fc8f8ff9640 1 -- 172.21.15.18:0/1479320406 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc8fc12ec80 con 0x7fc8e8035db0 2024-09-13T19:36:59.880 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T19:36:59.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc8e8035db0 msgr2=0x7fc8e8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 --2- 172.21.15.18:0/1479320406 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc8e8035db0 0x7fc8e8038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0007fd0 tx=0x7fc8f0007980 comp rx=0 tx=0).stop 2024-09-13T19:36:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 msgr2=0x7fc8fc130990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:36:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 --2- 172.21.15.18:0/1479320406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc130990 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec01a030 tx=0x7fc8ec01ac40 comp rx=0 tx=0).stop 2024-09-13T19:36:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 shutdown_connections 2024-09-13T19:36:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 --2- 172.21.15.18:0/1479320406 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc8e8035db0 0x7fc8e8038270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 --2- 172.21.15.18:0/1479320406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc12e760 0x7fc8fc130990 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:36:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 >> 172.21.15.18:0/1479320406 conn(0x7fc8fc0a10a0 msgr2=0x7fc8fc12c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:36:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 shutdown_connections 2024-09-13T19:36:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:36:59.878+0000 7fc90268e640 1 -- 172.21.15.18:0/1479320406 wait complete. 2024-09-13T19:36:59.900 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T19:36:59.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:37:00.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.014+0000 7fd373128640 1 Processor -- start 2024-09-13T19:37:00.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.014+0000 7fd373128640 1 -- start start 2024-09-13T19:37:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.014+0000 7fd373128640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd36c0968f0 0x7fd36c12fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.014+0000 7fd373128640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36c12ad10 con 0x7fd36c12a930 2024-09-13T19:37:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.014+0000 7fd373128640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd36c12b6f0 con 0x7fd36c0968f0 2024-09-13T19:37:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.014+0000 7fd370ec4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd36c12a930 0x7fd36c12afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41756/0 (socket says 172.21.15.18:41756) 2024-09-13T19:37:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.014+0000 7fd370ec4640 1 -- 172.21.15.18:0/3619367111 learned_addr learned my addr 172.21.15.18:0/3619367111 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:37:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.014+0000 7fd36bfff640 1 --2- 172.21.15.18:0/3619367111 >> v2:172.21.15.18:3300/0 conn(0x7fd36c0968f0 0x7fd36c12fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd36b7fe640 1 -- 172.21.15.18:0/3619367111 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088187431 0 0) 0x7fd36c12ad10 con 0x7fd36c12a930 2024-09-13T19:37:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd36b7fe640 1 -- 172.21.15.18:0/3619367111 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd354003530 con 0x7fd36c12a930 2024-09-13T19:37:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd36bfff640 1 -- 172.21.15.18:0/3619367111 >> v1:172.21.15.18:6789/0 conn(0x7fd36c12a930 legacy=0x7fd36c12afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd36bfff640 1 -- 172.21.15.18:0/3619367111 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c097060 con 0x7fd36c0968f0 2024-09-13T19:37:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd36bfff640 1 --2- 172.21.15.18:0/3619367111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c12fcb0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd360009740 tx=0x7fd36001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ac12da87639984 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd36b7fe640 1 -- 172.21.15.18:0/3619367111 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3600b0070 con 0x7fd36c0968f0 2024-09-13T19:37:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd36b7fe640 1 -- 172.21.15.18:0/3619367111 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3600ab530 con 0x7fd36c0968f0 2024-09-13T19:37:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd36b7fe640 1 -- 172.21.15.18:0/3619367111 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3600ab810 con 0x7fd36c0968f0 2024-09-13T19:37:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 -- 172.21.15.18:0/3619367111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 msgr2=0x7fd36c12fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 --2- 172.21.15.18:0/3619367111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c12fcb0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd360009740 tx=0x7fd36001c370 comp rx=0 tx=0).stop 2024-09-13T19:37:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 -- 172.21.15.18:0/3619367111 shutdown_connections 2024-09-13T19:37:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 --2- 172.21.15.18:0/3619367111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c12fcb0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 -- 172.21.15.18:0/3619367111 >> 172.21.15.18:0/3619367111 conn(0x7fd36c09d430 msgr2=0x7fd36c09d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 -- 172.21.15.18:0/3619367111 shutdown_connections 2024-09-13T19:37:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 -- 172.21.15.18:0/3619367111 wait complete. 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 Processor -- start 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 -- start start 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c1c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.018+0000 7fd373128640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c1350c0 con 0x7fd36c0968f0 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd370ec4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c1c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd370ec4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c1c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58488/0 (socket says 172.21.15.18:58488) 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd370ec4640 1 -- 172.21.15.18:0/3206640564 learned_addr learned my addr 172.21.15.18:0/3206640564 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd370ec4640 1 -- 172.21.15.18:0/3206640564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c133eb0 con 0x7fd36c0968f0 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd370ec4640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c1c6610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00cb40 tx=0x7fd35c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35c017070 con 0x7fd36c0968f0 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c00ab80 con 0x7fd36c0968f0 2024-09-13T19:37:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36c133300 con 0x7fd36c0968f0 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35c012400 con 0x7fd36c0968f0 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36c1c6d20 con 0x7fd36c0968f0 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd36c12afe0 con 0x7fd36c0968f0 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd35c01a070 con 0x7fd36c0968f0 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd358035db0 0x7fd358038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd35c048dd0 con 0x7fd36c0968f0 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7fd358041c10 0x7fd3580440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd358044780 con 0x7fd358041c10 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd35c04b480 con 0x7fd36c0968f0 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd36bfff640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd358035db0 0x7fd358038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3716c5640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7fd358041c10 0x7fd3580440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd3716c5640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7fd358041c10 0x7fd3580440b0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.022+0000 7fd36bfff640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd358035db0 0x7fd358038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd3600ad000 tx=0x7fd3600a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.026+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 <== osd.3 v2:172.21.15.144:6800/1157716661 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd358044780 con 0x7fd358041c10 2024-09-13T19:37:00.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 --> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd36c1c7010 con 0x7fd358041c10 2024-09-13T19:37:00.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd3697fa640 1 -- 172.21.15.18:0/3206640564 <== osd.3 v2:172.21.15.144:6800/1157716661 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd36c1c7010 con 0x7fd358041c10 2024-09-13T19:37:00.043 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-13T19:37:00.043 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:37:00.043 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7fd358041c10 msgr2=0x7fd3580440b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7fd358041c10 0x7fd3580440b0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd358035db0 msgr2=0x7fd358038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd358035db0 0x7fd358038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd3600ad000 tx=0x7fd3600a6000 comp rx=0 tx=0).stop 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 msgr2=0x7fd36c1c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c1c6610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00cb40 tx=0x7fd35c0021f0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 shutdown_connections 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6800/1157716661,v1:172.21.15.144:6801/1157716661] conn(0x7fd358041c10 0x7fd3580440b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd358035db0 0x7fd358038270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 --2- 172.21.15.18:0/3206640564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd36c0968f0 0x7fd36c1c6610 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 >> 172.21.15.18:0/3206640564 conn(0x7fd36c09d430 msgr2=0x7fd36c129860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:00.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 shutdown_connections 2024-09-13T19:37:00.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.038+0000 7fd373128640 1 -- 172.21.15.18:0/3206640564 wait complete. 2024-09-13T19:37:00.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T19:37:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f606170b640 1 Processor -- start 2024-09-13T19:37:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f606170b640 1 -- start start 2024-09-13T19:37:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f606170b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f605c095d10 0x7f605c132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f606170b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c096880 con 0x7f605c073290 2024-09-13T19:37:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f606170b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f605c09df00 con 0x7f605c095d10 2024-09-13T19:37:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f605a7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f605c095d10 0x7f605c132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f605affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f605c073290 0x7f605c095600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41768/0 (socket says 172.21.15.18:41768) 2024-09-13T19:37:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f605affd640 1 -- 172.21.15.18:0/3567880285 learned_addr learned my addr 172.21.15.18:0/3567880285 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:37:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f605a7fc640 1 -- 172.21.15.18:0/3567880285 >> v1:172.21.15.18:6789/0 conn(0x7f605c073290 legacy=0x7f605c095600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.170+0000 7f605a7fc640 1 -- 172.21.15.18:0/3567880285 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c096ca0 con 0x7f605c095d10 2024-09-13T19:37:00.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f605a7fc640 1 --2- 172.21.15.18:0/3567880285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c095d10 0x7f605c132290 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f6044009740 tx=0x7f604401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8741b4a938730a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f6059ffb640 1 -- 172.21.15.18:0/3567880285 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60440b1070 con 0x7f605c095d10 2024-09-13T19:37:00.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f6059ffb640 1 -- 172.21.15.18:0/3567880285 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60440ac520 con 0x7f605c095d10 2024-09-13T19:37:00.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f6059ffb640 1 -- 172.21.15.18:0/3567880285 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60440ac820 con 0x7f605c095d10 2024-09-13T19:37:00.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- 172.21.15.18:0/3567880285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c095d10 msgr2=0x7f605c132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 --2- 172.21.15.18:0/3567880285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c095d10 0x7f605c132290 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f6044009740 tx=0x7f604401c370 comp rx=0 tx=0).stop 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- 172.21.15.18:0/3567880285 shutdown_connections 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 --2- 172.21.15.18:0/3567880285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c095d10 0x7f605c132290 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- 172.21.15.18:0/3567880285 >> 172.21.15.18:0/3567880285 conn(0x7f605c09d6f0 msgr2=0x7f605c099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- 172.21.15.18:0/3567880285 shutdown_connections 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- 172.21.15.18:0/3567880285 wait complete. 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 Processor -- start 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- start start 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c073290 0x7f605c06e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f605c074fe0 con 0x7f605c073290 2024-09-13T19:37:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f605affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c073290 0x7f605c06e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f605affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c073290 0x7f605c06e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58506/0 (socket says 172.21.15.18:58506) 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f605affd640 1 -- 172.21.15.18:0/2600703259 learned_addr learned my addr 172.21.15.18:0/2600703259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f605affd640 1 -- 172.21.15.18:0/2600703259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c06f410 con 0x7f605c073290 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f605affd640 1 --2- 172.21.15.18:0/2600703259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c073290 0x7f605c06e8a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f605400cb40 tx=0x7f605400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f60537fe640 1 -- 172.21.15.18:0/2600703259 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6054017070 con 0x7f605c073290 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f60537fe640 1 -- 172.21.15.18:0/2600703259 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605400ab30 con 0x7f605c073290 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c0973f0 con 0x7f605c073290 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f60537fe640 1 -- 172.21.15.18:0/2600703259 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605400ae10 con 0x7f605c073290 2024-09-13T19:37:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.174+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c092960 con 0x7f605c073290 2024-09-13T19:37:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.178+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605c093f30 con 0x7f605c073290 2024-09-13T19:37:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.178+0000 7f60537fe640 1 -- 172.21.15.18:0/2600703259 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f605401a070 con 0x7f605c073290 2024-09-13T19:37:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.178+0000 7f60537fe640 1 --2- 172.21.15.18:0/2600703259 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c035d60 0x7f603c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.178+0000 7f60537fe640 1 -- 172.21.15.18:0/2600703259 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6054048d20 con 0x7f605c073290 2024-09-13T19:37:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.178+0000 7f605a7fc640 1 --2- 172.21.15.18:0/2600703259 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c035d60 0x7f603c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.178+0000 7f605a7fc640 1 --2- 172.21.15.18:0/2600703259 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c035d60 0x7f603c038220 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f60440ae000 tx=0x7f6044008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.182+0000 7f60537fe640 1 -- 172.21.15.18:0/2600703259 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f605404d070 con 0x7f605c073290 2024-09-13T19:37:00.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.346+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f605c091e20 con 0x7f603c035d60 2024-09-13T19:37:00.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f60537fe640 1 -- 172.21.15.18:0/2600703259 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f605c091e20 con 0x7f603c035d60 2024-09-13T19:37:00.353 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T19:37:00.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c035d60 msgr2=0x7f603c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 --2- 172.21.15.18:0/2600703259 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c035d60 0x7f603c038220 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f60440ae000 tx=0x7f6044008040 comp rx=0 tx=0).stop 2024-09-13T19:37:00.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c073290 msgr2=0x7f605c06e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 --2- 172.21.15.18:0/2600703259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c073290 0x7f605c06e8a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f605400cb40 tx=0x7f605400cf40 comp rx=0 tx=0).stop 2024-09-13T19:37:00.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 shutdown_connections 2024-09-13T19:37:00.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 --2- 172.21.15.18:0/2600703259 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f603c035d60 0x7f603c038220 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 --2- 172.21.15.18:0/2600703259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605c073290 0x7f605c06e8a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 >> 172.21.15.18:0/2600703259 conn(0x7f605c09d6f0 msgr2=0x7f605c098980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:00.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 shutdown_connections 2024-09-13T19:37:00.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.350+0000 7f606170b640 1 -- 172.21.15.18:0/2600703259 wait complete. 2024-09-13T19:37:00.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11c0e5b640 1 Processor -- start 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11c0e5b640 1 -- start start 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11c0e5b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f11bc06dbd0 0x7f11bc131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11c0e5b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11bc071c10 con 0x7f11bc06d0e0 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11c0e5b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f11bc072230 con 0x7f11bc06dbd0 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11ba59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f11bc06d0e0 0x7f11bc06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41772/0 (socket says 172.21.15.18:41772) 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11ba59c640 1 -- 172.21.15.18:0/3647967373 learned_addr learned my addr 172.21.15.18:0/3647967373 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11b9d9b640 1 --2- 172.21.15.18:0/3647967373 >> v2:172.21.15.18:3300/0 conn(0x7f11bc06dbd0 0x7f11bc131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11b959a640 1 -- 172.21.15.18:0/3647967373 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552247627 0 0) 0x7f11bc071c10 con 0x7f11bc06d0e0 2024-09-13T19:37:00.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11b959a640 1 -- 172.21.15.18:0/3647967373 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11a4003530 con 0x7f11bc06d0e0 2024-09-13T19:37:00.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11b9d9b640 1 -- 172.21.15.18:0/3647967373 >> v1:172.21.15.18:6789/0 conn(0x7f11bc06d0e0 legacy=0x7f11bc06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11b9d9b640 1 -- 172.21.15.18:0/3647967373 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc0709e0 con 0x7f11bc06dbd0 2024-09-13T19:37:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.490+0000 7f11b9d9b640 1 --2- 172.21.15.18:0/3647967373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06dbd0 0x7f11bc131e60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009740 tx=0x7f11b001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a6ce2be5bbde86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11b959a640 1 -- 172.21.15.18:0/3647967373 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11b00b0070 con 0x7f11bc06dbd0 2024-09-13T19:37:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11b959a640 1 -- 172.21.15.18:0/3647967373 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b00ab530 con 0x7f11bc06dbd0 2024-09-13T19:37:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11b959a640 1 -- 172.21.15.18:0/3647967373 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11b00ab830 con 0x7f11bc06dbd0 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- 172.21.15.18:0/3647967373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06dbd0 msgr2=0x7f11bc131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 --2- 172.21.15.18:0/3647967373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06dbd0 0x7f11bc131e60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009740 tx=0x7f11b001c370 comp rx=0 tx=0).stop 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- 172.21.15.18:0/3647967373 shutdown_connections 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 --2- 172.21.15.18:0/3647967373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06dbd0 0x7f11bc131e60 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- 172.21.15.18:0/3647967373 >> 172.21.15.18:0/3647967373 conn(0x7f11bc099a50 msgr2=0x7f11bc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- 172.21.15.18:0/3647967373 shutdown_connections 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- 172.21.15.18:0/3647967373 wait complete. 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 Processor -- start 2024-09-13T19:37:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- start start 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06d0e0 0x7f11bc092090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc134d40 con 0x7f11bc06d0e0 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11ba59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06d0e0 0x7f11bc092090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11ba59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06d0e0 0x7f11bc092090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58530/0 (socket says 172.21.15.18:58530) 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11ba59c640 1 -- 172.21.15.18:0/2074078344 learned_addr learned my addr 172.21.15.18:0/2074078344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11ba59c640 1 -- 172.21.15.18:0/2074078344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc094290 con 0x7f11bc06d0e0 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11ba59c640 1 --2- 172.21.15.18:0/2074078344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06d0e0 0x7f11bc092090 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00c450 tx=0x7f11ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11aaffd640 1 -- 172.21.15.18:0/2074078344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ac017070 con 0x7f11bc06d0e0 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11aaffd640 1 -- 172.21.15.18:0/2074078344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ac005c20 con 0x7f11bc06d0e0 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc095250 con 0x7f11bc06d0e0 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11aaffd640 1 -- 172.21.15.18:0/2074078344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ac007070 con 0x7f11bc06d0e0 2024-09-13T19:37:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc095690 con 0x7f11bc06d0e0 2024-09-13T19:37:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.494+0000 7f11aaffd640 1 -- 172.21.15.18:0/2074078344 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f11ac01a070 con 0x7f11bc06d0e0 2024-09-13T19:37:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.498+0000 7f11aaffd640 1 --2- 172.21.15.18:0/2074078344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f119c035db0 0x7f119c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.498+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc06d4c0 con 0x7f11bc06d0e0 2024-09-13T19:37:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.498+0000 7f11aaffd640 1 -- 172.21.15.18:0/2074078344 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f11ac0482d0 con 0x7f11bc06d0e0 2024-09-13T19:37:00.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.498+0000 7f11b9d9b640 1 --2- 172.21.15.18:0/2074078344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f119c035db0 0x7f119c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:00.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.498+0000 7f11b9d9b640 1 --2- 172.21.15.18:0/2074078344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f119c035db0 0x7f119c038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ad000 tx=0x7f11b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:00.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.502+0000 7f11aaffd640 1 -- 172.21.15.18:0/2074078344 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f11ac012400 con 0x7f11bc06d0e0 2024-09-13T19:37:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.662+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11bc073790 con 0x7f119c035db0 2024-09-13T19:37:00.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.706+0000 7f11aaffd640 1 -- 172.21.15.18:0/2074078344 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+663221 (secure 0 0 0) 0x7f11bc073790 con 0x7f119c035db0 2024-09-13T19:37:00.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:37:00.726 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f119c035db0 msgr2=0x7f119c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 --2- 172.21.15.18:0/2074078344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f119c035db0 0x7f119c038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ad000 tx=0x7f11b00a6000 comp rx=0 tx=0).stop 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06d0e0 msgr2=0x7f11bc092090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 --2- 172.21.15.18:0/2074078344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06d0e0 0x7f11bc092090 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00c450 tx=0x7f11ac00c910 comp rx=0 tx=0).stop 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 shutdown_connections 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 --2- 172.21.15.18:0/2074078344 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f119c035db0 0x7f119c038270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 --2- 172.21.15.18:0/2074078344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11bc06d0e0 0x7f11bc092090 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 >> 172.21.15.18:0/2074078344 conn(0x7f11bc099a50 msgr2=0x7f11bc08afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 shutdown_connections 2024-09-13T19:37:00.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:00.718+0000 7f11c0e5b640 1 -- 172.21.15.18:0/2074078344 wait complete. 2024-09-13T19:37:00.742 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-13T19:37:00.515742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22216794,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":4947,"num_read_kb":4535,"num_write":2125,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4547,"ondisk_log_size":4547,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182192,"kb_used_data":49132,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377305168,"statfs":{"total":386547056640,"available":386360492032,"internally_reserved":0,"allocated":50311168,"data_stored":49141715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4196015,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":60,"num_read_kb":67,"num_write":17,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005728"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.686210+0000","last_change":"2024-09-13T19:33:08.351986+0000","last_active":"2024-09-13T19:33:52.686210+0000","last_peered":"2024-09-13T19:33:52.686210+0000","last_clean":"2024-09-13T19:33:52.686210+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:33:52.686210+0000","last_undegraded":"2024-09-13T19:33:52.686210+0000","last_fullsized":"2024-09-13T19:33:52.686210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278487+0000","last_change":"2024-09-13T19:33:10.354610+0000","last_active":"2024-09-13T19:36:24.278487+0000","last_peered":"2024-09-13T19:36:24.278487+0000","last_clean":"2024-09-13T19:36:24.278487+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:36:24.278487+0000","last_undegraded":"2024-09-13T19:36:24.278487+0000","last_fullsized":"2024-09-13T19:36:24.278487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:03.258150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.091774+0000","last_change":"2024-09-13T19:33:08.349789+0000","last_active":"2024-09-13T19:36:24.091774+0000","last_peered":"2024-09-13T19:36:24.091774+0000","last_clean":"2024-09-13T19:36:24.091774+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:36:24.091774+0000","last_undegraded":"2024-09-13T19:36:24.091774+0000","last_fullsized":"2024-09-13T19:36:24.091774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.441692+0000","last_change":"2024-09-13T19:33:49.508985+0000","last_active":"2024-09-13T19:36:24.441692+0000","last_peered":"2024-09-13T19:36:24.441692+0000","last_clean":"2024-09-13T19:36:24.441692+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:36:24.441692+0000","last_undegraded":"2024-09-13T19:36:24.441692+0000","last_fullsized":"2024-09-13T19:36:24.441692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515719+0000","last_change":"2024-09-13T19:33:08.354845+0000","last_active":"2024-09-13T19:33:49.515719+0000","last_peered":"2024-09-13T19:33:49.515719+0000","last_clean":"2024-09-13T19:33:49.515719+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:33:49.515719+0000","last_undegraded":"2024-09-13T19:33:49.515719+0000","last_fullsized":"2024-09-13T19:33:49.515719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:38.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.223614+0000","last_change":"2024-09-13T19:33:10.349694+0000","last_active":"2024-09-13T19:36:24.223614+0000","last_peered":"2024-09-13T19:36:24.223614+0000","last_clean":"2024-09-13T19:36:24.223614+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:36:24.223614+0000","last_undegraded":"2024-09-13T19:36:24.223614+0000","last_fullsized":"2024-09-13T19:36:24.223614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:06.072800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.518838+0000","last_change":"2024-09-13T19:33:08.348066+0000","last_active":"2024-09-13T19:33:49.518838+0000","last_peered":"2024-09-13T19:33:49.518838+0000","last_clean":"2024-09-13T19:33:49.518838+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:33:49.518838+0000","last_undegraded":"2024-09-13T19:33:49.518838+0000","last_fullsized":"2024-09-13T19:33:49.518838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:46.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.522657+0000","last_change":"2024-09-13T19:33:10.348236+0000","last_active":"2024-09-13T19:34:37.522657+0000","last_peered":"2024-09-13T19:34:37.522657+0000","last_clean":"2024-09-13T19:34:37.522657+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:34:37.522657+0000","last_undegraded":"2024-09-13T19:34:37.522657+0000","last_fullsized":"2024-09-13T19:34:37.522657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:14.920902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505426+0000","last_change":"2024-09-13T19:33:08.336355+0000","last_active":"2024-09-13T19:33:49.505426+0000","last_peered":"2024-09-13T19:33:49.505426+0000","last_clean":"2024-09-13T19:33:49.505426+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:33:49.505426+0000","last_undegraded":"2024-09-13T19:33:49.505426+0000","last_fullsized":"2024-09-13T19:33:49.505426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:21.610997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.872394+0000","last_change":"2024-09-13T19:33:10.353752+0000","last_active":"2024-09-13T19:33:54.872394+0000","last_peered":"2024-09-13T19:33:54.872394+0000","last_clean":"2024-09-13T19:33:54.872394+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:33:54.872394+0000","last_undegraded":"2024-09-13T19:33:54.872394+0000","last_fullsized":"2024-09-13T19:33:54.872394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:25.322287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.518463+0000","last_change":"2024-09-13T19:33:08.333243+0000","last_active":"2024-09-13T19:33:49.518463+0000","last_peered":"2024-09-13T19:33:49.518463+0000","last_clean":"2024-09-13T19:33:49.518463+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:33:49.518463+0000","last_undegraded":"2024-09-13T19:33:49.518463+0000","last_fullsized":"2024-09-13T19:33:49.518463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:38.936603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.916325+0000","last_change":"2024-09-13T19:33:10.357587+0000","last_active":"2024-09-13T19:35:22.916325+0000","last_peered":"2024-09-13T19:35:22.916325+0000","last_clean":"2024-09-13T19:35:22.916325+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:35:22.916325+0000","last_undegraded":"2024-09-13T19:35:22.916325+0000","last_fullsized":"2024-09-13T19:35:22.916325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:19.567235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507129+0000","last_change":"2024-09-13T19:33:08.338158+0000","last_active":"2024-09-13T19:33:49.507129+0000","last_peered":"2024-09-13T19:33:49.507129+0000","last_clean":"2024-09-13T19:33:49.507129+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:33:49.507129+0000","last_undegraded":"2024-09-13T19:33:49.507129+0000","last_fullsized":"2024-09-13T19:33:49.507129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:12.010604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.180096+0000","last_change":"2024-09-13T19:33:10.355178+0000","last_active":"2024-09-13T19:35:18.180096+0000","last_peered":"2024-09-13T19:35:18.180096+0000","last_clean":"2024-09-13T19:35:18.180096+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:35:18.180096+0000","last_undegraded":"2024-09-13T19:35:18.180096+0000","last_fullsized":"2024-09-13T19:35:18.180096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:39.500372+0000","last_change":"2024-09-13T19:33:08.331646+0000","last_active":"2024-09-13T19:35:39.500372+0000","last_peered":"2024-09-13T19:35:39.500372+0000","last_clean":"2024-09-13T19:35:39.500372+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:35:39.500372+0000","last_undegraded":"2024-09-13T19:35:39.500372+0000","last_fullsized":"2024-09-13T19:35:39.500372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.521422+0000","last_change":"2024-09-13T19:33:10.332175+0000","last_active":"2024-09-13T19:34:37.521422+0000","last_peered":"2024-09-13T19:34:37.521422+0000","last_clean":"2024-09-13T19:34:37.521422+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:34:37.521422+0000","last_undegraded":"2024-09-13T19:34:37.521422+0000","last_fullsized":"2024-09-13T19:34:37.521422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.169782+0000","last_change":"2024-09-13T19:33:10.348601+0000","last_active":"2024-09-13T19:33:54.169782+0000","last_peered":"2024-09-13T19:33:54.169782+0000","last_clean":"2024-09-13T19:33:54.169782+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:33:54.169782+0000","last_undegraded":"2024-09-13T19:33:54.169782+0000","last_fullsized":"2024-09-13T19:33:54.169782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:18.388392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.176919+0000","last_change":"2024-09-13T19:33:08.338071+0000","last_active":"2024-09-13T19:35:18.176919+0000","last_peered":"2024-09-13T19:35:18.176919+0000","last_clean":"2024-09-13T19:35:18.176919+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:35:18.176919+0000","last_undegraded":"2024-09-13T19:35:18.176919+0000","last_fullsized":"2024-09-13T19:35:18.176919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.208248+0000","last_change":"2024-09-13T19:33:10.350836+0000","last_active":"2024-09-13T19:36:24.208248+0000","last_peered":"2024-09-13T19:36:24.208248+0000","last_clean":"2024-09-13T19:36:24.208248+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:36:24.208248+0000","last_undegraded":"2024-09-13T19:36:24.208248+0000","last_fullsized":"2024-09-13T19:36:24.208248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524586+0000","last_change":"2024-09-13T19:33:08.352861+0000","last_active":"2024-09-13T19:33:49.524586+0000","last_peered":"2024-09-13T19:33:49.524586+0000","last_clean":"2024-09-13T19:33:49.524586+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:33:49.524586+0000","last_undegraded":"2024-09-13T19:33:49.524586+0000","last_fullsized":"2024-09-13T19:33:49.524586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749546+0000","last_change":"2024-09-13T19:33:10.354940+0000","last_active":"2024-09-13T19:36:23.749546+0000","last_peered":"2024-09-13T19:36:23.749546+0000","last_clean":"2024-09-13T19:36:23.749546+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:36:23.749546+0000","last_undegraded":"2024-09-13T19:36:23.749546+0000","last_fullsized":"2024-09-13T19:36:23.749546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:32.796106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.813354+0000","last_change":"2024-09-13T19:33:08.337822+0000","last_active":"2024-09-13T19:35:22.813354+0000","last_peered":"2024-09-13T19:35:22.813354+0000","last_clean":"2024-09-13T19:35:22.813354+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:35:22.813354+0000","last_undegraded":"2024-09-13T19:35:22.813354+0000","last_fullsized":"2024-09-13T19:35:22.813354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:46.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499404+0000","last_change":"2024-09-13T19:33:10.341134+0000","last_active":"2024-09-13T19:35:34.499404+0000","last_peered":"2024-09-13T19:35:34.499404+0000","last_clean":"2024-09-13T19:35:34.499404+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:35:34.499404+0000","last_undegraded":"2024-09-13T19:35:34.499404+0000","last_fullsized":"2024-09-13T19:35:34.499404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.682621+0000","last_change":"2024-09-13T19:33:08.335101+0000","last_active":"2024-09-13T19:33:52.682621+0000","last_peered":"2024-09-13T19:33:52.682621+0000","last_clean":"2024-09-13T19:33:52.682621+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:33:52.682621+0000","last_undegraded":"2024-09-13T19:33:52.682621+0000","last_fullsized":"2024-09-13T19:33:52.682621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207846+0000","last_change":"2024-09-13T19:33:10.346663+0000","last_active":"2024-09-13T19:36:24.207846+0000","last_peered":"2024-09-13T19:36:24.207846+0000","last_clean":"2024-09-13T19:36:24.207846+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:36:24.207846+0000","last_undegraded":"2024-09-13T19:36:24.207846+0000","last_fullsized":"2024-09-13T19:36:24.207846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:19.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499377+0000","last_change":"2024-09-13T19:33:08.345933+0000","last_active":"2024-09-13T19:35:34.499377+0000","last_peered":"2024-09-13T19:35:34.499377+0000","last_clean":"2024-09-13T19:35:34.499377+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:35:34.499377+0000","last_undegraded":"2024-09-13T19:35:34.499377+0000","last_fullsized":"2024-09-13T19:35:34.499377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278174+0000","last_change":"2024-09-13T19:33:10.352700+0000","last_active":"2024-09-13T19:36:24.278174+0000","last_peered":"2024-09-13T19:36:24.278174+0000","last_clean":"2024-09-13T19:36:24.278174+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:36:24.278174+0000","last_undegraded":"2024-09-13T19:36:24.278174+0000","last_fullsized":"2024-09-13T19:36:24.278174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:42.703374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506193+0000","last_change":"2024-09-13T19:33:08.341033+0000","last_active":"2024-09-13T19:33:49.506193+0000","last_peered":"2024-09-13T19:33:49.506193+0000","last_clean":"2024-09-13T19:33:49.506193+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:33:49.506193+0000","last_undegraded":"2024-09-13T19:33:49.506193+0000","last_fullsized":"2024-09-13T19:33:49.506193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:05.069489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.289296+0000","last_change":"2024-09-13T19:33:18.418602+0000","last_active":"2024-09-13T19:36:24.289296+0000","last_peered":"2024-09-13T19:36:24.289296+0000","last_clean":"2024-09-13T19:36:24.289296+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:36:24.289296+0000","last_undegraded":"2024-09-13T19:36:24.289296+0000","last_fullsized":"2024-09-13T19:36:24.289296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:10.880859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.887329+0000","last_change":"2024-09-13T19:33:10.354595+0000","last_active":"2024-09-13T19:36:23.887329+0000","last_peered":"2024-09-13T19:36:23.887329+0000","last_clean":"2024-09-13T19:36:23.887329+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:36:23.887329+0000","last_undegraded":"2024-09-13T19:36:23.887329+0000","last_fullsized":"2024-09-13T19:36:23.887329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:20.279342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.425021+0000","last_change":"2024-09-13T19:33:08.354352+0000","last_active":"2024-09-13T19:36:23.425021+0000","last_peered":"2024-09-13T19:36:23.425021+0000","last_clean":"2024-09-13T19:36:23.425021+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:36:23.425021+0000","last_undegraded":"2024-09-13T19:36:23.425021+0000","last_fullsized":"2024-09-13T19:36:23.425021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:13.750930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":12,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506011+0000","last_change":"2024-09-13T19:33:12.348066+0000","last_active":"2024-09-13T19:33:49.506011+0000","last_peered":"2024-09-13T19:33:49.506011+0000","last_clean":"2024-09-13T19:33:49.506011+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:33:49.506011+0000","last_undegraded":"2024-09-13T19:33:49.506011+0000","last_fullsized":"2024-09-13T19:33:49.506011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:08.587167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507782+0000","last_change":"2024-09-13T19:33:14.385453+0000","last_active":"2024-09-13T19:35:40.507782+0000","last_peered":"2024-09-13T19:35:40.507782+0000","last_clean":"2024-09-13T19:35:40.507782+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:35:40.507782+0000","last_undegraded":"2024-09-13T19:35:40.507782+0000","last_fullsized":"2024-09-13T19:35:40.507782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:02.906563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510495+0000","last_change":"2024-09-13T19:33:16.394148+0000","last_active":"2024-09-13T19:33:49.510495+0000","last_peered":"2024-09-13T19:33:49.510495+0000","last_clean":"2024-09-13T19:33:49.510495+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:33:49.510495+0000","last_undegraded":"2024-09-13T19:33:49.510495+0000","last_fullsized":"2024-09-13T19:33:49.510495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:48.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.211547+0000","last_change":"2024-09-13T19:33:18.412565+0000","last_active":"2024-09-13T19:36:24.211547+0000","last_peered":"2024-09-13T19:36:24.211547+0000","last_clean":"2024-09-13T19:36:24.211547+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:36:24.211547+0000","last_undegraded":"2024-09-13T19:36:24.211547+0000","last_fullsized":"2024-09-13T19:36:24.211547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:17.846459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278687+0000","last_change":"2024-09-13T19:33:10.353417+0000","last_active":"2024-09-13T19:36:24.278687+0000","last_peered":"2024-09-13T19:36:24.278687+0000","last_clean":"2024-09-13T19:36:24.278687+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:36:24.278687+0000","last_undegraded":"2024-09-13T19:36:24.278687+0000","last_fullsized":"2024-09-13T19:36:24.278687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:18.375886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.344511+0000","last_change":"2024-09-13T19:33:08.348578+0000","last_active":"2024-09-13T19:33:53.344511+0000","last_peered":"2024-09-13T19:33:53.344511+0000","last_clean":"2024-09-13T19:33:53.344511+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:33:53.344511+0000","last_undegraded":"2024-09-13T19:33:53.344511+0000","last_fullsized":"2024-09-13T19:33:53.344511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.481580+0000","last_change":"2024-09-13T19:33:49.525696+0000","last_active":"2024-09-13T19:33:50.481580+0000","last_peered":"2024-09-13T19:33:50.481580+0000","last_clean":"2024-09-13T19:33:50.481580+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:33:50.481580+0000","last_undegraded":"2024-09-13T19:33:50.481580+0000","last_fullsized":"2024-09-13T19:33:50.481580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:29.119647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510753+0000","last_change":"2024-09-13T19:33:14.364101+0000","last_active":"2024-09-13T19:33:49.510753+0000","last_peered":"2024-09-13T19:33:49.510753+0000","last_clean":"2024-09-13T19:33:49.510753+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:33:49.510753+0000","last_undegraded":"2024-09-13T19:33:49.510753+0000","last_fullsized":"2024-09-13T19:33:49.510753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:18.964704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504881+0000","last_change":"2024-09-13T19:33:16.394670+0000","last_active":"2024-09-13T19:33:49.504881+0000","last_peered":"2024-09-13T19:33:49.504881+0000","last_clean":"2024-09-13T19:33:49.504881+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:33:49.504881+0000","last_undegraded":"2024-09-13T19:33:49.504881+0000","last_fullsized":"2024-09-13T19:33:49.504881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:21.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:49.502721+0000","last_change":"2024-09-13T19:33:18.407303+0000","last_active":"2024-09-13T19:35:49.502721+0000","last_peered":"2024-09-13T19:35:49.502721+0000","last_clean":"2024-09-13T19:35:49.502721+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:35:49.502721+0000","last_undegraded":"2024-09-13T19:35:49.502721+0000","last_fullsized":"2024-09-13T19:35:49.502721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'11","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.299618+0000","last_change":"2024-09-13T19:33:10.350582+0000","last_active":"2024-09-13T19:36:24.299618+0000","last_peered":"2024-09-13T19:36:24.299618+0000","last_clean":"2024-09-13T19:36:24.299618+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:36:24.299618+0000","last_undegraded":"2024-09-13T19:36:24.299618+0000","last_fullsized":"2024-09-13T19:36:24.299618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:48.834947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505235+0000","last_change":"2024-09-13T19:33:08.355253+0000","last_active":"2024-09-13T19:33:49.505235+0000","last_peered":"2024-09-13T19:33:49.505235+0000","last_clean":"2024-09-13T19:33:49.505235+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:33:49.505235+0000","last_undegraded":"2024-09-13T19:33:49.505235+0000","last_fullsized":"2024-09-13T19:33:49.505235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:24.473523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.421516+0000","last_change":"2024-09-13T19:33:12.350183+0000","last_active":"2024-09-13T19:36:55.421516+0000","last_peered":"2024-09-13T19:36:55.421516+0000","last_clean":"2024-09-13T19:36:55.421516+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:36:55.421516+0000","last_undegraded":"2024-09-13T19:36:55.421516+0000","last_fullsized":"2024-09-13T19:36:55.421516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.245650+0000","last_change":"2024-09-13T19:33:14.373660+0000","last_active":"2024-09-13T19:34:37.245650+0000","last_peered":"2024-09-13T19:34:37.245650+0000","last_clean":"2024-09-13T19:34:37.245650+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:34:37.245650+0000","last_undegraded":"2024-09-13T19:34:37.245650+0000","last_fullsized":"2024-09-13T19:34:37.245650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:29.436165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'284","reported_seq":393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.444937+0000","last_change":"2024-09-13T19:33:16.400903+0000","last_active":"2024-09-13T19:36:55.444937+0000","last_peered":"2024-09-13T19:36:55.444937+0000","last_clean":"2024-09-13T19:36:55.444937+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:36:55.444937+0000","last_undegraded":"2024-09-13T19:36:55.444937+0000","last_fullsized":"2024-09-13T19:36:55.444937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:31.714918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.826207+0000","last_change":"2024-09-13T19:33:18.416828+0000","last_active":"2024-09-13T19:33:53.826207+0000","last_peered":"2024-09-13T19:33:53.826207+0000","last_clean":"2024-09-13T19:33:53.826207+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:33:53.826207+0000","last_undegraded":"2024-09-13T19:33:53.826207+0000","last_fullsized":"2024-09-13T19:33:53.826207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:50.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749237+0000","last_change":"2024-09-13T19:33:10.342044+0000","last_active":"2024-09-13T19:36:23.749237+0000","last_peered":"2024-09-13T19:36:23.749237+0000","last_clean":"2024-09-13T19:36:23.749237+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:36:23.749237+0000","last_undegraded":"2024-09-13T19:36:23.749237+0000","last_fullsized":"2024-09-13T19:36:23.749237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498238+0000","last_change":"2024-09-13T19:33:08.337394+0000","last_active":"2024-09-13T19:33:49.498238+0000","last_peered":"2024-09-13T19:33:49.498238+0000","last_clean":"2024-09-13T19:33:49.498238+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:33:49.498238+0000","last_undegraded":"2024-09-13T19:33:49.498238+0000","last_fullsized":"2024-09-13T19:33:49.498238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:13.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513312+0000","last_change":"2024-09-13T19:33:12.356265+0000","last_active":"2024-09-13T19:33:49.513312+0000","last_peered":"2024-09-13T19:33:49.513312+0000","last_clean":"2024-09-13T19:33:49.513312+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:33:49.513312+0000","last_undegraded":"2024-09-13T19:33:49.513312+0000","last_fullsized":"2024-09-13T19:33:49.513312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:52.279609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'32","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503719+0000","last_change":"2024-09-13T19:33:14.371462+0000","last_active":"2024-09-13T19:35:40.503719+0000","last_peered":"2024-09-13T19:35:40.503719+0000","last_clean":"2024-09-13T19:35:40.503719+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:35:40.503719+0000","last_undegraded":"2024-09-13T19:35:40.503719+0000","last_fullsized":"2024-09-13T19:35:40.503719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:35.666084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":406,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.795748+0000","last_change":"2024-09-13T19:33:16.392294+0000","last_active":"2024-09-13T19:36:55.795748+0000","last_peered":"2024-09-13T19:36:55.795748+0000","last_clean":"2024-09-13T19:36:55.795748+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:36:55.795748+0000","last_undegraded":"2024-09-13T19:36:55.795748+0000","last_fullsized":"2024-09-13T19:36:55.795748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096128+0000","last_change":"2024-09-13T19:33:10.356414+0000","last_active":"2024-09-13T19:36:24.096128+0000","last_peered":"2024-09-13T19:36:24.096128+0000","last_clean":"2024-09-13T19:36:24.096128+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:36:24.096128+0000","last_undegraded":"2024-09-13T19:36:24.096128+0000","last_fullsized":"2024-09-13T19:36:24.096128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:05.759718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.500106+0000","last_change":"2024-09-13T19:33:08.347478+0000","last_active":"2024-09-13T19:35:25.500106+0000","last_peered":"2024-09-13T19:35:25.500106+0000","last_clean":"2024-09-13T19:35:25.500106+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:35:25.500106+0000","last_undegraded":"2024-09-13T19:35:25.500106+0000","last_fullsized":"2024-09-13T19:35:25.500106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:11.380672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499234+0000","last_change":"2024-09-13T19:33:12.362201+0000","last_active":"2024-09-13T19:33:49.499234+0000","last_peered":"2024-09-13T19:33:49.499234+0000","last_clean":"2024-09-13T19:33:49.499234+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:33:49.499234+0000","last_undegraded":"2024-09-13T19:33:49.499234+0000","last_fullsized":"2024-09-13T19:33:49.499234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:20.396847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'41","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.499748+0000","last_change":"2024-09-13T19:33:14.367131+0000","last_active":"2024-09-13T19:35:25.499748+0000","last_peered":"2024-09-13T19:35:25.499748+0000","last_clean":"2024-09-13T19:35:25.499748+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:35:25.499748+0000","last_undegraded":"2024-09-13T19:35:25.499748+0000","last_fullsized":"2024-09-13T19:35:25.499748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:41.769483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499317+0000","last_change":"2024-09-13T19:33:16.372536+0000","last_active":"2024-09-13T19:35:34.499317+0000","last_peered":"2024-09-13T19:35:34.499317+0000","last_clean":"2024-09-13T19:35:34.499317+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:35:34.499317+0000","last_undegraded":"2024-09-13T19:35:34.499317+0000","last_fullsized":"2024-09-13T19:35:34.499317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.255184+0000","last_change":"2024-09-13T19:33:18.417415+0000","last_active":"2024-09-13T19:34:37.255184+0000","last_peered":"2024-09-13T19:34:37.255184+0000","last_clean":"2024-09-13T19:34:37.255184+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:34:37.255184+0000","last_undegraded":"2024-09-13T19:34:37.255184+0000","last_fullsized":"2024-09-13T19:34:37.255184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:08.824528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278394+0000","last_change":"2024-09-13T19:33:10.352105+0000","last_active":"2024-09-13T19:36:24.278394+0000","last_peered":"2024-09-13T19:36:24.278394+0000","last_clean":"2024-09-13T19:36:24.278394+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:36:24.278394+0000","last_undegraded":"2024-09-13T19:36:24.278394+0000","last_fullsized":"2024-09-13T19:36:24.278394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.525145+0000","last_change":"2024-09-13T19:33:08.351524+0000","last_active":"2024-09-13T19:33:49.525145+0000","last_peered":"2024-09-13T19:33:49.525145+0000","last_clean":"2024-09-13T19:33:49.525145+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:33:49.525145+0000","last_undegraded":"2024-09-13T19:33:49.525145+0000","last_fullsized":"2024-09-13T19:33:49.525145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:27.423338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.496884+0000","last_change":"2024-09-13T19:33:12.346361+0000","last_active":"2024-09-13T19:35:24.496884+0000","last_peered":"2024-09-13T19:35:24.496884+0000","last_clean":"2024-09-13T19:35:24.496884+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:35:24.496884+0000","last_undegraded":"2024-09-13T19:35:24.496884+0000","last_fullsized":"2024-09-13T19:35:24.496884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.753674+0000","last_change":"2024-09-13T19:33:14.391496+0000","last_active":"2024-09-13T19:36:23.753674+0000","last_peered":"2024-09-13T19:36:23.753674+0000","last_clean":"2024-09-13T19:36:23.753674+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:36:23.753674+0000","last_undegraded":"2024-09-13T19:36:23.753674+0000","last_fullsized":"2024-09-13T19:36:23.753674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:30.872095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498176+0000","last_change":"2024-09-13T19:33:16.375752+0000","last_active":"2024-09-13T19:35:29.498176+0000","last_peered":"2024-09-13T19:35:29.498176+0000","last_clean":"2024-09-13T19:35:29.498176+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:35:29.498176+0000","last_undegraded":"2024-09-13T19:35:29.498176+0000","last_fullsized":"2024-09-13T19:35:29.498176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:31.549249+0000","last_change":"2024-09-13T19:33:18.420383+0000","last_active":"2024-09-13T19:34:31.549249+0000","last_peered":"2024-09-13T19:34:31.549249+0000","last_clean":"2024-09-13T19:34:31.549249+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:34:31.549249+0000","last_undegraded":"2024-09-13T19:34:31.549249+0000","last_fullsized":"2024-09-13T19:34:31.549249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:08.579627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207661+0000","last_change":"2024-09-13T19:33:10.330476+0000","last_active":"2024-09-13T19:36:24.207661+0000","last_peered":"2024-09-13T19:36:24.207661+0000","last_clean":"2024-09-13T19:36:24.207661+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:36:24.207661+0000","last_undegraded":"2024-09-13T19:36:24.207661+0000","last_fullsized":"2024-09-13T19:36:24.207661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:13.461248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507615+0000","last_change":"2024-09-13T19:33:08.341877+0000","last_active":"2024-09-13T19:33:49.507615+0000","last_peered":"2024-09-13T19:33:49.507615+0000","last_clean":"2024-09-13T19:33:49.507615+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:33:49.507615+0000","last_undegraded":"2024-09-13T19:33:49.507615+0000","last_fullsized":"2024-09-13T19:33:49.507615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.834092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498238+0000","last_change":"2024-09-13T19:33:12.348033+0000","last_active":"2024-09-13T19:35:29.498238+0000","last_peered":"2024-09-13T19:35:29.498238+0000","last_clean":"2024-09-13T19:35:29.498238+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:35:29.498238+0000","last_undegraded":"2024-09-13T19:35:29.498238+0000","last_fullsized":"2024-09-13T19:35:29.498238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'38","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.503049+0000","last_change":"2024-09-13T19:33:14.366093+0000","last_active":"2024-09-13T19:35:25.503049+0000","last_peered":"2024-09-13T19:35:25.503049+0000","last_clean":"2024-09-13T19:35:25.503049+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:35:25.503049+0000","last_undegraded":"2024-09-13T19:35:25.503049+0000","last_fullsized":"2024-09-13T19:35:25.503049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.379070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.798536+0000","last_change":"2024-09-13T19:33:16.377299+0000","last_active":"2024-09-13T19:36:55.798536+0000","last_peered":"2024-09-13T19:36:55.798536+0000","last_clean":"2024-09-13T19:36:55.798536+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:36:55.798536+0000","last_undegraded":"2024-09-13T19:36:55.798536+0000","last_fullsized":"2024-09-13T19:36:55.798536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.908496+0000","last_change":"2024-09-13T19:33:18.416155+0000","last_active":"2024-09-13T19:36:23.908496+0000","last_peered":"2024-09-13T19:36:23.908496+0000","last_clean":"2024-09-13T19:36:23.908496+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:36:23.908496+0000","last_undegraded":"2024-09-13T19:36:23.908496+0000","last_fullsized":"2024-09-13T19:36:23.908496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096247+0000","last_change":"2024-09-13T19:33:10.337441+0000","last_active":"2024-09-13T19:36:24.096247+0000","last_peered":"2024-09-13T19:36:24.096247+0000","last_clean":"2024-09-13T19:36:24.096247+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:36:24.096247+0000","last_undegraded":"2024-09-13T19:36:24.096247+0000","last_fullsized":"2024-09-13T19:36:24.096247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.481677+0000","last_change":"2024-09-13T19:33:49.524748+0000","last_active":"2024-09-13T19:33:50.481677+0000","last_peered":"2024-09-13T19:33:50.481677+0000","last_clean":"2024-09-13T19:33:50.481677+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:33:50.481677+0000","last_undegraded":"2024-09-13T19:33:50.481677+0000","last_fullsized":"2024-09-13T19:33:50.481677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:26.896197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.497022+0000","last_change":"2024-09-13T19:33:12.346224+0000","last_active":"2024-09-13T19:35:24.497022+0000","last_peered":"2024-09-13T19:35:24.497022+0000","last_clean":"2024-09-13T19:35:24.497022+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:35:24.497022+0000","last_undegraded":"2024-09-13T19:35:24.497022+0000","last_fullsized":"2024-09-13T19:35:24.497022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'57","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.471175+0000","last_change":"2024-09-13T19:33:14.376236+0000","last_active":"2024-09-13T19:36:55.471175+0000","last_peered":"2024-09-13T19:36:55.471175+0000","last_clean":"2024-09-13T19:36:55.471175+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:36:55.471175+0000","last_undegraded":"2024-09-13T19:36:55.471175+0000","last_fullsized":"2024-09-13T19:36:55.471175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:08.849176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498043+0000","last_change":"2024-09-13T19:33:16.380438+0000","last_active":"2024-09-13T19:35:29.498043+0000","last_peered":"2024-09-13T19:35:29.498043+0000","last_clean":"2024-09-13T19:35:29.498043+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:35:29.498043+0000","last_undegraded":"2024-09-13T19:35:29.498043+0000","last_fullsized":"2024-09-13T19:35:29.498043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.587873+0000","last_change":"2024-09-13T19:33:18.397231+0000","last_active":"2024-09-13T19:36:24.587873+0000","last_peered":"2024-09-13T19:36:24.587873+0000","last_clean":"2024-09-13T19:36:24.587873+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:36:24.587873+0000","last_undegraded":"2024-09-13T19:36:24.587873+0000","last_fullsized":"2024-09-13T19:36:24.587873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749484+0000","last_change":"2024-09-13T19:33:49.534836+0000","last_active":"2024-09-13T19:36:23.749484+0000","last_peered":"2024-09-13T19:36:23.749484+0000","last_clean":"2024-09-13T19:36:23.749484+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:36:23.749484+0000","last_undegraded":"2024-09-13T19:36:23.749484+0000","last_fullsized":"2024-09-13T19:36:23.749484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:46.631431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.497072+0000","last_change":"2024-09-13T19:33:08.332135+0000","last_active":"2024-09-13T19:35:24.497072+0000","last_peered":"2024-09-13T19:35:24.497072+0000","last_clean":"2024-09-13T19:35:24.497072+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:35:24.497072+0000","last_undegraded":"2024-09-13T19:35:24.497072+0000","last_fullsized":"2024-09-13T19:35:24.497072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520294+0000","last_change":"2024-09-13T19:33:12.358273+0000","last_active":"2024-09-13T19:33:49.520294+0000","last_peered":"2024-09-13T19:33:49.520294+0000","last_clean":"2024-09-13T19:33:49.520294+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:33:49.520294+0000","last_undegraded":"2024-09-13T19:33:49.520294+0000","last_fullsized":"2024-09-13T19:33:49.520294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:36.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'34","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503373+0000","last_change":"2024-09-13T19:33:14.364059+0000","last_active":"2024-09-13T19:35:30.503373+0000","last_peered":"2024-09-13T19:35:30.503373+0000","last_clean":"2024-09-13T19:35:30.503373+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:35:30.503373+0000","last_undegraded":"2024-09-13T19:35:30.503373+0000","last_fullsized":"2024-09-13T19:35:30.503373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:22.396286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512534+0000","last_change":"2024-09-13T19:33:16.403943+0000","last_active":"2024-09-13T19:33:49.512534+0000","last_peered":"2024-09-13T19:33:49.512534+0000","last_clean":"2024-09-13T19:33:49.512534+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:33:49.512534+0000","last_undegraded":"2024-09-13T19:33:49.512534+0000","last_fullsized":"2024-09-13T19:33:49.512534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:15.430735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.501955+0000","last_change":"2024-09-13T19:33:18.415707+0000","last_active":"2024-09-13T19:35:20.501955+0000","last_peered":"2024-09-13T19:35:20.501955+0000","last_clean":"2024-09-13T19:35:20.501955+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:35:20.501955+0000","last_undegraded":"2024-09-13T19:35:20.501955+0000","last_fullsized":"2024-09-13T19:35:20.501955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:34.463379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.279120+0000","last_change":"2024-09-13T19:33:10.359068+0000","last_active":"2024-09-13T19:36:24.279120+0000","last_peered":"2024-09-13T19:36:24.279120+0000","last_clean":"2024-09-13T19:36:24.279120+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:36:24.279120+0000","last_undegraded":"2024-09-13T19:36:24.279120+0000","last_fullsized":"2024-09-13T19:36:24.279120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:17.259191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507820+0000","last_change":"2024-09-13T19:33:08.342280+0000","last_active":"2024-09-13T19:33:49.507820+0000","last_peered":"2024-09-13T19:33:49.507820+0000","last_clean":"2024-09-13T19:33:49.507820+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:33:49.507820+0000","last_undegraded":"2024-09-13T19:33:49.507820+0000","last_fullsized":"2024-09-13T19:33:49.507820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:18.144107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498284+0000","last_change":"2024-09-13T19:33:12.348184+0000","last_active":"2024-09-13T19:35:29.498284+0000","last_peered":"2024-09-13T19:35:29.498284+0000","last_clean":"2024-09-13T19:35:29.498284+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:35:29.498284+0000","last_undegraded":"2024-09-13T19:35:29.498284+0000","last_fullsized":"2024-09-13T19:35:29.498284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.524983+0000","last_change":"2024-09-13T19:33:14.354520+0000","last_active":"2024-09-13T19:35:20.524983+0000","last_peered":"2024-09-13T19:35:20.524983+0000","last_clean":"2024-09-13T19:35:20.524983+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:35:20.524983+0000","last_undegraded":"2024-09-13T19:35:20.524983+0000","last_fullsized":"2024-09-13T19:35:20.524983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:18.105050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'284","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.446533+0000","last_change":"2024-09-13T19:33:16.390808+0000","last_active":"2024-09-13T19:36:55.446533+0000","last_peered":"2024-09-13T19:36:55.446533+0000","last_clean":"2024-09-13T19:36:55.446533+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:36:55.446533+0000","last_undegraded":"2024-09-13T19:36:55.446533+0000","last_fullsized":"2024-09-13T19:36:55.446533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:24.410292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.454484+0000","last_change":"2024-09-13T19:33:18.415690+0000","last_active":"2024-09-13T19:36:24.454484+0000","last_peered":"2024-09-13T19:36:24.454484+0000","last_clean":"2024-09-13T19:36:24.454484+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:36:24.454484+0000","last_undegraded":"2024-09-13T19:36:24.454484+0000","last_fullsized":"2024-09-13T19:36:24.454484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.528476+0000","last_change":"2024-09-13T19:33:10.333244+0000","last_active":"2024-09-13T19:33:49.528476+0000","last_peered":"2024-09-13T19:33:49.528476+0000","last_clean":"2024-09-13T19:33:49.528476+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:33:49.528476+0000","last_undegraded":"2024-09-13T19:33:49.528476+0000","last_fullsized":"2024-09-13T19:33:49.528476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:40.474137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.133553+0000","last_change":"2024-09-13T19:33:08.355262+0000","last_active":"2024-09-13T19:33:54.133553+0000","last_peered":"2024-09-13T19:33:54.133553+0000","last_clean":"2024-09-13T19:33:54.133553+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:33:54.133553+0000","last_undegraded":"2024-09-13T19:33:54.133553+0000","last_fullsized":"2024-09-13T19:33:54.133553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:41.635043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.418808+0000","last_change":"2024-09-13T19:33:12.355832+0000","last_active":"2024-09-13T19:36:55.418808+0000","last_peered":"2024-09-13T19:36:55.418808+0000","last_clean":"2024-09-13T19:36:55.418808+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:36:55.418808+0000","last_undegraded":"2024-09-13T19:36:55.418808+0000","last_fullsized":"2024-09-13T19:36:55.418808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:07.768173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509258+0000","last_change":"2024-09-13T19:33:14.392024+0000","last_active":"2024-09-13T19:33:49.509258+0000","last_peered":"2024-09-13T19:33:49.509258+0000","last_clean":"2024-09-13T19:33:49.509258+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:33:49.509258+0000","last_undegraded":"2024-09-13T19:33:49.509258+0000","last_fullsized":"2024-09-13T19:33:49.509258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:15.449504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'284","reported_seq":462,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.448687+0000","last_change":"2024-09-13T19:33:16.383487+0000","last_active":"2024-09-13T19:36:55.448687+0000","last_peered":"2024-09-13T19:36:55.448687+0000","last_clean":"2024-09-13T19:36:55.448687+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:36:55.448687+0000","last_undegraded":"2024-09-13T19:36:55.448687+0000","last_fullsized":"2024-09-13T19:36:55.448687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.397168+0000","last_change":"2024-09-13T19:33:18.405074+0000","last_active":"2024-09-13T19:35:22.397168+0000","last_peered":"2024-09-13T19:35:22.397168+0000","last_clean":"2024-09-13T19:35:22.397168+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:35:22.397168+0000","last_undegraded":"2024-09-13T19:35:22.397168+0000","last_fullsized":"2024-09-13T19:35:22.397168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:21.165425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278265+0000","last_change":"2024-09-13T19:33:10.351617+0000","last_active":"2024-09-13T19:36:24.278265+0000","last_peered":"2024-09-13T19:36:24.278265+0000","last_clean":"2024-09-13T19:36:24.278265+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:36:24.278265+0000","last_undegraded":"2024-09-13T19:36:24.278265+0000","last_fullsized":"2024-09-13T19:36:24.278265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:31.372401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.266908+0000","last_change":"2024-09-13T19:33:08.341993+0000","last_active":"2024-09-13T19:36:24.266908+0000","last_peered":"2024-09-13T19:36:24.266908+0000","last_clean":"2024-09-13T19:36:24.266908+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:36:24.266908+0000","last_undegraded":"2024-09-13T19:36:24.266908+0000","last_fullsized":"2024-09-13T19:36:24.266908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:50.411658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512635+0000","last_change":"2024-09-13T19:33:12.360435+0000","last_active":"2024-09-13T19:33:49.512635+0000","last_peered":"2024-09-13T19:33:49.512635+0000","last_clean":"2024-09-13T19:33:49.512635+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:33:49.512635+0000","last_undegraded":"2024-09-13T19:33:49.512635+0000","last_fullsized":"2024-09-13T19:33:49.512635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:06.192815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'39","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503321+0000","last_change":"2024-09-13T19:33:14.363402+0000","last_active":"2024-09-13T19:35:30.503321+0000","last_peered":"2024-09-13T19:35:30.503321+0000","last_clean":"2024-09-13T19:35:30.503321+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:35:30.503321+0000","last_undegraded":"2024-09-13T19:35:30.503321+0000","last_fullsized":"2024-09-13T19:35:30.503321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.213821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.519148+0000","last_change":"2024-09-13T19:33:16.392497+0000","last_active":"2024-09-13T19:33:49.519148+0000","last_peered":"2024-09-13T19:33:49.519148+0000","last_clean":"2024-09-13T19:33:49.519148+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:33:49.519148+0000","last_undegraded":"2024-09-13T19:33:49.519148+0000","last_fullsized":"2024-09-13T19:33:49.519148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:08.307092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.381185+0000","last_change":"2024-09-13T19:33:18.409575+0000","last_active":"2024-09-13T19:36:24.381185+0000","last_peered":"2024-09-13T19:36:24.381185+0000","last_clean":"2024-09-13T19:36:24.381185+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:36:24.381185+0000","last_undegraded":"2024-09-13T19:36:24.381185+0000","last_fullsized":"2024-09-13T19:36:24.381185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:03.846914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507876+0000","last_change":"2024-09-13T19:33:10.358838+0000","last_active":"2024-09-13T19:33:49.507876+0000","last_peered":"2024-09-13T19:33:49.507876+0000","last_clean":"2024-09-13T19:33:49.507876+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:33:49.507876+0000","last_undegraded":"2024-09-13T19:33:49.507876+0000","last_fullsized":"2024-09-13T19:33:49.507876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:55.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.497900+0000","last_change":"2024-09-13T19:32:57.877961+0000","last_active":"2024-09-13T19:33:49.497900+0000","last_peered":"2024-09-13T19:33:49.497900+0000","last_clean":"2024-09-13T19:33:49.497900+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:33:49.497900+0000","last_undegraded":"2024-09-13T19:33:49.497900+0000","last_fullsized":"2024-09-13T19:33:49.497900+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_clean_scrub_stamp":"2024-09-13T19:32:56.474648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504144+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:33:49.504144+0000","last_peered":"2024-09-13T19:33:49.504144+0000","last_clean":"2024-09-13T19:33:49.504144+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:33:49.504144+0000","last_undegraded":"2024-09-13T19:33:49.504144+0000","last_fullsized":"2024-09-13T19:33:49.504144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:41.432070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505312+0000","last_change":"2024-09-13T19:33:08.353659+0000","last_active":"2024-09-13T19:33:49.505312+0000","last_peered":"2024-09-13T19:33:49.505312+0000","last_clean":"2024-09-13T19:33:49.505312+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:33:49.505312+0000","last_undegraded":"2024-09-13T19:33:49.505312+0000","last_fullsized":"2024-09-13T19:33:49.505312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:40.029223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.526320+0000","last_change":"2024-09-13T19:33:49.523626+0000","last_active":"2024-09-13T19:33:49.526320+0000","last_peered":"2024-09-13T19:33:49.526320+0000","last_clean":"2024-09-13T19:33:49.526320+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:33:49.526320+0000","last_undegraded":"2024-09-13T19:33:49.526320+0000","last_fullsized":"2024-09-13T19:33:49.526320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:00.894619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'79","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.500417+0000","last_change":"2024-09-13T19:33:14.384076+0000","last_active":"2024-09-13T19:36:55.500417+0000","last_peered":"2024-09-13T19:36:55.500417+0000","last_clean":"2024-09-13T19:36:55.500417+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:36:55.500417+0000","last_undegraded":"2024-09-13T19:36:55.500417+0000","last_fullsized":"2024-09-13T19:36:55.500417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:28.403671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498367+0000","last_change":"2024-09-13T19:33:16.378379+0000","last_active":"2024-09-13T19:35:29.498367+0000","last_peered":"2024-09-13T19:35:29.498367+0000","last_clean":"2024-09-13T19:35:29.498367+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:35:29.498367+0000","last_undegraded":"2024-09-13T19:35:29.498367+0000","last_fullsized":"2024-09-13T19:35:29.498367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.306871+0000","last_change":"2024-09-13T19:33:18.410177+0000","last_active":"2024-09-13T19:36:24.306871+0000","last_peered":"2024-09-13T19:36:24.306871+0000","last_clean":"2024-09-13T19:36:24.306871+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:36:24.306871+0000","last_undegraded":"2024-09-13T19:36:24.306871+0000","last_fullsized":"2024-09-13T19:36:24.306871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:27.219574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097115+0000","last_change":"2024-09-13T19:33:49.529179+0000","last_active":"2024-09-13T19:36:24.097115+0000","last_peered":"2024-09-13T19:36:24.097115+0000","last_clean":"2024-09-13T19:36:24.097115+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:36:24.097115+0000","last_undegraded":"2024-09-13T19:36:24.097115+0000","last_fullsized":"2024-09-13T19:36:24.097115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:00.531797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502217+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:33:49.502217+0000","last_peered":"2024-09-13T19:33:49.502217+0000","last_clean":"2024-09-13T19:33:49.502217+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:33:49.502217+0000","last_undegraded":"2024-09-13T19:33:49.502217+0000","last_fullsized":"2024-09-13T19:33:49.502217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.193502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494352+0000","last_change":"2024-09-13T19:33:08.349400+0000","last_active":"2024-09-13T19:35:14.494352+0000","last_peered":"2024-09-13T19:35:14.494352+0000","last_clean":"2024-09-13T19:35:14.494352+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:35:14.494352+0000","last_undegraded":"2024-09-13T19:35:14.494352+0000","last_fullsized":"2024-09-13T19:35:14.494352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517380+0000","last_change":"2024-09-13T19:33:12.348082+0000","last_active":"2024-09-13T19:33:49.517380+0000","last_peered":"2024-09-13T19:33:49.517380+0000","last_clean":"2024-09-13T19:33:49.517380+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:33:49.517380+0000","last_undegraded":"2024-09-13T19:33:49.517380+0000","last_fullsized":"2024-09-13T19:33:49.517380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:26.997175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'277","reported_seq":482,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.488944+0000","last_change":"2024-09-13T19:33:14.367931+0000","last_active":"2024-09-13T19:36:55.488944+0000","last_peered":"2024-09-13T19:36:55.488944+0000","last_clean":"2024-09-13T19:36:55.488944+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:36:55.488944+0000","last_undegraded":"2024-09-13T19:36:55.488944+0000","last_fullsized":"2024-09-13T19:36:55.488944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:56.984417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":360,"num_read_kb":345,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505001+0000","last_change":"2024-09-13T19:33:16.401894+0000","last_active":"2024-09-13T19:33:49.505001+0000","last_peered":"2024-09-13T19:33:49.505001+0000","last_clean":"2024-09-13T19:33:49.505001+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:33:49.505001+0000","last_undegraded":"2024-09-13T19:33:49.505001+0000","last_fullsized":"2024-09-13T19:33:49.505001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.888292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.248196+0000","last_change":"2024-09-13T19:33:18.424198+0000","last_active":"2024-09-13T19:34:37.248196+0000","last_peered":"2024-09-13T19:34:37.248196+0000","last_clean":"2024-09-13T19:34:37.248196+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:34:37.248196+0000","last_undegraded":"2024-09-13T19:34:37.248196+0000","last_fullsized":"2024-09-13T19:34:37.248196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:43.261605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.935176+0000","last_change":"2024-09-13T19:33:10.340098+0000","last_active":"2024-09-13T19:35:22.935176+0000","last_peered":"2024-09-13T19:35:22.935176+0000","last_clean":"2024-09-13T19:35:22.935176+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:35:22.935176+0000","last_undegraded":"2024-09-13T19:35:22.935176+0000","last_fullsized":"2024-09-13T19:35:22.935176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517014+0000","last_change":"2024-09-13T19:33:02.801369+0000","last_active":"2024-09-13T19:33:49.517014+0000","last_peered":"2024-09-13T19:33:49.517014+0000","last_clean":"2024-09-13T19:33:49.517014+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:33:49.517014+0000","last_undegraded":"2024-09-13T19:33:49.517014+0000","last_fullsized":"2024-09-13T19:33:49.517014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:34.016598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.062622+0000","last_change":"2024-09-13T19:33:08.346175+0000","last_active":"2024-09-13T19:36:24.062622+0000","last_peered":"2024-09-13T19:36:24.062622+0000","last_clean":"2024-09-13T19:36:24.062622+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:36:24.062622+0000","last_undegraded":"2024-09-13T19:36:24.062622+0000","last_fullsized":"2024-09-13T19:36:24.062622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.525531+0000","last_change":"2024-09-13T19:33:12.354984+0000","last_active":"2024-09-13T19:33:49.525531+0000","last_peered":"2024-09-13T19:33:49.525531+0000","last_clean":"2024-09-13T19:33:49.525531+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:33:49.525531+0000","last_undegraded":"2024-09-13T19:33:49.525531+0000","last_fullsized":"2024-09-13T19:33:49.525531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:33.380857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.595253+0000","last_change":"2024-09-13T19:33:14.366942+0000","last_active":"2024-09-13T19:36:22.595253+0000","last_peered":"2024-09-13T19:36:22.595253+0000","last_clean":"2024-09-13T19:36:22.595253+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:36:22.595253+0000","last_undegraded":"2024-09-13T19:36:22.595253+0000","last_fullsized":"2024-09-13T19:36:22.595253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:22.408791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.497123+0000","last_change":"2024-09-13T19:33:16.375344+0000","last_active":"2024-09-13T19:35:24.497123+0000","last_peered":"2024-09-13T19:35:24.497123+0000","last_clean":"2024-09-13T19:35:24.497123+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:35:24.497123+0000","last_undegraded":"2024-09-13T19:35:24.497123+0000","last_fullsized":"2024-09-13T19:35:24.497123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502961+0000","last_change":"2024-09-13T19:33:18.414878+0000","last_active":"2024-09-13T19:33:49.502961+0000","last_peered":"2024-09-13T19:33:49.502961+0000","last_clean":"2024-09-13T19:33:49.502961+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:33:49.502961+0000","last_undegraded":"2024-09-13T19:33:49.502961+0000","last_fullsized":"2024-09-13T19:33:49.502961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:55.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.441681+0000","last_change":"2024-09-13T19:33:10.346530+0000","last_active":"2024-09-13T19:36:24.441681+0000","last_peered":"2024-09-13T19:36:24.441681+0000","last_clean":"2024-09-13T19:36:24.441681+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:36:24.441681+0000","last_undegraded":"2024-09-13T19:36:24.441681+0000","last_fullsized":"2024-09-13T19:36:24.441681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505061+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:33:49.505061+0000","last_peered":"2024-09-13T19:33:49.505061+0000","last_clean":"2024-09-13T19:33:49.505061+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:33:49.505061+0000","last_undegraded":"2024-09-13T19:33:49.505061+0000","last_fullsized":"2024-09-13T19:33:49.505061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:14.144438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.519543+0000","last_change":"2024-09-13T19:33:08.333264+0000","last_active":"2024-09-13T19:33:49.519543+0000","last_peered":"2024-09-13T19:33:49.519543+0000","last_clean":"2024-09-13T19:33:49.519543+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:33:49.519543+0000","last_undegraded":"2024-09-13T19:33:49.519543+0000","last_fullsized":"2024-09-13T19:33:49.519543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:49.017180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495703+0000","last_change":"2024-09-13T19:33:12.353699+0000","last_active":"2024-09-13T19:35:19.495703+0000","last_peered":"2024-09-13T19:35:19.495703+0000","last_clean":"2024-09-13T19:35:19.495703+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:35:19.495703+0000","last_undegraded":"2024-09-13T19:35:19.495703+0000","last_fullsized":"2024-09-13T19:35:19.495703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.961527+0000","last_change":"2024-09-13T19:33:14.392626+0000","last_active":"2024-09-13T19:36:22.961527+0000","last_peered":"2024-09-13T19:36:22.961527+0000","last_clean":"2024-09-13T19:36:22.961527+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:36:22.961527+0000","last_undegraded":"2024-09-13T19:36:22.961527+0000","last_fullsized":"2024-09-13T19:36:22.961527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:39.310340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512753+0000","last_change":"2024-09-13T19:33:16.402476+0000","last_active":"2024-09-13T19:33:49.512753+0000","last_peered":"2024-09-13T19:33:49.512753+0000","last_clean":"2024-09-13T19:33:49.512753+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:33:49.512753+0000","last_undegraded":"2024-09-13T19:33:49.512753+0000","last_fullsized":"2024-09-13T19:33:49.512753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:05.574640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.443488+0000","last_change":"2024-09-13T19:33:18.418222+0000","last_active":"2024-09-13T19:36:24.443488+0000","last_peered":"2024-09-13T19:36:24.443488+0000","last_clean":"2024-09-13T19:36:24.443488+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:36:24.443488+0000","last_undegraded":"2024-09-13T19:36:24.443488+0000","last_fullsized":"2024-09-13T19:36:24.443488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:20.302502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096257+0000","last_change":"2024-09-13T19:33:10.357857+0000","last_active":"2024-09-13T19:36:24.096257+0000","last_peered":"2024-09-13T19:36:24.096257+0000","last_clean":"2024-09-13T19:36:24.096257+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:36:24.096257+0000","last_undegraded":"2024-09-13T19:36:24.096257+0000","last_fullsized":"2024-09-13T19:36:24.096257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:17.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521202+0000","last_change":"2024-09-13T19:33:08.332236+0000","last_active":"2024-09-13T19:33:49.521202+0000","last_peered":"2024-09-13T19:33:49.521202+0000","last_clean":"2024-09-13T19:33:49.521202+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:33:49.521202+0000","last_undegraded":"2024-09-13T19:33:49.521202+0000","last_fullsized":"2024-09-13T19:33:49.521202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:09.493213+0000","last_change":"2024-09-13T19:33:02.523552+0000","last_active":"2024-09-13T19:35:09.493213+0000","last_peered":"2024-09-13T19:35:09.493213+0000","last_clean":"2024-09-13T19:35:09.493213+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:35:09.493213+0000","last_undegraded":"2024-09-13T19:35:09.493213+0000","last_fullsized":"2024-09-13T19:35:09.493213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.438456+0000","last_change":"2024-09-13T19:33:12.354235+0000","last_active":"2024-09-13T19:36:55.438456+0000","last_peered":"2024-09-13T19:36:55.438456+0000","last_clean":"2024-09-13T19:36:55.438456+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:36:55.438456+0000","last_undegraded":"2024-09-13T19:36:55.438456+0000","last_fullsized":"2024-09-13T19:36:55.438456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'67","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.667911+0000","last_change":"2024-09-13T19:33:14.353733+0000","last_active":"2024-09-13T19:36:55.667911+0000","last_peered":"2024-09-13T19:36:55.667911+0000","last_clean":"2024-09-13T19:36:55.667911+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:36:55.667911+0000","last_undegraded":"2024-09-13T19:36:55.667911+0000","last_fullsized":"2024-09-13T19:36:55.667911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517438+0000","last_change":"2024-09-13T19:33:16.390734+0000","last_active":"2024-09-13T19:33:49.517438+0000","last_peered":"2024-09-13T19:33:49.517438+0000","last_clean":"2024-09-13T19:33:49.517438+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:33:49.517438+0000","last_undegraded":"2024-09-13T19:33:49.517438+0000","last_fullsized":"2024-09-13T19:33:49.517438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:54.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499474+0000","last_change":"2024-09-13T19:33:18.401696+0000","last_active":"2024-09-13T19:35:34.499474+0000","last_peered":"2024-09-13T19:35:34.499474+0000","last_clean":"2024-09-13T19:35:34.499474+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:35:34.499474+0000","last_undegraded":"2024-09-13T19:35:34.499474+0000","last_fullsized":"2024-09-13T19:35:34.499474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.904012+0000","last_change":"2024-09-13T19:33:10.356809+0000","last_active":"2024-09-13T19:36:23.904012+0000","last_peered":"2024-09-13T19:36:23.904012+0000","last_clean":"2024-09-13T19:36:23.904012+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:36:23.904012+0000","last_undegraded":"2024-09-13T19:36:23.904012+0000","last_fullsized":"2024-09-13T19:36:23.904012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:44.333778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494482+0000","last_change":"2024-09-13T19:33:08.345805+0000","last_active":"2024-09-13T19:35:14.494482+0000","last_peered":"2024-09-13T19:35:14.494482+0000","last_clean":"2024-09-13T19:35:14.494482+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:35:14.494482+0000","last_undegraded":"2024-09-13T19:35:14.494482+0000","last_fullsized":"2024-09-13T19:35:14.494482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506699+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:33:49.506699+0000","last_peered":"2024-09-13T19:33:49.506699+0000","last_clean":"2024-09-13T19:33:49.506699+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:33:49.506699+0000","last_undegraded":"2024-09-13T19:33:49.506699+0000","last_fullsized":"2024-09-13T19:33:49.506699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:56.316476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505857+0000","last_change":"2024-09-13T19:33:12.356344+0000","last_active":"2024-09-13T19:33:49.505857+0000","last_peered":"2024-09-13T19:33:49.505857+0000","last_clean":"2024-09-13T19:33:49.505857+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:33:49.505857+0000","last_undegraded":"2024-09-13T19:33:49.505857+0000","last_fullsized":"2024-09-13T19:33:49.505857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:55.513441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500452+0000","last_change":"2024-09-13T19:33:14.368032+0000","last_active":"2024-09-13T19:35:20.500452+0000","last_peered":"2024-09-13T19:35:20.500452+0000","last_clean":"2024-09-13T19:35:20.500452+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:35:20.500452+0000","last_undegraded":"2024-09-13T19:35:20.500452+0000","last_fullsized":"2024-09-13T19:35:20.500452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:52.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'284","reported_seq":377,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.442134+0000","last_change":"2024-09-13T19:33:16.386778+0000","last_active":"2024-09-13T19:36:55.442134+0000","last_peered":"2024-09-13T19:36:55.442134+0000","last_clean":"2024-09-13T19:36:55.442134+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:55.442134+0000","last_undegraded":"2024-09-13T19:36:55.442134+0000","last_fullsized":"2024-09-13T19:36:55.442134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:06.811103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.518471+0000","last_change":"2024-09-13T19:33:18.410958+0000","last_active":"2024-09-13T19:34:37.518471+0000","last_peered":"2024-09-13T19:34:37.518471+0000","last_clean":"2024-09-13T19:34:37.518471+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:34:37.518471+0000","last_undegraded":"2024-09-13T19:34:37.518471+0000","last_fullsized":"2024-09-13T19:34:37.518471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:58.474286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.169685+0000","last_change":"2024-09-13T19:33:10.352017+0000","last_active":"2024-09-13T19:33:54.169685+0000","last_peered":"2024-09-13T19:33:54.169685+0000","last_clean":"2024-09-13T19:33:54.169685+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:33:54.169685+0000","last_undegraded":"2024-09-13T19:33:54.169685+0000","last_fullsized":"2024-09-13T19:33:54.169685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:06.912280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515639+0000","last_change":"2024-09-13T19:33:08.335852+0000","last_active":"2024-09-13T19:33:49.515639+0000","last_peered":"2024-09-13T19:33:49.515639+0000","last_clean":"2024-09-13T19:33:49.515639+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:33:49.515639+0000","last_undegraded":"2024-09-13T19:33:49.515639+0000","last_fullsized":"2024-09-13T19:33:49.515639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:15.529632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494560+0000","last_change":"2024-09-13T19:33:02.523653+0000","last_active":"2024-09-13T19:35:14.494560+0000","last_peered":"2024-09-13T19:35:14.494560+0000","last_clean":"2024-09-13T19:35:14.494560+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:35:14.494560+0000","last_undegraded":"2024-09-13T19:35:14.494560+0000","last_fullsized":"2024-09-13T19:35:14.494560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508088+0000","last_change":"2024-09-13T19:33:12.358233+0000","last_active":"2024-09-13T19:33:49.508088+0000","last_peered":"2024-09-13T19:33:49.508088+0000","last_clean":"2024-09-13T19:33:49.508088+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:33:49.508088+0000","last_undegraded":"2024-09-13T19:33:49.508088+0000","last_fullsized":"2024-09-13T19:33:49.508088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:59.060355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507097+0000","last_change":"2024-09-13T19:33:14.384476+0000","last_active":"2024-09-13T19:33:49.507097+0000","last_peered":"2024-09-13T19:33:49.507097+0000","last_clean":"2024-09-13T19:33:49.507097+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:33:49.507097+0000","last_undegraded":"2024-09-13T19:33:49.507097+0000","last_fullsized":"2024-09-13T19:33:49.507097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:32.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":394,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.793210+0000","last_change":"2024-09-13T19:33:16.372856+0000","last_active":"2024-09-13T19:36:55.793210+0000","last_peered":"2024-09-13T19:36:55.793210+0000","last_clean":"2024-09-13T19:36:55.793210+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:36:55.793210+0000","last_undegraded":"2024-09-13T19:36:55.793210+0000","last_fullsized":"2024-09-13T19:36:55.793210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508863+0000","last_change":"2024-09-13T19:33:18.412059+0000","last_active":"2024-09-13T19:33:49.508863+0000","last_peered":"2024-09-13T19:33:49.508863+0000","last_clean":"2024-09-13T19:33:49.508863+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:33:49.508863+0000","last_undegraded":"2024-09-13T19:33:49.508863+0000","last_fullsized":"2024-09-13T19:33:49.508863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:52.237012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278402+0000","last_change":"2024-09-13T19:33:10.344169+0000","last_active":"2024-09-13T19:36:24.278402+0000","last_peered":"2024-09-13T19:36:24.278402+0000","last_clean":"2024-09-13T19:36:24.278402+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:36:24.278402+0000","last_undegraded":"2024-09-13T19:36:24.278402+0000","last_fullsized":"2024-09-13T19:36:24.278402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:15.536531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.076994+0000","last_change":"2024-09-13T19:33:08.354348+0000","last_active":"2024-09-13T19:36:24.076994+0000","last_peered":"2024-09-13T19:36:24.076994+0000","last_clean":"2024-09-13T19:36:24.076994+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:36:24.076994+0000","last_undegraded":"2024-09-13T19:36:24.076994+0000","last_fullsized":"2024-09-13T19:36:24.076994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:33.720059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.512982+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:33:49.512982+0000","last_peered":"2024-09-13T19:33:49.512982+0000","last_clean":"2024-09-13T19:33:49.512982+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:33:49.512982+0000","last_undegraded":"2024-09-13T19:33:49.512982+0000","last_fullsized":"2024-09-13T19:33:49.512982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:46.024868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506376+0000","last_change":"2024-09-13T19:33:12.347595+0000","last_active":"2024-09-13T19:33:49.506376+0000","last_peered":"2024-09-13T19:33:49.506376+0000","last_clean":"2024-09-13T19:33:49.506376+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:33:49.506376+0000","last_undegraded":"2024-09-13T19:33:49.506376+0000","last_fullsized":"2024-09-13T19:33:49.506376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:04.841484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'86","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.480947+0000","last_change":"2024-09-13T19:33:14.370958+0000","last_active":"2024-09-13T19:36:55.480947+0000","last_peered":"2024-09-13T19:36:55.480947+0000","last_clean":"2024-09-13T19:36:55.480947+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:36:55.480947+0000","last_undegraded":"2024-09-13T19:36:55.480947+0000","last_fullsized":"2024-09-13T19:36:55.480947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:28.457253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.497002+0000","last_change":"2024-09-13T19:33:16.370368+0000","last_active":"2024-09-13T19:35:24.497002+0000","last_peered":"2024-09-13T19:35:24.497002+0000","last_clean":"2024-09-13T19:35:24.497002+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:35:24.497002+0000","last_undegraded":"2024-09-13T19:35:24.497002+0000","last_fullsized":"2024-09-13T19:35:24.497002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.238791+0000","last_change":"2024-09-13T19:33:18.418007+0000","last_active":"2024-09-13T19:34:37.238791+0000","last_peered":"2024-09-13T19:34:37.238791+0000","last_clean":"2024-09-13T19:34:37.238791+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:34:37.238791+0000","last_undegraded":"2024-09-13T19:34:37.238791+0000","last_fullsized":"2024-09-13T19:34:37.238791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:26.651502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523204+0000","last_change":"2024-09-13T19:33:18.416636+0000","last_active":"2024-09-13T19:33:49.523204+0000","last_peered":"2024-09-13T19:33:49.523204+0000","last_clean":"2024-09-13T19:33:49.523204+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:33:49.523204+0000","last_undegraded":"2024-09-13T19:33:49.523204+0000","last_fullsized":"2024-09-13T19:33:49.523204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.954769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207651+0000","last_change":"2024-09-13T19:33:10.337290+0000","last_active":"2024-09-13T19:36:24.207651+0000","last_peered":"2024-09-13T19:36:24.207651+0000","last_clean":"2024-09-13T19:36:24.207651+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:36:24.207651+0000","last_undegraded":"2024-09-13T19:36:24.207651+0000","last_fullsized":"2024-09-13T19:36:24.207651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:03.258150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.069994+0000","last_change":"2024-09-13T19:33:08.354023+0000","last_active":"2024-09-13T19:36:24.069994+0000","last_peered":"2024-09-13T19:36:24.069994+0000","last_clean":"2024-09-13T19:36:24.069994+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:36:24.069994+0000","last_undegraded":"2024-09-13T19:36:24.069994+0000","last_fullsized":"2024-09-13T19:36:24.069994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:12.440984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.500090+0000","last_change":"2024-09-13T19:33:12.349684+0000","last_active":"2024-09-13T19:33:49.500090+0000","last_peered":"2024-09-13T19:33:49.500090+0000","last_clean":"2024-09-13T19:33:49.500090+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:33:49.500090+0000","last_undegraded":"2024-09-13T19:33:49.500090+0000","last_fullsized":"2024-09-13T19:33:49.500090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:33.654140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505771+0000","last_change":"2024-09-13T19:33:14.379538+0000","last_active":"2024-09-13T19:35:35.505771+0000","last_peered":"2024-09-13T19:35:35.505771+0000","last_clean":"2024-09-13T19:35:35.505771+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:35:35.505771+0000","last_undegraded":"2024-09-13T19:35:35.505771+0000","last_fullsized":"2024-09-13T19:35:35.505771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:57.484464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.505865+0000","last_change":"2024-09-13T19:33:16.403644+0000","last_active":"2024-09-13T19:33:49.505865+0000","last_peered":"2024-09-13T19:33:49.505865+0000","last_clean":"2024-09-13T19:33:49.505865+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:33:49.505865+0000","last_undegraded":"2024-09-13T19:33:49.505865+0000","last_fullsized":"2024-09-13T19:33:49.505865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:05.807775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.741860+0000","last_change":"2024-09-13T19:33:18.396968+0000","last_active":"2024-09-13T19:36:23.741860+0000","last_peered":"2024-09-13T19:36:23.741860+0000","last_clean":"2024-09-13T19:36:23.741860+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:36:23.741860+0000","last_undegraded":"2024-09-13T19:36:23.741860+0000","last_fullsized":"2024-09-13T19:36:23.741860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.193661+0000","last_change":"2024-09-13T19:33:10.357927+0000","last_active":"2024-09-13T19:35:18.193661+0000","last_peered":"2024-09-13T19:35:18.193661+0000","last_clean":"2024-09-13T19:35:18.193661+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:35:18.193661+0000","last_undegraded":"2024-09-13T19:35:18.193661+0000","last_fullsized":"2024-09-13T19:35:18.193661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:43.220677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520659+0000","last_change":"2024-09-13T19:33:08.353099+0000","last_active":"2024-09-13T19:33:49.520659+0000","last_peered":"2024-09-13T19:33:49.520659+0000","last_clean":"2024-09-13T19:33:49.520659+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:33:49.520659+0000","last_undegraded":"2024-09-13T19:33:49.520659+0000","last_fullsized":"2024-09-13T19:33:49.520659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:35.405144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.532442+0000","last_change":"2024-09-13T19:33:49.530881+0000","last_active":"2024-09-13T19:33:49.532442+0000","last_peered":"2024-09-13T19:33:49.532442+0000","last_clean":"2024-09-13T19:33:49.532442+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:33:49.532442+0000","last_undegraded":"2024-09-13T19:33:49.532442+0000","last_fullsized":"2024-09-13T19:33:49.532442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:24.807153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.009626+0000","last_change":"2024-09-13T19:33:14.354248+0000","last_active":"2024-09-13T19:36:23.009626+0000","last_peered":"2024-09-13T19:36:23.009626+0000","last_clean":"2024-09-13T19:36:23.009626+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:36:23.009626+0000","last_undegraded":"2024-09-13T19:36:23.009626+0000","last_fullsized":"2024-09-13T19:36:23.009626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.517061+0000","last_change":"2024-09-13T19:33:16.382753+0000","last_active":"2024-09-13T19:33:49.517061+0000","last_peered":"2024-09-13T19:33:49.517061+0000","last_clean":"2024-09-13T19:33:49.517061+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:33:49.517061+0000","last_undegraded":"2024-09-13T19:33:49.517061+0000","last_fullsized":"2024-09-13T19:33:49.517061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:25.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:49.502868+0000","last_change":"2024-09-13T19:33:18.415711+0000","last_active":"2024-09-13T19:35:49.502868+0000","last_peered":"2024-09-13T19:35:49.502868+0000","last_clean":"2024-09-13T19:35:49.502868+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:35:49.502868+0000","last_undegraded":"2024-09-13T19:35:49.502868+0000","last_fullsized":"2024-09-13T19:35:49.502868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.115827+0000","last_change":"2024-09-13T19:33:10.340323+0000","last_active":"2024-09-13T19:36:24.115827+0000","last_peered":"2024-09-13T19:36:24.115827+0000","last_clean":"2024-09-13T19:36:24.115827+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:36:24.115827+0000","last_undegraded":"2024-09-13T19:36:24.115827+0000","last_fullsized":"2024-09-13T19:36:24.115827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.062661+0000","last_change":"2024-09-13T19:33:08.350962+0000","last_active":"2024-09-13T19:36:24.062661+0000","last_peered":"2024-09-13T19:36:24.062661+0000","last_clean":"2024-09-13T19:36:24.062661+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:36:24.062661+0000","last_undegraded":"2024-09-13T19:36:24.062661+0000","last_fullsized":"2024-09-13T19:36:24.062661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:33.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509563+0000","last_change":"2024-09-13T19:33:12.355722+0000","last_active":"2024-09-13T19:33:49.509563+0000","last_peered":"2024-09-13T19:33:49.509563+0000","last_clean":"2024-09-13T19:33:49.509563+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:33:49.509563+0000","last_undegraded":"2024-09-13T19:33:49.509563+0000","last_fullsized":"2024-09-13T19:33:49.509563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:44.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'43","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.539354+0000","last_change":"2024-09-13T19:33:14.361694+0000","last_active":"2024-09-13T19:36:55.539354+0000","last_peered":"2024-09-13T19:36:55.539354+0000","last_clean":"2024-09-13T19:36:55.539354+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:36:55.539354+0000","last_undegraded":"2024-09-13T19:36:55.539354+0000","last_fullsized":"2024-09-13T19:36:55.539354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499270+0000","last_change":"2024-09-13T19:33:16.374728+0000","last_active":"2024-09-13T19:33:49.499270+0000","last_peered":"2024-09-13T19:33:49.499270+0000","last_clean":"2024-09-13T19:33:49.499270+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:33:49.499270+0000","last_undegraded":"2024-09-13T19:33:49.499270+0000","last_fullsized":"2024-09-13T19:33:49.499270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:25.206149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508285+0000","last_change":"2024-09-13T19:33:18.420341+0000","last_active":"2024-09-13T19:33:49.508285+0000","last_peered":"2024-09-13T19:33:49.508285+0000","last_clean":"2024-09-13T19:33:49.508285+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:33:49.508285+0000","last_undegraded":"2024-09-13T19:33:49.508285+0000","last_fullsized":"2024-09-13T19:33:49.508285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:37.478476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278224+0000","last_change":"2024-09-13T19:33:10.348981+0000","last_active":"2024-09-13T19:36:24.278224+0000","last_peered":"2024-09-13T19:36:24.278224+0000","last_clean":"2024-09-13T19:36:24.278224+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:36:24.278224+0000","last_undegraded":"2024-09-13T19:36:24.278224+0000","last_fullsized":"2024-09-13T19:36:24.278224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:31.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.141217+0000","last_change":"2024-09-13T19:33:49.519345+0000","last_active":"2024-09-13T19:33:54.141217+0000","last_peered":"2024-09-13T19:33:54.141217+0000","last_clean":"2024-09-13T19:33:54.141217+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:33:54.141217+0000","last_undegraded":"2024-09-13T19:33:54.141217+0000","last_fullsized":"2024-09-13T19:33:54.141217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:09.643503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508299+0000","last_change":"2024-09-13T19:33:12.363653+0000","last_active":"2024-09-13T19:33:49.508299+0000","last_peered":"2024-09-13T19:33:49.508299+0000","last_clean":"2024-09-13T19:33:49.508299+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:33:49.508299+0000","last_undegraded":"2024-09-13T19:33:49.508299+0000","last_fullsized":"2024-09-13T19:33:49.508299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:53.868774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'33","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.502431+0000","last_change":"2024-09-13T19:33:14.358901+0000","last_active":"2024-09-13T19:35:35.502431+0000","last_peered":"2024-09-13T19:35:35.502431+0000","last_clean":"2024-09-13T19:35:35.502431+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:35:35.502431+0000","last_undegraded":"2024-09-13T19:35:35.502431+0000","last_fullsized":"2024-09-13T19:35:35.502431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.849530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521295+0000","last_change":"2024-09-13T19:33:16.384121+0000","last_active":"2024-09-13T19:33:49.521295+0000","last_peered":"2024-09-13T19:33:49.521295+0000","last_clean":"2024-09-13T19:33:49.521295+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:33:49.521295+0000","last_undegraded":"2024-09-13T19:33:49.521295+0000","last_fullsized":"2024-09-13T19:33:49.521295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:31.796586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207342+0000","last_change":"2024-09-13T19:33:10.355217+0000","last_active":"2024-09-13T19:36:24.207342+0000","last_peered":"2024-09-13T19:36:24.207342+0000","last_clean":"2024-09-13T19:36:24.207342+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:36:24.207342+0000","last_undegraded":"2024-09-13T19:36:24.207342+0000","last_fullsized":"2024-09-13T19:36:24.207342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:25.762180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.136723+0000","last_change":"2024-09-13T19:33:08.338446+0000","last_active":"2024-09-13T19:33:54.136723+0000","last_peered":"2024-09-13T19:33:54.136723+0000","last_clean":"2024-09-13T19:33:54.136723+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:33:54.136723+0000","last_undegraded":"2024-09-13T19:33:54.136723+0000","last_fullsized":"2024-09-13T19:33:54.136723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494609+0000","last_change":"2024-09-13T19:33:12.353907+0000","last_active":"2024-09-13T19:35:14.494609+0000","last_peered":"2024-09-13T19:35:14.494609+0000","last_clean":"2024-09-13T19:35:14.494609+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:35:14.494609+0000","last_undegraded":"2024-09-13T19:35:14.494609+0000","last_fullsized":"2024-09-13T19:35:14.494609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.756209+0000","last_change":"2024-09-13T19:33:14.353619+0000","last_active":"2024-09-13T19:36:55.756209+0000","last_peered":"2024-09-13T19:36:55.756209+0000","last_clean":"2024-09-13T19:36:55.756209+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:36:55.756209+0000","last_undegraded":"2024-09-13T19:36:55.756209+0000","last_fullsized":"2024-09-13T19:36:55.756209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523366+0000","last_change":"2024-09-13T19:33:16.391786+0000","last_active":"2024-09-13T19:33:49.523366+0000","last_peered":"2024-09-13T19:33:49.523366+0000","last_clean":"2024-09-13T19:33:49.523366+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:33:49.523366+0000","last_undegraded":"2024-09-13T19:33:49.523366+0000","last_fullsized":"2024-09-13T19:33:49.523366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:58.998423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:39.500518+0000","last_change":"2024-09-13T19:33:18.415632+0000","last_active":"2024-09-13T19:35:39.500518+0000","last_peered":"2024-09-13T19:35:39.500518+0000","last_clean":"2024-09-13T19:35:39.500518+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:35:39.500518+0000","last_undegraded":"2024-09-13T19:35:39.500518+0000","last_fullsized":"2024-09-13T19:35:39.500518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.440517+0000","last_change":"2024-09-13T19:33:10.348428+0000","last_active":"2024-09-13T19:36:24.440517+0000","last_peered":"2024-09-13T19:36:24.440517+0000","last_clean":"2024-09-13T19:36:24.440517+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:36:24.440517+0000","last_undegraded":"2024-09-13T19:36:24.440517+0000","last_fullsized":"2024-09-13T19:36:24.440517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.498512+0000","last_change":"2024-09-13T19:33:08.337364+0000","last_active":"2024-09-13T19:33:49.498512+0000","last_peered":"2024-09-13T19:33:49.498512+0000","last_clean":"2024-09-13T19:33:49.498512+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:33:49.498512+0000","last_undegraded":"2024-09-13T19:33:49.498512+0000","last_fullsized":"2024-09-13T19:33:49.498512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:58.350998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524310+0000","last_change":"2024-09-13T19:33:12.351793+0000","last_active":"2024-09-13T19:33:49.524310+0000","last_peered":"2024-09-13T19:33:49.524310+0000","last_clean":"2024-09-13T19:33:49.524310+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:33:49.524310+0000","last_undegraded":"2024-09-13T19:33:49.524310+0000","last_fullsized":"2024-09-13T19:33:49.524310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:00.497212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509046+0000","last_change":"2024-09-13T19:33:14.386801+0000","last_active":"2024-09-13T19:35:45.509046+0000","last_peered":"2024-09-13T19:35:45.509046+0000","last_clean":"2024-09-13T19:35:45.509046+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:35:45.509046+0000","last_undegraded":"2024-09-13T19:35:45.509046+0000","last_fullsized":"2024-09-13T19:35:45.509046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:50.651830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507072+0000","last_change":"2024-09-13T19:33:16.382777+0000","last_active":"2024-09-13T19:33:49.507072+0000","last_peered":"2024-09-13T19:33:49.507072+0000","last_clean":"2024-09-13T19:33:49.507072+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:33:49.507072+0000","last_undegraded":"2024-09-13T19:33:49.507072+0000","last_fullsized":"2024-09-13T19:33:49.507072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:40.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504119+0000","last_change":"2024-09-13T19:33:18.415435+0000","last_active":"2024-09-13T19:33:49.504119+0000","last_peered":"2024-09-13T19:33:49.504119+0000","last_clean":"2024-09-13T19:33:49.504119+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:33:49.504119+0000","last_undegraded":"2024-09-13T19:33:49.504119+0000","last_fullsized":"2024-09-13T19:33:49.504119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:23.857746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.278836+0000","last_change":"2024-09-13T19:33:10.358856+0000","last_active":"2024-09-13T19:36:24.278836+0000","last_peered":"2024-09-13T19:36:24.278836+0000","last_clean":"2024-09-13T19:36:24.278836+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:36:24.278836+0000","last_undegraded":"2024-09-13T19:36:24.278836+0000","last_fullsized":"2024-09-13T19:36:24.278836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:44.732919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.685544+0000","last_change":"2024-09-13T19:33:08.335612+0000","last_active":"2024-09-13T19:33:52.685544+0000","last_peered":"2024-09-13T19:33:52.685544+0000","last_clean":"2024-09-13T19:33:52.685544+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:33:52.685544+0000","last_undegraded":"2024-09-13T19:33:52.685544+0000","last_fullsized":"2024-09-13T19:33:52.685544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:38.936603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.520491+0000","last_change":"2024-09-13T19:33:12.352113+0000","last_active":"2024-09-13T19:33:49.520491+0000","last_peered":"2024-09-13T19:33:49.520491+0000","last_clean":"2024-09-13T19:33:49.520491+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:33:49.520491+0000","last_undegraded":"2024-09-13T19:33:49.520491+0000","last_fullsized":"2024-09-13T19:33:49.520491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:17.673522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.637555+0000","last_change":"2024-09-13T19:33:14.356847+0000","last_active":"2024-09-13T19:36:55.637555+0000","last_peered":"2024-09-13T19:36:55.637555+0000","last_clean":"2024-09-13T19:36:55.637555+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:36:55.637555+0000","last_undegraded":"2024-09-13T19:36:55.637555+0000","last_fullsized":"2024-09-13T19:36:55.637555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495794+0000","last_change":"2024-09-13T19:33:16.391926+0000","last_active":"2024-09-13T19:35:19.495794+0000","last_peered":"2024-09-13T19:35:19.495794+0000","last_clean":"2024-09-13T19:35:19.495794+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:35:19.495794+0000","last_undegraded":"2024-09-13T19:35:19.495794+0000","last_fullsized":"2024-09-13T19:35:19.495794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.922899+0000","last_change":"2024-09-13T19:33:18.414176+0000","last_active":"2024-09-13T19:35:22.922899+0000","last_peered":"2024-09-13T19:35:22.922899+0000","last_clean":"2024-09-13T19:35:22.922899+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:35:22.922899+0000","last_undegraded":"2024-09-13T19:35:22.922899+0000","last_fullsized":"2024-09-13T19:35:22.922899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:28.941440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.903435+0000","last_change":"2024-09-13T19:33:10.347270+0000","last_active":"2024-09-13T19:36:23.903435+0000","last_peered":"2024-09-13T19:36:23.903435+0000","last_clean":"2024-09-13T19:36:23.903435+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:36:23.903435+0000","last_undegraded":"2024-09-13T19:36:23.903435+0000","last_fullsized":"2024-09-13T19:36:23.903435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507379+0000","last_change":"2024-09-13T19:33:08.340688+0000","last_active":"2024-09-13T19:35:40.507379+0000","last_peered":"2024-09-13T19:35:40.507379+0000","last_clean":"2024-09-13T19:35:40.507379+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:35:40.507379+0000","last_undegraded":"2024-09-13T19:35:40.507379+0000","last_fullsized":"2024-09-13T19:35:40.507379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:11.675646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":13,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.506437+0000","last_change":"2024-09-13T19:33:12.349199+0000","last_active":"2024-09-13T19:33:49.506437+0000","last_peered":"2024-09-13T19:33:49.506437+0000","last_clean":"2024-09-13T19:33:49.506437+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:33:49.506437+0000","last_undegraded":"2024-09-13T19:33:49.506437+0000","last_fullsized":"2024-09-13T19:33:49.506437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:52.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513690+0000","last_change":"2024-09-13T19:33:14.391400+0000","last_active":"2024-09-13T19:33:49.513690+0000","last_peered":"2024-09-13T19:33:49.513690+0000","last_clean":"2024-09-13T19:33:49.513690+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:33:49.513690+0000","last_undegraded":"2024-09-13T19:33:49.513690+0000","last_fullsized":"2024-09-13T19:33:49.513690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:31.131591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'284","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.439828+0000","last_change":"2024-09-13T19:33:16.382339+0000","last_active":"2024-09-13T19:36:55.439828+0000","last_peered":"2024-09-13T19:36:55.439828+0000","last_clean":"2024-09-13T19:36:55.439828+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:36:55.439828+0000","last_undegraded":"2024-09-13T19:36:55.439828+0000","last_fullsized":"2024-09-13T19:36:55.439828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:01.227827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503374+0000","last_change":"2024-09-13T19:33:18.419381+0000","last_active":"2024-09-13T19:33:49.503374+0000","last_peered":"2024-09-13T19:33:49.503374+0000","last_clean":"2024-09-13T19:33:49.503374+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:33:49.503374+0000","last_undegraded":"2024-09-13T19:33:49.503374+0000","last_fullsized":"2024-09-13T19:33:49.503374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:08.781086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.207878+0000","last_change":"2024-09-13T19:33:10.336681+0000","last_active":"2024-09-13T19:36:24.207878+0000","last_peered":"2024-09-13T19:36:24.207878+0000","last_clean":"2024-09-13T19:36:24.207878+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:36:24.207878+0000","last_undegraded":"2024-09-13T19:36:24.207878+0000","last_fullsized":"2024-09-13T19:36:24.207878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:14.226586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509233+0000","last_change":"2024-09-13T19:33:08.338096+0000","last_active":"2024-09-13T19:33:49.509233+0000","last_peered":"2024-09-13T19:33:49.509233+0000","last_clean":"2024-09-13T19:33:49.509233+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:33:49.509233+0000","last_undegraded":"2024-09-13T19:33:49.509233+0000","last_fullsized":"2024-09-13T19:33:49.509233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:51.028493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.502590+0000","last_change":"2024-09-13T19:33:12.353110+0000","last_active":"2024-09-13T19:33:49.502590+0000","last_peered":"2024-09-13T19:33:49.502590+0000","last_clean":"2024-09-13T19:33:49.502590+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:33:49.502590+0000","last_undegraded":"2024-09-13T19:33:49.502590+0000","last_fullsized":"2024-09-13T19:33:49.502590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:39.757540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.505665+0000","last_change":"2024-09-13T19:33:14.366141+0000","last_active":"2024-09-13T19:35:40.505665+0000","last_peered":"2024-09-13T19:35:40.505665+0000","last_clean":"2024-09-13T19:35:40.505665+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:35:40.505665+0000","last_undegraded":"2024-09-13T19:35:40.505665+0000","last_fullsized":"2024-09-13T19:35:40.505665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:29.782580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:44.501533+0000","last_change":"2024-09-13T19:33:16.375274+0000","last_active":"2024-09-13T19:35:44.501533+0000","last_peered":"2024-09-13T19:35:44.501533+0000","last_clean":"2024-09-13T19:35:44.501533+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:35:44.501533+0000","last_undegraded":"2024-09-13T19:35:44.501533+0000","last_fullsized":"2024-09-13T19:35:44.501533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.510248+0000","last_change":"2024-09-13T19:33:18.425299+0000","last_active":"2024-09-13T19:33:49.510248+0000","last_peered":"2024-09-13T19:33:49.510248+0000","last_clean":"2024-09-13T19:33:49.510248+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:33:49.510248+0000","last_undegraded":"2024-09-13T19:33:49.510248+0000","last_fullsized":"2024-09-13T19:33:49.510248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:13:57.374815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503532+0000","last_change":"2024-09-13T19:33:10.344066+0000","last_active":"2024-09-13T19:35:40.503532+0000","last_peered":"2024-09-13T19:35:40.503532+0000","last_clean":"2024-09-13T19:35:40.503532+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:35:40.503532+0000","last_undegraded":"2024-09-13T19:35:40.503532+0000","last_fullsized":"2024-09-13T19:35:40.503532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:23.396598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.508140+0000","last_change":"2024-09-13T19:33:08.358155+0000","last_active":"2024-09-13T19:33:49.508140+0000","last_peered":"2024-09-13T19:33:49.508140+0000","last_clean":"2024-09-13T19:33:49.508140+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:33:49.508140+0000","last_undegraded":"2024-09-13T19:33:49.508140+0000","last_fullsized":"2024-09-13T19:33:49.508140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:23.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.521057+0000","last_change":"2024-09-13T19:33:12.358770+0000","last_active":"2024-09-13T19:33:49.521057+0000","last_peered":"2024-09-13T19:33:49.521057+0000","last_clean":"2024-09-13T19:33:49.521057+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:33:49.521057+0000","last_undegraded":"2024-09-13T19:33:49.521057+0000","last_fullsized":"2024-09-13T19:33:49.521057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:34.804561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.693372+0000","last_change":"2024-09-13T19:33:14.352918+0000","last_active":"2024-09-13T19:36:55.693372+0000","last_peered":"2024-09-13T19:36:55.693372+0000","last_clean":"2024-09-13T19:36:55.693372+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:36:55.693372+0000","last_undegraded":"2024-09-13T19:36:55.693372+0000","last_fullsized":"2024-09-13T19:36:55.693372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504142+0000","last_change":"2024-09-13T19:33:16.400962+0000","last_active":"2024-09-13T19:33:49.504142+0000","last_peered":"2024-09-13T19:33:49.504142+0000","last_clean":"2024-09-13T19:33:49.504142+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:33:49.504142+0000","last_undegraded":"2024-09-13T19:33:49.504142+0000","last_fullsized":"2024-09-13T19:33:49.504142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:43.936467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513374+0000","last_change":"2024-09-13T19:33:18.424633+0000","last_active":"2024-09-13T19:33:49.513374+0000","last_peered":"2024-09-13T19:33:49.513374+0000","last_clean":"2024-09-13T19:33:49.513374+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:33:49.513374+0000","last_undegraded":"2024-09-13T19:33:49.513374+0000","last_fullsized":"2024-09-13T19:33:49.513374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:44.258539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.115279+0000","last_change":"2024-09-13T19:33:10.346685+0000","last_active":"2024-09-13T19:36:24.115279+0000","last_peered":"2024-09-13T19:36:24.115279+0000","last_clean":"2024-09-13T19:36:24.115279+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:36:24.115279+0000","last_undegraded":"2024-09-13T19:36:24.115279+0000","last_fullsized":"2024-09-13T19:36:24.115279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:50.896604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.684205+0000","last_change":"2024-09-13T19:33:08.349745+0000","last_active":"2024-09-13T19:36:23.684205+0000","last_peered":"2024-09-13T19:36:23.684205+0000","last_clean":"2024-09-13T19:36:23.684205+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:36:23.684205+0000","last_undegraded":"2024-09-13T19:36:23.684205+0000","last_fullsized":"2024-09-13T19:36:23.684205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"23'1","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.405946+0000","last_change":"2024-09-13T19:33:12.360592+0000","last_active":"2024-09-13T19:36:55.405946+0000","last_peered":"2024-09-13T19:36:55.405946+0000","last_clean":"2024-09-13T19:36:55.405946+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:36:55.405946+0000","last_undegraded":"2024-09-13T19:36:55.405946+0000","last_fullsized":"2024-09-13T19:36:55.405946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:26.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'27","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.508946+0000","last_change":"2024-09-13T19:33:14.380786+0000","last_active":"2024-09-13T19:35:45.508946+0000","last_peered":"2024-09-13T19:35:45.508946+0000","last_clean":"2024-09-13T19:35:45.508946+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:35:45.508946+0000","last_undegraded":"2024-09-13T19:35:45.508946+0000","last_fullsized":"2024-09-13T19:35:45.508946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:37.500328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.504812+0000","last_change":"2024-09-13T19:33:16.403395+0000","last_active":"2024-09-13T19:33:49.504812+0000","last_peered":"2024-09-13T19:33:49.504812+0000","last_clean":"2024-09-13T19:33:49.504812+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:33:49.504812+0000","last_undegraded":"2024-09-13T19:33:49.504812+0000","last_fullsized":"2024-09-13T19:33:49.504812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:06.844982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.528359+0000","last_change":"2024-09-13T19:33:18.420238+0000","last_active":"2024-09-13T19:35:20.528359+0000","last_peered":"2024-09-13T19:35:20.528359+0000","last_clean":"2024-09-13T19:35:20.528359+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:35:20.528359+0000","last_undegraded":"2024-09-13T19:35:20.528359+0000","last_fullsized":"2024-09-13T19:35:20.528359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:39.541908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.725970+0000","last_change":"2024-09-13T19:33:10.336837+0000","last_active":"2024-09-13T19:36:23.725970+0000","last_peered":"2024-09-13T19:36:23.725970+0000","last_clean":"2024-09-13T19:36:23.725970+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:36:23.725970+0000","last_undegraded":"2024-09-13T19:36:23.725970+0000","last_fullsized":"2024-09-13T19:36:23.725970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:17.640715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513903+0000","last_change":"2024-09-13T19:33:08.329255+0000","last_active":"2024-09-13T19:33:49.513903+0000","last_peered":"2024-09-13T19:33:49.513903+0000","last_clean":"2024-09-13T19:33:49.513903+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:33:49.513903+0000","last_undegraded":"2024-09-13T19:33:49.513903+0000","last_fullsized":"2024-09-13T19:33:49.513903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:59.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.693342+0000","last_change":"2024-09-13T19:33:12.362162+0000","last_active":"2024-09-13T19:35:18.693342+0000","last_peered":"2024-09-13T19:35:18.693342+0000","last_clean":"2024-09-13T19:35:18.693342+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:35:18.693342+0000","last_undegraded":"2024-09-13T19:35:18.693342+0000","last_fullsized":"2024-09-13T19:35:18.693342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.424221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.010387+0000","last_change":"2024-09-13T19:33:14.372731+0000","last_active":"2024-09-13T19:36:23.010387+0000","last_peered":"2024-09-13T19:36:23.010387+0000","last_clean":"2024-09-13T19:36:23.010387+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:36:23.010387+0000","last_undegraded":"2024-09-13T19:36:23.010387+0000","last_fullsized":"2024-09-13T19:36:23.010387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:28.203288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.301505+0000","last_change":"2024-09-13T19:36:59.301555+0000","last_active":"2024-09-13T19:36:59.301505+0000","last_peered":"2024-09-13T19:36:59.301505+0000","last_clean":"2024-09-13T19:36:59.301505+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:36:59.301505+0000","last_undegraded":"2024-09-13T19:36:59.301505+0000","last_fullsized":"2024-09-13T19:36:59.301505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.301322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:26.231205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.533635+0000","last_change":"2024-09-13T19:33:18.420946+0000","last_active":"2024-09-13T19:35:20.533635+0000","last_peered":"2024-09-13T19:35:20.533635+0000","last_clean":"2024-09-13T19:35:20.533635+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:35:20.533635+0000","last_undegraded":"2024-09-13T19:35:20.533635+0000","last_fullsized":"2024-09-13T19:35:20.533635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:33.812134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:50.480170+0000","last_change":"2024-09-13T19:33:49.534946+0000","last_active":"2024-09-13T19:33:50.480170+0000","last_peered":"2024-09-13T19:33:50.480170+0000","last_clean":"2024-09-13T19:33:50.480170+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:33:50.480170+0000","last_undegraded":"2024-09-13T19:33:50.480170+0000","last_fullsized":"2024-09-13T19:33:50.480170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:55.799083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.582657+0000","last_change":"2024-09-13T19:33:08.332706+0000","last_active":"2024-09-13T19:36:23.582657+0000","last_peered":"2024-09-13T19:36:23.582657+0000","last_clean":"2024-09-13T19:36:23.582657+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:36:23.582657+0000","last_undegraded":"2024-09-13T19:36:23.582657+0000","last_fullsized":"2024-09-13T19:36:23.582657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:03.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.224620+0000","last_change":"2024-09-13T19:33:10.332473+0000","last_active":"2024-09-13T19:36:24.224620+0000","last_peered":"2024-09-13T19:36:24.224620+0000","last_clean":"2024-09-13T19:36:24.224620+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:36:24.224620+0000","last_undegraded":"2024-09-13T19:36:24.224620+0000","last_fullsized":"2024-09-13T19:36:24.224620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494291+0000","last_change":"2024-09-13T19:33:08.325598+0000","last_active":"2024-09-13T19:35:14.494291+0000","last_peered":"2024-09-13T19:35:14.494291+0000","last_clean":"2024-09-13T19:35:14.494291+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:35:14.494291+0000","last_undegraded":"2024-09-13T19:35:14.494291+0000","last_fullsized":"2024-09-13T19:35:14.494291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.513363+0000","last_change":"2024-09-13T19:33:10.353700+0000","last_active":"2024-09-13T19:33:49.513363+0000","last_peered":"2024-09-13T19:33:49.513363+0000","last_clean":"2024-09-13T19:33:49.513363+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:33:49.513363+0000","last_undegraded":"2024-09-13T19:33:49.513363+0000","last_fullsized":"2024-09-13T19:33:49.513363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:14.944305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.152054+0000","last_change":"2024-09-13T19:33:08.334993+0000","last_active":"2024-09-13T19:33:54.152054+0000","last_peered":"2024-09-13T19:33:54.152054+0000","last_clean":"2024-09-13T19:33:54.152054+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:33:54.152054+0000","last_undegraded":"2024-09-13T19:33:54.152054+0000","last_fullsized":"2024-09-13T19:33:54.152054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:15.855113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495595+0000","last_change":"2024-09-13T19:33:10.332930+0000","last_active":"2024-09-13T19:35:19.495595+0000","last_peered":"2024-09-13T19:35:19.495595+0000","last_clean":"2024-09-13T19:35:19.495595+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:35:19.495595+0000","last_undegraded":"2024-09-13T19:35:19.495595+0000","last_fullsized":"2024-09-13T19:35:19.495595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.743818+0000","last_change":"2024-09-13T19:33:08.345558+0000","last_active":"2024-09-13T19:36:55.743818+0000","last_peered":"2024-09-13T19:36:55.743818+0000","last_clean":"2024-09-13T19:36:55.743818+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:36:55.743818+0000","last_undegraded":"2024-09-13T19:36:55.743818+0000","last_fullsized":"2024-09-13T19:36:55.743818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.904876+0000","last_change":"2024-09-13T19:33:10.339115+0000","last_active":"2024-09-13T19:36:23.904876+0000","last_peered":"2024-09-13T19:36:23.904876+0000","last_clean":"2024-09-13T19:36:23.904876+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:36:23.904876+0000","last_undegraded":"2024-09-13T19:36:23.904876+0000","last_fullsized":"2024-09-13T19:36:23.904876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.637000+0000","last_change":"2024-09-13T19:33:08.325496+0000","last_active":"2024-09-13T19:35:22.637000+0000","last_peered":"2024-09-13T19:35:22.637000+0000","last_clean":"2024-09-13T19:35:22.637000+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:35:22.637000+0000","last_undegraded":"2024-09-13T19:35:22.637000+0000","last_fullsized":"2024-09-13T19:35:22.637000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.933809+0000","last_change":"2024-09-13T19:33:10.353514+0000","last_active":"2024-09-13T19:35:22.933809+0000","last_peered":"2024-09-13T19:35:22.933809+0000","last_clean":"2024-09-13T19:35:22.933809+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:35:22.933809+0000","last_undegraded":"2024-09-13T19:35:22.933809+0000","last_fullsized":"2024-09-13T19:35:22.933809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:34.718501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500558+0000","last_change":"2024-09-13T19:33:08.338958+0000","last_active":"2024-09-13T19:35:20.500558+0000","last_peered":"2024-09-13T19:35:20.500558+0000","last_clean":"2024-09-13T19:35:20.500558+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:35:20.500558+0000","last_undegraded":"2024-09-13T19:35:20.500558+0000","last_fullsized":"2024-09-13T19:35:20.500558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:02.352968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.440548+0000","last_change":"2024-09-13T19:33:10.339492+0000","last_active":"2024-09-13T19:36:24.440548+0000","last_peered":"2024-09-13T19:36:24.440548+0000","last_clean":"2024-09-13T19:36:24.440548+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:36:24.440548+0000","last_undegraded":"2024-09-13T19:36:24.440548+0000","last_fullsized":"2024-09-13T19:36:24.440548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.523956+0000","last_change":"2024-09-13T19:33:08.352331+0000","last_active":"2024-09-13T19:33:49.523956+0000","last_peered":"2024-09-13T19:33:49.523956+0000","last_clean":"2024-09-13T19:33:49.523956+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:33:49.523956+0000","last_undegraded":"2024-09-13T19:33:49.523956+0000","last_fullsized":"2024-09-13T19:33:49.523956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:14.487188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.206679+0000","last_change":"2024-09-13T19:33:10.340020+0000","last_active":"2024-09-13T19:36:24.206679+0000","last_peered":"2024-09-13T19:36:24.206679+0000","last_clean":"2024-09-13T19:36:24.206679+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:36:24.206679+0000","last_undegraded":"2024-09-13T19:36:24.206679+0000","last_fullsized":"2024-09-13T19:36:24.206679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:45.642178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495907+0000","last_change":"2024-09-13T19:33:08.325702+0000","last_active":"2024-09-13T19:35:19.495907+0000","last_peered":"2024-09-13T19:35:19.495907+0000","last_clean":"2024-09-13T19:35:19.495907+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:35:19.495907+0000","last_undegraded":"2024-09-13T19:35:19.495907+0000","last_fullsized":"2024-09-13T19:35:19.495907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:34:37.521893+0000","last_change":"2024-09-13T19:33:10.347711+0000","last_active":"2024-09-13T19:34:37.521893+0000","last_peered":"2024-09-13T19:34:37.521893+0000","last_clean":"2024-09-13T19:34:37.521893+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:34:37.521893+0000","last_undegraded":"2024-09-13T19:34:37.521893+0000","last_fullsized":"2024-09-13T19:34:37.521893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:35.663644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503292+0000","last_change":"2024-09-13T19:33:08.332434+0000","last_active":"2024-09-13T19:33:49.503292+0000","last_peered":"2024-09-13T19:33:49.503292+0000","last_clean":"2024-09-13T19:33:49.503292+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:33:49.503292+0000","last_undegraded":"2024-09-13T19:33:49.503292+0000","last_fullsized":"2024-09-13T19:33:49.503292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:37.935261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'13","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.748902+0000","last_change":"2024-09-13T19:33:10.357624+0000","last_active":"2024-09-13T19:36:23.748902+0000","last_peered":"2024-09-13T19:36:23.748902+0000","last_clean":"2024-09-13T19:36:23.748902+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:36:23.748902+0000","last_undegraded":"2024-09-13T19:36:23.748902+0000","last_fullsized":"2024-09-13T19:36:23.748902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:02.272686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.496940+0000","last_change":"2024-09-13T19:33:08.346231+0000","last_active":"2024-09-13T19:35:24.496940+0000","last_peered":"2024-09-13T19:35:24.496940+0000","last_clean":"2024-09-13T19:35:24.496940+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:35:24.496940+0000","last_undegraded":"2024-09-13T19:35:24.496940+0000","last_fullsized":"2024-09-13T19:35:24.496940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.301613+0000","last_change":"2024-09-13T19:33:10.344691+0000","last_active":"2024-09-13T19:36:24.301613+0000","last_peered":"2024-09-13T19:36:24.301613+0000","last_clean":"2024-09-13T19:36:24.301613+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:36:24.301613+0000","last_undegraded":"2024-09-13T19:36:24.301613+0000","last_fullsized":"2024-09-13T19:36:24.301613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.499748+0000","last_change":"2024-09-13T19:33:08.349717+0000","last_active":"2024-09-13T19:33:49.499748+0000","last_peered":"2024-09-13T19:33:49.499748+0000","last_clean":"2024-09-13T19:33:49.499748+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:33:49.499748+0000","last_undegraded":"2024-09-13T19:33:49.499748+0000","last_fullsized":"2024-09-13T19:33:49.499748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:53.138445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.507430+0000","last_change":"2024-09-13T19:33:10.343686+0000","last_active":"2024-09-13T19:33:49.507430+0000","last_peered":"2024-09-13T19:33:49.507430+0000","last_clean":"2024-09-13T19:33:49.507430+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:33:49.507430+0000","last_undegraded":"2024-09-13T19:33:49.507430+0000","last_fullsized":"2024-09-13T19:33:49.507430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503320+0000","last_change":"2024-09-13T19:33:08.349915+0000","last_active":"2024-09-13T19:33:49.503320+0000","last_peered":"2024-09-13T19:33:49.503320+0000","last_clean":"2024-09-13T19:33:49.503320+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:33:49.503320+0000","last_undegraded":"2024-09-13T19:33:49.503320+0000","last_fullsized":"2024-09-13T19:33:49.503320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:03.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.097014+0000","last_change":"2024-09-13T19:33:10.356426+0000","last_active":"2024-09-13T19:36:24.097014+0000","last_peered":"2024-09-13T19:36:24.097014+0000","last_clean":"2024-09-13T19:36:24.097014+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:36:24.097014+0000","last_undegraded":"2024-09-13T19:36:24.097014+0000","last_fullsized":"2024-09-13T19:36:24.097014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.420645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.509661+0000","last_change":"2024-09-13T19:33:08.342035+0000","last_active":"2024-09-13T19:33:49.509661+0000","last_peered":"2024-09-13T19:33:49.509661+0000","last_clean":"2024-09-13T19:33:49.509661+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:33:49.509661+0000","last_undegraded":"2024-09-13T19:33:49.509661+0000","last_fullsized":"2024-09-13T19:33:49.509661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:01.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:53.379678+0000","last_change":"2024-09-13T19:33:10.350348+0000","last_active":"2024-09-13T19:33:53.379678+0000","last_peered":"2024-09-13T19:33:53.379678+0000","last_clean":"2024-09-13T19:33:53.379678+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:33:53.379678+0000","last_undegraded":"2024-09-13T19:33:53.379678+0000","last_fullsized":"2024-09-13T19:33:53.379678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:09.619694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:52.685036+0000","last_change":"2024-09-13T19:33:08.335544+0000","last_active":"2024-09-13T19:33:52.685036+0000","last_peered":"2024-09-13T19:33:52.685036+0000","last_clean":"2024-09-13T19:33:52.685036+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:33:52.685036+0000","last_undegraded":"2024-09-13T19:33:52.685036+0000","last_fullsized":"2024-09-13T19:33:52.685036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:42.548177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:18.194003+0000","last_change":"2024-09-13T19:33:10.353586+0000","last_active":"2024-09-13T19:35:18.194003+0000","last_peered":"2024-09-13T19:35:18.194003+0000","last_clean":"2024-09-13T19:35:18.194003+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:35:18.194003+0000","last_undegraded":"2024-09-13T19:35:18.194003+0000","last_fullsized":"2024-09-13T19:35:18.194003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:45.252176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.524187+0000","last_change":"2024-09-13T19:33:08.351999+0000","last_active":"2024-09-13T19:33:49.524187+0000","last_peered":"2024-09-13T19:33:49.524187+0000","last_clean":"2024-09-13T19:33:49.524187+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:33:49.524187+0000","last_undegraded":"2024-09-13T19:33:49.524187+0000","last_fullsized":"2024-09-13T19:33:49.524187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:20.702363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.096154+0000","last_change":"2024-09-13T19:33:10.343404+0000","last_active":"2024-09-13T19:36:24.096154+0000","last_peered":"2024-09-13T19:36:24.096154+0000","last_clean":"2024-09-13T19:36:24.096154+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:36:24.096154+0000","last_undegraded":"2024-09-13T19:36:24.096154+0000","last_fullsized":"2024-09-13T19:36:24.096154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:41.814824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.515399+0000","last_change":"2024-09-13T19:33:08.354921+0000","last_active":"2024-09-13T19:33:49.515399+0000","last_peered":"2024-09-13T19:33:49.515399+0000","last_clean":"2024-09-13T19:33:49.515399+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:33:49.515399+0000","last_undegraded":"2024-09-13T19:33:49.515399+0000","last_fullsized":"2024-09-13T19:33:49.515399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:21.015465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:49.503594+0000","last_change":"2024-09-13T19:33:08.354409+0000","last_active":"2024-09-13T19:33:49.503594+0000","last_peered":"2024-09-13T19:33:49.503594+0000","last_clean":"2024-09-13T19:33:49.503594+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:33:49.503594+0000","last_undegraded":"2024-09-13T19:33:49.503594+0000","last_fullsized":"2024-09-13T19:33:49.503594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:08.466174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.114344+0000","last_change":"2024-09-13T19:33:10.340978+0000","last_active":"2024-09-13T19:36:24.114344+0000","last_peered":"2024-09-13T19:36:24.114344+0000","last_clean":"2024-09-13T19:36:24.114344+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:36:24.114344+0000","last_undegraded":"2024-09-13T19:36:24.114344+0000","last_fullsized":"2024-09-13T19:36:24.114344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498119+0000","last_change":"2024-09-13T19:33:08.349038+0000","last_active":"2024-09-13T19:35:29.498119+0000","last_peered":"2024-09-13T19:35:29.498119+0000","last_clean":"2024-09-13T19:35:29.498119+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:35:29.498119+0000","last_undegraded":"2024-09-13T19:35:29.498119+0000","last_fullsized":"2024-09-13T19:35:29.498119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:33:54.871653+0000","last_change":"2024-09-13T19:33:10.357819+0000","last_active":"2024-09-13T19:33:54.871653+0000","last_peered":"2024-09-13T19:33:54.871653+0000","last_clean":"2024-09-13T19:33:54.871653+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:33:54.871653+0000","last_undegraded":"2024-09-13T19:33:54.871653+0000","last_fullsized":"2024-09-13T19:33:54.871653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:15.665066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2275,"ondisk_log_size":2275,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1450,"num_read_kb":1244,"num_write":547,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1322,"ondisk_log_size":1322,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21611392,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":131,"num_read_kb":83,"num_write":310,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47423488,"data_stored":47417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52808,"kb_used_data":17464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":17883136,"data_stored":17553871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52688,"kb_used_data":17344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319152,"statfs":{"total":96636764160,"available":96582811648,"internally_reserved":0,"allocated":17760256,"data_stored":17502939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49252,"kb_used_data":13908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322588,"statfs":{"total":96636764160,"available":96586330112,"internally_reserved":0,"allocated":14241792,"data_stored":13948982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":425984,"data_stored":135923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:37:00.754 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.754 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.754 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.754 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.755 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.755 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.755 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.755 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.755 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.755 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.755 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.756 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.756 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.756 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.756 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.756 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.756 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.756 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.756 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.757 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.757 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.757 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.757 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.757 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.757 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.757 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.757 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.758 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.759 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.759 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.759 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.759 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.759 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.759 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.759 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.759 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.760 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.760 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.760 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.760 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.760 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.760 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.760 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.760 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.761 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.761 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.761 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.761 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.761 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.761 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.761 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.762 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.762 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.762 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.762 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.762 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.762 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.762 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.762 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.763 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.763 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.764 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.764 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.764 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.764 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.765 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.765 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.765 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.765 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.765 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.765 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.765 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.765 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.766 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.766 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.766 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.766 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.766 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.766 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.766 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.767 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.767 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.767 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.767 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.767 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.767 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.767 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.767 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.768 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.768 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.768 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.768 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.768 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.768 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:32:56.474648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.768 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.768 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.769 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.769 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.769 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.769 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.769 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.769 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.769 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.770 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.770 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.770 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.770 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.770 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.770 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.770 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.770 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.771 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.771 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.771 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.771 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.771 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.771 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.771 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.771 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.772 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.772 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.772 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.772 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.772 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.772 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.772 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.772 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.773 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.773 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.773 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.773 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.773 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.773 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.774 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.774 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.774 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.774 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.774 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.774 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.775 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.775 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.775 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.775 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.775 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.775 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.775 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.775 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.776 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.776 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.776 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.776 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.776 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.777 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.777 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.777 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.777 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.777 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.777 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.777 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.778 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.778 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.778 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.778 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.778 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.778 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.778 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.779 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.779 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.779 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.779 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.779 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.779 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.779 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.780 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.780 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.780 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.780 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.780 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.780 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.780 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.781 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.781 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.781 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.781 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.781 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.781 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.782 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.782 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.782 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.782 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.782 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.782 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.783 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.783 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.783 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.783 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.783 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.783 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.784 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.784 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.784 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.784 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.784 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.784 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.785 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.785 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.785 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.785 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.785 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.786 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.786 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.786 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.786 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.786 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.786 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.787 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.787 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.787 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.787 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.787 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.788 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.788 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.788 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.788 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.788 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.789 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.789 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.789 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.789 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.789 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.789 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.790 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.790 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.790 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.790 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.790 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.790 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.790 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.790 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.791 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.791 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.791 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.791 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.791 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.791 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.791 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.791 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.792 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.792 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.792 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.792 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.792 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.792 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.792 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.793 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.793 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:00.793 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:37:20.794 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:37:20.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a766e640 1 Processor -- start 2024-09-13T19:37:20.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a766e640 1 -- start start 2024-09-13T19:37:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a766e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5a0074ef0 0x7fd5a0133b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a766e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a012e900 con 0x7fd5a012ed50 2024-09-13T19:37:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a766e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a0091b40 con 0x7fd5a0074ef0 2024-09-13T19:37:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a540a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd5a012ed50 0x7fd5a012f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49386/0 (socket says 172.21.15.18:49386) 2024-09-13T19:37:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a540a640 1 -- 172.21.15.18:0/2871922628 learned_addr learned my addr 172.21.15.18:0/2871922628 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:37:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a4c09640 1 --2- 172.21.15.18:0/2871922628 >> v2:172.21.15.18:3300/0 conn(0x7fd5a0074ef0 0x7fd5a0133b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd597fff640 1 -- 172.21.15.18:0/2871922628 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611244914 0 0) 0x7fd5a012e900 con 0x7fd5a012ed50 2024-09-13T19:37:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd597fff640 1 -- 172.21.15.18:0/2871922628 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd58c003530 con 0x7fd5a012ed50 2024-09-13T19:37:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a4c09640 1 -- 172.21.15.18:0/2871922628 >> v1:172.21.15.18:6789/0 conn(0x7fd5a012ed50 legacy=0x7fd5a012f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a4c09640 1 -- 172.21.15.18:0/2871922628 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a0075320 con 0x7fd5a0074ef0 2024-09-13T19:37:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd5a4c09640 1 --2- 172.21.15.18:0/2871922628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a0133b10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd590009740 tx=0x7fd59001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ff84494690f4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd597fff640 1 -- 172.21.15.18:0/2871922628 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5900ab550 con 0x7fd5a0074ef0 2024-09-13T19:37:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd597fff640 1 -- 172.21.15.18:0/2871922628 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5900b0070 con 0x7fd5a0074ef0 2024-09-13T19:37:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.926+0000 7fd597fff640 1 -- 172.21.15.18:0/2871922628 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5900ab820 con 0x7fd5a0074ef0 2024-09-13T19:37:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- 172.21.15.18:0/2871922628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 msgr2=0x7fd5a0133b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 --2- 172.21.15.18:0/2871922628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a0133b10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd590009740 tx=0x7fd59001c400 comp rx=0 tx=0).stop 2024-09-13T19:37:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- 172.21.15.18:0/2871922628 shutdown_connections 2024-09-13T19:37:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 --2- 172.21.15.18:0/2871922628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a0133b10 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- 172.21.15.18:0/2871922628 >> 172.21.15.18:0/2871922628 conn(0x7fd5a009d4c0 msgr2=0x7fd5a009d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- 172.21.15.18:0/2871922628 shutdown_connections 2024-09-13T19:37:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- 172.21.15.18:0/2871922628 wait complete. 2024-09-13T19:37:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 Processor -- start 2024-09-13T19:37:20.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- start start 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a01309a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a0136c00 con 0x7fd5a0074ef0 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a540a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a01309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a540a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a01309a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36834/0 (socket says 172.21.15.18:36834) 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a540a640 1 -- 172.21.15.18:0/3397067208 learned_addr learned my addr 172.21.15.18:0/3397067208 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a540a640 1 -- 172.21.15.18:0/3397067208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a00906a0 con 0x7fd5a0074ef0 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a540a640 1 --2- 172.21.15.18:0/3397067208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a01309a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00c3d0 tx=0x7fd59c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd595ffb640 1 -- 172.21.15.18:0/3397067208 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59c017070 con 0x7fd5a0074ef0 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd595ffb640 1 -- 172.21.15.18:0/3397067208 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c005ce0 con 0x7fd5a0074ef0 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a0133650 con 0x7fd5a0074ef0 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd595ffb640 1 -- 172.21.15.18:0/3397067208 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59c0070d0 con 0x7fd5a0074ef0 2024-09-13T19:37:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a0130ee0 con 0x7fd5a0074ef0 2024-09-13T19:37:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd595ffb640 1 -- 172.21.15.18:0/3397067208 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd59c01a070 con 0x7fd5a0074ef0 2024-09-13T19:37:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd595ffb640 1 --2- 172.21.15.18:0/3397067208 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd584035db0 0x7fd584038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a0094090 con 0x7fd5a0074ef0 2024-09-13T19:37:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.930+0000 7fd595ffb640 1 -- 172.21.15.18:0/3397067208 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd59c048450 con 0x7fd5a0074ef0 2024-09-13T19:37:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.934+0000 7fd5a4c09640 1 --2- 172.21.15.18:0/3397067208 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd584035db0 0x7fd584038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.934+0000 7fd5a4c09640 1 --2- 172.21.15.18:0/3397067208 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd584035db0 0x7fd584038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd5900af000 tx=0x7fd5900a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:20.938+0000 7fd595ffb640 1 -- 172.21.15.18:0/3397067208 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd5a00906a0 con 0x7fd5a0074ef0 2024-09-13T19:37:21.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.098+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5a0075bf0 con 0x7fd584035db0 2024-09-13T19:37:21.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.142+0000 7fd595ffb640 1 -- 172.21.15.18:0/3397067208 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658507 (secure 0 0 0) 0x7fd5a0075bf0 con 0x7fd584035db0 2024-09-13T19:37:21.152 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:37:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:37:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd584035db0 msgr2=0x7fd584038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 --2- 172.21.15.18:0/3397067208 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd584035db0 0x7fd584038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd5900af000 tx=0x7fd5900a7000 comp rx=0 tx=0).stop 2024-09-13T19:37:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 msgr2=0x7fd5a01309a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 --2- 172.21.15.18:0/3397067208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a01309a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00c3d0 tx=0x7fd59c00c890 comp rx=0 tx=0).stop 2024-09-13T19:37:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 shutdown_connections 2024-09-13T19:37:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 --2- 172.21.15.18:0/3397067208 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fd584035db0 0x7fd584038270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 --2- 172.21.15.18:0/3397067208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a0074ef0 0x7fd5a01309a0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 >> 172.21.15.18:0/3397067208 conn(0x7fd5a009d4c0 msgr2=0x7fd5a0097ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 shutdown_connections 2024-09-13T19:37:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:21.150+0000 7fd5a766e640 1 -- 172.21.15.18:0/3397067208 wait complete. 2024-09-13T19:37:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-13T19:37:20.526794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5103,"num_read_kb":4688,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4731,"ondisk_log_size":4731,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":140032,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377347328,"statfs":{"total":386547056640,"available":386403663872,"internally_reserved":0,"allocated":2883584,"data_stored":1722916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006368"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879626+0000","last_change":"2024-09-13T19:33:08.351986+0000","last_active":"2024-09-13T19:36:59.879626+0000","last_peered":"2024-09-13T19:36:59.879626+0000","last_clean":"2024-09-13T19:36:59.879626+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:36:59.879626+0000","last_undegraded":"2024-09-13T19:36:59.879626+0000","last_fullsized":"2024-09-13T19:36:59.879626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.296956+0000","last_change":"2024-09-13T19:33:10.354610+0000","last_active":"2024-09-13T19:36:24.296956+0000","last_peered":"2024-09-13T19:36:24.296956+0000","last_clean":"2024-09-13T19:36:24.296956+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:36:24.296956+0000","last_undegraded":"2024-09-13T19:36:24.296956+0000","last_fullsized":"2024-09-13T19:36:24.296956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909474+0000","last_change":"2024-09-13T19:33:08.349789+0000","last_active":"2024-09-13T19:36:58.909474+0000","last_peered":"2024-09-13T19:36:58.909474+0000","last_clean":"2024-09-13T19:36:58.909474+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:36:58.909474+0000","last_undegraded":"2024-09-13T19:36:58.909474+0000","last_fullsized":"2024-09-13T19:36:58.909474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.441692+0000","last_change":"2024-09-13T19:33:49.508985+0000","last_active":"2024-09-13T19:36:24.441692+0000","last_peered":"2024-09-13T19:36:24.441692+0000","last_clean":"2024-09-13T19:36:24.441692+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:36:24.441692+0000","last_undegraded":"2024-09-13T19:36:24.441692+0000","last_fullsized":"2024-09-13T19:36:24.441692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:15.501121+0000","last_change":"2024-09-13T19:33:08.354845+0000","last_active":"2024-09-13T19:35:15.501121+0000","last_peered":"2024-09-13T19:35:15.501121+0000","last_clean":"2024-09-13T19:35:15.501121+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:35:15.501121+0000","last_undegraded":"2024-09-13T19:35:15.501121+0000","last_fullsized":"2024-09-13T19:35:15.501121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'9","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.440264+0000","last_change":"2024-09-13T19:33:10.349694+0000","last_active":"2024-09-13T19:36:24.440264+0000","last_peered":"2024-09-13T19:36:24.440264+0000","last_clean":"2024-09-13T19:36:24.440264+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:36:24.440264+0000","last_undegraded":"2024-09-13T19:36:24.440264+0000","last_fullsized":"2024-09-13T19:36:24.440264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879434+0000","last_change":"2024-09-13T19:33:08.348066+0000","last_active":"2024-09-13T19:36:59.879434+0000","last_peered":"2024-09-13T19:36:59.879434+0000","last_clean":"2024-09-13T19:36:59.879434+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:36:59.879434+0000","last_undegraded":"2024-09-13T19:36:59.879434+0000","last_fullsized":"2024-09-13T19:36:59.879434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507414+0000","last_change":"2024-09-13T19:33:10.348236+0000","last_active":"2024-09-13T19:35:40.507414+0000","last_peered":"2024-09-13T19:35:40.507414+0000","last_clean":"2024-09-13T19:35:40.507414+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:35:40.507414+0000","last_undegraded":"2024-09-13T19:35:40.507414+0000","last_fullsized":"2024-09-13T19:35:40.507414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507457+0000","last_change":"2024-09-13T19:33:08.336355+0000","last_active":"2024-09-13T19:35:40.507457+0000","last_peered":"2024-09-13T19:35:40.507457+0000","last_clean":"2024-09-13T19:35:40.507457+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:35:40.507457+0000","last_undegraded":"2024-09-13T19:35:40.507457+0000","last_fullsized":"2024-09-13T19:35:40.507457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.384896+0000","last_change":"2024-09-13T19:33:10.353752+0000","last_active":"2024-09-13T19:36:59.384896+0000","last_peered":"2024-09-13T19:36:59.384896+0000","last_clean":"2024-09-13T19:36:59.384896+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:36:59.384896+0000","last_undegraded":"2024-09-13T19:36:59.384896+0000","last_fullsized":"2024-09-13T19:36:59.384896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503599+0000","last_change":"2024-09-13T19:33:08.333243+0000","last_active":"2024-09-13T19:35:40.503599+0000","last_peered":"2024-09-13T19:35:40.503599+0000","last_clean":"2024-09-13T19:35:40.503599+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:35:40.503599+0000","last_undegraded":"2024-09-13T19:35:40.503599+0000","last_fullsized":"2024-09-13T19:35:40.503599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.934433+0000","last_change":"2024-09-13T19:33:10.357587+0000","last_active":"2024-09-13T19:35:22.934433+0000","last_peered":"2024-09-13T19:35:22.934433+0000","last_clean":"2024-09-13T19:35:22.934433+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:35:22.934433+0000","last_undegraded":"2024-09-13T19:35:22.934433+0000","last_fullsized":"2024-09-13T19:35:22.934433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507188+0000","last_change":"2024-09-13T19:33:08.338158+0000","last_active":"2024-09-13T19:35:40.507188+0000","last_peered":"2024-09-13T19:35:40.507188+0000","last_clean":"2024-09-13T19:35:40.507188+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:35:40.507188+0000","last_undegraded":"2024-09-13T19:35:40.507188+0000","last_fullsized":"2024-09-13T19:35:40.507188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.880123+0000","last_change":"2024-09-13T19:33:10.355178+0000","last_active":"2024-09-13T19:36:59.880123+0000","last_peered":"2024-09-13T19:36:59.880123+0000","last_clean":"2024-09-13T19:36:59.880123+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:36:59.880123+0000","last_undegraded":"2024-09-13T19:36:59.880123+0000","last_fullsized":"2024-09-13T19:36:59.880123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:39.500372+0000","last_change":"2024-09-13T19:33:08.331646+0000","last_active":"2024-09-13T19:35:39.500372+0000","last_peered":"2024-09-13T19:35:39.500372+0000","last_clean":"2024-09-13T19:35:39.500372+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:35:39.500372+0000","last_undegraded":"2024-09-13T19:35:39.500372+0000","last_fullsized":"2024-09-13T19:35:39.500372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879925+0000","last_change":"2024-09-13T19:33:10.332175+0000","last_active":"2024-09-13T19:36:59.879925+0000","last_peered":"2024-09-13T19:36:59.879925+0000","last_clean":"2024-09-13T19:36:59.879925+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:36:59.879925+0000","last_undegraded":"2024-09-13T19:36:59.879925+0000","last_fullsized":"2024-09-13T19:36:59.879925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504426+0000","last_change":"2024-09-13T19:33:10.348601+0000","last_active":"2024-09-13T19:35:30.504426+0000","last_peered":"2024-09-13T19:35:30.504426+0000","last_clean":"2024-09-13T19:35:30.504426+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:35:30.504426+0000","last_undegraded":"2024-09-13T19:35:30.504426+0000","last_fullsized":"2024-09-13T19:35:30.504426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504755+0000","last_change":"2024-09-13T19:33:08.338071+0000","last_active":"2024-09-13T19:35:35.504755+0000","last_peered":"2024-09-13T19:35:35.504755+0000","last_clean":"2024-09-13T19:35:35.504755+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:35:35.504755+0000","last_undegraded":"2024-09-13T19:35:35.504755+0000","last_fullsized":"2024-09-13T19:35:35.504755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.224429+0000","last_change":"2024-09-13T19:33:10.350836+0000","last_active":"2024-09-13T19:36:24.224429+0000","last_peered":"2024-09-13T19:36:24.224429+0000","last_clean":"2024-09-13T19:36:24.224429+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:36:24.224429+0000","last_undegraded":"2024-09-13T19:36:24.224429+0000","last_fullsized":"2024-09-13T19:36:24.224429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.502647+0000","last_change":"2024-09-13T19:33:08.352861+0000","last_active":"2024-09-13T19:35:35.502647+0000","last_peered":"2024-09-13T19:35:35.502647+0000","last_clean":"2024-09-13T19:35:35.502647+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:35:35.502647+0000","last_undegraded":"2024-09-13T19:35:35.502647+0000","last_fullsized":"2024-09-13T19:35:35.502647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'7","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.440351+0000","last_change":"2024-09-13T19:33:10.354940+0000","last_active":"2024-09-13T19:36:24.440351+0000","last_peered":"2024-09-13T19:36:24.440351+0000","last_clean":"2024-09-13T19:36:24.440351+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:36:24.440351+0000","last_undegraded":"2024-09-13T19:36:24.440351+0000","last_fullsized":"2024-09-13T19:36:24.440351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504622+0000","last_change":"2024-09-13T19:33:08.337822+0000","last_active":"2024-09-13T19:35:35.504622+0000","last_peered":"2024-09-13T19:35:35.504622+0000","last_clean":"2024-09-13T19:35:35.504622+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:35:35.504622+0000","last_undegraded":"2024-09-13T19:35:35.504622+0000","last_fullsized":"2024-09-13T19:35:35.504622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499404+0000","last_change":"2024-09-13T19:33:10.341134+0000","last_active":"2024-09-13T19:35:34.499404+0000","last_peered":"2024-09-13T19:35:34.499404+0000","last_clean":"2024-09-13T19:35:34.499404+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:35:34.499404+0000","last_undegraded":"2024-09-13T19:35:34.499404+0000","last_fullsized":"2024-09-13T19:35:34.499404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504544+0000","last_change":"2024-09-13T19:33:08.335101+0000","last_active":"2024-09-13T19:35:35.504544+0000","last_peered":"2024-09-13T19:35:35.504544+0000","last_clean":"2024-09-13T19:35:35.504544+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:35:35.504544+0000","last_undegraded":"2024-09-13T19:35:35.504544+0000","last_fullsized":"2024-09-13T19:35:35.504544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.224606+0000","last_change":"2024-09-13T19:33:10.346663+0000","last_active":"2024-09-13T19:36:24.224606+0000","last_peered":"2024-09-13T19:36:24.224606+0000","last_clean":"2024-09-13T19:36:24.224606+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:36:24.224606+0000","last_undegraded":"2024-09-13T19:36:24.224606+0000","last_fullsized":"2024-09-13T19:36:24.224606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499377+0000","last_change":"2024-09-13T19:33:08.345933+0000","last_active":"2024-09-13T19:35:34.499377+0000","last_peered":"2024-09-13T19:35:34.499377+0000","last_clean":"2024-09-13T19:35:34.499377+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:35:34.499377+0000","last_undegraded":"2024-09-13T19:35:34.499377+0000","last_fullsized":"2024-09-13T19:35:34.499377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.294918+0000","last_change":"2024-09-13T19:33:10.352700+0000","last_active":"2024-09-13T19:36:24.294918+0000","last_peered":"2024-09-13T19:36:24.294918+0000","last_clean":"2024-09-13T19:36:24.294918+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:36:24.294918+0000","last_undegraded":"2024-09-13T19:36:24.294918+0000","last_fullsized":"2024-09-13T19:36:24.294918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504526+0000","last_change":"2024-09-13T19:33:08.341033+0000","last_active":"2024-09-13T19:35:30.504526+0000","last_peered":"2024-09-13T19:35:30.504526+0000","last_clean":"2024-09-13T19:35:30.504526+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:35:30.504526+0000","last_undegraded":"2024-09-13T19:35:30.504526+0000","last_fullsized":"2024-09-13T19:35:30.504526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.323836+0000","last_change":"2024-09-13T19:33:18.418602+0000","last_active":"2024-09-13T19:36:24.323836+0000","last_peered":"2024-09-13T19:36:24.323836+0000","last_clean":"2024-09-13T19:36:24.323836+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:36:24.323836+0000","last_undegraded":"2024-09-13T19:36:24.323836+0000","last_fullsized":"2024-09-13T19:36:24.323836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.902979+0000","last_change":"2024-09-13T19:33:10.354595+0000","last_active":"2024-09-13T19:36:23.902979+0000","last_peered":"2024-09-13T19:36:23.902979+0000","last_clean":"2024-09-13T19:36:23.902979+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:36:23.902979+0000","last_undegraded":"2024-09-13T19:36:23.902979+0000","last_fullsized":"2024-09-13T19:36:23.902979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.748613+0000","last_change":"2024-09-13T19:33:08.354352+0000","last_active":"2024-09-13T19:36:55.748613+0000","last_peered":"2024-09-13T19:36:55.748613+0000","last_clean":"2024-09-13T19:36:55.748613+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:36:55.748613+0000","last_undegraded":"2024-09-13T19:36:55.748613+0000","last_fullsized":"2024-09-13T19:36:55.748613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.123239+0000","last_change":"2024-09-13T19:37:10.123297+0000","last_active":"2024-09-13T19:37:10.123239+0000","last_peered":"2024-09-13T19:37:10.123239+0000","last_clean":"2024-09-13T19:37:10.123239+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:37:10.123239+0000","last_undegraded":"2024-09-13T19:37:10.123239+0000","last_fullsized":"2024-09-13T19:37:10.123239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.123041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:12.989516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.575217+0000","last_change":"2024-09-13T19:33:14.385453+0000","last_active":"2024-09-13T19:36:55.575217+0000","last_peered":"2024-09-13T19:36:55.575217+0000","last_clean":"2024-09-13T19:36:55.575217+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:36:55.575217+0000","last_undegraded":"2024-09-13T19:36:55.575217+0000","last_fullsized":"2024-09-13T19:36:55.575217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.502465+0000","last_change":"2024-09-13T19:37:00.502515+0000","last_active":"2024-09-13T19:37:00.502465+0000","last_peered":"2024-09-13T19:37:00.502465+0000","last_clean":"2024-09-13T19:37:00.502465+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:37:00.502465+0000","last_undegraded":"2024-09-13T19:37:00.502465+0000","last_fullsized":"2024-09-13T19:37:00.502465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.502274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:43.889848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.227812+0000","last_change":"2024-09-13T19:33:18.412565+0000","last_active":"2024-09-13T19:36:24.227812+0000","last_peered":"2024-09-13T19:36:24.227812+0000","last_clean":"2024-09-13T19:36:24.227812+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:36:24.227812+0000","last_undegraded":"2024-09-13T19:36:24.227812+0000","last_fullsized":"2024-09-13T19:36:24.227812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.299613+0000","last_change":"2024-09-13T19:33:10.353417+0000","last_active":"2024-09-13T19:36:24.299613+0000","last_peered":"2024-09-13T19:36:24.299613+0000","last_clean":"2024-09-13T19:36:24.299613+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:36:24.299613+0000","last_undegraded":"2024-09-13T19:36:24.299613+0000","last_fullsized":"2024-09-13T19:36:24.299613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.501029+0000","last_change":"2024-09-13T19:33:08.348578+0000","last_active":"2024-09-13T19:35:30.501029+0000","last_peered":"2024-09-13T19:35:30.501029+0000","last_clean":"2024-09-13T19:35:30.501029+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:35:30.501029+0000","last_undegraded":"2024-09-13T19:35:30.501029+0000","last_fullsized":"2024-09-13T19:35:30.501029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:10.511887+0000","last_change":"2024-09-13T19:33:49.525696+0000","last_active":"2024-09-13T19:36:10.511887+0000","last_peered":"2024-09-13T19:36:10.511887+0000","last_clean":"2024-09-13T19:36:10.511887+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:36:10.511887+0000","last_undegraded":"2024-09-13T19:36:10.511887+0000","last_fullsized":"2024-09-13T19:36:10.511887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.502616+0000","last_change":"2024-09-13T19:37:10.502701+0000","last_active":"2024-09-13T19:37:10.502616+0000","last_peered":"2024-09-13T19:37:10.502616+0000","last_clean":"2024-09-13T19:37:10.502616+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:37:10.502616+0000","last_undegraded":"2024-09-13T19:37:10.502616+0000","last_fullsized":"2024-09-13T19:37:10.502616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.502401+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:01.003936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.551502+0000","last_change":"2024-09-13T19:37:04.551561+0000","last_active":"2024-09-13T19:37:04.551502+0000","last_peered":"2024-09-13T19:37:04.551502+0000","last_clean":"2024-09-13T19:37:04.551502+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:37:04.551502+0000","last_undegraded":"2024-09-13T19:37:04.551502+0000","last_fullsized":"2024-09-13T19:37:04.551502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.551265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.460322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:49.502721+0000","last_change":"2024-09-13T19:33:18.407303+0000","last_active":"2024-09-13T19:35:49.502721+0000","last_peered":"2024-09-13T19:35:49.502721+0000","last_clean":"2024-09-13T19:35:49.502721+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:35:49.502721+0000","last_undegraded":"2024-09-13T19:35:49.502721+0000","last_fullsized":"2024-09-13T19:35:49.502721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'11","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.438756+0000","last_change":"2024-09-13T19:33:10.350582+0000","last_active":"2024-09-13T19:36:24.438756+0000","last_peered":"2024-09-13T19:36:24.438756+0000","last_clean":"2024-09-13T19:36:24.438756+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:36:24.438756+0000","last_undegraded":"2024-09-13T19:36:24.438756+0000","last_fullsized":"2024-09-13T19:36:24.438756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504469+0000","last_change":"2024-09-13T19:33:08.355253+0000","last_active":"2024-09-13T19:35:30.504469+0000","last_peered":"2024-09-13T19:35:30.504469+0000","last_clean":"2024-09-13T19:35:30.504469+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:35:30.504469+0000","last_undegraded":"2024-09-13T19:35:30.504469+0000","last_fullsized":"2024-09-13T19:35:30.504469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.320659+0000","last_change":"2024-09-13T19:37:19.320730+0000","last_active":"2024-09-13T19:37:19.320659+0000","last_peered":"2024-09-13T19:37:19.320659+0000","last_clean":"2024-09-13T19:37:19.320659+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:37:19.320659+0000","last_undegraded":"2024-09-13T19:37:19.320659+0000","last_fullsized":"2024-09-13T19:37:19.320659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.320446+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:11.577834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.894176+0000","last_change":"2024-09-13T19:37:02.894258+0000","last_active":"2024-09-13T19:37:02.894176+0000","last_peered":"2024-09-13T19:37:02.894176+0000","last_clean":"2024-09-13T19:37:02.894176+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:37:02.894176+0000","last_undegraded":"2024-09-13T19:37:02.894176+0000","last_fullsized":"2024-09-13T19:37:02.894176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.893973+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:18.869439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":395,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.784331+0000","last_change":"2024-09-13T19:33:16.400903+0000","last_active":"2024-09-13T19:36:55.784331+0000","last_peered":"2024-09-13T19:36:55.784331+0000","last_clean":"2024-09-13T19:36:55.784331+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:36:55.784331+0000","last_undegraded":"2024-09-13T19:36:55.784331+0000","last_fullsized":"2024-09-13T19:36:55.784331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:50.505586+0000","last_change":"2024-09-13T19:33:18.416828+0000","last_active":"2024-09-13T19:35:50.505586+0000","last_peered":"2024-09-13T19:35:50.505586+0000","last_clean":"2024-09-13T19:35:50.505586+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:35:50.505586+0000","last_undegraded":"2024-09-13T19:35:50.505586+0000","last_fullsized":"2024-09-13T19:35:50.505586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749237+0000","last_change":"2024-09-13T19:33:10.342044+0000","last_active":"2024-09-13T19:36:23.749237+0000","last_peered":"2024-09-13T19:36:23.749237+0000","last_clean":"2024-09-13T19:36:23.749237+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:36:23.749237+0000","last_undegraded":"2024-09-13T19:36:23.749237+0000","last_fullsized":"2024-09-13T19:36:23.749237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.502849+0000","last_change":"2024-09-13T19:33:08.337394+0000","last_active":"2024-09-13T19:35:30.502849+0000","last_peered":"2024-09-13T19:35:30.502849+0000","last_clean":"2024-09-13T19:35:30.502849+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:35:30.502849+0000","last_undegraded":"2024-09-13T19:35:30.502849+0000","last_fullsized":"2024-09-13T19:35:30.502849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.109757+0000","last_change":"2024-09-13T19:37:08.109820+0000","last_active":"2024-09-13T19:37:08.109757+0000","last_peered":"2024-09-13T19:37:08.109757+0000","last_clean":"2024-09-13T19:37:08.109757+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:37:08.109757+0000","last_undegraded":"2024-09-13T19:37:08.109757+0000","last_fullsized":"2024-09-13T19:37:08.109757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.109562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.916198+0000","last_change":"2024-09-13T19:37:04.916276+0000","last_active":"2024-09-13T19:37:04.916198+0000","last_peered":"2024-09-13T19:37:04.916198+0000","last_clean":"2024-09-13T19:37:04.916198+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:37:04.916198+0000","last_undegraded":"2024-09-13T19:37:04.916198+0000","last_fullsized":"2024-09-13T19:37:04.916198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.915985+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:53.420288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":406,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.795748+0000","last_change":"2024-09-13T19:33:16.392294+0000","last_active":"2024-09-13T19:36:55.795748+0000","last_peered":"2024-09-13T19:36:55.795748+0000","last_clean":"2024-09-13T19:36:55.795748+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:36:55.795748+0000","last_undegraded":"2024-09-13T19:36:55.795748+0000","last_fullsized":"2024-09-13T19:36:55.795748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.113950+0000","last_change":"2024-09-13T19:33:10.356414+0000","last_active":"2024-09-13T19:36:24.113950+0000","last_peered":"2024-09-13T19:36:24.113950+0000","last_clean":"2024-09-13T19:36:24.113950+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:36:24.113950+0000","last_undegraded":"2024-09-13T19:36:24.113950+0000","last_fullsized":"2024-09-13T19:36:24.113950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.744801+0000","last_change":"2024-09-13T19:33:08.347478+0000","last_active":"2024-09-13T19:36:55.744801+0000","last_peered":"2024-09-13T19:36:55.744801+0000","last_clean":"2024-09-13T19:36:55.744801+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:36:55.744801+0000","last_undegraded":"2024-09-13T19:36:55.744801+0000","last_fullsized":"2024-09-13T19:36:55.744801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.519973+0000","last_change":"2024-09-13T19:37:14.520028+0000","last_active":"2024-09-13T19:37:14.519973+0000","last_peered":"2024-09-13T19:37:14.519973+0000","last_clean":"2024-09-13T19:37:14.519973+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:37:14.519973+0000","last_undegraded":"2024-09-13T19:37:14.519973+0000","last_fullsized":"2024-09-13T19:37:14.519973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.519779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:02.289326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.958769+0000","last_change":"2024-09-13T19:37:06.958861+0000","last_active":"2024-09-13T19:37:06.958769+0000","last_peered":"2024-09-13T19:37:06.958769+0000","last_clean":"2024-09-13T19:37:06.958769+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:37:06.958769+0000","last_undegraded":"2024-09-13T19:37:06.958769+0000","last_fullsized":"2024-09-13T19:37:06.958769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.958579+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:36.686521+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.385133+0000","last_change":"2024-09-13T19:37:04.385193+0000","last_active":"2024-09-13T19:37:04.385133+0000","last_peered":"2024-09-13T19:37:04.385133+0000","last_clean":"2024-09-13T19:37:04.385133+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:37:04.385133+0000","last_undegraded":"2024-09-13T19:37:04.385133+0000","last_fullsized":"2024-09-13T19:37:04.385133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.384941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.293998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.499813+0000","last_change":"2024-09-13T19:33:18.417415+0000","last_active":"2024-09-13T19:35:25.499813+0000","last_peered":"2024-09-13T19:35:25.499813+0000","last_clean":"2024-09-13T19:35:25.499813+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:35:25.499813+0000","last_undegraded":"2024-09-13T19:35:25.499813+0000","last_fullsized":"2024-09-13T19:35:25.499813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.296133+0000","last_change":"2024-09-13T19:33:10.352105+0000","last_active":"2024-09-13T19:36:24.296133+0000","last_peered":"2024-09-13T19:36:24.296133+0000","last_clean":"2024-09-13T19:36:24.296133+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:36:24.296133+0000","last_undegraded":"2024-09-13T19:36:24.296133+0000","last_fullsized":"2024-09-13T19:36:24.296133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.499930+0000","last_change":"2024-09-13T19:33:08.351524+0000","last_active":"2024-09-13T19:35:25.499930+0000","last_peered":"2024-09-13T19:35:25.499930+0000","last_clean":"2024-09-13T19:35:25.499930+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:35:25.499930+0000","last_undegraded":"2024-09-13T19:35:25.499930+0000","last_fullsized":"2024-09-13T19:35:25.499930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.496884+0000","last_change":"2024-09-13T19:33:12.346361+0000","last_active":"2024-09-13T19:35:24.496884+0000","last_peered":"2024-09-13T19:35:24.496884+0000","last_clean":"2024-09-13T19:35:24.496884+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:35:24.496884+0000","last_undegraded":"2024-09-13T19:35:24.496884+0000","last_fullsized":"2024-09-13T19:35:24.496884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'35","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.699999+0000","last_change":"2024-09-13T19:33:14.391496+0000","last_active":"2024-09-13T19:36:55.699999+0000","last_peered":"2024-09-13T19:36:55.699999+0000","last_clean":"2024-09-13T19:36:55.699999+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:36:55.699999+0000","last_undegraded":"2024-09-13T19:36:55.699999+0000","last_fullsized":"2024-09-13T19:36:55.699999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.277785+0000","last_change":"2024-09-13T19:37:01.277843+0000","last_active":"2024-09-13T19:37:01.277785+0000","last_peered":"2024-09-13T19:37:01.277785+0000","last_clean":"2024-09-13T19:37:01.277785+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:37:01.277785+0000","last_undegraded":"2024-09-13T19:37:01.277785+0000","last_fullsized":"2024-09-13T19:37:01.277785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.277591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:47.650563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.501831+0000","last_change":"2024-09-13T19:33:18.420383+0000","last_active":"2024-09-13T19:35:25.501831+0000","last_peered":"2024-09-13T19:35:25.501831+0000","last_clean":"2024-09-13T19:35:25.501831+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:35:25.501831+0000","last_undegraded":"2024-09-13T19:35:25.501831+0000","last_fullsized":"2024-09-13T19:35:25.501831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.223926+0000","last_change":"2024-09-13T19:33:10.330476+0000","last_active":"2024-09-13T19:36:24.223926+0000","last_peered":"2024-09-13T19:36:24.223926+0000","last_clean":"2024-09-13T19:36:24.223926+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:36:24.223926+0000","last_undegraded":"2024-09-13T19:36:24.223926+0000","last_fullsized":"2024-09-13T19:36:24.223926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.503381+0000","last_change":"2024-09-13T19:33:08.341877+0000","last_active":"2024-09-13T19:35:25.503381+0000","last_peered":"2024-09-13T19:35:25.503381+0000","last_clean":"2024-09-13T19:35:25.503381+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:35:25.503381+0000","last_undegraded":"2024-09-13T19:35:25.503381+0000","last_fullsized":"2024-09-13T19:35:25.503381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498238+0000","last_change":"2024-09-13T19:33:12.348033+0000","last_active":"2024-09-13T19:35:29.498238+0000","last_peered":"2024-09-13T19:35:29.498238+0000","last_clean":"2024-09-13T19:35:29.498238+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:35:29.498238+0000","last_undegraded":"2024-09-13T19:35:29.498238+0000","last_fullsized":"2024-09-13T19:35:29.498238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.088189+0000","last_change":"2024-09-13T19:37:03.088355+0000","last_active":"2024-09-13T19:37:03.088189+0000","last_peered":"2024-09-13T19:37:03.088189+0000","last_clean":"2024-09-13T19:37:03.088189+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:37:03.088189+0000","last_undegraded":"2024-09-13T19:37:03.088189+0000","last_fullsized":"2024-09-13T19:37:03.088189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.087975+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:03.716710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":367,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.337974+0000","last_change":"2024-09-13T19:37:05.338036+0000","last_active":"2024-09-13T19:37:05.337974+0000","last_peered":"2024-09-13T19:37:05.337974+0000","last_clean":"2024-09-13T19:37:05.337974+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:37:05.337974+0000","last_undegraded":"2024-09-13T19:37:05.337974+0000","last_fullsized":"2024-09-13T19:37:05.337974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.337780+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.947112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.908496+0000","last_change":"2024-09-13T19:33:18.416155+0000","last_active":"2024-09-13T19:36:23.908496+0000","last_peered":"2024-09-13T19:36:23.908496+0000","last_clean":"2024-09-13T19:36:23.908496+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:36:23.908496+0000","last_undegraded":"2024-09-13T19:36:23.908496+0000","last_fullsized":"2024-09-13T19:36:23.908496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.114184+0000","last_change":"2024-09-13T19:33:10.337441+0000","last_active":"2024-09-13T19:36:24.114184+0000","last_peered":"2024-09-13T19:36:24.114184+0000","last_clean":"2024-09-13T19:36:24.114184+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:36:24.114184+0000","last_undegraded":"2024-09-13T19:36:24.114184+0000","last_fullsized":"2024-09-13T19:36:24.114184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:05.510900+0000","last_change":"2024-09-13T19:33:49.524748+0000","last_active":"2024-09-13T19:36:05.510900+0000","last_peered":"2024-09-13T19:36:05.510900+0000","last_clean":"2024-09-13T19:36:05.510900+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:36:05.510900+0000","last_undegraded":"2024-09-13T19:36:05.510900+0000","last_fullsized":"2024-09-13T19:36:05.510900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.497022+0000","last_change":"2024-09-13T19:33:12.346224+0000","last_active":"2024-09-13T19:35:24.497022+0000","last_peered":"2024-09-13T19:35:24.497022+0000","last_clean":"2024-09-13T19:35:24.497022+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:35:24.497022+0000","last_undegraded":"2024-09-13T19:35:24.497022+0000","last_fullsized":"2024-09-13T19:35:24.497022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'64","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.075282+0000","last_change":"2024-09-13T19:37:07.075367+0000","last_active":"2024-09-13T19:37:07.075282+0000","last_peered":"2024-09-13T19:37:07.075282+0000","last_clean":"2024-09-13T19:37:07.075282+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:37:07.075282+0000","last_undegraded":"2024-09-13T19:37:07.075282+0000","last_fullsized":"2024-09-13T19:37:07.075282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'64","last_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_deep_scrub":"32'64","last_deep_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.075082+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:36.529696+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.200659+0000","last_change":"2024-09-13T19:37:13.200714+0000","last_active":"2024-09-13T19:37:13.200659+0000","last_peered":"2024-09-13T19:37:13.200659+0000","last_clean":"2024-09-13T19:37:13.200659+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:37:13.200659+0000","last_undegraded":"2024-09-13T19:37:13.200659+0000","last_fullsized":"2024-09-13T19:37:13.200659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.200465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:35.576125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.587873+0000","last_change":"2024-09-13T19:33:18.397231+0000","last_active":"2024-09-13T19:36:24.587873+0000","last_peered":"2024-09-13T19:36:24.587873+0000","last_clean":"2024-09-13T19:36:24.587873+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:36:24.587873+0000","last_undegraded":"2024-09-13T19:36:24.587873+0000","last_fullsized":"2024-09-13T19:36:24.587873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.750177+0000","last_change":"2024-09-13T19:33:49.534836+0000","last_active":"2024-09-13T19:36:23.750177+0000","last_peered":"2024-09-13T19:36:23.750177+0000","last_clean":"2024-09-13T19:36:23.750177+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:36:23.750177+0000","last_undegraded":"2024-09-13T19:36:23.750177+0000","last_fullsized":"2024-09-13T19:36:23.750177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.497072+0000","last_change":"2024-09-13T19:33:08.332135+0000","last_active":"2024-09-13T19:35:24.497072+0000","last_peered":"2024-09-13T19:35:24.497072+0000","last_clean":"2024-09-13T19:35:24.497072+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:35:24.497072+0000","last_undegraded":"2024-09-13T19:35:24.497072+0000","last_fullsized":"2024-09-13T19:35:24.497072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.831151+0000","last_change":"2024-09-13T19:37:13.831206+0000","last_active":"2024-09-13T19:37:13.831151+0000","last_peered":"2024-09-13T19:37:13.831151+0000","last_clean":"2024-09-13T19:37:13.831151+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:37:13.831151+0000","last_undegraded":"2024-09-13T19:37:13.831151+0000","last_fullsized":"2024-09-13T19:37:13.831151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.830975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:27.492677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.519849+0000","last_change":"2024-09-13T19:37:09.520047+0000","last_active":"2024-09-13T19:37:09.519849+0000","last_peered":"2024-09-13T19:37:09.519849+0000","last_clean":"2024-09-13T19:37:09.519849+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:37:09.519849+0000","last_undegraded":"2024-09-13T19:37:09.519849+0000","last_fullsized":"2024-09-13T19:37:09.519849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.519587+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:50.509060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504817+0000","last_change":"2024-09-13T19:33:16.403943+0000","last_active":"2024-09-13T19:35:30.504817+0000","last_peered":"2024-09-13T19:35:30.504817+0000","last_clean":"2024-09-13T19:35:30.504817+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:35:30.504817+0000","last_undegraded":"2024-09-13T19:35:30.504817+0000","last_fullsized":"2024-09-13T19:35:30.504817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.448467+0000","last_change":"2024-09-13T19:33:18.415707+0000","last_active":"2024-09-13T19:36:24.448467+0000","last_peered":"2024-09-13T19:36:24.448467+0000","last_clean":"2024-09-13T19:36:24.448467+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:36:24.448467+0000","last_undegraded":"2024-09-13T19:36:24.448467+0000","last_fullsized":"2024-09-13T19:36:24.448467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.160642+0000","last_change":"2024-09-13T19:37:14.160708+0000","last_active":"2024-09-13T19:37:14.160642+0000","last_peered":"2024-09-13T19:37:14.160642+0000","last_clean":"2024-09-13T19:37:14.160642+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:37:14.160642+0000","last_undegraded":"2024-09-13T19:37:14.160642+0000","last_fullsized":"2024-09-13T19:37:14.160642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.160448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:32.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.502176+0000","last_change":"2024-09-13T19:33:08.342280+0000","last_active":"2024-09-13T19:35:20.502176+0000","last_peered":"2024-09-13T19:35:20.502176+0000","last_clean":"2024-09-13T19:35:20.502176+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:35:20.502176+0000","last_undegraded":"2024-09-13T19:35:20.502176+0000","last_fullsized":"2024-09-13T19:35:20.502176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498284+0000","last_change":"2024-09-13T19:33:12.348184+0000","last_active":"2024-09-13T19:35:29.498284+0000","last_peered":"2024-09-13T19:35:29.498284+0000","last_clean":"2024-09-13T19:35:29.498284+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:35:29.498284+0000","last_undegraded":"2024-09-13T19:35:29.498284+0000","last_fullsized":"2024-09-13T19:35:29.498284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.844696+0000","last_change":"2024-09-13T19:37:10.844787+0000","last_active":"2024-09-13T19:37:10.844696+0000","last_peered":"2024-09-13T19:37:10.844696+0000","last_clean":"2024-09-13T19:37:10.844696+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:37:10.844696+0000","last_undegraded":"2024-09-13T19:37:10.844696+0000","last_fullsized":"2024-09-13T19:37:10.844696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.844519+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:16.097647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.934460+0000","last_change":"2024-09-13T19:37:07.934519+0000","last_active":"2024-09-13T19:37:07.934460+0000","last_peered":"2024-09-13T19:37:07.934460+0000","last_clean":"2024-09-13T19:37:07.934460+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:37:07.934460+0000","last_undegraded":"2024-09-13T19:37:07.934460+0000","last_fullsized":"2024-09-13T19:37:07.934460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.934270+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:17.446351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.454484+0000","last_change":"2024-09-13T19:33:18.415690+0000","last_active":"2024-09-13T19:36:24.454484+0000","last_peered":"2024-09-13T19:36:24.454484+0000","last_clean":"2024-09-13T19:36:24.454484+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:36:24.454484+0000","last_undegraded":"2024-09-13T19:36:24.454484+0000","last_fullsized":"2024-09-13T19:36:24.454484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.500006+0000","last_change":"2024-09-13T19:33:10.333244+0000","last_active":"2024-09-13T19:35:25.500006+0000","last_peered":"2024-09-13T19:35:25.500006+0000","last_clean":"2024-09-13T19:35:25.500006+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:35:25.500006+0000","last_undegraded":"2024-09-13T19:35:25.500006+0000","last_fullsized":"2024-09-13T19:35:25.500006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.502063+0000","last_change":"2024-09-13T19:33:08.355262+0000","last_active":"2024-09-13T19:35:20.502063+0000","last_peered":"2024-09-13T19:35:20.502063+0000","last_clean":"2024-09-13T19:35:20.502063+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:35:20.502063+0000","last_undegraded":"2024-09-13T19:35:20.502063+0000","last_fullsized":"2024-09-13T19:35:20.502063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.436298+0000","last_change":"2024-09-13T19:33:12.355832+0000","last_active":"2024-09-13T19:36:55.436298+0000","last_peered":"2024-09-13T19:36:55.436298+0000","last_clean":"2024-09-13T19:36:55.436298+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:36:55.436298+0000","last_undegraded":"2024-09-13T19:36:55.436298+0000","last_fullsized":"2024-09-13T19:36:55.436298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504655+0000","last_change":"2024-09-13T19:33:14.392024+0000","last_active":"2024-09-13T19:35:30.504655+0000","last_peered":"2024-09-13T19:35:30.504655+0000","last_clean":"2024-09-13T19:35:30.504655+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:35:30.504655+0000","last_undegraded":"2024-09-13T19:35:30.504655+0000","last_fullsized":"2024-09-13T19:35:30.504655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.467278+0000","last_change":"2024-09-13T19:37:01.467344+0000","last_active":"2024-09-13T19:37:01.467278+0000","last_peered":"2024-09-13T19:37:01.467278+0000","last_clean":"2024-09-13T19:37:01.467278+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:37:01.467278+0000","last_undegraded":"2024-09-13T19:37:01.467278+0000","last_fullsized":"2024-09-13T19:37:01.467278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.467091+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:04.385381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.905038+0000","last_change":"2024-09-13T19:37:19.905199+0000","last_active":"2024-09-13T19:37:19.905038+0000","last_peered":"2024-09-13T19:37:19.905038+0000","last_clean":"2024-09-13T19:37:19.905038+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:37:19.905038+0000","last_undegraded":"2024-09-13T19:37:19.905038+0000","last_fullsized":"2024-09-13T19:37:19.905038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.904819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:30.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.300189+0000","last_change":"2024-09-13T19:33:10.351617+0000","last_active":"2024-09-13T19:36:24.300189+0000","last_peered":"2024-09-13T19:36:24.300189+0000","last_clean":"2024-09-13T19:36:24.300189+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:36:24.300189+0000","last_undegraded":"2024-09-13T19:36:24.300189+0000","last_fullsized":"2024-09-13T19:36:24.300189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.746093+0000","last_change":"2024-09-13T19:33:08.341993+0000","last_active":"2024-09-13T19:36:55.746093+0000","last_peered":"2024-09-13T19:36:55.746093+0000","last_clean":"2024-09-13T19:36:55.746093+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:36:55.746093+0000","last_undegraded":"2024-09-13T19:36:55.746093+0000","last_fullsized":"2024-09-13T19:36:55.746093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.118493+0000","last_change":"2024-09-13T19:37:02.118554+0000","last_active":"2024-09-13T19:37:02.118493+0000","last_peered":"2024-09-13T19:37:02.118493+0000","last_clean":"2024-09-13T19:37:02.118493+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:37:02.118493+0000","last_undegraded":"2024-09-13T19:37:02.118493+0000","last_fullsized":"2024-09-13T19:37:02.118493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.118290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:01.693866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.541952+0000","last_change":"2024-09-13T19:37:11.542034+0000","last_active":"2024-09-13T19:37:11.541952+0000","last_peered":"2024-09-13T19:37:11.541952+0000","last_clean":"2024-09-13T19:37:11.541952+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:37:11.541952+0000","last_undegraded":"2024-09-13T19:37:11.541952+0000","last_fullsized":"2024-09-13T19:37:11.541952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.541770+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:28.664323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.819564+0000","last_change":"2024-09-13T19:37:15.819618+0000","last_active":"2024-09-13T19:37:15.819564+0000","last_peered":"2024-09-13T19:37:15.819564+0000","last_clean":"2024-09-13T19:37:15.819564+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:37:15.819564+0000","last_undegraded":"2024-09-13T19:37:15.819564+0000","last_fullsized":"2024-09-13T19:37:15.819564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.819343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:17.226606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.492453+0000","last_change":"2024-09-13T19:37:08.492524+0000","last_active":"2024-09-13T19:37:08.492453+0000","last_peered":"2024-09-13T19:37:08.492453+0000","last_clean":"2024-09-13T19:37:08.492453+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:37:08.492453+0000","last_undegraded":"2024-09-13T19:37:08.492453+0000","last_fullsized":"2024-09-13T19:37:08.492453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.492240+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.753771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:15.501087+0000","last_change":"2024-09-13T19:33:10.358838+0000","last_active":"2024-09-13T19:35:15.501087+0000","last_peered":"2024-09-13T19:35:15.501087+0000","last_clean":"2024-09-13T19:35:15.501087+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:35:15.501087+0000","last_undegraded":"2024-09-13T19:35:15.501087+0000","last_fullsized":"2024-09-13T19:35:15.501087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.383861+0000","last_change":"2024-09-13T19:32:57.877961+0000","last_active":"2024-09-13T19:36:59.383861+0000","last_peered":"2024-09-13T19:36:59.383861+0000","last_clean":"2024-09-13T19:36:59.383861+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:36:59.383861+0000","last_undegraded":"2024-09-13T19:36:59.383861+0000","last_fullsized":"2024-09-13T19:36:59.383861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_clean_scrub_stamp":"2024-09-13T19:32:56.474648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351769+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:37:00.351769+0000","last_peered":"2024-09-13T19:37:00.351769+0000","last_clean":"2024-09-13T19:37:00.351769+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:37:00.351769+0000","last_undegraded":"2024-09-13T19:37:00.351769+0000","last_fullsized":"2024-09-13T19:37:00.351769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:15.500890+0000","last_change":"2024-09-13T19:33:08.353659+0000","last_active":"2024-09-13T19:35:15.500890+0000","last_peered":"2024-09-13T19:35:15.500890+0000","last_clean":"2024-09-13T19:35:15.500890+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:35:15.500890+0000","last_undegraded":"2024-09-13T19:35:15.500890+0000","last_fullsized":"2024-09-13T19:35:15.500890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.500512+0000","last_change":"2024-09-13T19:33:49.523626+0000","last_active":"2024-09-13T19:35:20.500512+0000","last_peered":"2024-09-13T19:35:20.500512+0000","last_clean":"2024-09-13T19:35:20.500512+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:35:20.500512+0000","last_undegraded":"2024-09-13T19:35:20.500512+0000","last_fullsized":"2024-09-13T19:35:20.500512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'87","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.129933+0000","last_change":"2024-09-13T19:37:15.130003+0000","last_active":"2024-09-13T19:37:15.129933+0000","last_peered":"2024-09-13T19:37:15.129933+0000","last_clean":"2024-09-13T19:37:15.129933+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:37:15.129933+0000","last_undegraded":"2024-09-13T19:37:15.129933+0000","last_fullsized":"2024-09-13T19:37:15.129933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.129728+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:51:47.372002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.228642+0000","last_change":"2024-09-13T19:37:09.228695+0000","last_active":"2024-09-13T19:37:09.228642+0000","last_peered":"2024-09-13T19:37:09.228642+0000","last_clean":"2024-09-13T19:37:09.228642+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:37:09.228642+0000","last_undegraded":"2024-09-13T19:37:09.228642+0000","last_fullsized":"2024-09-13T19:37:09.228642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.228417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:56.994751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.319023+0000","last_change":"2024-09-13T19:33:18.410177+0000","last_active":"2024-09-13T19:36:24.319023+0000","last_peered":"2024-09-13T19:36:24.319023+0000","last_clean":"2024-09-13T19:36:24.319023+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:36:24.319023+0000","last_undegraded":"2024-09-13T19:36:24.319023+0000","last_fullsized":"2024-09-13T19:36:24.319023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.114531+0000","last_change":"2024-09-13T19:33:49.529179+0000","last_active":"2024-09-13T19:36:24.114531+0000","last_peered":"2024-09-13T19:36:24.114531+0000","last_clean":"2024-09-13T19:36:24.114531+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:36:24.114531+0000","last_undegraded":"2024-09-13T19:36:24.114531+0000","last_fullsized":"2024-09-13T19:36:24.114531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351712+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:37:00.351712+0000","last_peered":"2024-09-13T19:37:00.351712+0000","last_clean":"2024-09-13T19:37:00.351712+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:37:00.351712+0000","last_undegraded":"2024-09-13T19:37:00.351712+0000","last_fullsized":"2024-09-13T19:37:00.351712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909313+0000","last_change":"2024-09-13T19:33:08.349400+0000","last_active":"2024-09-13T19:36:58.909313+0000","last_peered":"2024-09-13T19:36:58.909313+0000","last_clean":"2024-09-13T19:36:58.909313+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:36:58.909313+0000","last_undegraded":"2024-09-13T19:36:58.909313+0000","last_fullsized":"2024-09-13T19:36:58.909313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.147209+0000","last_change":"2024-09-13T19:37:09.147263+0000","last_active":"2024-09-13T19:37:09.147209+0000","last_peered":"2024-09-13T19:37:09.147209+0000","last_clean":"2024-09-13T19:37:09.147209+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:37:09.147209+0000","last_undegraded":"2024-09-13T19:37:09.147209+0000","last_fullsized":"2024-09-13T19:37:09.147209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.147011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:17.425294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":516,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.504186+0000","last_change":"2024-09-13T19:37:06.504345+0000","last_active":"2024-09-13T19:37:06.504186+0000","last_peered":"2024-09-13T19:37:06.504186+0000","last_clean":"2024-09-13T19:37:06.504186+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:37:06.504186+0000","last_undegraded":"2024-09-13T19:37:06.504186+0000","last_fullsized":"2024-09-13T19:37:06.504186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.503927+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:35.014112+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.502226+0000","last_change":"2024-09-13T19:33:16.401894+0000","last_active":"2024-09-13T19:35:20.502226+0000","last_peered":"2024-09-13T19:35:20.502226+0000","last_clean":"2024-09-13T19:35:20.502226+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:35:20.502226+0000","last_undegraded":"2024-09-13T19:35:20.502226+0000","last_fullsized":"2024-09-13T19:35:20.502226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503157+0000","last_change":"2024-09-13T19:33:18.424198+0000","last_active":"2024-09-13T19:35:30.503157+0000","last_peered":"2024-09-13T19:35:30.503157+0000","last_clean":"2024-09-13T19:35:30.503157+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:35:30.503157+0000","last_undegraded":"2024-09-13T19:35:30.503157+0000","last_fullsized":"2024-09-13T19:35:30.503157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.935176+0000","last_change":"2024-09-13T19:33:10.340098+0000","last_active":"2024-09-13T19:35:22.935176+0000","last_peered":"2024-09-13T19:35:22.935176+0000","last_clean":"2024-09-13T19:35:22.935176+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:35:22.935176+0000","last_undegraded":"2024-09-13T19:35:22.935176+0000","last_fullsized":"2024-09-13T19:35:22.935176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879012+0000","last_change":"2024-09-13T19:33:02.801369+0000","last_active":"2024-09-13T19:36:59.879012+0000","last_peered":"2024-09-13T19:36:59.879012+0000","last_clean":"2024-09-13T19:36:59.879012+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:36:59.879012+0000","last_undegraded":"2024-09-13T19:36:59.879012+0000","last_fullsized":"2024-09-13T19:36:59.879012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909294+0000","last_change":"2024-09-13T19:33:08.346175+0000","last_active":"2024-09-13T19:36:58.909294+0000","last_peered":"2024-09-13T19:36:58.909294+0000","last_clean":"2024-09-13T19:36:58.909294+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:36:58.909294+0000","last_undegraded":"2024-09-13T19:36:58.909294+0000","last_fullsized":"2024-09-13T19:36:58.909294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.849125+0000","last_change":"2024-09-13T19:37:16.849196+0000","last_active":"2024-09-13T19:37:16.849125+0000","last_peered":"2024-09-13T19:37:16.849125+0000","last_clean":"2024-09-13T19:37:16.849125+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:37:16.849125+0000","last_undegraded":"2024-09-13T19:37:16.849125+0000","last_fullsized":"2024-09-13T19:37:16.849125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.848911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:35.095041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.900480+0000","last_change":"2024-09-13T19:37:08.900571+0000","last_active":"2024-09-13T19:37:08.900480+0000","last_peered":"2024-09-13T19:37:08.900480+0000","last_clean":"2024-09-13T19:37:08.900480+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:37:08.900480+0000","last_undegraded":"2024-09-13T19:37:08.900480+0000","last_fullsized":"2024-09-13T19:37:08.900480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.900272+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:29.326850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.306062+0000","last_change":"2024-09-13T19:37:00.306113+0000","last_active":"2024-09-13T19:37:00.306062+0000","last_peered":"2024-09-13T19:37:00.306062+0000","last_clean":"2024-09-13T19:37:00.306062+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:37:00.306062+0000","last_undegraded":"2024-09-13T19:37:00.306062+0000","last_fullsized":"2024-09-13T19:37:00.306062+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.305866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:41.036690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505951+0000","last_change":"2024-09-13T19:33:18.414878+0000","last_active":"2024-09-13T19:35:35.505951+0000","last_peered":"2024-09-13T19:35:35.505951+0000","last_clean":"2024-09-13T19:35:35.505951+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:35:35.505951+0000","last_undegraded":"2024-09-13T19:35:35.505951+0000","last_fullsized":"2024-09-13T19:35:35.505951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909605+0000","last_change":"2024-09-13T19:33:10.346530+0000","last_active":"2024-09-13T19:36:58.909605+0000","last_peered":"2024-09-13T19:36:58.909605+0000","last_clean":"2024-09-13T19:36:58.909605+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:36:58.909605+0000","last_undegraded":"2024-09-13T19:36:58.909605+0000","last_fullsized":"2024-09-13T19:36:58.909605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351734+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:37:00.351734+0000","last_peered":"2024-09-13T19:37:00.351734+0000","last_clean":"2024-09-13T19:37:00.351734+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:37:00.351734+0000","last_undegraded":"2024-09-13T19:37:00.351734+0000","last_fullsized":"2024-09-13T19:37:00.351734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879032+0000","last_change":"2024-09-13T19:33:08.333264+0000","last_active":"2024-09-13T19:36:59.879032+0000","last_peered":"2024-09-13T19:36:59.879032+0000","last_clean":"2024-09-13T19:36:59.879032+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:36:59.879032+0000","last_undegraded":"2024-09-13T19:36:59.879032+0000","last_fullsized":"2024-09-13T19:36:59.879032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.316293+0000","last_change":"2024-09-13T19:37:18.316430+0000","last_active":"2024-09-13T19:37:18.316293+0000","last_peered":"2024-09-13T19:37:18.316293+0000","last_clean":"2024-09-13T19:37:18.316293+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:37:18.316293+0000","last_undegraded":"2024-09-13T19:37:18.316293+0000","last_fullsized":"2024-09-13T19:37:18.316293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.316023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:53.513548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:22.999383+0000","last_change":"2024-09-13T19:33:14.392626+0000","last_active":"2024-09-13T19:36:22.999383+0000","last_peered":"2024-09-13T19:36:22.999383+0000","last_clean":"2024-09-13T19:36:22.999383+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:36:22.999383+0000","last_undegraded":"2024-09-13T19:36:22.999383+0000","last_fullsized":"2024-09-13T19:36:22.999383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.503516+0000","last_change":"2024-09-13T19:33:16.402476+0000","last_active":"2024-09-13T19:35:25.503516+0000","last_peered":"2024-09-13T19:35:25.503516+0000","last_clean":"2024-09-13T19:35:25.503516+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:35:25.503516+0000","last_undegraded":"2024-09-13T19:35:25.503516+0000","last_fullsized":"2024-09-13T19:35:25.503516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.621754+0000","last_change":"2024-09-13T19:33:18.418222+0000","last_active":"2024-09-13T19:36:24.621754+0000","last_peered":"2024-09-13T19:36:24.621754+0000","last_clean":"2024-09-13T19:36:24.621754+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:36:24.621754+0000","last_undegraded":"2024-09-13T19:36:24.621754+0000","last_fullsized":"2024-09-13T19:36:24.621754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.114421+0000","last_change":"2024-09-13T19:33:10.357857+0000","last_active":"2024-09-13T19:36:24.114421+0000","last_peered":"2024-09-13T19:36:24.114421+0000","last_clean":"2024-09-13T19:36:24.114421+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:36:24.114421+0000","last_undegraded":"2024-09-13T19:36:24.114421+0000","last_fullsized":"2024-09-13T19:36:24.114421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879054+0000","last_change":"2024-09-13T19:33:08.332236+0000","last_active":"2024-09-13T19:36:59.879054+0000","last_peered":"2024-09-13T19:36:59.879054+0000","last_clean":"2024-09-13T19:36:59.879054+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:36:59.879054+0000","last_undegraded":"2024-09-13T19:36:59.879054+0000","last_fullsized":"2024-09-13T19:36:59.879054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909219+0000","last_change":"2024-09-13T19:33:02.523552+0000","last_active":"2024-09-13T19:36:58.909219+0000","last_peered":"2024-09-13T19:36:58.909219+0000","last_clean":"2024-09-13T19:36:58.909219+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:36:58.909219+0000","last_undegraded":"2024-09-13T19:36:58.909219+0000","last_fullsized":"2024-09-13T19:36:58.909219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.274945+0000","last_change":"2024-09-13T19:37:15.275009+0000","last_active":"2024-09-13T19:37:15.274945+0000","last_peered":"2024-09-13T19:37:15.274945+0000","last_clean":"2024-09-13T19:37:15.274945+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:37:15.274945+0000","last_undegraded":"2024-09-13T19:37:15.274945+0000","last_fullsized":"2024-09-13T19:37:15.274945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.274757+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:13.076733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'74","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.172215+0000","last_change":"2024-09-13T19:37:11.172215+0000","last_active":"2024-09-13T19:37:11.172215+0000","last_peered":"2024-09-13T19:37:11.172215+0000","last_clean":"2024-09-13T19:37:11.172215+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:37:11.172215+0000","last_undegraded":"2024-09-13T19:37:11.172215+0000","last_fullsized":"2024-09-13T19:37:11.172215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.171938+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:48.364805+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.934711+0000","last_change":"2024-09-13T19:37:03.934769+0000","last_active":"2024-09-13T19:37:03.934711+0000","last_peered":"2024-09-13T19:37:03.934711+0000","last_clean":"2024-09-13T19:37:03.934711+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:37:03.934711+0000","last_undegraded":"2024-09-13T19:37:03.934711+0000","last_fullsized":"2024-09-13T19:37:03.934711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.934524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:27.912903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499474+0000","last_change":"2024-09-13T19:33:18.401696+0000","last_active":"2024-09-13T19:35:34.499474+0000","last_peered":"2024-09-13T19:35:34.499474+0000","last_clean":"2024-09-13T19:35:34.499474+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:35:34.499474+0000","last_undegraded":"2024-09-13T19:35:34.499474+0000","last_fullsized":"2024-09-13T19:35:34.499474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.904542+0000","last_change":"2024-09-13T19:33:10.356809+0000","last_active":"2024-09-13T19:36:23.904542+0000","last_peered":"2024-09-13T19:36:23.904542+0000","last_clean":"2024-09-13T19:36:23.904542+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:36:23.904542+0000","last_undegraded":"2024-09-13T19:36:23.904542+0000","last_fullsized":"2024-09-13T19:36:23.904542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909420+0000","last_change":"2024-09-13T19:33:08.345805+0000","last_active":"2024-09-13T19:36:58.909420+0000","last_peered":"2024-09-13T19:36:58.909420+0000","last_clean":"2024-09-13T19:36:58.909420+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:36:58.909420+0000","last_undegraded":"2024-09-13T19:36:58.909420+0000","last_fullsized":"2024-09-13T19:36:58.909420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351746+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:37:00.351746+0000","last_peered":"2024-09-13T19:37:00.351746+0000","last_clean":"2024-09-13T19:37:00.351746+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:37:00.351746+0000","last_undegraded":"2024-09-13T19:37:00.351746+0000","last_fullsized":"2024-09-13T19:37:00.351746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.079757+0000","last_change":"2024-09-13T19:37:06.079813+0000","last_active":"2024-09-13T19:37:06.079757+0000","last_peered":"2024-09-13T19:37:06.079757+0000","last_clean":"2024-09-13T19:37:06.079757+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:37:06.079757+0000","last_undegraded":"2024-09-13T19:37:06.079757+0000","last_fullsized":"2024-09-13T19:37:06.079757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.079564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:35.654908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.552083+0000","last_change":"2024-09-13T19:37:05.552224+0000","last_active":"2024-09-13T19:37:05.552083+0000","last_peered":"2024-09-13T19:37:05.552083+0000","last_clean":"2024-09-13T19:37:05.552083+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:37:05.552083+0000","last_undegraded":"2024-09-13T19:37:05.552083+0000","last_fullsized":"2024-09-13T19:37:05.552083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.551819+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:23.797950+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.523331+0000","last_change":"2024-09-13T19:36:59.523331+0000","last_active":"2024-09-13T19:36:59.523331+0000","last_peered":"2024-09-13T19:36:59.523331+0000","last_clean":"2024-09-13T19:36:59.523331+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:59.523331+0000","last_undegraded":"2024-09-13T19:36:59.523331+0000","last_fullsized":"2024-09-13T19:36:59.523331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.522965+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:04.776093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.506154+0000","last_change":"2024-09-13T19:33:18.410958+0000","last_active":"2024-09-13T19:35:35.506154+0000","last_peered":"2024-09-13T19:35:35.506154+0000","last_clean":"2024-09-13T19:35:35.506154+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:35:35.506154+0000","last_undegraded":"2024-09-13T19:35:35.506154+0000","last_fullsized":"2024-09-13T19:35:35.506154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352585+0000","last_change":"2024-09-13T19:33:10.352017+0000","last_active":"2024-09-13T19:37:00.352585+0000","last_peered":"2024-09-13T19:37:00.352585+0000","last_clean":"2024-09-13T19:37:00.352585+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:37:00.352585+0000","last_undegraded":"2024-09-13T19:37:00.352585+0000","last_fullsized":"2024-09-13T19:37:00.352585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.502309+0000","last_change":"2024-09-13T19:33:08.335852+0000","last_active":"2024-09-13T19:35:20.502309+0000","last_peered":"2024-09-13T19:35:20.502309+0000","last_clean":"2024-09-13T19:35:20.502309+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:35:20.502309+0000","last_undegraded":"2024-09-13T19:35:20.502309+0000","last_fullsized":"2024-09-13T19:35:20.502309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:14.494560+0000","last_change":"2024-09-13T19:33:02.523653+0000","last_active":"2024-09-13T19:35:14.494560+0000","last_peered":"2024-09-13T19:35:14.494560+0000","last_clean":"2024-09-13T19:35:14.494560+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:35:14.494560+0000","last_undegraded":"2024-09-13T19:35:14.494560+0000","last_fullsized":"2024-09-13T19:35:14.494560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.076382+0000","last_change":"2024-09-13T19:37:04.076438+0000","last_active":"2024-09-13T19:37:04.076382+0000","last_peered":"2024-09-13T19:37:04.076382+0000","last_clean":"2024-09-13T19:37:04.076382+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:37:04.076382+0000","last_undegraded":"2024-09-13T19:37:04.076382+0000","last_fullsized":"2024-09-13T19:37:04.076382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.076154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:39.308586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.502162+0000","last_change":"2024-09-13T19:33:14.384476+0000","last_active":"2024-09-13T19:35:20.502162+0000","last_peered":"2024-09-13T19:35:20.502162+0000","last_clean":"2024-09-13T19:35:20.502162+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:35:20.502162+0000","last_undegraded":"2024-09-13T19:35:20.502162+0000","last_fullsized":"2024-09-13T19:35:20.502162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.358757+0000","last_change":"2024-09-13T19:37:03.358816+0000","last_active":"2024-09-13T19:37:03.358757+0000","last_peered":"2024-09-13T19:37:03.358757+0000","last_clean":"2024-09-13T19:37:03.358757+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:37:03.358757+0000","last_undegraded":"2024-09-13T19:37:03.358757+0000","last_fullsized":"2024-09-13T19:37:03.358757+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.358562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.021089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.557171+0000","last_change":"2024-09-13T19:37:12.557231+0000","last_active":"2024-09-13T19:37:12.557171+0000","last_peered":"2024-09-13T19:37:12.557171+0000","last_clean":"2024-09-13T19:37:12.557171+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:37:12.557171+0000","last_undegraded":"2024-09-13T19:37:12.557171+0000","last_fullsized":"2024-09-13T19:37:12.557171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.556957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.679686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879532+0000","last_change":"2024-09-13T19:33:10.344169+0000","last_active":"2024-09-13T19:36:59.879532+0000","last_peered":"2024-09-13T19:36:59.879532+0000","last_clean":"2024-09-13T19:36:59.879532+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:36:59.879532+0000","last_undegraded":"2024-09-13T19:36:59.879532+0000","last_fullsized":"2024-09-13T19:36:59.879532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.083221+0000","last_change":"2024-09-13T19:33:08.354348+0000","last_active":"2024-09-13T19:36:24.083221+0000","last_peered":"2024-09-13T19:36:24.083221+0000","last_clean":"2024-09-13T19:36:24.083221+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:36:24.083221+0000","last_undegraded":"2024-09-13T19:36:24.083221+0000","last_fullsized":"2024-09-13T19:36:24.083221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:10.499905+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:35:10.499905+0000","last_peered":"2024-09-13T19:35:10.499905+0000","last_clean":"2024-09-13T19:35:10.499905+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:35:10.499905+0000","last_undegraded":"2024-09-13T19:35:10.499905+0000","last_fullsized":"2024-09-13T19:35:10.499905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.142377+0000","last_change":"2024-09-13T19:37:12.142377+0000","last_active":"2024-09-13T19:37:12.142377+0000","last_peered":"2024-09-13T19:37:12.142377+0000","last_clean":"2024-09-13T19:37:12.142377+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:37:12.142377+0000","last_undegraded":"2024-09-13T19:37:12.142377+0000","last_fullsized":"2024-09-13T19:37:12.142377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.142129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:18.473708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'97","reported_seq":190,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.931459+0000","last_change":"2024-09-13T19:37:05.931606+0000","last_active":"2024-09-13T19:37:05.931459+0000","last_peered":"2024-09-13T19:37:05.931459+0000","last_clean":"2024-09-13T19:37:05.931459+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:37:05.931459+0000","last_undegraded":"2024-09-13T19:37:05.931459+0000","last_fullsized":"2024-09-13T19:37:05.931459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.931238+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:45.454573+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.298081+0000","last_change":"2024-09-13T19:37:06.298133+0000","last_active":"2024-09-13T19:37:06.298081+0000","last_peered":"2024-09-13T19:37:06.298081+0000","last_clean":"2024-09-13T19:37:06.298081+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:37:06.298081+0000","last_undegraded":"2024-09-13T19:37:06.298081+0000","last_fullsized":"2024-09-13T19:37:06.298081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:34.808071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.502557+0000","last_change":"2024-09-13T19:33:18.418007+0000","last_active":"2024-09-13T19:35:35.502557+0000","last_peered":"2024-09-13T19:35:35.502557+0000","last_clean":"2024-09-13T19:35:35.502557+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:35:35.502557+0000","last_undegraded":"2024-09-13T19:35:35.502557+0000","last_fullsized":"2024-09-13T19:35:35.502557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.500043+0000","last_change":"2024-09-13T19:33:18.416636+0000","last_active":"2024-09-13T19:35:25.500043+0000","last_peered":"2024-09-13T19:35:25.500043+0000","last_clean":"2024-09-13T19:35:25.500043+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:35:25.500043+0000","last_undegraded":"2024-09-13T19:35:25.500043+0000","last_fullsized":"2024-09-13T19:35:25.500043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.224482+0000","last_change":"2024-09-13T19:33:10.337290+0000","last_active":"2024-09-13T19:36:24.224482+0000","last_peered":"2024-09-13T19:36:24.224482+0000","last_clean":"2024-09-13T19:36:24.224482+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:36:24.224482+0000","last_undegraded":"2024-09-13T19:36:24.224482+0000","last_fullsized":"2024-09-13T19:36:24.224482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.076072+0000","last_change":"2024-09-13T19:33:08.354023+0000","last_active":"2024-09-13T19:36:24.076072+0000","last_peered":"2024-09-13T19:36:24.076072+0000","last_clean":"2024-09-13T19:36:24.076072+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:36:24.076072+0000","last_undegraded":"2024-09-13T19:36:24.076072+0000","last_fullsized":"2024-09-13T19:36:24.076072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504487+0000","last_change":"2024-09-13T19:33:12.349684+0000","last_active":"2024-09-13T19:35:35.504487+0000","last_peered":"2024-09-13T19:35:35.504487+0000","last_clean":"2024-09-13T19:35:35.504487+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:35:35.504487+0000","last_undegraded":"2024-09-13T19:35:35.504487+0000","last_fullsized":"2024-09-13T19:35:35.504487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.155894+0000","last_change":"2024-09-13T19:37:11.156055+0000","last_active":"2024-09-13T19:37:11.155894+0000","last_peered":"2024-09-13T19:37:11.155894+0000","last_clean":"2024-09-13T19:37:11.155894+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:37:11.155894+0000","last_undegraded":"2024-09-13T19:37:11.155894+0000","last_fullsized":"2024-09-13T19:37:11.155894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.155624+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:30.748402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505710+0000","last_change":"2024-09-13T19:33:16.403644+0000","last_active":"2024-09-13T19:35:35.505710+0000","last_peered":"2024-09-13T19:35:35.505710+0000","last_clean":"2024-09-13T19:35:35.505710+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:35:35.505710+0000","last_undegraded":"2024-09-13T19:35:35.505710+0000","last_fullsized":"2024-09-13T19:35:35.505710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.911291+0000","last_change":"2024-09-13T19:33:18.396968+0000","last_active":"2024-09-13T19:36:58.911291+0000","last_peered":"2024-09-13T19:36:58.911291+0000","last_clean":"2024-09-13T19:36:58.911291+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:36:58.911291+0000","last_undegraded":"2024-09-13T19:36:58.911291+0000","last_fullsized":"2024-09-13T19:36:58.911291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503105+0000","last_change":"2024-09-13T19:33:10.357927+0000","last_active":"2024-09-13T19:35:30.503105+0000","last_peered":"2024-09-13T19:35:30.503105+0000","last_clean":"2024-09-13T19:35:30.503105+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:35:30.503105+0000","last_undegraded":"2024-09-13T19:35:30.503105+0000","last_fullsized":"2024-09-13T19:35:30.503105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.502586+0000","last_change":"2024-09-13T19:33:08.353099+0000","last_active":"2024-09-13T19:35:35.502586+0000","last_peered":"2024-09-13T19:35:35.502586+0000","last_clean":"2024-09-13T19:35:35.502586+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:35:35.502586+0000","last_undegraded":"2024-09-13T19:35:35.502586+0000","last_fullsized":"2024-09-13T19:35:35.502586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505996+0000","last_change":"2024-09-13T19:33:49.530881+0000","last_active":"2024-09-13T19:35:35.505996+0000","last_peered":"2024-09-13T19:35:35.505996+0000","last_clean":"2024-09-13T19:35:35.505996+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:35:35.505996+0000","last_undegraded":"2024-09-13T19:35:35.505996+0000","last_fullsized":"2024-09-13T19:35:35.505996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.196965+0000","last_change":"2024-09-13T19:37:10.197029+0000","last_active":"2024-09-13T19:37:10.196965+0000","last_peered":"2024-09-13T19:37:10.196965+0000","last_clean":"2024-09-13T19:37:10.196965+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:37:10.196965+0000","last_undegraded":"2024-09-13T19:37:10.196965+0000","last_fullsized":"2024-09-13T19:37:10.196965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.196773+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:26.963041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.867169+0000","last_change":"2024-09-13T19:37:00.867223+0000","last_active":"2024-09-13T19:37:00.867169+0000","last_peered":"2024-09-13T19:37:00.867169+0000","last_clean":"2024-09-13T19:37:00.867169+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:37:00.867169+0000","last_undegraded":"2024-09-13T19:37:00.867169+0000","last_fullsized":"2024-09-13T19:37:00.867169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.866964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:18.237819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:49.502868+0000","last_change":"2024-09-13T19:33:18.415711+0000","last_active":"2024-09-13T19:35:49.502868+0000","last_peered":"2024-09-13T19:35:49.502868+0000","last_clean":"2024-09-13T19:35:49.502868+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:35:49.502868+0000","last_undegraded":"2024-09-13T19:35:49.502868+0000","last_fullsized":"2024-09-13T19:35:49.502868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.115827+0000","last_change":"2024-09-13T19:33:10.340323+0000","last_active":"2024-09-13T19:36:24.115827+0000","last_peered":"2024-09-13T19:36:24.115827+0000","last_clean":"2024-09-13T19:36:24.115827+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:36:24.115827+0000","last_undegraded":"2024-09-13T19:36:24.115827+0000","last_fullsized":"2024-09-13T19:36:24.115827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.068750+0000","last_change":"2024-09-13T19:33:08.350962+0000","last_active":"2024-09-13T19:36:24.068750+0000","last_peered":"2024-09-13T19:36:24.068750+0000","last_clean":"2024-09-13T19:36:24.068750+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:36:24.068750+0000","last_undegraded":"2024-09-13T19:36:24.068750+0000","last_fullsized":"2024-09-13T19:36:24.068750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.795496+0000","last_change":"2024-09-13T19:37:14.795551+0000","last_active":"2024-09-13T19:37:14.795496+0000","last_peered":"2024-09-13T19:37:14.795496+0000","last_clean":"2024-09-13T19:37:14.795496+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:37:14.795496+0000","last_undegraded":"2024-09-13T19:37:14.795496+0000","last_fullsized":"2024-09-13T19:37:14.795496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.795303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:39.429169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'48","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.298165+0000","last_change":"2024-09-13T19:37:07.298241+0000","last_active":"2024-09-13T19:37:07.298165+0000","last_peered":"2024-09-13T19:37:07.298165+0000","last_clean":"2024-09-13T19:37:07.298165+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:37:07.298165+0000","last_undegraded":"2024-09-13T19:37:07.298165+0000","last_fullsized":"2024-09-13T19:37:07.298165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.297980+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.187946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.510044+0000","last_change":"2024-09-13T19:37:03.510102+0000","last_active":"2024-09-13T19:37:03.510044+0000","last_peered":"2024-09-13T19:37:03.510044+0000","last_clean":"2024-09-13T19:37:03.510044+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:37:03.510044+0000","last_undegraded":"2024-09-13T19:37:03.510044+0000","last_fullsized":"2024-09-13T19:37:03.510044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.509824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.172352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:50.510224+0000","last_change":"2024-09-13T19:33:18.420341+0000","last_active":"2024-09-13T19:35:50.510224+0000","last_peered":"2024-09-13T19:35:50.510224+0000","last_clean":"2024-09-13T19:35:50.510224+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:35:50.510224+0000","last_undegraded":"2024-09-13T19:35:50.510224+0000","last_fullsized":"2024-09-13T19:35:50.510224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.297259+0000","last_change":"2024-09-13T19:33:10.348981+0000","last_active":"2024-09-13T19:36:24.297259+0000","last_peered":"2024-09-13T19:36:24.297259+0000","last_clean":"2024-09-13T19:36:24.297259+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:36:24.297259+0000","last_undegraded":"2024-09-13T19:36:24.297259+0000","last_fullsized":"2024-09-13T19:36:24.297259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504730+0000","last_change":"2024-09-13T19:33:49.519345+0000","last_active":"2024-09-13T19:35:35.504730+0000","last_peered":"2024-09-13T19:35:35.504730+0000","last_clean":"2024-09-13T19:35:35.504730+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:35:35.504730+0000","last_undegraded":"2024-09-13T19:35:35.504730+0000","last_fullsized":"2024-09-13T19:35:35.504730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.122088+0000","last_change":"2024-09-13T19:37:01.122142+0000","last_active":"2024-09-13T19:37:01.122088+0000","last_peered":"2024-09-13T19:37:01.122088+0000","last_clean":"2024-09-13T19:37:01.122088+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:37:01.122088+0000","last_undegraded":"2024-09-13T19:37:01.122088+0000","last_fullsized":"2024-09-13T19:37:01.122088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.121885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:18.346905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.862011+0000","last_change":"2024-09-13T19:37:09.862096+0000","last_active":"2024-09-13T19:37:09.862011+0000","last_peered":"2024-09-13T19:37:09.862011+0000","last_clean":"2024-09-13T19:37:09.862011+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:37:09.862011+0000","last_undegraded":"2024-09-13T19:37:09.862011+0000","last_fullsized":"2024-09-13T19:37:09.862011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.861787+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:30.468598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.892978+0000","last_change":"2024-09-13T19:36:59.893029+0000","last_active":"2024-09-13T19:36:59.892978+0000","last_peered":"2024-09-13T19:36:59.892978+0000","last_clean":"2024-09-13T19:36:59.892978+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:36:59.892978+0000","last_undegraded":"2024-09-13T19:36:59.892978+0000","last_fullsized":"2024-09-13T19:36:59.892978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.892784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:26.796881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.223858+0000","last_change":"2024-09-13T19:33:10.355217+0000","last_active":"2024-09-13T19:36:24.223858+0000","last_peered":"2024-09-13T19:36:24.223858+0000","last_clean":"2024-09-13T19:36:24.223858+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:36:24.223858+0000","last_undegraded":"2024-09-13T19:36:24.223858+0000","last_fullsized":"2024-09-13T19:36:24.223858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505644+0000","last_change":"2024-09-13T19:33:08.338446+0000","last_active":"2024-09-13T19:35:35.505644+0000","last_peered":"2024-09-13T19:35:35.505644+0000","last_clean":"2024-09-13T19:35:35.505644+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:35:35.505644+0000","last_undegraded":"2024-09-13T19:35:35.505644+0000","last_fullsized":"2024-09-13T19:35:35.505644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.250956+0000","last_change":"2024-09-13T19:37:16.251010+0000","last_active":"2024-09-13T19:37:16.250956+0000","last_peered":"2024-09-13T19:37:16.250956+0000","last_clean":"2024-09-13T19:37:16.250956+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:37:16.250956+0000","last_undegraded":"2024-09-13T19:37:16.250956+0000","last_fullsized":"2024-09-13T19:37:16.250956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.250752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:17.682001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'66","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.201407+0000","last_change":"2024-09-13T19:37:12.201490+0000","last_active":"2024-09-13T19:37:12.201407+0000","last_peered":"2024-09-13T19:37:12.201407+0000","last_clean":"2024-09-13T19:37:12.201407+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:37:12.201407+0000","last_undegraded":"2024-09-13T19:37:12.201407+0000","last_fullsized":"2024-09-13T19:37:12.201407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.201193+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:16.321625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.836414+0000","last_change":"2024-09-13T19:37:11.836514+0000","last_active":"2024-09-13T19:37:11.836414+0000","last_peered":"2024-09-13T19:37:11.836414+0000","last_clean":"2024-09-13T19:37:11.836414+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:37:11.836414+0000","last_undegraded":"2024-09-13T19:37:11.836414+0000","last_fullsized":"2024-09-13T19:37:11.836414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.836187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:55.223762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:39.500518+0000","last_change":"2024-09-13T19:33:18.415632+0000","last_active":"2024-09-13T19:35:39.500518+0000","last_peered":"2024-09-13T19:35:39.500518+0000","last_clean":"2024-09-13T19:35:39.500518+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:35:39.500518+0000","last_undegraded":"2024-09-13T19:35:39.500518+0000","last_fullsized":"2024-09-13T19:35:39.500518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909780+0000","last_change":"2024-09-13T19:33:10.348428+0000","last_active":"2024-09-13T19:36:58.909780+0000","last_peered":"2024-09-13T19:36:58.909780+0000","last_clean":"2024-09-13T19:36:58.909780+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:36:58.909780+0000","last_undegraded":"2024-09-13T19:36:58.909780+0000","last_fullsized":"2024-09-13T19:36:58.909780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504395+0000","last_change":"2024-09-13T19:33:08.337364+0000","last_active":"2024-09-13T19:35:35.504395+0000","last_peered":"2024-09-13T19:35:35.504395+0000","last_clean":"2024-09-13T19:35:35.504395+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:35:35.504395+0000","last_undegraded":"2024-09-13T19:35:35.504395+0000","last_fullsized":"2024-09-13T19:35:35.504395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.878270+0000","last_change":"2024-09-13T19:37:18.878321+0000","last_active":"2024-09-13T19:37:18.878270+0000","last_peered":"2024-09-13T19:37:18.878270+0000","last_clean":"2024-09-13T19:37:18.878270+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:37:18.878270+0000","last_undegraded":"2024-09-13T19:37:18.878270+0000","last_fullsized":"2024-09-13T19:37:18.878270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.878068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.266511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.772986+0000","last_change":"2024-09-13T19:33:14.386801+0000","last_active":"2024-09-13T19:36:55.772986+0000","last_peered":"2024-09-13T19:36:55.772986+0000","last_clean":"2024-09-13T19:36:55.772986+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:36:55.772986+0000","last_undegraded":"2024-09-13T19:36:55.772986+0000","last_fullsized":"2024-09-13T19:36:55.772986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.465555+0000","last_change":"2024-09-13T19:37:02.465714+0000","last_active":"2024-09-13T19:37:02.465555+0000","last_peered":"2024-09-13T19:37:02.465555+0000","last_clean":"2024-09-13T19:37:02.465555+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:37:02.465555+0000","last_undegraded":"2024-09-13T19:37:02.465555+0000","last_fullsized":"2024-09-13T19:37:02.465555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.465336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.671030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507238+0000","last_change":"2024-09-13T19:33:18.415435+0000","last_active":"2024-09-13T19:35:40.507238+0000","last_peered":"2024-09-13T19:35:40.507238+0000","last_clean":"2024-09-13T19:35:40.507238+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:35:40.507238+0000","last_undegraded":"2024-09-13T19:35:40.507238+0000","last_fullsized":"2024-09-13T19:35:40.507238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.299848+0000","last_change":"2024-09-13T19:33:10.358856+0000","last_active":"2024-09-13T19:36:24.299848+0000","last_peered":"2024-09-13T19:36:24.299848+0000","last_clean":"2024-09-13T19:36:24.299848+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:36:24.299848+0000","last_undegraded":"2024-09-13T19:36:24.299848+0000","last_fullsized":"2024-09-13T19:36:24.299848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.505695+0000","last_change":"2024-09-13T19:33:08.335612+0000","last_active":"2024-09-13T19:35:40.505695+0000","last_peered":"2024-09-13T19:35:40.505695+0000","last_clean":"2024-09-13T19:35:40.505695+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:35:40.505695+0000","last_undegraded":"2024-09-13T19:35:40.505695+0000","last_fullsized":"2024-09-13T19:35:40.505695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.846935+0000","last_change":"2024-09-13T19:37:17.846985+0000","last_active":"2024-09-13T19:37:17.846935+0000","last_peered":"2024-09-13T19:37:17.846935+0000","last_clean":"2024-09-13T19:37:17.846935+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:37:17.846935+0000","last_undegraded":"2024-09-13T19:37:17.846935+0000","last_fullsized":"2024-09-13T19:37:17.846935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.846741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:49.584937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.250475+0000","last_change":"2024-09-13T19:37:08.250550+0000","last_active":"2024-09-13T19:37:08.250475+0000","last_peered":"2024-09-13T19:37:08.250475+0000","last_clean":"2024-09-13T19:37:08.250475+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:37:08.250475+0000","last_undegraded":"2024-09-13T19:37:08.250475+0000","last_fullsized":"2024-09-13T19:37:08.250475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.250286+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.511817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.299423+0000","last_change":"2024-09-13T19:37:17.299423+0000","last_active":"2024-09-13T19:37:17.299423+0000","last_peered":"2024-09-13T19:37:17.299423+0000","last_clean":"2024-09-13T19:37:17.299423+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:37:17.299423+0000","last_undegraded":"2024-09-13T19:37:17.299423+0000","last_fullsized":"2024-09-13T19:37:17.299423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.299176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:11.887369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507086+0000","last_change":"2024-09-13T19:33:18.414176+0000","last_active":"2024-09-13T19:35:40.507086+0000","last_peered":"2024-09-13T19:35:40.507086+0000","last_clean":"2024-09-13T19:35:40.507086+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:35:40.507086+0000","last_undegraded":"2024-09-13T19:35:40.507086+0000","last_fullsized":"2024-09-13T19:35:40.507086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.903435+0000","last_change":"2024-09-13T19:33:10.347270+0000","last_active":"2024-09-13T19:36:23.903435+0000","last_peered":"2024-09-13T19:36:23.903435+0000","last_clean":"2024-09-13T19:36:23.903435+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:36:23.903435+0000","last_undegraded":"2024-09-13T19:36:23.903435+0000","last_fullsized":"2024-09-13T19:36:23.903435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.747903+0000","last_change":"2024-09-13T19:33:08.340688+0000","last_active":"2024-09-13T19:36:55.747903+0000","last_peered":"2024-09-13T19:36:55.747903+0000","last_clean":"2024-09-13T19:36:55.747903+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:36:55.747903+0000","last_undegraded":"2024-09-13T19:36:55.747903+0000","last_fullsized":"2024-09-13T19:36:55.747903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.506892+0000","last_change":"2024-09-13T19:33:12.349199+0000","last_active":"2024-09-13T19:35:45.506892+0000","last_peered":"2024-09-13T19:35:45.506892+0000","last_clean":"2024-09-13T19:35:45.506892+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:35:45.506892+0000","last_undegraded":"2024-09-13T19:35:45.506892+0000","last_fullsized":"2024-09-13T19:35:45.506892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.354367+0000","last_change":"2024-09-13T19:33:14.391400+0000","last_active":"2024-09-13T19:37:00.354367+0000","last_peered":"2024-09-13T19:37:00.354367+0000","last_clean":"2024-09-13T19:37:00.354367+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:37:00.354367+0000","last_undegraded":"2024-09-13T19:37:00.354367+0000","last_fullsized":"2024-09-13T19:37:00.354367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:13.327011+0000","last_clean_scrub_stamp":"2024-09-13T19:33:13.327011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":419,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.871005+0000","last_change":"2024-09-13T19:37:01.871065+0000","last_active":"2024-09-13T19:37:01.871005+0000","last_peered":"2024-09-13T19:37:01.871005+0000","last_clean":"2024-09-13T19:37:01.871005+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:37:01.871005+0000","last_undegraded":"2024-09-13T19:37:01.871005+0000","last_fullsized":"2024-09-13T19:37:01.871005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.870803+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:04.118178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.506975+0000","last_change":"2024-09-13T19:33:18.419381+0000","last_active":"2024-09-13T19:35:40.506975+0000","last_peered":"2024-09-13T19:35:40.506975+0000","last_clean":"2024-09-13T19:35:40.506975+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:35:40.506975+0000","last_undegraded":"2024-09-13T19:35:40.506975+0000","last_fullsized":"2024-09-13T19:35:40.506975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.222411+0000","last_change":"2024-09-13T19:33:10.336681+0000","last_active":"2024-09-13T19:36:24.222411+0000","last_peered":"2024-09-13T19:36:24.222411+0000","last_clean":"2024-09-13T19:36:24.222411+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:36:24.222411+0000","last_undegraded":"2024-09-13T19:36:24.222411+0000","last_fullsized":"2024-09-13T19:36:24.222411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.505781+0000","last_change":"2024-09-13T19:33:08.338096+0000","last_active":"2024-09-13T19:35:40.505781+0000","last_peered":"2024-09-13T19:35:40.505781+0000","last_clean":"2024-09-13T19:35:40.505781+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:35:40.505781+0000","last_undegraded":"2024-09-13T19:35:40.505781+0000","last_fullsized":"2024-09-13T19:35:40.505781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.506798+0000","last_change":"2024-09-13T19:33:12.353110+0000","last_active":"2024-09-13T19:35:45.506798+0000","last_peered":"2024-09-13T19:35:45.506798+0000","last_clean":"2024-09-13T19:35:45.506798+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:35:45.506798+0000","last_undegraded":"2024-09-13T19:35:45.506798+0000","last_fullsized":"2024-09-13T19:35:45.506798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.503996+0000","last_change":"2024-09-13T19:37:07.504071+0000","last_active":"2024-09-13T19:37:07.503996+0000","last_peered":"2024-09-13T19:37:07.503996+0000","last_clean":"2024-09-13T19:37:07.503996+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:37:07.503996+0000","last_undegraded":"2024-09-13T19:37:07.503996+0000","last_fullsized":"2024-09-13T19:37:07.503996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.503821+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.393786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.318408+0000","last_change":"2024-09-13T19:37:02.318463+0000","last_active":"2024-09-13T19:37:02.318408+0000","last_peered":"2024-09-13T19:37:02.318408+0000","last_clean":"2024-09-13T19:37:02.318408+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:37:02.318408+0000","last_undegraded":"2024-09-13T19:37:02.318408+0000","last_fullsized":"2024-09-13T19:37:02.318408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.318220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:12.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.506980+0000","last_change":"2024-09-13T19:33:18.425299+0000","last_active":"2024-09-13T19:35:45.506980+0000","last_peered":"2024-09-13T19:35:45.506980+0000","last_clean":"2024-09-13T19:35:45.506980+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:35:45.506980+0000","last_undegraded":"2024-09-13T19:35:45.506980+0000","last_fullsized":"2024-09-13T19:35:45.506980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'7","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.439391+0000","last_change":"2024-09-13T19:33:10.344066+0000","last_active":"2024-09-13T19:36:24.439391+0000","last_peered":"2024-09-13T19:36:24.439391+0000","last_clean":"2024-09-13T19:36:24.439391+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:36:24.439391+0000","last_undegraded":"2024-09-13T19:36:24.439391+0000","last_fullsized":"2024-09-13T19:36:24.439391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507672+0000","last_change":"2024-09-13T19:33:08.358155+0000","last_active":"2024-09-13T19:35:40.507672+0000","last_peered":"2024-09-13T19:35:40.507672+0000","last_clean":"2024-09-13T19:35:40.507672+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:35:40.507672+0000","last_undegraded":"2024-09-13T19:35:40.507672+0000","last_fullsized":"2024-09-13T19:35:40.507672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.865865+0000","last_change":"2024-09-13T19:37:12.865947+0000","last_active":"2024-09-13T19:37:12.865865+0000","last_peered":"2024-09-13T19:37:12.865865+0000","last_clean":"2024-09-13T19:37:12.865865+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:37:12.865865+0000","last_undegraded":"2024-09-13T19:37:12.865865+0000","last_fullsized":"2024-09-13T19:37:12.865865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.865683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.157355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.251983+0000","last_change":"2024-09-13T19:37:14.252058+0000","last_active":"2024-09-13T19:37:14.251983+0000","last_peered":"2024-09-13T19:37:14.251983+0000","last_clean":"2024-09-13T19:37:14.251983+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:37:14.251983+0000","last_undegraded":"2024-09-13T19:37:14.251983+0000","last_fullsized":"2024-09-13T19:37:14.251983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.251796+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.000429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507124+0000","last_change":"2024-09-13T19:33:16.400962+0000","last_active":"2024-09-13T19:35:40.507124+0000","last_peered":"2024-09-13T19:35:40.507124+0000","last_clean":"2024-09-13T19:35:40.507124+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:35:40.507124+0000","last_undegraded":"2024-09-13T19:35:40.507124+0000","last_fullsized":"2024-09-13T19:35:40.507124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509143+0000","last_change":"2024-09-13T19:33:18.424633+0000","last_active":"2024-09-13T19:35:45.509143+0000","last_peered":"2024-09-13T19:35:45.509143+0000","last_clean":"2024-09-13T19:35:45.509143+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:35:45.509143+0000","last_undegraded":"2024-09-13T19:35:45.509143+0000","last_fullsized":"2024-09-13T19:35:45.509143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.438708+0000","last_change":"2024-09-13T19:33:10.346685+0000","last_active":"2024-09-13T19:36:24.438708+0000","last_peered":"2024-09-13T19:36:24.438708+0000","last_clean":"2024-09-13T19:36:24.438708+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:36:24.438708+0000","last_undegraded":"2024-09-13T19:36:24.438708+0000","last_fullsized":"2024-09-13T19:36:24.438708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909294+0000","last_change":"2024-09-13T19:33:08.349745+0000","last_active":"2024-09-13T19:36:58.909294+0000","last_peered":"2024-09-13T19:36:58.909294+0000","last_clean":"2024-09-13T19:36:58.909294+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:36:58.909294+0000","last_undegraded":"2024-09-13T19:36:58.909294+0000","last_fullsized":"2024-09-13T19:36:58.909294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"23'1","reported_seq":221,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.436648+0000","last_change":"2024-09-13T19:33:12.360592+0000","last_active":"2024-09-13T19:36:55.436648+0000","last_peered":"2024-09-13T19:36:55.436648+0000","last_clean":"2024-09-13T19:36:55.436648+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:36:55.436648+0000","last_undegraded":"2024-09-13T19:36:55.436648+0000","last_fullsized":"2024-09-13T19:36:55.436648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.117221+0000","last_change":"2024-09-13T19:37:13.117296+0000","last_active":"2024-09-13T19:37:13.117221+0000","last_peered":"2024-09-13T19:37:13.117221+0000","last_clean":"2024-09-13T19:37:13.117221+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:37:13.117221+0000","last_undegraded":"2024-09-13T19:37:13.117221+0000","last_fullsized":"2024-09-13T19:37:13.117221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.117012+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:54.888683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.508885+0000","last_change":"2024-09-13T19:33:16.403395+0000","last_active":"2024-09-13T19:35:45.508885+0000","last_peered":"2024-09-13T19:35:45.508885+0000","last_clean":"2024-09-13T19:35:45.508885+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:35:45.508885+0000","last_undegraded":"2024-09-13T19:35:45.508885+0000","last_fullsized":"2024-09-13T19:35:45.508885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:15.341017+0000","last_clean_scrub_stamp":"2024-09-13T19:33:15.341017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509079+0000","last_change":"2024-09-13T19:33:18.420238+0000","last_active":"2024-09-13T19:35:45.509079+0000","last_peered":"2024-09-13T19:35:45.509079+0000","last_clean":"2024-09-13T19:35:45.509079+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:35:45.509079+0000","last_undegraded":"2024-09-13T19:35:45.509079+0000","last_fullsized":"2024-09-13T19:35:45.509079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.750282+0000","last_change":"2024-09-13T19:33:10.336837+0000","last_active":"2024-09-13T19:36:23.750282+0000","last_peered":"2024-09-13T19:36:23.750282+0000","last_clean":"2024-09-13T19:36:23.750282+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:36:23.750282+0000","last_undegraded":"2024-09-13T19:36:23.750282+0000","last_fullsized":"2024-09-13T19:36:23.750282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:15.499589+0000","last_change":"2024-09-13T19:33:08.329255+0000","last_active":"2024-09-13T19:35:15.499589+0000","last_peered":"2024-09-13T19:35:15.499589+0000","last_clean":"2024-09-13T19:35:15.499589+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:35:15.499589+0000","last_undegraded":"2024-09-13T19:35:15.499589+0000","last_fullsized":"2024-09-13T19:35:15.499589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.532624+0000","last_change":"2024-09-13T19:37:13.532693+0000","last_active":"2024-09-13T19:37:13.532624+0000","last_peered":"2024-09-13T19:37:13.532624+0000","last_clean":"2024-09-13T19:37:13.532624+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:37:13.532624+0000","last_undegraded":"2024-09-13T19:37:13.532624+0000","last_fullsized":"2024-09-13T19:37:13.532624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.532406+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:58.383662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.062342+0000","last_change":"2024-09-13T19:37:05.062437+0000","last_active":"2024-09-13T19:37:05.062342+0000","last_peered":"2024-09-13T19:37:05.062342+0000","last_clean":"2024-09-13T19:37:05.062342+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:37:05.062342+0000","last_undegraded":"2024-09-13T19:37:05.062342+0000","last_fullsized":"2024-09-13T19:37:05.062342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.062147+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:44.414993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.301505+0000","last_change":"2024-09-13T19:36:59.301555+0000","last_active":"2024-09-13T19:36:59.301505+0000","last_peered":"2024-09-13T19:36:59.301505+0000","last_clean":"2024-09-13T19:36:59.301505+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:36:59.301505+0000","last_undegraded":"2024-09-13T19:36:59.301505+0000","last_fullsized":"2024-09-13T19:36:59.301505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.301322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:26.231205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507509+0000","last_change":"2024-09-13T19:33:18.420946+0000","last_active":"2024-09-13T19:35:40.507509+0000","last_peered":"2024-09-13T19:35:40.507509+0000","last_clean":"2024-09-13T19:35:40.507509+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:35:40.507509+0000","last_undegraded":"2024-09-13T19:35:40.507509+0000","last_fullsized":"2024-09-13T19:35:40.507509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:00.507711+0000","last_change":"2024-09-13T19:33:49.534946+0000","last_active":"2024-09-13T19:36:00.507711+0000","last_peered":"2024-09-13T19:36:00.507711+0000","last_clean":"2024-09-13T19:36:00.507711+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:36:00.507711+0000","last_undegraded":"2024-09-13T19:36:00.507711+0000","last_fullsized":"2024-09-13T19:36:00.507711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879237+0000","last_change":"2024-09-13T19:33:08.332706+0000","last_active":"2024-09-13T19:36:59.879237+0000","last_peered":"2024-09-13T19:36:59.879237+0000","last_clean":"2024-09-13T19:36:59.879237+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:36:59.879237+0000","last_undegraded":"2024-09-13T19:36:59.879237+0000","last_fullsized":"2024-09-13T19:36:59.879237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.224620+0000","last_change":"2024-09-13T19:33:10.332473+0000","last_active":"2024-09-13T19:36:24.224620+0000","last_peered":"2024-09-13T19:36:24.224620+0000","last_clean":"2024-09-13T19:36:24.224620+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:36:24.224620+0000","last_undegraded":"2024-09-13T19:36:24.224620+0000","last_fullsized":"2024-09-13T19:36:24.224620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909425+0000","last_change":"2024-09-13T19:33:08.325598+0000","last_active":"2024-09-13T19:36:58.909425+0000","last_peered":"2024-09-13T19:36:58.909425+0000","last_clean":"2024-09-13T19:36:58.909425+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:36:58.909425+0000","last_undegraded":"2024-09-13T19:36:58.909425+0000","last_fullsized":"2024-09-13T19:36:58.909425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.502260+0000","last_change":"2024-09-13T19:33:10.353700+0000","last_active":"2024-09-13T19:35:20.502260+0000","last_peered":"2024-09-13T19:35:20.502260+0000","last_clean":"2024-09-13T19:35:20.502260+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:35:20.502260+0000","last_undegraded":"2024-09-13T19:35:20.502260+0000","last_fullsized":"2024-09-13T19:35:20.502260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:15.500921+0000","last_change":"2024-09-13T19:33:08.334993+0000","last_active":"2024-09-13T19:35:15.500921+0000","last_peered":"2024-09-13T19:35:15.500921+0000","last_clean":"2024-09-13T19:35:15.500921+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:35:15.500921+0000","last_undegraded":"2024-09-13T19:35:15.500921+0000","last_fullsized":"2024-09-13T19:35:15.500921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495595+0000","last_change":"2024-09-13T19:33:10.332930+0000","last_active":"2024-09-13T19:35:19.495595+0000","last_peered":"2024-09-13T19:35:19.495595+0000","last_clean":"2024-09-13T19:35:19.495595+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:35:19.495595+0000","last_undegraded":"2024-09-13T19:35:19.495595+0000","last_fullsized":"2024-09-13T19:35:19.495595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909590+0000","last_change":"2024-09-13T19:33:08.345558+0000","last_active":"2024-09-13T19:36:58.909590+0000","last_peered":"2024-09-13T19:36:58.909590+0000","last_clean":"2024-09-13T19:36:58.909590+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:36:58.909590+0000","last_undegraded":"2024-09-13T19:36:58.909590+0000","last_fullsized":"2024-09-13T19:36:58.909590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909871+0000","last_change":"2024-09-13T19:33:10.339115+0000","last_active":"2024-09-13T19:36:58.909871+0000","last_peered":"2024-09-13T19:36:58.909871+0000","last_clean":"2024-09-13T19:36:58.909871+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:36:58.909871+0000","last_undegraded":"2024-09-13T19:36:58.909871+0000","last_fullsized":"2024-09-13T19:36:58.909871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:22.637000+0000","last_change":"2024-09-13T19:33:08.325496+0000","last_active":"2024-09-13T19:35:22.637000+0000","last_peered":"2024-09-13T19:35:22.637000+0000","last_clean":"2024-09-13T19:35:22.637000+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:35:22.637000+0000","last_undegraded":"2024-09-13T19:35:22.637000+0000","last_fullsized":"2024-09-13T19:35:22.637000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.439778+0000","last_change":"2024-09-13T19:33:10.353514+0000","last_active":"2024-09-13T19:36:24.439778+0000","last_peered":"2024-09-13T19:36:24.439778+0000","last_clean":"2024-09-13T19:36:24.439778+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:36:24.439778+0000","last_undegraded":"2024-09-13T19:36:24.439778+0000","last_fullsized":"2024-09-13T19:36:24.439778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.746767+0000","last_change":"2024-09-13T19:33:08.338958+0000","last_active":"2024-09-13T19:36:55.746767+0000","last_peered":"2024-09-13T19:36:55.746767+0000","last_clean":"2024-09-13T19:36:55.746767+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:36:55.746767+0000","last_undegraded":"2024-09-13T19:36:55.746767+0000","last_fullsized":"2024-09-13T19:36:55.746767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.910261+0000","last_change":"2024-09-13T19:33:10.339492+0000","last_active":"2024-09-13T19:36:58.910261+0000","last_peered":"2024-09-13T19:36:58.910261+0000","last_clean":"2024-09-13T19:36:58.910261+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:36:58.910261+0000","last_undegraded":"2024-09-13T19:36:58.910261+0000","last_fullsized":"2024-09-13T19:36:58.910261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.498733+0000","last_change":"2024-09-13T19:33:08.352331+0000","last_active":"2024-09-13T19:35:20.498733+0000","last_peered":"2024-09-13T19:35:20.498733+0000","last_clean":"2024-09-13T19:35:20.498733+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:35:20.498733+0000","last_undegraded":"2024-09-13T19:35:20.498733+0000","last_fullsized":"2024-09-13T19:35:20.498733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.225161+0000","last_change":"2024-09-13T19:33:10.340020+0000","last_active":"2024-09-13T19:36:24.225161+0000","last_peered":"2024-09-13T19:36:24.225161+0000","last_clean":"2024-09-13T19:36:24.225161+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:36:24.225161+0000","last_undegraded":"2024-09-13T19:36:24.225161+0000","last_fullsized":"2024-09-13T19:36:24.225161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:19.495907+0000","last_change":"2024-09-13T19:33:08.325702+0000","last_active":"2024-09-13T19:35:19.495907+0000","last_peered":"2024-09-13T19:35:19.495907+0000","last_clean":"2024-09-13T19:35:19.495907+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:35:19.495907+0000","last_undegraded":"2024-09-13T19:35:19.495907+0000","last_fullsized":"2024-09-13T19:35:19.495907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.503495+0000","last_change":"2024-09-13T19:33:10.347711+0000","last_active":"2024-09-13T19:35:30.503495+0000","last_peered":"2024-09-13T19:35:30.503495+0000","last_clean":"2024-09-13T19:35:30.503495+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:35:30.503495+0000","last_undegraded":"2024-09-13T19:35:30.503495+0000","last_fullsized":"2024-09-13T19:35:30.503495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:20.502011+0000","last_change":"2024-09-13T19:33:08.332434+0000","last_active":"2024-09-13T19:35:20.502011+0000","last_peered":"2024-09-13T19:35:20.502011+0000","last_clean":"2024-09-13T19:35:20.502011+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:35:20.502011+0000","last_undegraded":"2024-09-13T19:35:20.502011+0000","last_fullsized":"2024-09-13T19:35:20.502011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'13","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.440425+0000","last_change":"2024-09-13T19:33:10.357624+0000","last_active":"2024-09-13T19:36:24.440425+0000","last_peered":"2024-09-13T19:36:24.440425+0000","last_clean":"2024-09-13T19:36:24.440425+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:36:24.440425+0000","last_undegraded":"2024-09-13T19:36:24.440425+0000","last_fullsized":"2024-09-13T19:36:24.440425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:24.496940+0000","last_change":"2024-09-13T19:33:08.346231+0000","last_active":"2024-09-13T19:35:24.496940+0000","last_peered":"2024-09-13T19:35:24.496940+0000","last_clean":"2024-09-13T19:35:24.496940+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:35:24.496940+0000","last_undegraded":"2024-09-13T19:35:24.496940+0000","last_fullsized":"2024-09-13T19:35:24.496940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.301613+0000","last_change":"2024-09-13T19:33:10.344691+0000","last_active":"2024-09-13T19:36:24.301613+0000","last_peered":"2024-09-13T19:36:24.301613+0000","last_clean":"2024-09-13T19:36:24.301613+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:36:24.301613+0000","last_undegraded":"2024-09-13T19:36:24.301613+0000","last_fullsized":"2024-09-13T19:36:24.301613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.501475+0000","last_change":"2024-09-13T19:33:08.349717+0000","last_active":"2024-09-13T19:35:25.501475+0000","last_peered":"2024-09-13T19:35:25.501475+0000","last_clean":"2024-09-13T19:35:25.501475+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:35:25.501475+0000","last_undegraded":"2024-09-13T19:35:25.501475+0000","last_fullsized":"2024-09-13T19:35:25.501475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.501765+0000","last_change":"2024-09-13T19:33:10.343686+0000","last_active":"2024-09-13T19:35:25.501765+0000","last_peered":"2024-09-13T19:35:25.501765+0000","last_clean":"2024-09-13T19:35:25.501765+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:35:25.501765+0000","last_undegraded":"2024-09-13T19:35:25.501765+0000","last_fullsized":"2024-09-13T19:35:25.501765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.501680+0000","last_change":"2024-09-13T19:33:08.349915+0000","last_active":"2024-09-13T19:35:25.501680+0000","last_peered":"2024-09-13T19:35:25.501680+0000","last_clean":"2024-09-13T19:35:25.501680+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:35:25.501680+0000","last_undegraded":"2024-09-13T19:35:25.501680+0000","last_fullsized":"2024-09-13T19:35:25.501680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.114269+0000","last_change":"2024-09-13T19:33:10.356426+0000","last_active":"2024-09-13T19:36:24.114269+0000","last_peered":"2024-09-13T19:36:24.114269+0000","last_clean":"2024-09-13T19:36:24.114269+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:36:24.114269+0000","last_undegraded":"2024-09-13T19:36:24.114269+0000","last_fullsized":"2024-09-13T19:36:24.114269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.503330+0000","last_change":"2024-09-13T19:33:08.342035+0000","last_active":"2024-09-13T19:35:25.503330+0000","last_peered":"2024-09-13T19:35:25.503330+0000","last_clean":"2024-09-13T19:35:25.503330+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:35:25.503330+0000","last_undegraded":"2024-09-13T19:35:25.503330+0000","last_fullsized":"2024-09-13T19:35:25.503330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.501538+0000","last_change":"2024-09-13T19:33:10.350348+0000","last_active":"2024-09-13T19:35:25.501538+0000","last_peered":"2024-09-13T19:35:25.501538+0000","last_clean":"2024-09-13T19:35:25.501538+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:35:25.501538+0000","last_undegraded":"2024-09-13T19:35:25.501538+0000","last_fullsized":"2024-09-13T19:35:25.501538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.503407+0000","last_change":"2024-09-13T19:33:08.335544+0000","last_active":"2024-09-13T19:35:25.503407+0000","last_peered":"2024-09-13T19:35:25.503407+0000","last_clean":"2024-09-13T19:35:25.503407+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:35:25.503407+0000","last_undegraded":"2024-09-13T19:35:25.503407+0000","last_fullsized":"2024-09-13T19:35:25.503407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:25.503208+0000","last_change":"2024-09-13T19:33:10.353586+0000","last_active":"2024-09-13T19:35:25.503208+0000","last_peered":"2024-09-13T19:35:25.503208+0000","last_clean":"2024-09-13T19:35:25.503208+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:35:25.503208+0000","last_undegraded":"2024-09-13T19:35:25.503208+0000","last_fullsized":"2024-09-13T19:35:25.503208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.501272+0000","last_change":"2024-09-13T19:33:08.351999+0000","last_active":"2024-09-13T19:35:30.501272+0000","last_peered":"2024-09-13T19:35:30.501272+0000","last_clean":"2024-09-13T19:35:30.501272+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:35:30.501272+0000","last_undegraded":"2024-09-13T19:35:30.501272+0000","last_fullsized":"2024-09-13T19:35:30.501272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.112213+0000","last_change":"2024-09-13T19:33:10.343404+0000","last_active":"2024-09-13T19:36:24.112213+0000","last_peered":"2024-09-13T19:36:24.112213+0000","last_clean":"2024-09-13T19:36:24.112213+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:36:24.112213+0000","last_undegraded":"2024-09-13T19:36:24.112213+0000","last_fullsized":"2024-09-13T19:36:24.112213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504844+0000","last_change":"2024-09-13T19:33:08.354921+0000","last_active":"2024-09-13T19:35:30.504844+0000","last_peered":"2024-09-13T19:35:30.504844+0000","last_clean":"2024-09-13T19:35:30.504844+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:35:30.504844+0000","last_undegraded":"2024-09-13T19:35:30.504844+0000","last_fullsized":"2024-09-13T19:35:30.504844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504359+0000","last_change":"2024-09-13T19:33:08.354409+0000","last_active":"2024-09-13T19:35:30.504359+0000","last_peered":"2024-09-13T19:35:30.504359+0000","last_clean":"2024-09-13T19:35:30.504359+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:35:30.504359+0000","last_undegraded":"2024-09-13T19:35:30.504359+0000","last_fullsized":"2024-09-13T19:35:30.504359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.114344+0000","last_change":"2024-09-13T19:33:10.340978+0000","last_active":"2024-09-13T19:36:24.114344+0000","last_peered":"2024-09-13T19:36:24.114344+0000","last_clean":"2024-09-13T19:36:24.114344+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:36:24.114344+0000","last_undegraded":"2024-09-13T19:36:24.114344+0000","last_fullsized":"2024-09-13T19:36:24.114344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:29.498119+0000","last_change":"2024-09-13T19:33:08.349038+0000","last_active":"2024-09-13T19:35:29.498119+0000","last_peered":"2024-09-13T19:35:29.498119+0000","last_clean":"2024-09-13T19:35:29.498119+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:35:29.498119+0000","last_undegraded":"2024-09-13T19:35:29.498119+0000","last_fullsized":"2024-09-13T19:35:29.498119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504691+0000","last_change":"2024-09-13T19:33:10.357819+0000","last_active":"2024-09-13T19:35:35.504691+0000","last_peered":"2024-09-13T19:35:35.504691+0000","last_clean":"2024-09-13T19:35:35.504691+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:35:35.504691+0000","last_undegraded":"2024-09-13T19:35:35.504691+0000","last_fullsized":"2024-09-13T19:35:35.504691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1490,"ondisk_log_size":1490,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673015,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673017,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335540,"statfs":{"total":96636764160,"available":96599592960,"internally_reserved":0,"allocated":978944,"data_stored":724012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673015,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1015808,"data_stored":726198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":135923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:37:21.184 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.185 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.186 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.187 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.188 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.188 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.188 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.188 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.188 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.188 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.188 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.188 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.189 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.189 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.189 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.189 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.189 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.189 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.189 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.189 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.190 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.190 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.190 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.190 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.190 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.190 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.190 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.190 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.191 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.192 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.192 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.192 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.192 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.192 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.192 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.192 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.192 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.193 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.193 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.193 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.193 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.193 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.193 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:32:56.474648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.193 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.194 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.194 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.194 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.194 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.194 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.194 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.194 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.194 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.195 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.195 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.195 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.195 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.195 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.195 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.195 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.195 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.196 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.196 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.196 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.196 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.196 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.196 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.196 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.196 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.197 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.197 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.197 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.197 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.197 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.197 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.197 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.197 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.198 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.198 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.198 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.198 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.198 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.198 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.199 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.199 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.199 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.199 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.199 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.199 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.200 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.200 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.200 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.200 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.200 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.200 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.200 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.201 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.201 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.201 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.201 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.201 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.201 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.201 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.201 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.202 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.202 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.202 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.202 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T19:33:13.327011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.202 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.202 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.202 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.202 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.203 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T19:33:15.341017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.204 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.204 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.204 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.204 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.204 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.204 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.205 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.205 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.205 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.205 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.205 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.206 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.206 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.206 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.206 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.206 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.206 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.206 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.206 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.207 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.207 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.207 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.207 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.207 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.207 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.208 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.208 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.208 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.208 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.208 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.208 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.209 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.209 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.209 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.209 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.209 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.209 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.209 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.209 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.210 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:21.210 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:37:41.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:37:41.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c45d8640 1 Processor -- start 2024-09-13T19:37:41.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c45d8640 1 -- start start 2024-09-13T19:37:41.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c45d8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc6bc06dbd0 0x7fc6bc131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:41.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c45d8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6bc071c10 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c45d8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc6bc072230 con 0x7fc6bc06dbd0 2024-09-13T19:37:41.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c1b73640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc6bc06dbd0 0x7fc6bc131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:41.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c1b73640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc6bc06dbd0 0x7fc6bc131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39684/0 (socket says 172.21.15.18:39684) 2024-09-13T19:37:41.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c1b73640 1 -- 172.21.15.18:0/191785715 learned_addr learned my addr 172.21.15.18:0/191785715 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:37:41.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c1b73640 1 -- 172.21.15.18:0/191785715 >> v1:172.21.15.18:6789/0 conn(0x7fc6bc06d0e0 legacy=0x7fc6bc06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:41.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c1b73640 1 -- 172.21.15.18:0/191785715 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc0709e0 con 0x7fc6bc06dbd0 2024-09-13T19:37:41.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.341+0000 7fc6c1b73640 1 --2- 172.21.15.18:0/191785715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06dbd0 0x7fc6bc131e60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80097f0 tx=0x7fc6b801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0503572e28bbc3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:41.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c1372640 1 -- 172.21.15.18:0/191785715 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6b80b0070 con 0x7fc6bc06dbd0 2024-09-13T19:37:41.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c1372640 1 -- 172.21.15.18:0/191785715 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b80ab530 con 0x7fc6bc06dbd0 2024-09-13T19:37:41.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c1372640 1 -- 172.21.15.18:0/191785715 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6b80ab830 con 0x7fc6bc06dbd0 2024-09-13T19:37:41.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- 172.21.15.18:0/191785715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06dbd0 msgr2=0x7fc6bc131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:41.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 --2- 172.21.15.18:0/191785715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06dbd0 0x7fc6bc131e60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80097f0 tx=0x7fc6b801c430 comp rx=0 tx=0).stop 2024-09-13T19:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- 172.21.15.18:0/191785715 shutdown_connections 2024-09-13T19:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 --2- 172.21.15.18:0/191785715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06dbd0 0x7fc6bc131e60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- 172.21.15.18:0/191785715 >> 172.21.15.18:0/191785715 conn(0x7fc6bc099a50 msgr2=0x7fc6bc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- 172.21.15.18:0/191785715 shutdown_connections 2024-09-13T19:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- 172.21.15.18:0/191785715 wait complete. 2024-09-13T19:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 Processor -- start 2024-09-13T19:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- start start 2024-09-13T19:37:41.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06d0e0 0x7fc6bc1c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:41.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc134d40 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c2374640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06d0e0 0x7fc6bc1c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:41.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c2374640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06d0e0 0x7fc6bc1c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39696/0 (socket says 172.21.15.18:39696) 2024-09-13T19:37:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c2374640 1 -- 172.21.15.18:0/471103145 learned_addr learned my addr 172.21.15.18:0/471103145 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:37:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c2374640 1 -- 172.21.15.18:0/471103145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc127b30 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c2374640 1 --2- 172.21.15.18:0/471103145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06d0e0 0x7fc6bc1c4290 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00c480 tx=0x7fc6ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6b2ffd640 1 -- 172.21.15.18:0/471103145 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6ac005150 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6b2ffd640 1 -- 172.21.15.18:0/471103145 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac0052f0 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6bc1274f0 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6b2ffd640 1 -- 172.21.15.18:0/471103145 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6ac007030 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6bc128390 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6b2ffd640 1 -- 172.21.15.18:0/471103145 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc6ac019020 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.345+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6bc06d4c0 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.349+0000 7fc6b2ffd640 1 --2- 172.21.15.18:0/471103145 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc6a0035db0 0x7fc6a0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:37:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.349+0000 7fc6b2ffd640 1 -- 172.21.15.18:0/471103145 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc6ac0483d0 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.349+0000 7fc6c1b73640 1 --2- 172.21.15.18:0/471103145 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc6a0035db0 0x7fc6a0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:37:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.349+0000 7fc6c1b73640 1 --2- 172.21.15.18:0/471103145 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc6a0035db0 0x7fc6a0038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80ad000 tx=0x7fc6b80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:37:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.353+0000 7fc6b2ffd640 1 -- 172.21.15.18:0/471103145 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc6ac01a560 con 0x7fc6bc06d0e0 2024-09-13T19:37:41.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.513+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6bc132030 con 0x7fc6a0035db0 2024-09-13T19:37:41.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.557+0000 7fc6b2ffd640 1 -- 172.21.15.18:0/471103145 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662073 (secure 0 0 0) 0x7fc6bc132030 con 0x7fc6a0035db0 2024-09-13T19:37:41.570 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:37:41.576 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc6a0035db0 msgr2=0x7fc6a0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 --2- 172.21.15.18:0/471103145 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc6a0035db0 0x7fc6a0038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80ad000 tx=0x7fc6b80a6000 comp rx=0 tx=0).stop 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06d0e0 msgr2=0x7fc6bc1c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 --2- 172.21.15.18:0/471103145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06d0e0 0x7fc6bc1c4290 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00c480 tx=0x7fc6ac00c940 comp rx=0 tx=0).stop 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 shutdown_connections 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 --2- 172.21.15.18:0/471103145 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc6a0035db0 0x7fc6a0038270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 --2- 172.21.15.18:0/471103145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6bc06d0e0 0x7fc6bc1c4290 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 >> 172.21.15.18:0/471103145 conn(0x7fc6bc099a50 msgr2=0x7fc6bc12aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 shutdown_connections 2024-09-13T19:37:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:37:41.565+0000 7fc6c45d8640 1 -- 172.21.15.18:0/471103145 wait complete. 2024-09-13T19:37:41.588 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-13T19:37:40.537531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5103,"num_read_kb":4688,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144192,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343168,"statfs":{"total":386547056640,"available":386399404032,"internally_reserved":0,"allocated":2883584,"data_stored":1722916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006094"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.048263+0000","last_change":"2024-09-13T19:37:33.048322+0000","last_active":"2024-09-13T19:37:33.048263+0000","last_peered":"2024-09-13T19:37:33.048263+0000","last_clean":"2024-09-13T19:37:33.048263+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:37:33.048263+0000","last_undegraded":"2024-09-13T19:37:33.048263+0000","last_fullsized":"2024-09-13T19:37:33.048263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.048081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.048081+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.048081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:51.634204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.296956+0000","last_change":"2024-09-13T19:33:10.354610+0000","last_active":"2024-09-13T19:36:24.296956+0000","last_peered":"2024-09-13T19:36:24.296956+0000","last_clean":"2024-09-13T19:36:24.296956+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:36:24.296956+0000","last_undegraded":"2024-09-13T19:36:24.296956+0000","last_fullsized":"2024-09-13T19:36:24.296956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.210640+0000","last_change":"2024-09-13T19:37:32.210703+0000","last_active":"2024-09-13T19:37:32.210640+0000","last_peered":"2024-09-13T19:37:32.210640+0000","last_clean":"2024-09-13T19:37:32.210640+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:37:32.210640+0000","last_undegraded":"2024-09-13T19:37:32.210640+0000","last_fullsized":"2024-09-13T19:37:32.210640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:32.210444+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:32.210444+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.210444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:10.274425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.441692+0000","last_change":"2024-09-13T19:33:49.508985+0000","last_active":"2024-09-13T19:36:24.441692+0000","last_peered":"2024-09-13T19:36:24.441692+0000","last_clean":"2024-09-13T19:36:24.441692+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:36:24.441692+0000","last_undegraded":"2024-09-13T19:36:24.441692+0000","last_fullsized":"2024-09-13T19:36:24.441692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352642+0000","last_change":"2024-09-13T19:33:08.354845+0000","last_active":"2024-09-13T19:37:00.352642+0000","last_peered":"2024-09-13T19:37:00.352642+0000","last_clean":"2024-09-13T19:37:00.352642+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:37:00.352642+0000","last_undegraded":"2024-09-13T19:37:00.352642+0000","last_fullsized":"2024-09-13T19:37:00.352642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'9","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.440264+0000","last_change":"2024-09-13T19:33:10.349694+0000","last_active":"2024-09-13T19:36:24.440264+0000","last_peered":"2024-09-13T19:36:24.440264+0000","last_clean":"2024-09-13T19:36:24.440264+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:36:24.440264+0000","last_undegraded":"2024-09-13T19:36:24.440264+0000","last_fullsized":"2024-09-13T19:36:24.440264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879434+0000","last_change":"2024-09-13T19:33:08.348066+0000","last_active":"2024-09-13T19:36:59.879434+0000","last_peered":"2024-09-13T19:36:59.879434+0000","last_clean":"2024-09-13T19:36:59.879434+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:36:59.879434+0000","last_undegraded":"2024-09-13T19:36:59.879434+0000","last_fullsized":"2024-09-13T19:36:59.879434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507414+0000","last_change":"2024-09-13T19:33:10.348236+0000","last_active":"2024-09-13T19:35:40.507414+0000","last_peered":"2024-09-13T19:35:40.507414+0000","last_clean":"2024-09-13T19:35:40.507414+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:35:40.507414+0000","last_undegraded":"2024-09-13T19:35:40.507414+0000","last_fullsized":"2024-09-13T19:35:40.507414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507457+0000","last_change":"2024-09-13T19:33:08.336355+0000","last_active":"2024-09-13T19:35:40.507457+0000","last_peered":"2024-09-13T19:35:40.507457+0000","last_clean":"2024-09-13T19:35:40.507457+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:35:40.507457+0000","last_undegraded":"2024-09-13T19:35:40.507457+0000","last_fullsized":"2024-09-13T19:35:40.507457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.384896+0000","last_change":"2024-09-13T19:33:10.353752+0000","last_active":"2024-09-13T19:36:59.384896+0000","last_peered":"2024-09-13T19:36:59.384896+0000","last_clean":"2024-09-13T19:36:59.384896+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:36:59.384896+0000","last_undegraded":"2024-09-13T19:36:59.384896+0000","last_fullsized":"2024-09-13T19:36:59.384896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.503599+0000","last_change":"2024-09-13T19:33:08.333243+0000","last_active":"2024-09-13T19:35:40.503599+0000","last_peered":"2024-09-13T19:35:40.503599+0000","last_clean":"2024-09-13T19:35:40.503599+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:35:40.503599+0000","last_undegraded":"2024-09-13T19:35:40.503599+0000","last_fullsized":"2024-09-13T19:35:40.503599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.052391+0000","last_change":"2024-09-13T19:37:20.052391+0000","last_active":"2024-09-13T19:37:20.052391+0000","last_peered":"2024-09-13T19:37:20.052391+0000","last_clean":"2024-09-13T19:37:20.052391+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:37:20.052391+0000","last_undegraded":"2024-09-13T19:37:20.052391+0000","last_fullsized":"2024-09-13T19:37:20.052391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:20.052114+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:20.052114+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.052114+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:18.722062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507188+0000","last_change":"2024-09-13T19:33:08.338158+0000","last_active":"2024-09-13T19:35:40.507188+0000","last_peered":"2024-09-13T19:35:40.507188+0000","last_clean":"2024-09-13T19:35:40.507188+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:35:40.507188+0000","last_undegraded":"2024-09-13T19:35:40.507188+0000","last_fullsized":"2024-09-13T19:35:40.507188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.891639+0000","last_change":"2024-09-13T19:37:20.891706+0000","last_active":"2024-09-13T19:37:20.891639+0000","last_peered":"2024-09-13T19:37:20.891639+0000","last_clean":"2024-09-13T19:37:20.891639+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:37:20.891639+0000","last_undegraded":"2024-09-13T19:37:20.891639+0000","last_fullsized":"2024-09-13T19:37:20.891639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:20.891432+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:20.891432+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.891432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:01.880905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:39.500372+0000","last_change":"2024-09-13T19:33:08.331646+0000","last_active":"2024-09-13T19:35:39.500372+0000","last_peered":"2024-09-13T19:35:39.500372+0000","last_clean":"2024-09-13T19:35:39.500372+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:35:39.500372+0000","last_undegraded":"2024-09-13T19:35:39.500372+0000","last_fullsized":"2024-09-13T19:35:39.500372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.934911+0000","last_change":"2024-09-13T19:37:21.934969+0000","last_active":"2024-09-13T19:37:21.934911+0000","last_peered":"2024-09-13T19:37:21.934911+0000","last_clean":"2024-09-13T19:37:21.934911+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:37:21.934911+0000","last_undegraded":"2024-09-13T19:37:21.934911+0000","last_fullsized":"2024-09-13T19:37:21.934911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:21.934729+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:21.934729+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.934729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:12.436264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504426+0000","last_change":"2024-09-13T19:33:10.348601+0000","last_active":"2024-09-13T19:35:30.504426+0000","last_peered":"2024-09-13T19:35:30.504426+0000","last_clean":"2024-09-13T19:35:30.504426+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:35:30.504426+0000","last_undegraded":"2024-09-13T19:35:30.504426+0000","last_fullsized":"2024-09-13T19:35:30.504426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504755+0000","last_change":"2024-09-13T19:33:08.338071+0000","last_active":"2024-09-13T19:35:35.504755+0000","last_peered":"2024-09-13T19:35:35.504755+0000","last_clean":"2024-09-13T19:35:35.504755+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:35:35.504755+0000","last_undegraded":"2024-09-13T19:35:35.504755+0000","last_fullsized":"2024-09-13T19:35:35.504755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.477653+0000","last_change":"2024-09-13T19:37:34.477714+0000","last_active":"2024-09-13T19:37:34.477653+0000","last_peered":"2024-09-13T19:37:34.477653+0000","last_clean":"2024-09-13T19:37:34.477653+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:37:34.477653+0000","last_undegraded":"2024-09-13T19:37:34.477653+0000","last_fullsized":"2024-09-13T19:37:34.477653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:34.477463+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:34.477463+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.477463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:52.475004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.910466+0000","last_change":"2024-09-13T19:37:26.910580+0000","last_active":"2024-09-13T19:37:26.910466+0000","last_peered":"2024-09-13T19:37:26.910466+0000","last_clean":"2024-09-13T19:37:26.910466+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:37:26.910466+0000","last_undegraded":"2024-09-13T19:37:26.910466+0000","last_fullsized":"2024-09-13T19:37:26.910466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:26.910211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:26.910211+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.910211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:56.864518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.506363+0000","last_change":"2024-09-13T19:37:29.506434+0000","last_active":"2024-09-13T19:37:29.506363+0000","last_peered":"2024-09-13T19:37:29.506363+0000","last_clean":"2024-09-13T19:37:29.506363+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:37:29.506363+0000","last_undegraded":"2024-09-13T19:37:29.506363+0000","last_fullsized":"2024-09-13T19:37:29.506363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:29.506176+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:29.506176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.506176+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:37.784459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504622+0000","last_change":"2024-09-13T19:33:08.337822+0000","last_active":"2024-09-13T19:35:35.504622+0000","last_peered":"2024-09-13T19:35:35.504622+0000","last_clean":"2024-09-13T19:35:35.504622+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:35:35.504622+0000","last_undegraded":"2024-09-13T19:35:35.504622+0000","last_fullsized":"2024-09-13T19:35:35.504622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499404+0000","last_change":"2024-09-13T19:33:10.341134+0000","last_active":"2024-09-13T19:35:34.499404+0000","last_peered":"2024-09-13T19:35:34.499404+0000","last_clean":"2024-09-13T19:35:34.499404+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:35:34.499404+0000","last_undegraded":"2024-09-13T19:35:34.499404+0000","last_fullsized":"2024-09-13T19:35:34.499404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504544+0000","last_change":"2024-09-13T19:33:08.335101+0000","last_active":"2024-09-13T19:35:35.504544+0000","last_peered":"2024-09-13T19:35:35.504544+0000","last_clean":"2024-09-13T19:35:35.504544+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:35:35.504544+0000","last_undegraded":"2024-09-13T19:35:35.504544+0000","last_fullsized":"2024-09-13T19:35:35.504544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.224606+0000","last_change":"2024-09-13T19:33:10.346663+0000","last_active":"2024-09-13T19:36:24.224606+0000","last_peered":"2024-09-13T19:36:24.224606+0000","last_clean":"2024-09-13T19:36:24.224606+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:36:24.224606+0000","last_undegraded":"2024-09-13T19:36:24.224606+0000","last_fullsized":"2024-09-13T19:36:24.224606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499377+0000","last_change":"2024-09-13T19:33:08.345933+0000","last_active":"2024-09-13T19:35:34.499377+0000","last_peered":"2024-09-13T19:35:34.499377+0000","last_clean":"2024-09-13T19:35:34.499377+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:35:34.499377+0000","last_undegraded":"2024-09-13T19:35:34.499377+0000","last_fullsized":"2024-09-13T19:35:34.499377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.487230+0000","last_change":"2024-09-13T19:37:40.487343+0000","last_active":"2024-09-13T19:37:40.487230+0000","last_peered":"2024-09-13T19:37:40.487230+0000","last_clean":"2024-09-13T19:37:40.487230+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:37:40.487230+0000","last_undegraded":"2024-09-13T19:37:40.487230+0000","last_fullsized":"2024-09-13T19:37:40.487230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-13T19:37:40.486977+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-13T19:37:40.486977+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.486977+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:46.217708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504526+0000","last_change":"2024-09-13T19:33:08.341033+0000","last_active":"2024-09-13T19:35:30.504526+0000","last_peered":"2024-09-13T19:35:30.504526+0000","last_clean":"2024-09-13T19:35:30.504526+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:35:30.504526+0000","last_undegraded":"2024-09-13T19:35:30.504526+0000","last_fullsized":"2024-09-13T19:35:30.504526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'38","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.620260+0000","last_change":"2024-09-13T19:37:24.620329+0000","last_active":"2024-09-13T19:37:24.620260+0000","last_peered":"2024-09-13T19:37:24.620260+0000","last_clean":"2024-09-13T19:37:24.620260+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:37:24.620260+0000","last_undegraded":"2024-09-13T19:37:24.620260+0000","last_fullsized":"2024-09-13T19:37:24.620260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:24.620070+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:24.620070+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.620070+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.852503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.924762+0000","last_change":"2024-09-13T19:37:35.924828+0000","last_active":"2024-09-13T19:37:35.924762+0000","last_peered":"2024-09-13T19:37:35.924762+0000","last_clean":"2024-09-13T19:37:35.924762+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:37:35.924762+0000","last_undegraded":"2024-09-13T19:37:35.924762+0000","last_fullsized":"2024-09-13T19:37:35.924762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:35.924562+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:35.924562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.924562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:06.221435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.748613+0000","last_change":"2024-09-13T19:33:08.354352+0000","last_active":"2024-09-13T19:36:55.748613+0000","last_peered":"2024-09-13T19:36:55.748613+0000","last_clean":"2024-09-13T19:36:55.748613+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:36:55.748613+0000","last_undegraded":"2024-09-13T19:36:55.748613+0000","last_fullsized":"2024-09-13T19:36:55.748613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.123239+0000","last_change":"2024-09-13T19:37:10.123297+0000","last_active":"2024-09-13T19:37:10.123239+0000","last_peered":"2024-09-13T19:37:10.123239+0000","last_clean":"2024-09-13T19:37:10.123239+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:37:10.123239+0000","last_undegraded":"2024-09-13T19:37:10.123239+0000","last_fullsized":"2024-09-13T19:37:10.123239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.123041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:12.989516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.993769+0000","last_change":"2024-09-13T19:37:31.993844+0000","last_active":"2024-09-13T19:37:31.993769+0000","last_peered":"2024-09-13T19:37:31.993769+0000","last_clean":"2024-09-13T19:37:31.993769+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:37:31.993769+0000","last_undegraded":"2024-09-13T19:37:31.993769+0000","last_fullsized":"2024-09-13T19:37:31.993769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:31.993552+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:31.993552+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.993552+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.328726+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.502465+0000","last_change":"2024-09-13T19:37:00.502515+0000","last_active":"2024-09-13T19:37:00.502465+0000","last_peered":"2024-09-13T19:37:00.502465+0000","last_clean":"2024-09-13T19:37:00.502465+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:37:00.502465+0000","last_undegraded":"2024-09-13T19:37:00.502465+0000","last_fullsized":"2024-09-13T19:37:00.502465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.502274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:43.889848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.582211+0000","last_change":"2024-09-13T19:37:16.582272+0000","last_active":"2024-09-13T19:37:16.582211+0000","last_peered":"2024-09-13T19:37:16.582211+0000","last_clean":"2024-09-13T19:37:16.582211+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:37:16.582211+0000","last_undegraded":"2024-09-13T19:37:16.582211+0000","last_fullsized":"2024-09-13T19:37:16.582211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-13T19:37:16.582006+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-13T19:37:16.582006+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.582006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:42.046488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.917930+0000","last_change":"2024-09-13T19:37:39.917995+0000","last_active":"2024-09-13T19:37:39.917930+0000","last_peered":"2024-09-13T19:37:39.917930+0000","last_clean":"2024-09-13T19:37:39.917930+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:37:39.917930+0000","last_undegraded":"2024-09-13T19:37:39.917930+0000","last_fullsized":"2024-09-13T19:37:39.917930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:39.917704+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:39.917704+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.917704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:51.364335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.501029+0000","last_change":"2024-09-13T19:33:08.348578+0000","last_active":"2024-09-13T19:35:30.501029+0000","last_peered":"2024-09-13T19:35:30.501029+0000","last_clean":"2024-09-13T19:35:30.501029+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:35:30.501029+0000","last_undegraded":"2024-09-13T19:35:30.501029+0000","last_fullsized":"2024-09-13T19:35:30.501029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:10.511887+0000","last_change":"2024-09-13T19:33:49.525696+0000","last_active":"2024-09-13T19:36:10.511887+0000","last_peered":"2024-09-13T19:36:10.511887+0000","last_clean":"2024-09-13T19:36:10.511887+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:36:10.511887+0000","last_undegraded":"2024-09-13T19:36:10.511887+0000","last_fullsized":"2024-09-13T19:36:10.511887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.502616+0000","last_change":"2024-09-13T19:37:10.502701+0000","last_active":"2024-09-13T19:37:10.502616+0000","last_peered":"2024-09-13T19:37:10.502616+0000","last_clean":"2024-09-13T19:37:10.502616+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:37:10.502616+0000","last_undegraded":"2024-09-13T19:37:10.502616+0000","last_fullsized":"2024-09-13T19:37:10.502616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.502401+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:01.003936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.551502+0000","last_change":"2024-09-13T19:37:04.551561+0000","last_active":"2024-09-13T19:37:04.551502+0000","last_peered":"2024-09-13T19:37:04.551502+0000","last_clean":"2024-09-13T19:37:04.551502+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:37:04.551502+0000","last_undegraded":"2024-09-13T19:37:04.551502+0000","last_fullsized":"2024-09-13T19:37:04.551502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.551265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.460322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:49.502721+0000","last_change":"2024-09-13T19:33:18.407303+0000","last_active":"2024-09-13T19:35:49.502721+0000","last_peered":"2024-09-13T19:35:49.502721+0000","last_clean":"2024-09-13T19:35:49.502721+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:35:49.502721+0000","last_undegraded":"2024-09-13T19:35:49.502721+0000","last_fullsized":"2024-09-13T19:35:49.502721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'11","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.438756+0000","last_change":"2024-09-13T19:33:10.350582+0000","last_active":"2024-09-13T19:36:24.438756+0000","last_peered":"2024-09-13T19:36:24.438756+0000","last_clean":"2024-09-13T19:36:24.438756+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:36:24.438756+0000","last_undegraded":"2024-09-13T19:36:24.438756+0000","last_fullsized":"2024-09-13T19:36:24.438756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504469+0000","last_change":"2024-09-13T19:33:08.355253+0000","last_active":"2024-09-13T19:35:30.504469+0000","last_peered":"2024-09-13T19:35:30.504469+0000","last_clean":"2024-09-13T19:35:30.504469+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:35:30.504469+0000","last_undegraded":"2024-09-13T19:35:30.504469+0000","last_fullsized":"2024-09-13T19:35:30.504469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.320659+0000","last_change":"2024-09-13T19:37:19.320730+0000","last_active":"2024-09-13T19:37:19.320659+0000","last_peered":"2024-09-13T19:37:19.320659+0000","last_clean":"2024-09-13T19:37:19.320659+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:37:19.320659+0000","last_undegraded":"2024-09-13T19:37:19.320659+0000","last_fullsized":"2024-09-13T19:37:19.320659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.320446+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:11.577834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.894176+0000","last_change":"2024-09-13T19:37:02.894258+0000","last_active":"2024-09-13T19:37:02.894176+0000","last_peered":"2024-09-13T19:37:02.894176+0000","last_clean":"2024-09-13T19:37:02.894176+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:37:02.894176+0000","last_undegraded":"2024-09-13T19:37:02.894176+0000","last_fullsized":"2024-09-13T19:37:02.894176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.893973+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:18.869439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.036366+0000","last_change":"2024-09-13T19:37:24.036435+0000","last_active":"2024-09-13T19:37:24.036366+0000","last_peered":"2024-09-13T19:37:24.036366+0000","last_clean":"2024-09-13T19:37:24.036366+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:37:24.036366+0000","last_undegraded":"2024-09-13T19:37:24.036366+0000","last_fullsized":"2024-09-13T19:37:24.036366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:24.036142+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:24.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.036142+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:55.593216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:50.505586+0000","last_change":"2024-09-13T19:33:18.416828+0000","last_active":"2024-09-13T19:35:50.505586+0000","last_peered":"2024-09-13T19:35:50.505586+0000","last_clean":"2024-09-13T19:35:50.505586+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:35:50.505586+0000","last_undegraded":"2024-09-13T19:35:50.505586+0000","last_fullsized":"2024-09-13T19:35:50.505586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:23.749237+0000","last_change":"2024-09-13T19:33:10.342044+0000","last_active":"2024-09-13T19:36:23.749237+0000","last_peered":"2024-09-13T19:36:23.749237+0000","last_clean":"2024-09-13T19:36:23.749237+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:36:23.749237+0000","last_undegraded":"2024-09-13T19:36:23.749237+0000","last_fullsized":"2024-09-13T19:36:23.749237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.502849+0000","last_change":"2024-09-13T19:33:08.337394+0000","last_active":"2024-09-13T19:35:30.502849+0000","last_peered":"2024-09-13T19:35:30.502849+0000","last_clean":"2024-09-13T19:35:30.502849+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:35:30.502849+0000","last_undegraded":"2024-09-13T19:35:30.502849+0000","last_fullsized":"2024-09-13T19:35:30.502849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.109757+0000","last_change":"2024-09-13T19:37:08.109820+0000","last_active":"2024-09-13T19:37:08.109757+0000","last_peered":"2024-09-13T19:37:08.109757+0000","last_clean":"2024-09-13T19:37:08.109757+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:37:08.109757+0000","last_undegraded":"2024-09-13T19:37:08.109757+0000","last_fullsized":"2024-09-13T19:37:08.109757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.109562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.916198+0000","last_change":"2024-09-13T19:37:04.916276+0000","last_active":"2024-09-13T19:37:04.916198+0000","last_peered":"2024-09-13T19:37:04.916198+0000","last_clean":"2024-09-13T19:37:04.916198+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:37:04.916198+0000","last_undegraded":"2024-09-13T19:37:04.916198+0000","last_fullsized":"2024-09-13T19:37:04.916198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.915985+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:53.420288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.239271+0000","last_change":"2024-09-13T19:37:21.239330+0000","last_active":"2024-09-13T19:37:21.239271+0000","last_peered":"2024-09-13T19:37:21.239271+0000","last_clean":"2024-09-13T19:37:21.239271+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:37:21.239271+0000","last_undegraded":"2024-09-13T19:37:21.239271+0000","last_fullsized":"2024-09-13T19:37:21.239271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:21.239082+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:21.239082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.239082+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:39.825205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.937814+0000","last_change":"2024-09-13T19:37:32.937966+0000","last_active":"2024-09-13T19:37:32.937814+0000","last_peered":"2024-09-13T19:37:32.937814+0000","last_clean":"2024-09-13T19:37:32.937814+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:37:32.937814+0000","last_undegraded":"2024-09-13T19:37:32.937814+0000","last_fullsized":"2024-09-13T19:37:32.937814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:32.937538+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:32.937538+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.937538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:49.829336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879120+0000","last_change":"2024-09-13T19:33:08.347478+0000","last_active":"2024-09-13T19:36:59.879120+0000","last_peered":"2024-09-13T19:36:59.879120+0000","last_clean":"2024-09-13T19:36:59.879120+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:36:59.879120+0000","last_undegraded":"2024-09-13T19:36:59.879120+0000","last_fullsized":"2024-09-13T19:36:59.879120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.520028+0000","last_change":"2024-09-13T19:37:14.520028+0000","last_active":"2024-09-13T19:37:14.520028+0000","last_peered":"2024-09-13T19:37:14.520028+0000","last_clean":"2024-09-13T19:37:14.520028+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:37:14.520028+0000","last_undegraded":"2024-09-13T19:37:14.520028+0000","last_fullsized":"2024-09-13T19:37:14.520028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.519779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:02.289326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.958861+0000","last_change":"2024-09-13T19:37:06.958861+0000","last_active":"2024-09-13T19:37:06.958861+0000","last_peered":"2024-09-13T19:37:06.958861+0000","last_clean":"2024-09-13T19:37:06.958861+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:37:06.958861+0000","last_undegraded":"2024-09-13T19:37:06.958861+0000","last_fullsized":"2024-09-13T19:37:06.958861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.958579+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:36.686521+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.385133+0000","last_change":"2024-09-13T19:37:04.385193+0000","last_active":"2024-09-13T19:37:04.385133+0000","last_peered":"2024-09-13T19:37:04.385133+0000","last_clean":"2024-09-13T19:37:04.385133+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:37:04.385133+0000","last_undegraded":"2024-09-13T19:37:04.385133+0000","last_fullsized":"2024-09-13T19:37:04.385133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.384941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.293998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.880812+0000","last_change":"2024-09-13T19:33:18.417415+0000","last_active":"2024-09-13T19:36:59.880812+0000","last_peered":"2024-09-13T19:36:59.880812+0000","last_clean":"2024-09-13T19:36:59.880812+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:36:59.880812+0000","last_undegraded":"2024-09-13T19:36:59.880812+0000","last_fullsized":"2024-09-13T19:36:59.880812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.481235+0000","last_change":"2024-09-13T19:37:38.481358+0000","last_active":"2024-09-13T19:37:38.481235+0000","last_peered":"2024-09-13T19:37:38.481235+0000","last_clean":"2024-09-13T19:37:38.481235+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:37:38.481235+0000","last_undegraded":"2024-09-13T19:37:38.481235+0000","last_fullsized":"2024-09-13T19:37:38.481235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:38.480942+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:38.480942+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.480942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:38.661510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.067867+0000","last_change":"2024-09-13T19:37:35.067867+0000","last_active":"2024-09-13T19:37:35.067867+0000","last_peered":"2024-09-13T19:37:35.067867+0000","last_clean":"2024-09-13T19:37:35.067867+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:37:35.067867+0000","last_undegraded":"2024-09-13T19:37:35.067867+0000","last_fullsized":"2024-09-13T19:37:35.067867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:35.067634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:35.067634+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.067634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:35.696369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.247615+0000","last_change":"2024-09-13T19:37:23.247615+0000","last_active":"2024-09-13T19:37:23.247615+0000","last_peered":"2024-09-13T19:37:23.247615+0000","last_clean":"2024-09-13T19:37:23.247615+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:37:23.247615+0000","last_undegraded":"2024-09-13T19:37:23.247615+0000","last_fullsized":"2024-09-13T19:37:23.247615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:23.247331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:23.247331+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.247331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:14.966141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'39","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.019870+0000","last_change":"2024-09-13T19:37:28.020012+0000","last_active":"2024-09-13T19:37:28.019870+0000","last_peered":"2024-09-13T19:37:28.019870+0000","last_clean":"2024-09-13T19:37:28.019870+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:37:28.019870+0000","last_undegraded":"2024-09-13T19:37:28.019870+0000","last_fullsized":"2024-09-13T19:37:28.019870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:28.019573+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:28.019573+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.019573+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:49.017132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.277843+0000","last_change":"2024-09-13T19:37:01.277843+0000","last_active":"2024-09-13T19:37:01.277843+0000","last_peered":"2024-09-13T19:37:01.277843+0000","last_clean":"2024-09-13T19:37:01.277843+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:37:01.277843+0000","last_undegraded":"2024-09-13T19:37:01.277843+0000","last_fullsized":"2024-09-13T19:37:01.277843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.277591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:47.650563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.546916+0000","last_change":"2024-09-13T19:37:28.546916+0000","last_active":"2024-09-13T19:37:28.546916+0000","last_peered":"2024-09-13T19:37:28.546916+0000","last_clean":"2024-09-13T19:37:28.546916+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:37:28.546916+0000","last_undegraded":"2024-09-13T19:37:28.546916+0000","last_fullsized":"2024-09-13T19:37:28.546916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:28.546498+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:28.546498+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.546498+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.520168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.887692+0000","last_change":"2024-09-13T19:37:22.887692+0000","last_active":"2024-09-13T19:37:22.887692+0000","last_peered":"2024-09-13T19:37:22.887692+0000","last_clean":"2024-09-13T19:37:22.887692+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:37:22.887692+0000","last_undegraded":"2024-09-13T19:37:22.887692+0000","last_fullsized":"2024-09-13T19:37:22.887692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:22.887344+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:22.887344+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.887344+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:40.009897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351903+0000","last_change":"2024-09-13T19:33:08.341877+0000","last_active":"2024-09-13T19:37:00.351903+0000","last_peered":"2024-09-13T19:37:00.351903+0000","last_clean":"2024-09-13T19:37:00.351903+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:37:00.351903+0000","last_undegraded":"2024-09-13T19:37:00.351903+0000","last_fullsized":"2024-09-13T19:37:00.351903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.272630+0000","last_change":"2024-09-13T19:37:22.272682+0000","last_active":"2024-09-13T19:37:22.272630+0000","last_peered":"2024-09-13T19:37:22.272630+0000","last_clean":"2024-09-13T19:37:22.272630+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:37:22.272630+0000","last_undegraded":"2024-09-13T19:37:22.272630+0000","last_fullsized":"2024-09-13T19:37:22.272630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:22.272435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:22.272435+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.272435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:06.134902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.088355+0000","last_change":"2024-09-13T19:37:03.088355+0000","last_active":"2024-09-13T19:37:03.088355+0000","last_peered":"2024-09-13T19:37:03.088355+0000","last_clean":"2024-09-13T19:37:03.088355+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:37:03.088355+0000","last_undegraded":"2024-09-13T19:37:03.088355+0000","last_fullsized":"2024-09-13T19:37:03.088355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.087975+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:03.716710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.338036+0000","last_change":"2024-09-13T19:37:05.338036+0000","last_active":"2024-09-13T19:37:05.338036+0000","last_peered":"2024-09-13T19:37:05.338036+0000","last_clean":"2024-09-13T19:37:05.338036+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:37:05.338036+0000","last_undegraded":"2024-09-13T19:37:05.338036+0000","last_fullsized":"2024-09-13T19:37:05.338036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.337780+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.947112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.911165+0000","last_change":"2024-09-13T19:33:18.416155+0000","last_active":"2024-09-13T19:36:58.911165+0000","last_peered":"2024-09-13T19:36:58.911165+0000","last_clean":"2024-09-13T19:36:58.911165+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:36:58.911165+0000","last_undegraded":"2024-09-13T19:36:58.911165+0000","last_fullsized":"2024-09-13T19:36:58.911165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.095511+0000","last_change":"2024-09-13T19:37:36.095511+0000","last_active":"2024-09-13T19:37:36.095511+0000","last_peered":"2024-09-13T19:37:36.095511+0000","last_clean":"2024-09-13T19:37:36.095511+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:37:36.095511+0000","last_undegraded":"2024-09-13T19:37:36.095511+0000","last_fullsized":"2024-09-13T19:37:36.095511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:36.095267+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:36.095267+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.095267+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:11.327700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:05.510900+0000","last_change":"2024-09-13T19:33:49.524748+0000","last_active":"2024-09-13T19:36:05.510900+0000","last_peered":"2024-09-13T19:36:05.510900+0000","last_clean":"2024-09-13T19:36:05.510900+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:36:05.510900+0000","last_undegraded":"2024-09-13T19:36:05.510900+0000","last_fullsized":"2024-09-13T19:36:05.510900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.198989+0000","last_change":"2024-09-13T19:37:24.198989+0000","last_active":"2024-09-13T19:37:24.198989+0000","last_peered":"2024-09-13T19:37:24.198989+0000","last_clean":"2024-09-13T19:37:24.198989+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:37:24.198989+0000","last_undegraded":"2024-09-13T19:37:24.198989+0000","last_fullsized":"2024-09-13T19:37:24.198989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:24.198733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:24.198733+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.198733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.431165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'64","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.075367+0000","last_change":"2024-09-13T19:37:07.075367+0000","last_active":"2024-09-13T19:37:07.075367+0000","last_peered":"2024-09-13T19:37:07.075367+0000","last_clean":"2024-09-13T19:37:07.075367+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:37:07.075367+0000","last_undegraded":"2024-09-13T19:37:07.075367+0000","last_fullsized":"2024-09-13T19:37:07.075367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'64","last_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_deep_scrub":"32'64","last_deep_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.075082+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:36.529696+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.200714+0000","last_change":"2024-09-13T19:37:13.200714+0000","last_active":"2024-09-13T19:37:13.200714+0000","last_peered":"2024-09-13T19:37:13.200714+0000","last_clean":"2024-09-13T19:37:13.200714+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:37:13.200714+0000","last_undegraded":"2024-09-13T19:37:13.200714+0000","last_fullsized":"2024-09-13T19:37:13.200714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.200465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:35.576125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'23","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.239795+0000","last_change":"2024-09-13T19:37:29.239795+0000","last_active":"2024-09-13T19:37:29.239795+0000","last_peered":"2024-09-13T19:37:29.239795+0000","last_clean":"2024-09-13T19:37:29.239795+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:37:29.239795+0000","last_undegraded":"2024-09-13T19:37:29.239795+0000","last_fullsized":"2024-09-13T19:37:29.239795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-09-13T19:37:29.239551+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-09-13T19:37:29.239551+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.239551+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:37.517834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.384380+0000","last_change":"2024-09-13T19:33:49.534836+0000","last_active":"2024-09-13T19:36:59.384380+0000","last_peered":"2024-09-13T19:36:59.384380+0000","last_clean":"2024-09-13T19:36:59.384380+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:36:59.384380+0000","last_undegraded":"2024-09-13T19:36:59.384380+0000","last_fullsized":"2024-09-13T19:36:59.384380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909300+0000","last_change":"2024-09-13T19:33:08.332135+0000","last_active":"2024-09-13T19:36:58.909300+0000","last_peered":"2024-09-13T19:36:58.909300+0000","last_clean":"2024-09-13T19:36:58.909300+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:36:58.909300+0000","last_undegraded":"2024-09-13T19:36:58.909300+0000","last_fullsized":"2024-09-13T19:36:58.909300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.831151+0000","last_change":"2024-09-13T19:37:13.831206+0000","last_active":"2024-09-13T19:37:13.831151+0000","last_peered":"2024-09-13T19:37:13.831151+0000","last_clean":"2024-09-13T19:37:13.831151+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:37:13.831151+0000","last_undegraded":"2024-09-13T19:37:13.831151+0000","last_fullsized":"2024-09-13T19:37:13.831151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.830975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:27.492677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.519849+0000","last_change":"2024-09-13T19:37:09.520047+0000","last_active":"2024-09-13T19:37:09.519849+0000","last_peered":"2024-09-13T19:37:09.519849+0000","last_clean":"2024-09-13T19:37:09.519849+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:37:09.519849+0000","last_undegraded":"2024-09-13T19:37:09.519849+0000","last_fullsized":"2024-09-13T19:37:09.519849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.519587+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:50.509060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.886762+0000","last_change":"2024-09-13T19:37:34.886815+0000","last_active":"2024-09-13T19:37:34.886762+0000","last_peered":"2024-09-13T19:37:34.886762+0000","last_clean":"2024-09-13T19:37:34.886762+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:37:34.886762+0000","last_undegraded":"2024-09-13T19:37:34.886762+0000","last_fullsized":"2024-09-13T19:37:34.886762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:34.886569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:34.886569+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.886569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:58.702803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.355187+0000","last_change":"2024-09-13T19:33:18.415707+0000","last_active":"2024-09-13T19:37:00.355187+0000","last_peered":"2024-09-13T19:37:00.355187+0000","last_clean":"2024-09-13T19:37:00.355187+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:37:00.355187+0000","last_undegraded":"2024-09-13T19:37:00.355187+0000","last_fullsized":"2024-09-13T19:37:00.355187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.160708+0000","last_change":"2024-09-13T19:37:14.160708+0000","last_active":"2024-09-13T19:37:14.160708+0000","last_peered":"2024-09-13T19:37:14.160708+0000","last_clean":"2024-09-13T19:37:14.160708+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:37:14.160708+0000","last_undegraded":"2024-09-13T19:37:14.160708+0000","last_fullsized":"2024-09-13T19:37:14.160708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.160448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:32.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352065+0000","last_change":"2024-09-13T19:33:08.342280+0000","last_active":"2024-09-13T19:37:00.352065+0000","last_peered":"2024-09-13T19:37:00.352065+0000","last_clean":"2024-09-13T19:37:00.352065+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:37:00.352065+0000","last_undegraded":"2024-09-13T19:37:00.352065+0000","last_fullsized":"2024-09-13T19:37:00.352065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.282020+0000","last_change":"2024-09-13T19:37:20.282076+0000","last_active":"2024-09-13T19:37:20.282020+0000","last_peered":"2024-09-13T19:37:20.282020+0000","last_clean":"2024-09-13T19:37:20.282020+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:37:20.282020+0000","last_undegraded":"2024-09-13T19:37:20.282020+0000","last_fullsized":"2024-09-13T19:37:20.282020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:20.281828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:20.281828+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.281828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:26.429181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.844696+0000","last_change":"2024-09-13T19:37:10.844787+0000","last_active":"2024-09-13T19:37:10.844696+0000","last_peered":"2024-09-13T19:37:10.844696+0000","last_clean":"2024-09-13T19:37:10.844696+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:37:10.844696+0000","last_undegraded":"2024-09-13T19:37:10.844696+0000","last_fullsized":"2024-09-13T19:37:10.844696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.844519+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:16.097647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.934460+0000","last_change":"2024-09-13T19:37:07.934519+0000","last_active":"2024-09-13T19:37:07.934460+0000","last_peered":"2024-09-13T19:37:07.934460+0000","last_clean":"2024-09-13T19:37:07.934460+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:37:07.934460+0000","last_undegraded":"2024-09-13T19:37:07.934460+0000","last_fullsized":"2024-09-13T19:37:07.934460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.934270+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:17.446351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.910963+0000","last_change":"2024-09-13T19:33:18.415690+0000","last_active":"2024-09-13T19:36:58.910963+0000","last_peered":"2024-09-13T19:36:58.910963+0000","last_clean":"2024-09-13T19:36:58.910963+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:36:58.910963+0000","last_undegraded":"2024-09-13T19:36:58.910963+0000","last_fullsized":"2024-09-13T19:36:58.910963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.897513+0000","last_change":"2024-09-13T19:37:23.897513+0000","last_active":"2024-09-13T19:37:23.897513+0000","last_peered":"2024-09-13T19:37:23.897513+0000","last_clean":"2024-09-13T19:37:23.897513+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:37:23.897513+0000","last_undegraded":"2024-09-13T19:37:23.897513+0000","last_fullsized":"2024-09-13T19:37:23.897513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:23.897240+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:23.897240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.897240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:28.019969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352086+0000","last_change":"2024-09-13T19:33:08.355262+0000","last_active":"2024-09-13T19:37:00.352086+0000","last_peered":"2024-09-13T19:37:00.352086+0000","last_clean":"2024-09-13T19:37:00.352086+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:37:00.352086+0000","last_undegraded":"2024-09-13T19:37:00.352086+0000","last_fullsized":"2024-09-13T19:37:00.352086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.585137+0000","last_change":"2024-09-13T19:37:17.585204+0000","last_active":"2024-09-13T19:37:17.585137+0000","last_peered":"2024-09-13T19:37:17.585137+0000","last_clean":"2024-09-13T19:37:17.585137+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:37:17.585137+0000","last_undegraded":"2024-09-13T19:37:17.585137+0000","last_fullsized":"2024-09-13T19:37:17.585137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:17.584949+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:17.584949+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.584949+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:44.456695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.992170+0000","last_change":"2024-09-13T19:37:25.992249+0000","last_active":"2024-09-13T19:37:25.992170+0000","last_peered":"2024-09-13T19:37:25.992170+0000","last_clean":"2024-09-13T19:37:25.992170+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:37:25.992170+0000","last_undegraded":"2024-09-13T19:37:25.992170+0000","last_fullsized":"2024-09-13T19:37:25.992170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:25.991984+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:25.991984+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.991984+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:34.178024+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.467278+0000","last_change":"2024-09-13T19:37:01.467344+0000","last_active":"2024-09-13T19:37:01.467278+0000","last_peered":"2024-09-13T19:37:01.467278+0000","last_clean":"2024-09-13T19:37:01.467278+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:37:01.467278+0000","last_undegraded":"2024-09-13T19:37:01.467278+0000","last_fullsized":"2024-09-13T19:37:01.467278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.467091+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:04.385381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.905199+0000","last_change":"2024-09-13T19:37:19.905199+0000","last_active":"2024-09-13T19:37:19.905199+0000","last_peered":"2024-09-13T19:37:19.905199+0000","last_clean":"2024-09-13T19:37:19.905199+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:37:19.905199+0000","last_undegraded":"2024-09-13T19:37:19.905199+0000","last_fullsized":"2024-09-13T19:37:19.905199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.904819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:30.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.439047+0000","last_change":"2024-09-13T19:37:36.439047+0000","last_active":"2024-09-13T19:37:36.439047+0000","last_peered":"2024-09-13T19:37:36.439047+0000","last_clean":"2024-09-13T19:37:36.439047+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:37:36.439047+0000","last_undegraded":"2024-09-13T19:37:36.439047+0000","last_fullsized":"2024-09-13T19:37:36.439047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:36.438801+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:36.438801+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.438801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:08.256631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351888+0000","last_change":"2024-09-13T19:33:08.341993+0000","last_active":"2024-09-13T19:37:00.351888+0000","last_peered":"2024-09-13T19:37:00.351888+0000","last_clean":"2024-09-13T19:37:00.351888+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:37:00.351888+0000","last_undegraded":"2024-09-13T19:37:00.351888+0000","last_fullsized":"2024-09-13T19:37:00.351888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.118493+0000","last_change":"2024-09-13T19:37:02.118554+0000","last_active":"2024-09-13T19:37:02.118493+0000","last_peered":"2024-09-13T19:37:02.118493+0000","last_clean":"2024-09-13T19:37:02.118493+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:37:02.118493+0000","last_undegraded":"2024-09-13T19:37:02.118493+0000","last_fullsized":"2024-09-13T19:37:02.118493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.118290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:01.693866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.541952+0000","last_change":"2024-09-13T19:37:11.542034+0000","last_active":"2024-09-13T19:37:11.541952+0000","last_peered":"2024-09-13T19:37:11.541952+0000","last_clean":"2024-09-13T19:37:11.541952+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:37:11.541952+0000","last_undegraded":"2024-09-13T19:37:11.541952+0000","last_fullsized":"2024-09-13T19:37:11.541952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.541770+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:28.664323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.819564+0000","last_change":"2024-09-13T19:37:15.819618+0000","last_active":"2024-09-13T19:37:15.819564+0000","last_peered":"2024-09-13T19:37:15.819564+0000","last_clean":"2024-09-13T19:37:15.819564+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:37:15.819564+0000","last_undegraded":"2024-09-13T19:37:15.819564+0000","last_fullsized":"2024-09-13T19:37:15.819564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.819343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:17.226606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.492524+0000","last_change":"2024-09-13T19:37:08.492524+0000","last_active":"2024-09-13T19:37:08.492524+0000","last_peered":"2024-09-13T19:37:08.492524+0000","last_clean":"2024-09-13T19:37:08.492524+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:37:08.492524+0000","last_undegraded":"2024-09-13T19:37:08.492524+0000","last_fullsized":"2024-09-13T19:37:08.492524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.492240+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.753771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.119769+0000","last_change":"2024-09-13T19:37:17.119769+0000","last_active":"2024-09-13T19:37:17.119769+0000","last_peered":"2024-09-13T19:37:17.119769+0000","last_clean":"2024-09-13T19:37:17.119769+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:37:17.119769+0000","last_undegraded":"2024-09-13T19:37:17.119769+0000","last_fullsized":"2024-09-13T19:37:17.119769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.119389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.119389+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.119389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:39.478375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.383861+0000","last_change":"2024-09-13T19:32:57.877961+0000","last_active":"2024-09-13T19:36:59.383861+0000","last_peered":"2024-09-13T19:36:59.383861+0000","last_clean":"2024-09-13T19:36:59.383861+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:36:59.383861+0000","last_undegraded":"2024-09-13T19:36:59.383861+0000","last_fullsized":"2024-09-13T19:36:59.383861+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:56.474648+0000","last_clean_scrub_stamp":"2024-09-13T19:32:56.474648+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351769+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:37:00.351769+0000","last_peered":"2024-09-13T19:37:00.351769+0000","last_clean":"2024-09-13T19:37:00.351769+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:37:00.351769+0000","last_undegraded":"2024-09-13T19:37:00.351769+0000","last_fullsized":"2024-09-13T19:37:00.351769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351911+0000","last_change":"2024-09-13T19:33:08.353659+0000","last_active":"2024-09-13T19:37:00.351911+0000","last_peered":"2024-09-13T19:37:00.351911+0000","last_clean":"2024-09-13T19:37:00.351911+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:37:00.351911+0000","last_undegraded":"2024-09-13T19:37:00.351911+0000","last_fullsized":"2024-09-13T19:37:00.351911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.385003+0000","last_change":"2024-09-13T19:33:49.523626+0000","last_active":"2024-09-13T19:36:59.385003+0000","last_peered":"2024-09-13T19:36:59.385003+0000","last_clean":"2024-09-13T19:36:59.385003+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:36:59.385003+0000","last_undegraded":"2024-09-13T19:36:59.385003+0000","last_fullsized":"2024-09-13T19:36:59.385003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'87","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.130003+0000","last_change":"2024-09-13T19:37:15.130003+0000","last_active":"2024-09-13T19:37:15.130003+0000","last_peered":"2024-09-13T19:37:15.130003+0000","last_clean":"2024-09-13T19:37:15.130003+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:37:15.130003+0000","last_undegraded":"2024-09-13T19:37:15.130003+0000","last_fullsized":"2024-09-13T19:37:15.130003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.129728+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:51:47.372002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.228695+0000","last_change":"2024-09-13T19:37:09.228695+0000","last_active":"2024-09-13T19:37:09.228695+0000","last_peered":"2024-09-13T19:37:09.228695+0000","last_clean":"2024-09-13T19:37:09.228695+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:37:09.228695+0000","last_undegraded":"2024-09-13T19:37:09.228695+0000","last_fullsized":"2024-09-13T19:37:09.228695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.228417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:56.994751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.880869+0000","last_change":"2024-09-13T19:33:18.410177+0000","last_active":"2024-09-13T19:36:59.880869+0000","last_peered":"2024-09-13T19:36:59.880869+0000","last_clean":"2024-09-13T19:36:59.880869+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:36:59.880869+0000","last_undegraded":"2024-09-13T19:36:59.880869+0000","last_fullsized":"2024-09-13T19:36:59.880869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.114531+0000","last_change":"2024-09-13T19:33:49.529179+0000","last_active":"2024-09-13T19:36:24.114531+0000","last_peered":"2024-09-13T19:36:24.114531+0000","last_clean":"2024-09-13T19:36:24.114531+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:36:24.114531+0000","last_undegraded":"2024-09-13T19:36:24.114531+0000","last_fullsized":"2024-09-13T19:36:24.114531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351712+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:37:00.351712+0000","last_peered":"2024-09-13T19:37:00.351712+0000","last_clean":"2024-09-13T19:37:00.351712+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:37:00.351712+0000","last_undegraded":"2024-09-13T19:37:00.351712+0000","last_fullsized":"2024-09-13T19:37:00.351712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.161972+0000","last_change":"2024-09-13T19:37:36.162036+0000","last_active":"2024-09-13T19:37:36.161972+0000","last_peered":"2024-09-13T19:37:36.161972+0000","last_clean":"2024-09-13T19:37:36.161972+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:37:36.161972+0000","last_undegraded":"2024-09-13T19:37:36.161972+0000","last_fullsized":"2024-09-13T19:37:36.161972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:36.161776+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:36.161776+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.161776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.979606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.147263+0000","last_change":"2024-09-13T19:37:09.147263+0000","last_active":"2024-09-13T19:37:09.147263+0000","last_peered":"2024-09-13T19:37:09.147263+0000","last_clean":"2024-09-13T19:37:09.147263+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:37:09.147263+0000","last_undegraded":"2024-09-13T19:37:09.147263+0000","last_fullsized":"2024-09-13T19:37:09.147263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.147011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:17.425294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":517,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.504345+0000","last_change":"2024-09-13T19:37:06.504345+0000","last_active":"2024-09-13T19:37:06.504345+0000","last_peered":"2024-09-13T19:37:06.504345+0000","last_clean":"2024-09-13T19:37:06.504345+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:37:06.504345+0000","last_undegraded":"2024-09-13T19:37:06.504345+0000","last_fullsized":"2024-09-13T19:37:06.504345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.503927+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:35.014112+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.089943+0000","last_change":"2024-09-13T19:37:21.089943+0000","last_active":"2024-09-13T19:37:21.089943+0000","last_peered":"2024-09-13T19:37:21.089943+0000","last_clean":"2024-09-13T19:37:21.089943+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:37:21.089943+0000","last_undegraded":"2024-09-13T19:37:21.089943+0000","last_fullsized":"2024-09-13T19:37:21.089943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:21.089650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:21.089650+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.089650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:32.669122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.385806+0000","last_change":"2024-09-13T19:33:18.424198+0000","last_active":"2024-09-13T19:36:59.385806+0000","last_peered":"2024-09-13T19:36:59.385806+0000","last_clean":"2024-09-13T19:36:59.385806+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:36:59.385806+0000","last_undegraded":"2024-09-13T19:36:59.385806+0000","last_fullsized":"2024-09-13T19:36:59.385806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.074650+0000","last_change":"2024-09-13T19:37:39.074710+0000","last_active":"2024-09-13T19:37:39.074650+0000","last_peered":"2024-09-13T19:37:39.074650+0000","last_clean":"2024-09-13T19:37:39.074650+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:37:39.074650+0000","last_undegraded":"2024-09-13T19:37:39.074650+0000","last_fullsized":"2024-09-13T19:37:39.074650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:39.074462+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:39.074462+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.074462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:20.601071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.093185+0000","last_change":"2024-09-13T19:37:38.093238+0000","last_active":"2024-09-13T19:37:38.093185+0000","last_peered":"2024-09-13T19:37:38.093185+0000","last_clean":"2024-09-13T19:37:38.093185+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:37:38.093185+0000","last_undegraded":"2024-09-13T19:37:38.093185+0000","last_fullsized":"2024-09-13T19:37:38.093185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:38.092962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:38.092962+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.092962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:20.037272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909294+0000","last_change":"2024-09-13T19:33:08.346175+0000","last_active":"2024-09-13T19:36:58.909294+0000","last_peered":"2024-09-13T19:36:58.909294+0000","last_clean":"2024-09-13T19:36:58.909294+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:36:58.909294+0000","last_undegraded":"2024-09-13T19:36:58.909294+0000","last_fullsized":"2024-09-13T19:36:58.909294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.849196+0000","last_change":"2024-09-13T19:37:16.849196+0000","last_active":"2024-09-13T19:37:16.849196+0000","last_peered":"2024-09-13T19:37:16.849196+0000","last_clean":"2024-09-13T19:37:16.849196+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:37:16.849196+0000","last_undegraded":"2024-09-13T19:37:16.849196+0000","last_fullsized":"2024-09-13T19:37:16.849196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.848911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:35.095041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.900571+0000","last_change":"2024-09-13T19:37:08.900571+0000","last_active":"2024-09-13T19:37:08.900571+0000","last_peered":"2024-09-13T19:37:08.900571+0000","last_clean":"2024-09-13T19:37:08.900571+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:37:08.900571+0000","last_undegraded":"2024-09-13T19:37:08.900571+0000","last_fullsized":"2024-09-13T19:37:08.900571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.900272+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:29.326850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.306113+0000","last_change":"2024-09-13T19:37:00.306113+0000","last_active":"2024-09-13T19:37:00.306113+0000","last_peered":"2024-09-13T19:37:00.306113+0000","last_clean":"2024-09-13T19:37:00.306113+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:37:00.306113+0000","last_undegraded":"2024-09-13T19:37:00.306113+0000","last_fullsized":"2024-09-13T19:37:00.306113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.305866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:41.036690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505951+0000","last_change":"2024-09-13T19:33:18.414878+0000","last_active":"2024-09-13T19:35:35.505951+0000","last_peered":"2024-09-13T19:35:35.505951+0000","last_clean":"2024-09-13T19:35:35.505951+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:35:35.505951+0000","last_undegraded":"2024-09-13T19:35:35.505951+0000","last_fullsized":"2024-09-13T19:35:35.505951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.212375+0000","last_change":"2024-09-13T19:37:28.212520+0000","last_active":"2024-09-13T19:37:28.212375+0000","last_peered":"2024-09-13T19:37:28.212375+0000","last_clean":"2024-09-13T19:37:28.212375+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:37:28.212375+0000","last_undegraded":"2024-09-13T19:37:28.212375+0000","last_fullsized":"2024-09-13T19:37:28.212375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-13T19:37:28.212060+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-13T19:37:28.212060+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.212060+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.185729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351734+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:37:00.351734+0000","last_peered":"2024-09-13T19:37:00.351734+0000","last_clean":"2024-09-13T19:37:00.351734+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:37:00.351734+0000","last_undegraded":"2024-09-13T19:37:00.351734+0000","last_fullsized":"2024-09-13T19:37:00.351734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.879032+0000","last_change":"2024-09-13T19:33:08.333264+0000","last_active":"2024-09-13T19:36:59.879032+0000","last_peered":"2024-09-13T19:36:59.879032+0000","last_clean":"2024-09-13T19:36:59.879032+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:36:59.879032+0000","last_undegraded":"2024-09-13T19:36:59.879032+0000","last_fullsized":"2024-09-13T19:36:59.879032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.316430+0000","last_change":"2024-09-13T19:37:18.316430+0000","last_active":"2024-09-13T19:37:18.316430+0000","last_peered":"2024-09-13T19:37:18.316430+0000","last_clean":"2024-09-13T19:37:18.316430+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:37:18.316430+0000","last_undegraded":"2024-09-13T19:37:18.316430+0000","last_fullsized":"2024-09-13T19:37:18.316430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.316023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:53.513548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.034575+0000","last_change":"2024-09-13T19:37:25.034575+0000","last_active":"2024-09-13T19:37:25.034575+0000","last_peered":"2024-09-13T19:37:25.034575+0000","last_clean":"2024-09-13T19:37:25.034575+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:37:25.034575+0000","last_undegraded":"2024-09-13T19:37:25.034575+0000","last_fullsized":"2024-09-13T19:37:25.034575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-13T19:37:25.034296+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-13T19:37:25.034296+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.034296+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:16.184148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.084251+0000","last_change":"2024-09-13T19:37:23.084251+0000","last_active":"2024-09-13T19:37:23.084251+0000","last_peered":"2024-09-13T19:37:23.084251+0000","last_clean":"2024-09-13T19:37:23.084251+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:37:23.084251+0000","last_undegraded":"2024-09-13T19:37:23.084251+0000","last_fullsized":"2024-09-13T19:37:23.084251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:23.083834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:23.083834+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.083834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:08.356001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.665709+0000","last_change":"2024-09-13T19:37:20.665709+0000","last_active":"2024-09-13T19:37:20.665709+0000","last_peered":"2024-09-13T19:37:20.665709+0000","last_clean":"2024-09-13T19:37:20.665709+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:37:20.665709+0000","last_undegraded":"2024-09-13T19:37:20.665709+0000","last_fullsized":"2024-09-13T19:37:20.665709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:20.665452+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:20.665452+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.665452+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:26.812805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.605404+0000","last_change":"2024-09-13T19:37:23.605471+0000","last_active":"2024-09-13T19:37:23.605404+0000","last_peered":"2024-09-13T19:37:23.605404+0000","last_clean":"2024-09-13T19:37:23.605404+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:37:23.605404+0000","last_undegraded":"2024-09-13T19:37:23.605404+0000","last_fullsized":"2024-09-13T19:37:23.605404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:23.605199+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:23.605199+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.605199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:24.233934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.053088+0000","last_change":"2024-09-13T19:37:39.053139+0000","last_active":"2024-09-13T19:37:39.053088+0000","last_peered":"2024-09-13T19:37:39.053088+0000","last_clean":"2024-09-13T19:37:39.053088+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:37:39.053088+0000","last_undegraded":"2024-09-13T19:37:39.053088+0000","last_fullsized":"2024-09-13T19:37:39.053088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:39.052897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:39.052897+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.052897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:08.507511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909219+0000","last_change":"2024-09-13T19:33:02.523552+0000","last_active":"2024-09-13T19:36:58.909219+0000","last_peered":"2024-09-13T19:36:58.909219+0000","last_clean":"2024-09-13T19:36:58.909219+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:36:58.909219+0000","last_undegraded":"2024-09-13T19:36:58.909219+0000","last_fullsized":"2024-09-13T19:36:58.909219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.275009+0000","last_change":"2024-09-13T19:37:15.275009+0000","last_active":"2024-09-13T19:37:15.275009+0000","last_peered":"2024-09-13T19:37:15.275009+0000","last_clean":"2024-09-13T19:37:15.275009+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:37:15.275009+0000","last_undegraded":"2024-09-13T19:37:15.275009+0000","last_fullsized":"2024-09-13T19:37:15.275009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.274757+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:13.076733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'74","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.172215+0000","last_change":"2024-09-13T19:37:11.172215+0000","last_active":"2024-09-13T19:37:11.172215+0000","last_peered":"2024-09-13T19:37:11.172215+0000","last_clean":"2024-09-13T19:37:11.172215+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:37:11.172215+0000","last_undegraded":"2024-09-13T19:37:11.172215+0000","last_fullsized":"2024-09-13T19:37:11.172215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.171938+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:48.364805+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.934769+0000","last_change":"2024-09-13T19:37:03.934769+0000","last_active":"2024-09-13T19:37:03.934769+0000","last_peered":"2024-09-13T19:37:03.934769+0000","last_clean":"2024-09-13T19:37:03.934769+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:37:03.934769+0000","last_undegraded":"2024-09-13T19:37:03.934769+0000","last_fullsized":"2024-09-13T19:37:03.934769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.934524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:27.912903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:34.499474+0000","last_change":"2024-09-13T19:33:18.401696+0000","last_active":"2024-09-13T19:35:34.499474+0000","last_peered":"2024-09-13T19:35:34.499474+0000","last_clean":"2024-09-13T19:35:34.499474+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:35:34.499474+0000","last_undegraded":"2024-09-13T19:35:34.499474+0000","last_fullsized":"2024-09-13T19:35:34.499474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.540294+0000","last_change":"2024-09-13T19:37:26.540356+0000","last_active":"2024-09-13T19:37:26.540294+0000","last_peered":"2024-09-13T19:37:26.540294+0000","last_clean":"2024-09-13T19:37:26.540294+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:37:26.540294+0000","last_undegraded":"2024-09-13T19:37:26.540294+0000","last_fullsized":"2024-09-13T19:37:26.540294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:26.540098+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:26.540098+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.540098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:08.484408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909420+0000","last_change":"2024-09-13T19:33:08.345805+0000","last_active":"2024-09-13T19:36:58.909420+0000","last_peered":"2024-09-13T19:36:58.909420+0000","last_clean":"2024-09-13T19:36:58.909420+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:36:58.909420+0000","last_undegraded":"2024-09-13T19:36:58.909420+0000","last_fullsized":"2024-09-13T19:36:58.909420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351746+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:37:00.351746+0000","last_peered":"2024-09-13T19:37:00.351746+0000","last_clean":"2024-09-13T19:37:00.351746+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:37:00.351746+0000","last_undegraded":"2024-09-13T19:37:00.351746+0000","last_fullsized":"2024-09-13T19:37:00.351746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.079813+0000","last_change":"2024-09-13T19:37:06.079813+0000","last_active":"2024-09-13T19:37:06.079813+0000","last_peered":"2024-09-13T19:37:06.079813+0000","last_clean":"2024-09-13T19:37:06.079813+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:37:06.079813+0000","last_undegraded":"2024-09-13T19:37:06.079813+0000","last_fullsized":"2024-09-13T19:37:06.079813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.079564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:35.654908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.552224+0000","last_change":"2024-09-13T19:37:05.552224+0000","last_active":"2024-09-13T19:37:05.552224+0000","last_peered":"2024-09-13T19:37:05.552224+0000","last_clean":"2024-09-13T19:37:05.552224+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:37:05.552224+0000","last_undegraded":"2024-09-13T19:37:05.552224+0000","last_fullsized":"2024-09-13T19:37:05.552224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.551819+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:23.797950+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.523331+0000","last_change":"2024-09-13T19:36:59.523331+0000","last_active":"2024-09-13T19:36:59.523331+0000","last_peered":"2024-09-13T19:36:59.523331+0000","last_clean":"2024-09-13T19:36:59.523331+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:59.523331+0000","last_undegraded":"2024-09-13T19:36:59.523331+0000","last_fullsized":"2024-09-13T19:36:59.523331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.522965+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:04.776093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.956155+0000","last_change":"2024-09-13T19:37:38.956223+0000","last_active":"2024-09-13T19:37:38.956155+0000","last_peered":"2024-09-13T19:37:38.956155+0000","last_clean":"2024-09-13T19:37:38.956155+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:37:38.956155+0000","last_undegraded":"2024-09-13T19:37:38.956155+0000","last_fullsized":"2024-09-13T19:37:38.956155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:38.955963+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:38.955963+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.955963+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:04.315165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352585+0000","last_change":"2024-09-13T19:33:10.352017+0000","last_active":"2024-09-13T19:37:00.352585+0000","last_peered":"2024-09-13T19:37:00.352585+0000","last_clean":"2024-09-13T19:37:00.352585+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:37:00.352585+0000","last_undegraded":"2024-09-13T19:37:00.352585+0000","last_fullsized":"2024-09-13T19:37:00.352585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351981+0000","last_change":"2024-09-13T19:33:08.335852+0000","last_active":"2024-09-13T19:37:00.351981+0000","last_peered":"2024-09-13T19:37:00.351981+0000","last_clean":"2024-09-13T19:37:00.351981+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:37:00.351981+0000","last_undegraded":"2024-09-13T19:37:00.351981+0000","last_fullsized":"2024-09-13T19:37:00.351981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909173+0000","last_change":"2024-09-13T19:33:02.523653+0000","last_active":"2024-09-13T19:36:58.909173+0000","last_peered":"2024-09-13T19:36:58.909173+0000","last_clean":"2024-09-13T19:36:58.909173+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:36:58.909173+0000","last_undegraded":"2024-09-13T19:36:58.909173+0000","last_fullsized":"2024-09-13T19:36:58.909173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.076438+0000","last_change":"2024-09-13T19:37:04.076438+0000","last_active":"2024-09-13T19:37:04.076438+0000","last_peered":"2024-09-13T19:37:04.076438+0000","last_clean":"2024-09-13T19:37:04.076438+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:37:04.076438+0000","last_undegraded":"2024-09-13T19:37:04.076438+0000","last_fullsized":"2024-09-13T19:37:04.076438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.076154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:39.308586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.094198+0000","last_change":"2024-09-13T19:37:19.094198+0000","last_active":"2024-09-13T19:37:19.094198+0000","last_peered":"2024-09-13T19:37:19.094198+0000","last_clean":"2024-09-13T19:37:19.094198+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:37:19.094198+0000","last_undegraded":"2024-09-13T19:37:19.094198+0000","last_fullsized":"2024-09-13T19:37:19.094198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:19.093865+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:19.093865+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.093865+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:00.620474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.358816+0000","last_change":"2024-09-13T19:37:03.358816+0000","last_active":"2024-09-13T19:37:03.358816+0000","last_peered":"2024-09-13T19:37:03.358816+0000","last_clean":"2024-09-13T19:37:03.358816+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:37:03.358816+0000","last_undegraded":"2024-09-13T19:37:03.358816+0000","last_fullsized":"2024-09-13T19:37:03.358816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.358562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.021089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.557171+0000","last_change":"2024-09-13T19:37:12.557231+0000","last_active":"2024-09-13T19:37:12.557171+0000","last_peered":"2024-09-13T19:37:12.557171+0000","last_clean":"2024-09-13T19:37:12.557171+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:37:12.557171+0000","last_undegraded":"2024-09-13T19:37:12.557171+0000","last_fullsized":"2024-09-13T19:37:12.557171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.556957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.679686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.029314+0000","last_change":"2024-09-13T19:37:34.029405+0000","last_active":"2024-09-13T19:37:34.029314+0000","last_peered":"2024-09-13T19:37:34.029314+0000","last_clean":"2024-09-13T19:37:34.029314+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:37:34.029314+0000","last_undegraded":"2024-09-13T19:37:34.029314+0000","last_fullsized":"2024-09-13T19:37:34.029314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:34.029094+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:34.029094+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.029094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:33.604670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.451967+0000","last_change":"2024-09-13T19:37:37.452031+0000","last_active":"2024-09-13T19:37:37.451967+0000","last_peered":"2024-09-13T19:37:37.451967+0000","last_clean":"2024-09-13T19:37:37.451967+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:37:37.451967+0000","last_undegraded":"2024-09-13T19:37:37.451967+0000","last_fullsized":"2024-09-13T19:37:37.451967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:37.451769+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:37.451769+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.451769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:59.810756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351796+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:37:00.351796+0000","last_peered":"2024-09-13T19:37:00.351796+0000","last_clean":"2024-09-13T19:37:00.351796+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:37:00.351796+0000","last_undegraded":"2024-09-13T19:37:00.351796+0000","last_fullsized":"2024-09-13T19:37:00.351796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.142377+0000","last_change":"2024-09-13T19:37:12.142377+0000","last_active":"2024-09-13T19:37:12.142377+0000","last_peered":"2024-09-13T19:37:12.142377+0000","last_clean":"2024-09-13T19:37:12.142377+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:37:12.142377+0000","last_undegraded":"2024-09-13T19:37:12.142377+0000","last_fullsized":"2024-09-13T19:37:12.142377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.142129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:18.473708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'97","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.931606+0000","last_change":"2024-09-13T19:37:05.931606+0000","last_active":"2024-09-13T19:37:05.931606+0000","last_peered":"2024-09-13T19:37:05.931606+0000","last_clean":"2024-09-13T19:37:05.931606+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:37:05.931606+0000","last_undegraded":"2024-09-13T19:37:05.931606+0000","last_fullsized":"2024-09-13T19:37:05.931606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.931238+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:45.454573+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.298133+0000","last_change":"2024-09-13T19:37:06.298133+0000","last_active":"2024-09-13T19:37:06.298133+0000","last_peered":"2024-09-13T19:37:06.298133+0000","last_clean":"2024-09-13T19:37:06.298133+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:37:06.298133+0000","last_undegraded":"2024-09-13T19:37:06.298133+0000","last_fullsized":"2024-09-13T19:37:06.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:34.808071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.502557+0000","last_change":"2024-09-13T19:33:18.418007+0000","last_active":"2024-09-13T19:35:35.502557+0000","last_peered":"2024-09-13T19:35:35.502557+0000","last_clean":"2024-09-13T19:35:35.502557+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:35:35.502557+0000","last_undegraded":"2024-09-13T19:35:35.502557+0000","last_fullsized":"2024-09-13T19:35:35.502557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.880892+0000","last_change":"2024-09-13T19:33:18.416636+0000","last_active":"2024-09-13T19:36:59.880892+0000","last_peered":"2024-09-13T19:36:59.880892+0000","last_clean":"2024-09-13T19:36:59.880892+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:36:59.880892+0000","last_undegraded":"2024-09-13T19:36:59.880892+0000","last_fullsized":"2024-09-13T19:36:59.880892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.934800+0000","last_change":"2024-09-13T19:37:29.934942+0000","last_active":"2024-09-13T19:37:29.934800+0000","last_peered":"2024-09-13T19:37:29.934800+0000","last_clean":"2024-09-13T19:37:29.934800+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:37:29.934800+0000","last_undegraded":"2024-09-13T19:37:29.934800+0000","last_fullsized":"2024-09-13T19:37:29.934800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:29.934579+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:29.934579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.934579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:05.520975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.076072+0000","last_change":"2024-09-13T19:33:08.354023+0000","last_active":"2024-09-13T19:36:24.076072+0000","last_peered":"2024-09-13T19:36:24.076072+0000","last_clean":"2024-09-13T19:36:24.076072+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:36:24.076072+0000","last_undegraded":"2024-09-13T19:36:24.076072+0000","last_fullsized":"2024-09-13T19:36:24.076072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.615226+0000","last_change":"2024-09-13T19:37:19.615290+0000","last_active":"2024-09-13T19:37:19.615226+0000","last_peered":"2024-09-13T19:37:19.615226+0000","last_clean":"2024-09-13T19:37:19.615226+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:37:19.615226+0000","last_undegraded":"2024-09-13T19:37:19.615226+0000","last_fullsized":"2024-09-13T19:37:19.615226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:19.615030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:19.615030+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.615030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:23.322720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.155894+0000","last_change":"2024-09-13T19:37:11.156055+0000","last_active":"2024-09-13T19:37:11.155894+0000","last_peered":"2024-09-13T19:37:11.155894+0000","last_clean":"2024-09-13T19:37:11.155894+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:37:11.155894+0000","last_undegraded":"2024-09-13T19:37:11.155894+0000","last_fullsized":"2024-09-13T19:37:11.155894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.155624+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:30.748402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.008871+0000","last_change":"2024-09-13T19:37:31.008931+0000","last_active":"2024-09-13T19:37:31.008871+0000","last_peered":"2024-09-13T19:37:31.008871+0000","last_clean":"2024-09-13T19:37:31.008871+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:37:31.008871+0000","last_undegraded":"2024-09-13T19:37:31.008871+0000","last_fullsized":"2024-09-13T19:37:31.008871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:31.008661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:31.008661+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.008661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:00.939978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.163660+0000","last_change":"2024-09-13T19:37:25.163723+0000","last_active":"2024-09-13T19:37:25.163660+0000","last_peered":"2024-09-13T19:37:25.163660+0000","last_clean":"2024-09-13T19:37:25.163660+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:37:25.163660+0000","last_undegraded":"2024-09-13T19:37:25.163660+0000","last_fullsized":"2024-09-13T19:37:25.163660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-13T19:37:25.163440+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-13T19:37:25.163440+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.163440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:32.363103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.618840+0000","last_change":"2024-09-13T19:37:22.618900+0000","last_active":"2024-09-13T19:37:22.618840+0000","last_peered":"2024-09-13T19:37:22.618840+0000","last_clean":"2024-09-13T19:37:22.618840+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:37:22.618840+0000","last_undegraded":"2024-09-13T19:37:22.618840+0000","last_fullsized":"2024-09-13T19:37:22.618840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:22.618647+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:22.618647+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.618647+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:22.194223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.922747+0000","last_change":"2024-09-13T19:37:24.922798+0000","last_active":"2024-09-13T19:37:24.922747+0000","last_peered":"2024-09-13T19:37:24.922747+0000","last_clean":"2024-09-13T19:37:24.922747+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:37:24.922747+0000","last_undegraded":"2024-09-13T19:37:24.922747+0000","last_fullsized":"2024-09-13T19:37:24.922747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:24.922556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:24.922556+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.922556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:12.432860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505996+0000","last_change":"2024-09-13T19:33:49.530881+0000","last_active":"2024-09-13T19:35:35.505996+0000","last_peered":"2024-09-13T19:35:35.505996+0000","last_clean":"2024-09-13T19:35:35.505996+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:35:35.505996+0000","last_undegraded":"2024-09-13T19:35:35.505996+0000","last_fullsized":"2024-09-13T19:35:35.505996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.196965+0000","last_change":"2024-09-13T19:37:10.197029+0000","last_active":"2024-09-13T19:37:10.196965+0000","last_peered":"2024-09-13T19:37:10.196965+0000","last_clean":"2024-09-13T19:37:10.196965+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:37:10.196965+0000","last_undegraded":"2024-09-13T19:37:10.196965+0000","last_fullsized":"2024-09-13T19:37:10.196965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.196773+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:26.963041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.867169+0000","last_change":"2024-09-13T19:37:00.867223+0000","last_active":"2024-09-13T19:37:00.867169+0000","last_peered":"2024-09-13T19:37:00.867169+0000","last_clean":"2024-09-13T19:37:00.867169+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:37:00.867169+0000","last_undegraded":"2024-09-13T19:37:00.867169+0000","last_fullsized":"2024-09-13T19:37:00.867169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.866964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:18.237819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:49.502868+0000","last_change":"2024-09-13T19:33:18.415711+0000","last_active":"2024-09-13T19:35:49.502868+0000","last_peered":"2024-09-13T19:35:49.502868+0000","last_clean":"2024-09-13T19:35:49.502868+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:35:49.502868+0000","last_undegraded":"2024-09-13T19:35:49.502868+0000","last_fullsized":"2024-09-13T19:35:49.502868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.115827+0000","last_change":"2024-09-13T19:33:10.340323+0000","last_active":"2024-09-13T19:36:24.115827+0000","last_peered":"2024-09-13T19:36:24.115827+0000","last_clean":"2024-09-13T19:36:24.115827+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:36:24.115827+0000","last_undegraded":"2024-09-13T19:36:24.115827+0000","last_fullsized":"2024-09-13T19:36:24.115827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.060709+0000","last_change":"2024-09-13T19:37:37.060765+0000","last_active":"2024-09-13T19:37:37.060709+0000","last_peered":"2024-09-13T19:37:37.060709+0000","last_clean":"2024-09-13T19:37:37.060709+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:37:37.060709+0000","last_undegraded":"2024-09-13T19:37:37.060709+0000","last_fullsized":"2024-09-13T19:37:37.060709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:37.060494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:37.060494+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.060494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:44.260157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.795496+0000","last_change":"2024-09-13T19:37:14.795551+0000","last_active":"2024-09-13T19:37:14.795496+0000","last_peered":"2024-09-13T19:37:14.795496+0000","last_clean":"2024-09-13T19:37:14.795496+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:37:14.795496+0000","last_undegraded":"2024-09-13T19:37:14.795496+0000","last_fullsized":"2024-09-13T19:37:14.795496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.795303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:39.429169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'48","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.298165+0000","last_change":"2024-09-13T19:37:07.298241+0000","last_active":"2024-09-13T19:37:07.298165+0000","last_peered":"2024-09-13T19:37:07.298165+0000","last_clean":"2024-09-13T19:37:07.298165+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:37:07.298165+0000","last_undegraded":"2024-09-13T19:37:07.298165+0000","last_fullsized":"2024-09-13T19:37:07.298165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.297980+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.187946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.510044+0000","last_change":"2024-09-13T19:37:03.510102+0000","last_active":"2024-09-13T19:37:03.510044+0000","last_peered":"2024-09-13T19:37:03.510044+0000","last_clean":"2024-09-13T19:37:03.510044+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:37:03.510044+0000","last_undegraded":"2024-09-13T19:37:03.510044+0000","last_fullsized":"2024-09-13T19:37:03.510044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.509824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.172352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:50.510224+0000","last_change":"2024-09-13T19:33:18.420341+0000","last_active":"2024-09-13T19:35:50.510224+0000","last_peered":"2024-09-13T19:35:50.510224+0000","last_clean":"2024-09-13T19:35:50.510224+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:35:50.510224+0000","last_undegraded":"2024-09-13T19:35:50.510224+0000","last_fullsized":"2024-09-13T19:35:50.510224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.297259+0000","last_change":"2024-09-13T19:33:10.348981+0000","last_active":"2024-09-13T19:36:24.297259+0000","last_peered":"2024-09-13T19:36:24.297259+0000","last_clean":"2024-09-13T19:36:24.297259+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:36:24.297259+0000","last_undegraded":"2024-09-13T19:36:24.297259+0000","last_fullsized":"2024-09-13T19:36:24.297259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504730+0000","last_change":"2024-09-13T19:33:49.519345+0000","last_active":"2024-09-13T19:35:35.504730+0000","last_peered":"2024-09-13T19:35:35.504730+0000","last_clean":"2024-09-13T19:35:35.504730+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:35:35.504730+0000","last_undegraded":"2024-09-13T19:35:35.504730+0000","last_fullsized":"2024-09-13T19:35:35.504730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.122088+0000","last_change":"2024-09-13T19:37:01.122142+0000","last_active":"2024-09-13T19:37:01.122088+0000","last_peered":"2024-09-13T19:37:01.122088+0000","last_clean":"2024-09-13T19:37:01.122088+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:37:01.122088+0000","last_undegraded":"2024-09-13T19:37:01.122088+0000","last_fullsized":"2024-09-13T19:37:01.122088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.121885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:18.346905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.862011+0000","last_change":"2024-09-13T19:37:09.862096+0000","last_active":"2024-09-13T19:37:09.862011+0000","last_peered":"2024-09-13T19:37:09.862011+0000","last_clean":"2024-09-13T19:37:09.862011+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:37:09.862011+0000","last_undegraded":"2024-09-13T19:37:09.862011+0000","last_fullsized":"2024-09-13T19:37:09.862011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.861787+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:30.468598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.892978+0000","last_change":"2024-09-13T19:36:59.893029+0000","last_active":"2024-09-13T19:36:59.892978+0000","last_peered":"2024-09-13T19:36:59.892978+0000","last_clean":"2024-09-13T19:36:59.892978+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:36:59.892978+0000","last_undegraded":"2024-09-13T19:36:59.892978+0000","last_fullsized":"2024-09-13T19:36:59.892978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.892784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:26.796881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.922723+0000","last_change":"2024-09-13T19:37:33.922792+0000","last_active":"2024-09-13T19:37:33.922723+0000","last_peered":"2024-09-13T19:37:33.922723+0000","last_clean":"2024-09-13T19:37:33.922723+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:37:33.922723+0000","last_undegraded":"2024-09-13T19:37:33.922723+0000","last_fullsized":"2024-09-13T19:37:33.922723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:33.922489+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:33.922489+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.922489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:49.484234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.505644+0000","last_change":"2024-09-13T19:33:08.338446+0000","last_active":"2024-09-13T19:35:35.505644+0000","last_peered":"2024-09-13T19:35:35.505644+0000","last_clean":"2024-09-13T19:35:35.505644+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:35:35.505644+0000","last_undegraded":"2024-09-13T19:35:35.505644+0000","last_fullsized":"2024-09-13T19:35:35.505644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.250956+0000","last_change":"2024-09-13T19:37:16.251010+0000","last_active":"2024-09-13T19:37:16.250956+0000","last_peered":"2024-09-13T19:37:16.250956+0000","last_clean":"2024-09-13T19:37:16.250956+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:37:16.250956+0000","last_undegraded":"2024-09-13T19:37:16.250956+0000","last_fullsized":"2024-09-13T19:37:16.250956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.250752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:17.682001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'66","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.201407+0000","last_change":"2024-09-13T19:37:12.201490+0000","last_active":"2024-09-13T19:37:12.201407+0000","last_peered":"2024-09-13T19:37:12.201407+0000","last_clean":"2024-09-13T19:37:12.201407+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:37:12.201407+0000","last_undegraded":"2024-09-13T19:37:12.201407+0000","last_fullsized":"2024-09-13T19:37:12.201407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.201193+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:16.321625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.836414+0000","last_change":"2024-09-13T19:37:11.836514+0000","last_active":"2024-09-13T19:37:11.836414+0000","last_peered":"2024-09-13T19:37:11.836414+0000","last_clean":"2024-09-13T19:37:11.836414+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:37:11.836414+0000","last_undegraded":"2024-09-13T19:37:11.836414+0000","last_fullsized":"2024-09-13T19:37:11.836414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.836187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:55.223762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:39.500518+0000","last_change":"2024-09-13T19:33:18.415632+0000","last_active":"2024-09-13T19:35:39.500518+0000","last_peered":"2024-09-13T19:35:39.500518+0000","last_clean":"2024-09-13T19:35:39.500518+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:35:39.500518+0000","last_undegraded":"2024-09-13T19:35:39.500518+0000","last_fullsized":"2024-09-13T19:35:39.500518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.164238+0000","last_change":"2024-09-13T19:37:26.164322+0000","last_active":"2024-09-13T19:37:26.164238+0000","last_peered":"2024-09-13T19:37:26.164238+0000","last_clean":"2024-09-13T19:37:26.164238+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:37:26.164238+0000","last_undegraded":"2024-09-13T19:37:26.164238+0000","last_fullsized":"2024-09-13T19:37:26.164238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:26.164044+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:26.164044+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.164044+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:08.108354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:35.504395+0000","last_change":"2024-09-13T19:33:08.337364+0000","last_active":"2024-09-13T19:35:35.504395+0000","last_peered":"2024-09-13T19:35:35.504395+0000","last_clean":"2024-09-13T19:35:35.504395+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:35:35.504395+0000","last_undegraded":"2024-09-13T19:35:35.504395+0000","last_fullsized":"2024-09-13T19:35:35.504395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.878321+0000","last_change":"2024-09-13T19:37:18.878321+0000","last_active":"2024-09-13T19:37:18.878321+0000","last_peered":"2024-09-13T19:37:18.878321+0000","last_clean":"2024-09-13T19:37:18.878321+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:37:18.878321+0000","last_undegraded":"2024-09-13T19:37:18.878321+0000","last_fullsized":"2024-09-13T19:37:18.878321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.878068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.266511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.006283+0000","last_change":"2024-09-13T19:37:30.006370+0000","last_active":"2024-09-13T19:37:30.006283+0000","last_peered":"2024-09-13T19:37:30.006283+0000","last_clean":"2024-09-13T19:37:30.006283+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:37:30.006283+0000","last_undegraded":"2024-09-13T19:37:30.006283+0000","last_fullsized":"2024-09-13T19:37:30.006283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:30.006093+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:30.006093+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.006093+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:55.908367+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.465555+0000","last_change":"2024-09-13T19:37:02.465714+0000","last_active":"2024-09-13T19:37:02.465555+0000","last_peered":"2024-09-13T19:37:02.465555+0000","last_clean":"2024-09-13T19:37:02.465555+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:37:02.465555+0000","last_undegraded":"2024-09-13T19:37:02.465555+0000","last_fullsized":"2024-09-13T19:37:02.465555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.465336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.671030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507238+0000","last_change":"2024-09-13T19:33:18.415435+0000","last_active":"2024-09-13T19:35:40.507238+0000","last_peered":"2024-09-13T19:35:40.507238+0000","last_clean":"2024-09-13T19:35:40.507238+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:35:40.507238+0000","last_undegraded":"2024-09-13T19:35:40.507238+0000","last_fullsized":"2024-09-13T19:35:40.507238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.118164+0000","last_change":"2024-09-13T19:37:16.118224+0000","last_active":"2024-09-13T19:37:16.118164+0000","last_peered":"2024-09-13T19:37:16.118164+0000","last_clean":"2024-09-13T19:37:16.118164+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:37:16.118164+0000","last_undegraded":"2024-09-13T19:37:16.118164+0000","last_fullsized":"2024-09-13T19:37:16.118164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:16.117977+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:16.117977+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.117977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.935807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.505695+0000","last_change":"2024-09-13T19:33:08.335612+0000","last_active":"2024-09-13T19:35:40.505695+0000","last_peered":"2024-09-13T19:35:40.505695+0000","last_clean":"2024-09-13T19:35:40.505695+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:35:40.505695+0000","last_undegraded":"2024-09-13T19:35:40.505695+0000","last_fullsized":"2024-09-13T19:35:40.505695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.846935+0000","last_change":"2024-09-13T19:37:17.846985+0000","last_active":"2024-09-13T19:37:17.846935+0000","last_peered":"2024-09-13T19:37:17.846935+0000","last_clean":"2024-09-13T19:37:17.846935+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:37:17.846935+0000","last_undegraded":"2024-09-13T19:37:17.846935+0000","last_fullsized":"2024-09-13T19:37:17.846935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.846741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:49.584937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.250550+0000","last_change":"2024-09-13T19:37:08.250550+0000","last_active":"2024-09-13T19:37:08.250550+0000","last_peered":"2024-09-13T19:37:08.250550+0000","last_clean":"2024-09-13T19:37:08.250550+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:37:08.250550+0000","last_undegraded":"2024-09-13T19:37:08.250550+0000","last_fullsized":"2024-09-13T19:37:08.250550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.250286+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.511817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.299423+0000","last_change":"2024-09-13T19:37:17.299423+0000","last_active":"2024-09-13T19:37:17.299423+0000","last_peered":"2024-09-13T19:37:17.299423+0000","last_clean":"2024-09-13T19:37:17.299423+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:37:17.299423+0000","last_undegraded":"2024-09-13T19:37:17.299423+0000","last_fullsized":"2024-09-13T19:37:17.299423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.299176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:11.887369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507086+0000","last_change":"2024-09-13T19:33:18.414176+0000","last_active":"2024-09-13T19:35:40.507086+0000","last_peered":"2024-09-13T19:35:40.507086+0000","last_clean":"2024-09-13T19:35:40.507086+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:35:40.507086+0000","last_undegraded":"2024-09-13T19:35:40.507086+0000","last_fullsized":"2024-09-13T19:35:40.507086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.170269+0000","last_change":"2024-09-13T19:37:27.170330+0000","last_active":"2024-09-13T19:37:27.170269+0000","last_peered":"2024-09-13T19:37:27.170269+0000","last_clean":"2024-09-13T19:37:27.170269+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:37:27.170269+0000","last_undegraded":"2024-09-13T19:37:27.170269+0000","last_fullsized":"2024-09-13T19:37:27.170269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:27.170072+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:27.170072+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.170072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:51.374174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:55.747903+0000","last_change":"2024-09-13T19:33:08.340688+0000","last_active":"2024-09-13T19:36:55.747903+0000","last_peered":"2024-09-13T19:36:55.747903+0000","last_clean":"2024-09-13T19:36:55.747903+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:36:55.747903+0000","last_undegraded":"2024-09-13T19:36:55.747903+0000","last_fullsized":"2024-09-13T19:36:55.747903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.667220+0000","last_change":"2024-09-13T19:37:21.667320+0000","last_active":"2024-09-13T19:37:21.667220+0000","last_peered":"2024-09-13T19:37:21.667220+0000","last_clean":"2024-09-13T19:37:21.667220+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:37:21.667220+0000","last_undegraded":"2024-09-13T19:37:21.667220+0000","last_fullsized":"2024-09-13T19:37:21.667220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:21.666993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:21.666993+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.666993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:40.253116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.027267+0000","last_change":"2024-09-13T19:37:29.027432+0000","last_active":"2024-09-13T19:37:29.027267+0000","last_peered":"2024-09-13T19:37:29.027267+0000","last_clean":"2024-09-13T19:37:29.027267+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:37:29.027267+0000","last_undegraded":"2024-09-13T19:37:29.027267+0000","last_fullsized":"2024-09-13T19:37:29.027267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:29.027005+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:29.027005+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.027005+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:23.111450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":420,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.871065+0000","last_change":"2024-09-13T19:37:01.871065+0000","last_active":"2024-09-13T19:37:01.871065+0000","last_peered":"2024-09-13T19:37:01.871065+0000","last_clean":"2024-09-13T19:37:01.871065+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:37:01.871065+0000","last_undegraded":"2024-09-13T19:37:01.871065+0000","last_fullsized":"2024-09-13T19:37:01.871065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.870803+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:04.118178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.506975+0000","last_change":"2024-09-13T19:33:18.419381+0000","last_active":"2024-09-13T19:35:40.506975+0000","last_peered":"2024-09-13T19:35:40.506975+0000","last_clean":"2024-09-13T19:35:40.506975+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:35:40.506975+0000","last_undegraded":"2024-09-13T19:35:40.506975+0000","last_fullsized":"2024-09-13T19:35:40.506975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.914455+0000","last_change":"2024-09-13T19:37:25.914489+0000","last_active":"2024-09-13T19:37:25.914455+0000","last_peered":"2024-09-13T19:37:25.914455+0000","last_clean":"2024-09-13T19:37:25.914455+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:37:25.914455+0000","last_undegraded":"2024-09-13T19:37:25.914455+0000","last_fullsized":"2024-09-13T19:37:25.914455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:25.914351+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:25.914351+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.914351+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:13.683898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.505781+0000","last_change":"2024-09-13T19:33:08.338096+0000","last_active":"2024-09-13T19:35:40.505781+0000","last_peered":"2024-09-13T19:35:40.505781+0000","last_clean":"2024-09-13T19:35:40.505781+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:35:40.505781+0000","last_undegraded":"2024-09-13T19:35:40.505781+0000","last_fullsized":"2024-09-13T19:35:40.505781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.580786+0000","last_change":"2024-09-13T19:37:18.580839+0000","last_active":"2024-09-13T19:37:18.580786+0000","last_peered":"2024-09-13T19:37:18.580786+0000","last_clean":"2024-09-13T19:37:18.580786+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:37:18.580786+0000","last_undegraded":"2024-09-13T19:37:18.580786+0000","last_fullsized":"2024-09-13T19:37:18.580786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.580585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.580585+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.580585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:54.166980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.503996+0000","last_change":"2024-09-13T19:37:07.504071+0000","last_active":"2024-09-13T19:37:07.503996+0000","last_peered":"2024-09-13T19:37:07.503996+0000","last_clean":"2024-09-13T19:37:07.503996+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:37:07.503996+0000","last_undegraded":"2024-09-13T19:37:07.503996+0000","last_fullsized":"2024-09-13T19:37:07.503996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.503821+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.393786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.318408+0000","last_change":"2024-09-13T19:37:02.318463+0000","last_active":"2024-09-13T19:37:02.318408+0000","last_peered":"2024-09-13T19:37:02.318408+0000","last_clean":"2024-09-13T19:37:02.318408+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:37:02.318408+0000","last_undegraded":"2024-09-13T19:37:02.318408+0000","last_fullsized":"2024-09-13T19:37:02.318408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.318220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:12.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.506980+0000","last_change":"2024-09-13T19:33:18.425299+0000","last_active":"2024-09-13T19:35:45.506980+0000","last_peered":"2024-09-13T19:35:45.506980+0000","last_clean":"2024-09-13T19:35:45.506980+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:35:45.506980+0000","last_undegraded":"2024-09-13T19:35:45.506980+0000","last_fullsized":"2024-09-13T19:35:45.506980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.014355+0000","last_change":"2024-09-13T19:37:32.014422+0000","last_active":"2024-09-13T19:37:32.014355+0000","last_peered":"2024-09-13T19:37:32.014355+0000","last_clean":"2024-09-13T19:37:32.014355+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:37:32.014355+0000","last_undegraded":"2024-09-13T19:37:32.014355+0000","last_fullsized":"2024-09-13T19:37:32.014355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:32.014177+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:32.014177+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.014177+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.161530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507672+0000","last_change":"2024-09-13T19:33:08.358155+0000","last_active":"2024-09-13T19:35:40.507672+0000","last_peered":"2024-09-13T19:35:40.507672+0000","last_clean":"2024-09-13T19:35:40.507672+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:35:40.507672+0000","last_undegraded":"2024-09-13T19:35:40.507672+0000","last_fullsized":"2024-09-13T19:35:40.507672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.865865+0000","last_change":"2024-09-13T19:37:12.865947+0000","last_active":"2024-09-13T19:37:12.865865+0000","last_peered":"2024-09-13T19:37:12.865865+0000","last_clean":"2024-09-13T19:37:12.865865+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:37:12.865865+0000","last_undegraded":"2024-09-13T19:37:12.865865+0000","last_fullsized":"2024-09-13T19:37:12.865865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.865683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.157355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.251983+0000","last_change":"2024-09-13T19:37:14.252058+0000","last_active":"2024-09-13T19:37:14.251983+0000","last_peered":"2024-09-13T19:37:14.251983+0000","last_clean":"2024-09-13T19:37:14.251983+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:37:14.251983+0000","last_undegraded":"2024-09-13T19:37:14.251983+0000","last_fullsized":"2024-09-13T19:37:14.251983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.251796+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.000429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.120244+0000","last_change":"2024-09-13T19:37:22.120297+0000","last_active":"2024-09-13T19:37:22.120244+0000","last_peered":"2024-09-13T19:37:22.120244+0000","last_clean":"2024-09-13T19:37:22.120244+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:37:22.120244+0000","last_undegraded":"2024-09-13T19:37:22.120244+0000","last_fullsized":"2024-09-13T19:37:22.120244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:22.120047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:22.120047+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.120047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:39.824427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509143+0000","last_change":"2024-09-13T19:33:18.424633+0000","last_active":"2024-09-13T19:35:45.509143+0000","last_peered":"2024-09-13T19:35:45.509143+0000","last_clean":"2024-09-13T19:35:45.509143+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:35:45.509143+0000","last_undegraded":"2024-09-13T19:35:45.509143+0000","last_fullsized":"2024-09-13T19:35:45.509143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.438708+0000","last_change":"2024-09-13T19:33:10.346685+0000","last_active":"2024-09-13T19:36:24.438708+0000","last_peered":"2024-09-13T19:36:24.438708+0000","last_clean":"2024-09-13T19:36:24.438708+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:36:24.438708+0000","last_undegraded":"2024-09-13T19:36:24.438708+0000","last_fullsized":"2024-09-13T19:36:24.438708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.148982+0000","last_change":"2024-09-13T19:37:34.149044+0000","last_active":"2024-09-13T19:37:34.148982+0000","last_peered":"2024-09-13T19:37:34.148982+0000","last_clean":"2024-09-13T19:37:34.148982+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:37:34.148982+0000","last_undegraded":"2024-09-13T19:37:34.148982+0000","last_fullsized":"2024-09-13T19:37:34.148982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:34.148784+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:34.148784+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.148784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:52.146325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.541565+0000","last_change":"2024-09-13T19:37:15.541626+0000","last_active":"2024-09-13T19:37:15.541565+0000","last_peered":"2024-09-13T19:37:15.541565+0000","last_clean":"2024-09-13T19:37:15.541565+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:37:15.541565+0000","last_undegraded":"2024-09-13T19:37:15.541565+0000","last_fullsized":"2024-09-13T19:37:15.541565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.541376+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.541376+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.541376+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.495683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.117221+0000","last_change":"2024-09-13T19:37:13.117296+0000","last_active":"2024-09-13T19:37:13.117221+0000","last_peered":"2024-09-13T19:37:13.117221+0000","last_clean":"2024-09-13T19:37:13.117221+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:37:13.117221+0000","last_undegraded":"2024-09-13T19:37:13.117221+0000","last_fullsized":"2024-09-13T19:37:13.117221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.117012+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:54.888683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.982704+0000","last_change":"2024-09-13T19:37:26.982763+0000","last_active":"2024-09-13T19:37:26.982704+0000","last_peered":"2024-09-13T19:37:26.982704+0000","last_clean":"2024-09-13T19:37:26.982704+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:37:26.982704+0000","last_undegraded":"2024-09-13T19:37:26.982704+0000","last_fullsized":"2024-09-13T19:37:26.982704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:26.982499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:26.982499+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.982499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:34.956774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509079+0000","last_change":"2024-09-13T19:33:18.420238+0000","last_active":"2024-09-13T19:35:45.509079+0000","last_peered":"2024-09-13T19:35:45.509079+0000","last_clean":"2024-09-13T19:35:45.509079+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:35:45.509079+0000","last_undegraded":"2024-09-13T19:35:45.509079+0000","last_fullsized":"2024-09-13T19:35:45.509079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.942174+0000","last_change":"2024-09-13T19:37:27.942239+0000","last_active":"2024-09-13T19:37:27.942174+0000","last_peered":"2024-09-13T19:37:27.942174+0000","last_clean":"2024-09-13T19:37:27.942174+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:37:27.942174+0000","last_undegraded":"2024-09-13T19:37:27.942174+0000","last_fullsized":"2024-09-13T19:37:27.942174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:27.941988+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:27.941988+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.941988+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:53.406471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.384069+0000","last_change":"2024-09-13T19:33:08.329255+0000","last_active":"2024-09-13T19:36:59.384069+0000","last_peered":"2024-09-13T19:36:59.384069+0000","last_clean":"2024-09-13T19:36:59.384069+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:36:59.384069+0000","last_undegraded":"2024-09-13T19:36:59.384069+0000","last_fullsized":"2024-09-13T19:36:59.384069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.532624+0000","last_change":"2024-09-13T19:37:13.532693+0000","last_active":"2024-09-13T19:37:13.532624+0000","last_peered":"2024-09-13T19:37:13.532624+0000","last_clean":"2024-09-13T19:37:13.532624+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:37:13.532624+0000","last_undegraded":"2024-09-13T19:37:13.532624+0000","last_fullsized":"2024-09-13T19:37:13.532624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.532406+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:58.383662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.062342+0000","last_change":"2024-09-13T19:37:05.062437+0000","last_active":"2024-09-13T19:37:05.062342+0000","last_peered":"2024-09-13T19:37:05.062342+0000","last_clean":"2024-09-13T19:37:05.062342+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:37:05.062342+0000","last_undegraded":"2024-09-13T19:37:05.062342+0000","last_fullsized":"2024-09-13T19:37:05.062342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.062147+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:44.414993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.301505+0000","last_change":"2024-09-13T19:36:59.301555+0000","last_active":"2024-09-13T19:36:59.301505+0000","last_peered":"2024-09-13T19:36:59.301505+0000","last_clean":"2024-09-13T19:36:59.301505+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:36:59.301505+0000","last_undegraded":"2024-09-13T19:36:59.301505+0000","last_fullsized":"2024-09-13T19:36:59.301505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.301322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:26.231205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507509+0000","last_change":"2024-09-13T19:33:18.420946+0000","last_active":"2024-09-13T19:35:40.507509+0000","last_peered":"2024-09-13T19:35:40.507509+0000","last_clean":"2024-09-13T19:35:40.507509+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:35:40.507509+0000","last_undegraded":"2024-09-13T19:35:40.507509+0000","last_fullsized":"2024-09-13T19:35:40.507509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:00.507711+0000","last_change":"2024-09-13T19:33:49.534946+0000","last_active":"2024-09-13T19:36:00.507711+0000","last_peered":"2024-09-13T19:36:00.507711+0000","last_clean":"2024-09-13T19:36:00.507711+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:36:00.507711+0000","last_undegraded":"2024-09-13T19:36:00.507711+0000","last_fullsized":"2024-09-13T19:36:00.507711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.052768+0000","last_change":"2024-09-13T19:37:40.052825+0000","last_active":"2024-09-13T19:37:40.052768+0000","last_peered":"2024-09-13T19:37:40.052768+0000","last_clean":"2024-09-13T19:37:40.052768+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:37:40.052768+0000","last_undegraded":"2024-09-13T19:37:40.052768+0000","last_fullsized":"2024-09-13T19:37:40.052768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:40.052581+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:40.052581+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.052581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:52.026250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.200561+0000","last_change":"2024-09-13T19:37:31.200618+0000","last_active":"2024-09-13T19:37:31.200561+0000","last_peered":"2024-09-13T19:37:31.200561+0000","last_clean":"2024-09-13T19:37:31.200561+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:37:31.200561+0000","last_undegraded":"2024-09-13T19:37:31.200561+0000","last_fullsized":"2024-09-13T19:37:31.200561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:31.200373+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:31.200373+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.200373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:01.945557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909425+0000","last_change":"2024-09-13T19:33:08.325598+0000","last_active":"2024-09-13T19:36:58.909425+0000","last_peered":"2024-09-13T19:36:58.909425+0000","last_clean":"2024-09-13T19:36:58.909425+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:36:58.909425+0000","last_undegraded":"2024-09-13T19:36:58.909425+0000","last_fullsized":"2024-09-13T19:36:58.909425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.954921+0000","last_change":"2024-09-13T19:37:36.955053+0000","last_active":"2024-09-13T19:37:36.954921+0000","last_peered":"2024-09-13T19:37:36.954921+0000","last_clean":"2024-09-13T19:37:36.954921+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:37:36.954921+0000","last_undegraded":"2024-09-13T19:37:36.954921+0000","last_fullsized":"2024-09-13T19:37:36.954921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:36.954674+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:36.954674+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.954674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:38.360824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352403+0000","last_change":"2024-09-13T19:33:08.334993+0000","last_active":"2024-09-13T19:37:00.352403+0000","last_peered":"2024-09-13T19:37:00.352403+0000","last_clean":"2024-09-13T19:37:00.352403+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:37:00.352403+0000","last_undegraded":"2024-09-13T19:37:00.352403+0000","last_fullsized":"2024-09-13T19:37:00.352403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.167479+0000","last_change":"2024-09-13T19:37:33.167544+0000","last_active":"2024-09-13T19:37:33.167479+0000","last_peered":"2024-09-13T19:37:33.167479+0000","last_clean":"2024-09-13T19:37:33.167479+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:37:33.167479+0000","last_undegraded":"2024-09-13T19:37:33.167479+0000","last_fullsized":"2024-09-13T19:37:33.167479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.167253+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.167253+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.167253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:45.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909590+0000","last_change":"2024-09-13T19:33:08.345558+0000","last_active":"2024-09-13T19:36:58.909590+0000","last_peered":"2024-09-13T19:36:58.909590+0000","last_clean":"2024-09-13T19:36:58.909590+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:36:58.909590+0000","last_undegraded":"2024-09-13T19:36:58.909590+0000","last_fullsized":"2024-09-13T19:36:58.909590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.163622+0000","last_change":"2024-09-13T19:37:35.163796+0000","last_active":"2024-09-13T19:37:35.163622+0000","last_peered":"2024-09-13T19:37:35.163622+0000","last_clean":"2024-09-13T19:37:35.163622+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:37:35.163622+0000","last_undegraded":"2024-09-13T19:37:35.163622+0000","last_fullsized":"2024-09-13T19:37:35.163622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:35.163395+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:35.163395+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.163395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:10.385936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909513+0000","last_change":"2024-09-13T19:33:08.325496+0000","last_active":"2024-09-13T19:36:58.909513+0000","last_peered":"2024-09-13T19:36:58.909513+0000","last_clean":"2024-09-13T19:36:58.909513+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:36:58.909513+0000","last_undegraded":"2024-09-13T19:36:58.909513+0000","last_fullsized":"2024-09-13T19:36:58.909513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'5","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.384590+0000","last_change":"2024-09-13T19:33:10.353514+0000","last_active":"2024-09-13T19:36:59.384590+0000","last_peered":"2024-09-13T19:36:59.384590+0000","last_clean":"2024-09-13T19:36:59.384590+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:36:59.384590+0000","last_undegraded":"2024-09-13T19:36:59.384590+0000","last_fullsized":"2024-09-13T19:36:59.384590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.384285+0000","last_change":"2024-09-13T19:33:08.338958+0000","last_active":"2024-09-13T19:36:59.384285+0000","last_peered":"2024-09-13T19:36:59.384285+0000","last_clean":"2024-09-13T19:36:59.384285+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:36:59.384285+0000","last_undegraded":"2024-09-13T19:36:59.384285+0000","last_fullsized":"2024-09-13T19:36:59.384285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.150134+0000","last_change":"2024-09-13T19:37:37.150197+0000","last_active":"2024-09-13T19:37:37.150134+0000","last_peered":"2024-09-13T19:37:37.150134+0000","last_clean":"2024-09-13T19:37:37.150134+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:37:37.150134+0000","last_undegraded":"2024-09-13T19:37:37.150134+0000","last_fullsized":"2024-09-13T19:37:37.150134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:37.149953+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:37.149953+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.149953+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.044893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.905881+0000","last_change":"2024-09-13T19:37:28.905881+0000","last_active":"2024-09-13T19:37:28.905881+0000","last_peered":"2024-09-13T19:37:28.905881+0000","last_clean":"2024-09-13T19:37:28.905881+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:37:28.905881+0000","last_undegraded":"2024-09-13T19:37:28.905881+0000","last_fullsized":"2024-09-13T19:37:28.905881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:28.905626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:28.905626+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.905626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:55.777372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.430872+0000","last_change":"2024-09-13T19:37:35.430941+0000","last_active":"2024-09-13T19:37:35.430872+0000","last_peered":"2024-09-13T19:37:35.430872+0000","last_clean":"2024-09-13T19:37:35.430872+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:37:35.430872+0000","last_undegraded":"2024-09-13T19:37:35.430872+0000","last_fullsized":"2024-09-13T19:37:35.430872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:35.430664+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:35.430664+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.430664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.672938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909388+0000","last_change":"2024-09-13T19:33:08.325702+0000","last_active":"2024-09-13T19:36:58.909388+0000","last_peered":"2024-09-13T19:36:58.909388+0000","last_clean":"2024-09-13T19:36:58.909388+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:36:58.909388+0000","last_undegraded":"2024-09-13T19:36:58.909388+0000","last_fullsized":"2024-09-13T19:36:58.909388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.512782+0000","last_change":"2024-09-13T19:37:30.512846+0000","last_active":"2024-09-13T19:37:30.512782+0000","last_peered":"2024-09-13T19:37:30.512782+0000","last_clean":"2024-09-13T19:37:30.512782+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:37:30.512782+0000","last_undegraded":"2024-09-13T19:37:30.512782+0000","last_fullsized":"2024-09-13T19:37:30.512782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:30.512571+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:30.512571+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.512571+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:33.379047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352168+0000","last_change":"2024-09-13T19:33:08.332434+0000","last_active":"2024-09-13T19:37:00.352168+0000","last_peered":"2024-09-13T19:37:00.352168+0000","last_clean":"2024-09-13T19:37:00.352168+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:37:00.352168+0000","last_undegraded":"2024-09-13T19:37:00.352168+0000","last_fullsized":"2024-09-13T19:37:00.352168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'14","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.104702+0000","last_change":"2024-09-13T19:37:18.104875+0000","last_active":"2024-09-13T19:37:18.104702+0000","last_peered":"2024-09-13T19:37:18.104702+0000","last_clean":"2024-09-13T19:37:18.104702+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:37:18.104702+0000","last_undegraded":"2024-09-13T19:37:18.104702+0000","last_fullsized":"2024-09-13T19:37:18.104702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:18.104473+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:18.104473+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.104473+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:20.278237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.909870+0000","last_change":"2024-09-13T19:33:08.346231+0000","last_active":"2024-09-13T19:36:58.909870+0000","last_peered":"2024-09-13T19:36:58.909870+0000","last_clean":"2024-09-13T19:36:58.909870+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:36:58.909870+0000","last_undegraded":"2024-09-13T19:36:58.909870+0000","last_fullsized":"2024-09-13T19:36:58.909870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.244707+0000","last_change":"2024-09-13T19:37:30.244707+0000","last_active":"2024-09-13T19:37:30.244707+0000","last_peered":"2024-09-13T19:37:30.244707+0000","last_clean":"2024-09-13T19:37:30.244707+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:37:30.244707+0000","last_undegraded":"2024-09-13T19:37:30.244707+0000","last_fullsized":"2024-09-13T19:37:30.244707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:30.244451+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:30.244451+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.244451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:22.965504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.384001+0000","last_change":"2024-09-13T19:33:08.349717+0000","last_active":"2024-09-13T19:36:59.384001+0000","last_peered":"2024-09-13T19:36:59.384001+0000","last_clean":"2024-09-13T19:36:59.384001+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:36:59.384001+0000","last_undegraded":"2024-09-13T19:36:59.384001+0000","last_fullsized":"2024-09-13T19:36:59.384001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.500426+0000","last_change":"2024-09-13T19:37:31.500426+0000","last_active":"2024-09-13T19:37:31.500426+0000","last_peered":"2024-09-13T19:37:31.500426+0000","last_clean":"2024-09-13T19:37:31.500426+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:37:31.500426+0000","last_undegraded":"2024-09-13T19:37:31.500426+0000","last_fullsized":"2024-09-13T19:37:31.500426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:31.500107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:31.500107+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.500107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:51.092885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.528643+0000","last_change":"2024-09-13T19:37:39.528643+0000","last_active":"2024-09-13T19:37:39.528643+0000","last_peered":"2024-09-13T19:37:39.528643+0000","last_clean":"2024-09-13T19:37:39.528643+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:37:39.528643+0000","last_undegraded":"2024-09-13T19:37:39.528643+0000","last_fullsized":"2024-09-13T19:37:39.528643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:39.528373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:39.528373+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.528373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:21.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.501778+0000","last_change":"2024-09-13T19:37:27.501778+0000","last_active":"2024-09-13T19:37:27.501778+0000","last_peered":"2024-09-13T19:37:27.501778+0000","last_clean":"2024-09-13T19:37:27.501778+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:37:27.501778+0000","last_undegraded":"2024-09-13T19:37:27.501778+0000","last_fullsized":"2024-09-13T19:37:27.501778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:27.501537+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:27.501537+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.501537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:56.956150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352355+0000","last_change":"2024-09-13T19:33:08.342035+0000","last_active":"2024-09-13T19:37:00.352355+0000","last_peered":"2024-09-13T19:37:00.352355+0000","last_clean":"2024-09-13T19:37:00.352355+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:37:00.352355+0000","last_undegraded":"2024-09-13T19:37:00.352355+0000","last_fullsized":"2024-09-13T19:37:00.352355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.493010+0000","last_change":"2024-09-13T19:37:32.493010+0000","last_active":"2024-09-13T19:37:32.493010+0000","last_peered":"2024-09-13T19:37:32.493010+0000","last_clean":"2024-09-13T19:37:32.493010+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:37:32.493010+0000","last_undegraded":"2024-09-13T19:37:32.493010+0000","last_fullsized":"2024-09-13T19:37:32.493010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:32.492604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:32.492604+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.492604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:38.824183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352486+0000","last_change":"2024-09-13T19:33:08.335544+0000","last_active":"2024-09-13T19:37:00.352486+0000","last_peered":"2024-09-13T19:37:00.352486+0000","last_clean":"2024-09-13T19:37:00.352486+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:37:00.352486+0000","last_undegraded":"2024-09-13T19:37:00.352486+0000","last_fullsized":"2024-09-13T19:37:00.352486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.937555+0000","last_change":"2024-09-13T19:37:37.937555+0000","last_active":"2024-09-13T19:37:37.937555+0000","last_peered":"2024-09-13T19:37:37.937555+0000","last_clean":"2024-09-13T19:37:37.937555+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:37:37.937555+0000","last_undegraded":"2024-09-13T19:37:37.937555+0000","last_fullsized":"2024-09-13T19:37:37.937555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:37.937265+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:37.937265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.937265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:03.903704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.965002+0000","last_change":"2024-09-13T19:37:30.965052+0000","last_active":"2024-09-13T19:37:30.965002+0000","last_peered":"2024-09-13T19:37:30.965002+0000","last_clean":"2024-09-13T19:37:30.965002+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:37:30.965002+0000","last_undegraded":"2024-09-13T19:37:30.965002+0000","last_fullsized":"2024-09-13T19:37:30.965002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:30.964823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:30.964823+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.964823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:34.672513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.479987+0000","last_change":"2024-09-13T19:37:33.480053+0000","last_active":"2024-09-13T19:37:33.479987+0000","last_peered":"2024-09-13T19:37:33.479987+0000","last_clean":"2024-09-13T19:37:33.479987+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:37:33.479987+0000","last_undegraded":"2024-09-13T19:37:33.479987+0000","last_fullsized":"2024-09-13T19:37:33.479987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.479793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.479793+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.479793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:15.251464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504844+0000","last_change":"2024-09-13T19:33:08.354921+0000","last_active":"2024-09-13T19:35:30.504844+0000","last_peered":"2024-09-13T19:35:30.504844+0000","last_clean":"2024-09-13T19:35:30.504844+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:35:30.504844+0000","last_undegraded":"2024-09-13T19:35:30.504844+0000","last_fullsized":"2024-09-13T19:35:30.504844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:30.504359+0000","last_change":"2024-09-13T19:33:08.354409+0000","last_active":"2024-09-13T19:35:30.504359+0000","last_peered":"2024-09-13T19:35:30.504359+0000","last_clean":"2024-09-13T19:35:30.504359+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:35:30.504359+0000","last_undegraded":"2024-09-13T19:35:30.504359+0000","last_fullsized":"2024-09-13T19:35:30.504359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.114344+0000","last_change":"2024-09-13T19:33:10.340978+0000","last_active":"2024-09-13T19:36:24.114344+0000","last_peered":"2024-09-13T19:36:24.114344+0000","last_clean":"2024-09-13T19:36:24.114344+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:36:24.114344+0000","last_undegraded":"2024-09-13T19:36:24.114344+0000","last_fullsized":"2024-09-13T19:36:24.114344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.117866+0000","last_change":"2024-09-13T19:37:38.117918+0000","last_active":"2024-09-13T19:37:38.117866+0000","last_peered":"2024-09-13T19:37:38.117866+0000","last_clean":"2024-09-13T19:37:38.117866+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:37:38.117866+0000","last_undegraded":"2024-09-13T19:37:38.117866+0000","last_fullsized":"2024-09-13T19:37:38.117866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:38.117676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:38.117676+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.117676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:38.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.574471+0000","last_change":"2024-09-13T19:37:25.574599+0000","last_active":"2024-09-13T19:37:25.574471+0000","last_peered":"2024-09-13T19:37:25.574471+0000","last_clean":"2024-09-13T19:37:25.574471+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:37:25.574471+0000","last_undegraded":"2024-09-13T19:37:25.574471+0000","last_fullsized":"2024-09-13T19:37:25.574471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:25.574184+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:25.574184+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.574184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:32.773848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1527,"ondisk_log_size":1527,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673021,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40460,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331380,"statfs":{"total":96636764160,"available":96595333120,"internally_reserved":0,"allocated":978944,"data_stored":724012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1015808,"data_stored":726198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":135923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:37:41.599 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.599 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.600 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.600 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.600 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.600 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.600 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.600 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.600 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.600 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.601 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.601 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.601 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.601 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.601 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.601 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.601 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.601 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.602 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.602 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.602 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.602 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.602 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.602 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.602 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.603 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.603 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.603 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.603 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.603 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.603 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.604 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.604 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.604 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.604 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.605 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.605 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.605 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.605 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.605 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.605 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:32:56.474648+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.606 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.606 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.606 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.606 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.606 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.606 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.606 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.606 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.607 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.607 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.607 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.607 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.607 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.607 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.608 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.608 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.608 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.608 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.608 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.608 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.608 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.609 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.609 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.609 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.609 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.609 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.609 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.609 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.610 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.610 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.610 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.610 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.610 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.610 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.611 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.611 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.611 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.611 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.611 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.611 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.611 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.612 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.612 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.612 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.612 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.612 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.613 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.613 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.613 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.613 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.613 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.613 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.613 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.613 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.614 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.614 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.614 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.614 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.614 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.614 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:37:41.614 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:38:01.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:38:01.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.741+0000 7fc46651d640 1 Processor -- start 2024-09-13T19:38:01.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc46651d640 1 -- start start 2024-09-13T19:38:01.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc46651d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc46006d0e0 0x7fc46006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:01.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc46651d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc460071c10 con 0x7fc46006da00 2024-09-13T19:38:01.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc46651d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc460072230 con 0x7fc46006d0e0 2024-09-13T19:38:01.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc46006d0e0 0x7fc46006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:01.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc46006da00 0x7fc46012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48090/0 (socket says 172.21.15.18:48090) 2024-09-13T19:38:01.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45f7fe640 1 -- 172.21.15.18:0/2140801753 learned_addr learned my addr 172.21.15.18:0/2140801753 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:38:01.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45ffff640 1 -- 172.21.15.18:0/2140801753 >> v1:172.21.15.18:6789/0 conn(0x7fc46006da00 legacy=0x7fc46012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:01.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45ffff640 1 -- 172.21.15.18:0/2140801753 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4600709e0 con 0x7fc46006d0e0 2024-09-13T19:38:01.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45ffff640 1 --2- 172.21.15.18:0/2140801753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46006d4c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc450009740 tx=0x7fc45001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafbe0c910d935cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:01.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45effd640 1 -- 172.21.15.18:0/2140801753 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4500b0070 con 0x7fc46006d0e0 2024-09-13T19:38:01.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45effd640 1 -- 172.21.15.18:0/2140801753 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4500ab530 con 0x7fc46006d0e0 2024-09-13T19:38:01.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc45effd640 1 -- 172.21.15.18:0/2140801753 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4500ab830 con 0x7fc46006d0e0 2024-09-13T19:38:01.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc46651d640 1 -- 172.21.15.18:0/2140801753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 msgr2=0x7fc46006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:01.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.745+0000 7fc46651d640 1 --2- 172.21.15.18:0/2140801753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46006d4c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc450009740 tx=0x7fc45001c370 comp rx=0 tx=0).stop 2024-09-13T19:38:01.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- 172.21.15.18:0/2140801753 shutdown_connections 2024-09-13T19:38:01.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 --2- 172.21.15.18:0/2140801753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46006d4c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:01.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- 172.21.15.18:0/2140801753 >> 172.21.15.18:0/2140801753 conn(0x7fc460099a50 msgr2=0x7fc4600972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:38:01.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- 172.21.15.18:0/2140801753 shutdown_connections 2024-09-13T19:38:01.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- 172.21.15.18:0/2140801753 wait complete. 2024-09-13T19:38:01.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 Processor -- start 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- start start 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46012b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc460134e80 con 0x7fc46006d0e0 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46012b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46012b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42420/0 (socket says 172.21.15.18:42420) 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45ffff640 1 -- 172.21.15.18:0/3764071612 learned_addr learned my addr 172.21.15.18:0/3764071612 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45ffff640 1 -- 172.21.15.18:0/3764071612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46012b900 con 0x7fc46006d0e0 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45ffff640 1 --2- 172.21.15.18:0/3764071612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46012b3c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc4500ae040 tx=0x7fc45001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45cff9640 1 -- 172.21.15.18:0/3764071612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4500b0050 con 0x7fc46006d0e0 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45cff9640 1 -- 172.21.15.18:0/3764071612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4500b1040 con 0x7fc46006d0e0 2024-09-13T19:38:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45cff9640 1 -- 172.21.15.18:0/3764071612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4500b5780 con 0x7fc46006d0e0 2024-09-13T19:38:01.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46012bad0 con 0x7fc46006d0e0 2024-09-13T19:38:01.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46012bf90 con 0x7fc46006d0e0 2024-09-13T19:38:01.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45cff9640 1 -- 172.21.15.18:0/3764071612 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4500be030 con 0x7fc46006d0e0 2024-09-13T19:38:01.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45cff9640 1 --2- 172.21.15.18:0/3764071612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc44c035db0 0x7fc44c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:01.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45cff9640 1 -- 172.21.15.18:0/3764071612 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc4500bc070 con 0x7fc46006d0e0 2024-09-13T19:38:01.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc46006d4c0 con 0x7fc46006d0e0 2024-09-13T19:38:01.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.749+0000 7fc45f7fe640 1 --2- 172.21.15.18:0/3764071612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc44c035db0 0x7fc44c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:01.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.753+0000 7fc45f7fe640 1 --2- 172.21.15.18:0/3764071612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc44c035db0 0x7fc44c038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc454001610 tx=0x7fc454007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:01.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.757+0000 7fc45cff9640 1 -- 172.21.15.18:0/3764071612 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4500c5060 con 0x7fc46006d0e0 2024-09-13T19:38:01.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.913+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc460072710 con 0x7fc44c035db0 2024-09-13T19:38:01.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.957+0000 7fc45cff9640 1 -- 172.21.15.18:0/3764071612 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664858 (secure 0 0 0) 0x7fc4540058c0 con 0x7fc44c035db0 2024-09-13T19:38:01.965 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:38:01.975 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:38:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc44c035db0 msgr2=0x7fc44c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 --2- 172.21.15.18:0/3764071612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc44c035db0 0x7fc44c038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc454001610 tx=0x7fc454007ad0 comp rx=0 tx=0).stop 2024-09-13T19:38:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 msgr2=0x7fc46012b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 --2- 172.21.15.18:0/3764071612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46012b3c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc4500ae040 tx=0x7fc45001abb0 comp rx=0 tx=0).stop 2024-09-13T19:38:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 shutdown_connections 2024-09-13T19:38:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 --2- 172.21.15.18:0/3764071612 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fc44c035db0 0x7fc44c038270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 --2- 172.21.15.18:0/3764071612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc46006d0e0 0x7fc46012b3c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 >> 172.21.15.18:0/3764071612 conn(0x7fc460099a50 msgr2=0x7fc46009b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:38:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 shutdown_connections 2024-09-13T19:38:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:01.965+0000 7fc46651d640 1 -- 172.21.15.18:0/3764071612 wait complete. 2024-09-13T19:38:01.993 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-13T19:38:00.548265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5103,"num_read_kb":4688,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4790,"ondisk_log_size":4790,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144192,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343168,"statfs":{"total":386547056640,"available":386399404032,"internally_reserved":0,"allocated":2883584,"data_stored":1722916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006208"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.048263+0000","last_change":"2024-09-13T19:37:33.048322+0000","last_active":"2024-09-13T19:37:33.048263+0000","last_peered":"2024-09-13T19:37:33.048263+0000","last_clean":"2024-09-13T19:37:33.048263+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:37:33.048263+0000","last_undegraded":"2024-09-13T19:37:33.048263+0000","last_fullsized":"2024-09-13T19:37:33.048263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.048081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.048081+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.048081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:51.634204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.602255+0000","last_change":"2024-09-13T19:37:54.602314+0000","last_active":"2024-09-13T19:37:54.602255+0000","last_peered":"2024-09-13T19:37:54.602255+0000","last_clean":"2024-09-13T19:37:54.602255+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:37:54.602255+0000","last_undegraded":"2024-09-13T19:37:54.602255+0000","last_fullsized":"2024-09-13T19:37:54.602255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:54.602013+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:54.602013+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.602013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:18.418246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.210640+0000","last_change":"2024-09-13T19:37:32.210703+0000","last_active":"2024-09-13T19:37:32.210640+0000","last_peered":"2024-09-13T19:37:32.210640+0000","last_clean":"2024-09-13T19:37:32.210640+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:37:32.210640+0000","last_undegraded":"2024-09-13T19:37:32.210640+0000","last_fullsized":"2024-09-13T19:37:32.210640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:32.210444+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:32.210444+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.210444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:10.274425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:24.441692+0000","last_change":"2024-09-13T19:33:49.508985+0000","last_active":"2024-09-13T19:36:24.441692+0000","last_peered":"2024-09-13T19:36:24.441692+0000","last_clean":"2024-09-13T19:36:24.441692+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:36:24.441692+0000","last_undegraded":"2024-09-13T19:36:24.441692+0000","last_fullsized":"2024-09-13T19:36:24.441692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352642+0000","last_change":"2024-09-13T19:33:08.354845+0000","last_active":"2024-09-13T19:37:00.352642+0000","last_peered":"2024-09-13T19:37:00.352642+0000","last_clean":"2024-09-13T19:37:00.352642+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:37:00.352642+0000","last_undegraded":"2024-09-13T19:37:00.352642+0000","last_fullsized":"2024-09-13T19:37:00.352642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.874149+0000","last_change":"2024-09-13T19:37:43.874219+0000","last_active":"2024-09-13T19:37:43.874149+0000","last_peered":"2024-09-13T19:37:43.874149+0000","last_clean":"2024-09-13T19:37:43.874149+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:37:43.874149+0000","last_undegraded":"2024-09-13T19:37:43.874149+0000","last_fullsized":"2024-09-13T19:37:43.874149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:43.873952+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:43.873952+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.873952+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:37.149472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.942566+0000","last_change":"2024-09-13T19:37:43.942694+0000","last_active":"2024-09-13T19:37:43.942566+0000","last_peered":"2024-09-13T19:37:43.942566+0000","last_clean":"2024-09-13T19:37:43.942566+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:37:43.942566+0000","last_undegraded":"2024-09-13T19:37:43.942566+0000","last_fullsized":"2024-09-13T19:37:43.942566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:43.942314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:43.942314+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.942314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:55.792500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.872072+0000","last_change":"2024-09-13T19:37:47.872136+0000","last_active":"2024-09-13T19:37:47.872072+0000","last_peered":"2024-09-13T19:37:47.872072+0000","last_clean":"2024-09-13T19:37:47.872072+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:37:47.872072+0000","last_undegraded":"2024-09-13T19:37:47.872072+0000","last_fullsized":"2024-09-13T19:37:47.872072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:47.871853+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:47.871853+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.871853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:41.399592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507457+0000","last_change":"2024-09-13T19:33:08.336355+0000","last_active":"2024-09-13T19:35:40.507457+0000","last_peered":"2024-09-13T19:35:40.507457+0000","last_clean":"2024-09-13T19:35:40.507457+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:35:40.507457+0000","last_undegraded":"2024-09-13T19:35:40.507457+0000","last_fullsized":"2024-09-13T19:35:40.507457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.501820+0000","last_change":"2024-09-13T19:37:44.501917+0000","last_active":"2024-09-13T19:37:44.501820+0000","last_peered":"2024-09-13T19:37:44.501820+0000","last_clean":"2024-09-13T19:37:44.501820+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:37:44.501820+0000","last_undegraded":"2024-09-13T19:37:44.501820+0000","last_fullsized":"2024-09-13T19:37:44.501820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:44.501619+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:44.501619+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.501619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:32.640242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.068175+0000","last_change":"2024-09-13T19:37:41.068228+0000","last_active":"2024-09-13T19:37:41.068175+0000","last_peered":"2024-09-13T19:37:41.068175+0000","last_clean":"2024-09-13T19:37:41.068175+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:37:41.068175+0000","last_undegraded":"2024-09-13T19:37:41.068175+0000","last_fullsized":"2024-09-13T19:37:41.068175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:41.067989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:41.067989+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.067989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:54.472887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.052391+0000","last_change":"2024-09-13T19:37:20.052391+0000","last_active":"2024-09-13T19:37:20.052391+0000","last_peered":"2024-09-13T19:37:20.052391+0000","last_clean":"2024-09-13T19:37:20.052391+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:37:20.052391+0000","last_undegraded":"2024-09-13T19:37:20.052391+0000","last_fullsized":"2024-09-13T19:37:20.052391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:20.052114+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:20.052114+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.052114+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:18.722062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:40.507188+0000","last_change":"2024-09-13T19:33:08.338158+0000","last_active":"2024-09-13T19:35:40.507188+0000","last_peered":"2024-09-13T19:35:40.507188+0000","last_clean":"2024-09-13T19:35:40.507188+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:35:40.507188+0000","last_undegraded":"2024-09-13T19:35:40.507188+0000","last_fullsized":"2024-09-13T19:35:40.507188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.891639+0000","last_change":"2024-09-13T19:37:20.891706+0000","last_active":"2024-09-13T19:37:20.891639+0000","last_peered":"2024-09-13T19:37:20.891639+0000","last_clean":"2024-09-13T19:37:20.891639+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:37:20.891639+0000","last_undegraded":"2024-09-13T19:37:20.891639+0000","last_fullsized":"2024-09-13T19:37:20.891639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:20.891432+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:20.891432+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.891432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:01.880905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.014503+0000","last_change":"2024-09-13T19:37:52.014562+0000","last_active":"2024-09-13T19:37:52.014503+0000","last_peered":"2024-09-13T19:37:52.014503+0000","last_clean":"2024-09-13T19:37:52.014503+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:37:52.014503+0000","last_undegraded":"2024-09-13T19:37:52.014503+0000","last_fullsized":"2024-09-13T19:37:52.014503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:52.014296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:52.014296+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.014296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:22.126180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.934911+0000","last_change":"2024-09-13T19:37:21.934969+0000","last_active":"2024-09-13T19:37:21.934911+0000","last_peered":"2024-09-13T19:37:21.934911+0000","last_clean":"2024-09-13T19:37:21.934911+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:37:21.934911+0000","last_undegraded":"2024-09-13T19:37:21.934911+0000","last_fullsized":"2024-09-13T19:37:21.934911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:21.934729+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:21.934729+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.934729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:12.436264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.894788+0000","last_change":"2024-09-13T19:37:45.894788+0000","last_active":"2024-09-13T19:37:45.894788+0000","last_peered":"2024-09-13T19:37:45.894788+0000","last_clean":"2024-09-13T19:37:45.894788+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:37:45.894788+0000","last_undegraded":"2024-09-13T19:37:45.894788+0000","last_fullsized":"2024-09-13T19:37:45.894788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:45.894519+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:45.894519+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.894519+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:39.495425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.580592+0000","last_change":"2024-09-13T19:37:53.580592+0000","last_active":"2024-09-13T19:37:53.580592+0000","last_peered":"2024-09-13T19:37:53.580592+0000","last_clean":"2024-09-13T19:37:53.580592+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:37:53.580592+0000","last_undegraded":"2024-09-13T19:37:53.580592+0000","last_fullsized":"2024-09-13T19:37:53.580592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:53.580309+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:53.580309+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.580309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:09.142055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.477714+0000","last_change":"2024-09-13T19:37:34.477714+0000","last_active":"2024-09-13T19:37:34.477714+0000","last_peered":"2024-09-13T19:37:34.477714+0000","last_clean":"2024-09-13T19:37:34.477714+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:37:34.477714+0000","last_undegraded":"2024-09-13T19:37:34.477714+0000","last_fullsized":"2024-09-13T19:37:34.477714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:34.477463+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:34.477463+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.477463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:52.475004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.910580+0000","last_change":"2024-09-13T19:37:26.910580+0000","last_active":"2024-09-13T19:37:26.910580+0000","last_peered":"2024-09-13T19:37:26.910580+0000","last_clean":"2024-09-13T19:37:26.910580+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:37:26.910580+0000","last_undegraded":"2024-09-13T19:37:26.910580+0000","last_fullsized":"2024-09-13T19:37:26.910580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:26.910211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:26.910211+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.910211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:56.864518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.506434+0000","last_change":"2024-09-13T19:37:29.506434+0000","last_active":"2024-09-13T19:37:29.506434+0000","last_peered":"2024-09-13T19:37:29.506434+0000","last_clean":"2024-09-13T19:37:29.506434+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:37:29.506434+0000","last_undegraded":"2024-09-13T19:37:29.506434+0000","last_fullsized":"2024-09-13T19:37:29.506434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:29.506176+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:29.506176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.506176+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:37.784459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.561591+0000","last_change":"2024-09-13T19:37:52.561591+0000","last_active":"2024-09-13T19:37:52.561591+0000","last_peered":"2024-09-13T19:37:52.561591+0000","last_clean":"2024-09-13T19:37:52.561591+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:37:52.561591+0000","last_undegraded":"2024-09-13T19:37:52.561591+0000","last_fullsized":"2024-09-13T19:37:52.561591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:52.561338+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:52.561338+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.561338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.056750+0000","last_change":"2024-09-13T19:37:45.056750+0000","last_active":"2024-09-13T19:37:45.056750+0000","last_peered":"2024-09-13T19:37:45.056750+0000","last_clean":"2024-09-13T19:37:45.056750+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:37:45.056750+0000","last_undegraded":"2024-09-13T19:37:45.056750+0000","last_fullsized":"2024-09-13T19:37:45.056750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:45.056474+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:45.056474+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.056474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:36.206327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.504678+0000","last_change":"2024-09-13T19:37:48.504678+0000","last_active":"2024-09-13T19:37:48.504678+0000","last_peered":"2024-09-13T19:37:48.504678+0000","last_clean":"2024-09-13T19:37:48.504678+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:37:48.504678+0000","last_undegraded":"2024-09-13T19:37:48.504678+0000","last_fullsized":"2024-09-13T19:37:48.504678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:48.504384+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:48.504384+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.504384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:42.588829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.955812+0000","last_change":"2024-09-13T19:37:45.955812+0000","last_active":"2024-09-13T19:37:45.955812+0000","last_peered":"2024-09-13T19:37:45.955812+0000","last_clean":"2024-09-13T19:37:45.955812+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:37:45.955812+0000","last_undegraded":"2024-09-13T19:37:45.955812+0000","last_fullsized":"2024-09-13T19:37:45.955812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:45.955540+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:45.955540+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.955540+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:18.197814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.033559+0000","last_change":"2024-09-13T19:37:44.033559+0000","last_active":"2024-09-13T19:37:44.033559+0000","last_peered":"2024-09-13T19:37:44.033559+0000","last_clean":"2024-09-13T19:37:44.033559+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:37:44.033559+0000","last_undegraded":"2024-09-13T19:37:44.033559+0000","last_fullsized":"2024-09-13T19:37:44.033559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:44.033185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:44.033185+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.033185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:32.171808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.487343+0000","last_change":"2024-09-13T19:37:40.487343+0000","last_active":"2024-09-13T19:37:40.487343+0000","last_peered":"2024-09-13T19:37:40.487343+0000","last_clean":"2024-09-13T19:37:40.487343+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:37:40.487343+0000","last_undegraded":"2024-09-13T19:37:40.487343+0000","last_fullsized":"2024-09-13T19:37:40.487343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-13T19:37:40.486977+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-13T19:37:40.486977+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.486977+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:46.217708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.707576+0000","last_change":"2024-09-13T19:37:57.707631+0000","last_active":"2024-09-13T19:37:57.707576+0000","last_peered":"2024-09-13T19:37:57.707576+0000","last_clean":"2024-09-13T19:37:57.707576+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:37:57.707576+0000","last_undegraded":"2024-09-13T19:37:57.707576+0000","last_fullsized":"2024-09-13T19:37:57.707576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:57.707380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:57.707380+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.707380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:31.582933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'38","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.620260+0000","last_change":"2024-09-13T19:37:24.620329+0000","last_active":"2024-09-13T19:37:24.620260+0000","last_peered":"2024-09-13T19:37:24.620260+0000","last_clean":"2024-09-13T19:37:24.620260+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:37:24.620260+0000","last_undegraded":"2024-09-13T19:37:24.620260+0000","last_fullsized":"2024-09-13T19:37:24.620260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:24.620070+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:24.620070+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.620070+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.852503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.924828+0000","last_change":"2024-09-13T19:37:35.924828+0000","last_active":"2024-09-13T19:37:35.924828+0000","last_peered":"2024-09-13T19:37:35.924828+0000","last_clean":"2024-09-13T19:37:35.924828+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:37:35.924828+0000","last_undegraded":"2024-09-13T19:37:35.924828+0000","last_fullsized":"2024-09-13T19:37:35.924828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:35.924562+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:35.924562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.924562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:06.221435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351957+0000","last_change":"2024-09-13T19:33:08.354352+0000","last_active":"2024-09-13T19:37:00.351957+0000","last_peered":"2024-09-13T19:37:00.351957+0000","last_clean":"2024-09-13T19:37:00.351957+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:37:00.351957+0000","last_undegraded":"2024-09-13T19:37:00.351957+0000","last_fullsized":"2024-09-13T19:37:00.351957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.123239+0000","last_change":"2024-09-13T19:37:10.123297+0000","last_active":"2024-09-13T19:37:10.123239+0000","last_peered":"2024-09-13T19:37:10.123239+0000","last_clean":"2024-09-13T19:37:10.123239+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:37:10.123239+0000","last_undegraded":"2024-09-13T19:37:10.123239+0000","last_fullsized":"2024-09-13T19:37:10.123239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.123041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:12.989516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.993769+0000","last_change":"2024-09-13T19:37:31.993844+0000","last_active":"2024-09-13T19:37:31.993769+0000","last_peered":"2024-09-13T19:37:31.993769+0000","last_clean":"2024-09-13T19:37:31.993769+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:37:31.993769+0000","last_undegraded":"2024-09-13T19:37:31.993769+0000","last_fullsized":"2024-09-13T19:37:31.993769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:31.993552+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:31.993552+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.993552+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.328726+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.502465+0000","last_change":"2024-09-13T19:37:00.502515+0000","last_active":"2024-09-13T19:37:00.502465+0000","last_peered":"2024-09-13T19:37:00.502465+0000","last_clean":"2024-09-13T19:37:00.502465+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:37:00.502465+0000","last_undegraded":"2024-09-13T19:37:00.502465+0000","last_fullsized":"2024-09-13T19:37:00.502465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.502274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:43.889848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.582211+0000","last_change":"2024-09-13T19:37:16.582272+0000","last_active":"2024-09-13T19:37:16.582211+0000","last_peered":"2024-09-13T19:37:16.582211+0000","last_clean":"2024-09-13T19:37:16.582211+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:37:16.582211+0000","last_undegraded":"2024-09-13T19:37:16.582211+0000","last_fullsized":"2024-09-13T19:37:16.582211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-13T19:37:16.582006+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-13T19:37:16.582006+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.582006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:42.046488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.917995+0000","last_change":"2024-09-13T19:37:39.917995+0000","last_active":"2024-09-13T19:37:39.917995+0000","last_peered":"2024-09-13T19:37:39.917995+0000","last_clean":"2024-09-13T19:37:39.917995+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:37:39.917995+0000","last_undegraded":"2024-09-13T19:37:39.917995+0000","last_fullsized":"2024-09-13T19:37:39.917995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:39.917704+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:39.917704+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.917704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:51.364335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.969945+0000","last_change":"2024-09-13T19:37:44.969945+0000","last_active":"2024-09-13T19:37:44.969945+0000","last_peered":"2024-09-13T19:37:44.969945+0000","last_clean":"2024-09-13T19:37:44.969945+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:37:44.969945+0000","last_undegraded":"2024-09-13T19:37:44.969945+0000","last_fullsized":"2024-09-13T19:37:44.969945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:44.969547+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:44.969547+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.969547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:09:58.625718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:10.511887+0000","last_change":"2024-09-13T19:33:49.525696+0000","last_active":"2024-09-13T19:36:10.511887+0000","last_peered":"2024-09-13T19:36:10.511887+0000","last_clean":"2024-09-13T19:36:10.511887+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:36:10.511887+0000","last_undegraded":"2024-09-13T19:36:10.511887+0000","last_fullsized":"2024-09-13T19:36:10.511887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.502616+0000","last_change":"2024-09-13T19:37:10.502701+0000","last_active":"2024-09-13T19:37:10.502616+0000","last_peered":"2024-09-13T19:37:10.502616+0000","last_clean":"2024-09-13T19:37:10.502616+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:37:10.502616+0000","last_undegraded":"2024-09-13T19:37:10.502616+0000","last_fullsized":"2024-09-13T19:37:10.502616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.502401+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:01.003936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.551502+0000","last_change":"2024-09-13T19:37:04.551561+0000","last_active":"2024-09-13T19:37:04.551502+0000","last_peered":"2024-09-13T19:37:04.551502+0000","last_clean":"2024-09-13T19:37:04.551502+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:37:04.551502+0000","last_undegraded":"2024-09-13T19:37:04.551502+0000","last_fullsized":"2024-09-13T19:37:04.551502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.551265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.460322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.175436+0000","last_change":"2024-09-13T19:37:57.175506+0000","last_active":"2024-09-13T19:37:57.175436+0000","last_peered":"2024-09-13T19:37:57.175436+0000","last_clean":"2024-09-13T19:37:57.175436+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:37:57.175436+0000","last_undegraded":"2024-09-13T19:37:57.175436+0000","last_fullsized":"2024-09-13T19:37:57.175436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:57.175229+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:57.175229+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.175229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:31.384558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.904559+0000","last_change":"2024-09-13T19:37:41.904559+0000","last_active":"2024-09-13T19:37:41.904559+0000","last_peered":"2024-09-13T19:37:41.904559+0000","last_clean":"2024-09-13T19:37:41.904559+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:37:41.904559+0000","last_undegraded":"2024-09-13T19:37:41.904559+0000","last_fullsized":"2024-09-13T19:37:41.904559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:41.904294+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:41.904294+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.904294+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:31.261094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352196+0000","last_change":"2024-09-13T19:33:08.355253+0000","last_active":"2024-09-13T19:37:00.352196+0000","last_peered":"2024-09-13T19:37:00.352196+0000","last_clean":"2024-09-13T19:37:00.352196+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:37:00.352196+0000","last_undegraded":"2024-09-13T19:37:00.352196+0000","last_fullsized":"2024-09-13T19:37:00.352196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.320659+0000","last_change":"2024-09-13T19:37:19.320730+0000","last_active":"2024-09-13T19:37:19.320659+0000","last_peered":"2024-09-13T19:37:19.320659+0000","last_clean":"2024-09-13T19:37:19.320659+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:37:19.320659+0000","last_undegraded":"2024-09-13T19:37:19.320659+0000","last_fullsized":"2024-09-13T19:37:19.320659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.320446+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:11.577834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.894258+0000","last_change":"2024-09-13T19:37:02.894258+0000","last_active":"2024-09-13T19:37:02.894258+0000","last_peered":"2024-09-13T19:37:02.894258+0000","last_clean":"2024-09-13T19:37:02.894258+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:37:02.894258+0000","last_undegraded":"2024-09-13T19:37:02.894258+0000","last_fullsized":"2024-09-13T19:37:02.894258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.893973+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:18.869439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.036366+0000","last_change":"2024-09-13T19:37:24.036435+0000","last_active":"2024-09-13T19:37:24.036366+0000","last_peered":"2024-09-13T19:37:24.036366+0000","last_clean":"2024-09-13T19:37:24.036366+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:37:24.036366+0000","last_undegraded":"2024-09-13T19:37:24.036366+0000","last_fullsized":"2024-09-13T19:37:24.036366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:24.036142+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:24.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.036142+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:55.593216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.949478+0000","last_change":"2024-09-13T19:37:48.949535+0000","last_active":"2024-09-13T19:37:48.949478+0000","last_peered":"2024-09-13T19:37:48.949478+0000","last_clean":"2024-09-13T19:37:48.949478+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:37:48.949478+0000","last_undegraded":"2024-09-13T19:37:48.949478+0000","last_fullsized":"2024-09-13T19:37:48.949478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:48.949281+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:48.949281+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.949281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:51.123045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.092390+0000","last_change":"2024-09-13T19:37:55.092390+0000","last_active":"2024-09-13T19:37:55.092390+0000","last_peered":"2024-09-13T19:37:55.092390+0000","last_clean":"2024-09-13T19:37:55.092390+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:37:55.092390+0000","last_undegraded":"2024-09-13T19:37:55.092390+0000","last_fullsized":"2024-09-13T19:37:55.092390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:55.092086+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:55.092086+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.092086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:47.647736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.552036+0000","last_change":"2024-09-13T19:37:51.552097+0000","last_active":"2024-09-13T19:37:51.552036+0000","last_peered":"2024-09-13T19:37:51.552036+0000","last_clean":"2024-09-13T19:37:51.552036+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:37:51.552036+0000","last_undegraded":"2024-09-13T19:37:51.552036+0000","last_fullsized":"2024-09-13T19:37:51.552036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:51.551850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:51.551850+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.551850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:16.887024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.109757+0000","last_change":"2024-09-13T19:37:08.109820+0000","last_active":"2024-09-13T19:37:08.109757+0000","last_peered":"2024-09-13T19:37:08.109757+0000","last_clean":"2024-09-13T19:37:08.109757+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:37:08.109757+0000","last_undegraded":"2024-09-13T19:37:08.109757+0000","last_fullsized":"2024-09-13T19:37:08.109757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.109562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.916198+0000","last_change":"2024-09-13T19:37:04.916276+0000","last_active":"2024-09-13T19:37:04.916198+0000","last_peered":"2024-09-13T19:37:04.916198+0000","last_clean":"2024-09-13T19:37:04.916198+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:37:04.916198+0000","last_undegraded":"2024-09-13T19:37:04.916198+0000","last_fullsized":"2024-09-13T19:37:04.916198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.915985+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:53.420288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.239330+0000","last_change":"2024-09-13T19:37:21.239330+0000","last_active":"2024-09-13T19:37:21.239330+0000","last_peered":"2024-09-13T19:37:21.239330+0000","last_clean":"2024-09-13T19:37:21.239330+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:37:21.239330+0000","last_undegraded":"2024-09-13T19:37:21.239330+0000","last_fullsized":"2024-09-13T19:37:21.239330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:21.239082+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:21.239082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.239082+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:39.825205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.937814+0000","last_change":"2024-09-13T19:37:32.937966+0000","last_active":"2024-09-13T19:37:32.937814+0000","last_peered":"2024-09-13T19:37:32.937814+0000","last_clean":"2024-09-13T19:37:32.937814+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:37:32.937814+0000","last_undegraded":"2024-09-13T19:37:32.937814+0000","last_fullsized":"2024-09-13T19:37:32.937814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:32.937538+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:32.937538+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.937538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:49.829336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.990830+0000","last_change":"2024-09-13T19:37:42.990896+0000","last_active":"2024-09-13T19:37:42.990830+0000","last_peered":"2024-09-13T19:37:42.990830+0000","last_clean":"2024-09-13T19:37:42.990830+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:37:42.990830+0000","last_undegraded":"2024-09-13T19:37:42.990830+0000","last_fullsized":"2024-09-13T19:37:42.990830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:42.990615+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:42.990615+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.990615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:21.054596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.520028+0000","last_change":"2024-09-13T19:37:14.520028+0000","last_active":"2024-09-13T19:37:14.520028+0000","last_peered":"2024-09-13T19:37:14.520028+0000","last_clean":"2024-09-13T19:37:14.520028+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:37:14.520028+0000","last_undegraded":"2024-09-13T19:37:14.520028+0000","last_fullsized":"2024-09-13T19:37:14.520028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.519779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:02.289326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.958861+0000","last_change":"2024-09-13T19:37:06.958861+0000","last_active":"2024-09-13T19:37:06.958861+0000","last_peered":"2024-09-13T19:37:06.958861+0000","last_clean":"2024-09-13T19:37:06.958861+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:37:06.958861+0000","last_undegraded":"2024-09-13T19:37:06.958861+0000","last_fullsized":"2024-09-13T19:37:06.958861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.958579+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:36.686521+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.385193+0000","last_change":"2024-09-13T19:37:04.385193+0000","last_active":"2024-09-13T19:37:04.385193+0000","last_peered":"2024-09-13T19:37:04.385193+0000","last_clean":"2024-09-13T19:37:04.385193+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:37:04.385193+0000","last_undegraded":"2024-09-13T19:37:04.385193+0000","last_fullsized":"2024-09-13T19:37:04.385193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.384941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.293998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.904564+0000","last_change":"2024-09-13T19:37:49.904631+0000","last_active":"2024-09-13T19:37:49.904564+0000","last_peered":"2024-09-13T19:37:49.904564+0000","last_clean":"2024-09-13T19:37:49.904564+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:37:49.904564+0000","last_undegraded":"2024-09-13T19:37:49.904564+0000","last_fullsized":"2024-09-13T19:37:49.904564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:49.904383+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:49.904383+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.904383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:18.998987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.481235+0000","last_change":"2024-09-13T19:37:38.481358+0000","last_active":"2024-09-13T19:37:38.481235+0000","last_peered":"2024-09-13T19:37:38.481235+0000","last_clean":"2024-09-13T19:37:38.481235+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:37:38.481235+0000","last_undegraded":"2024-09-13T19:37:38.481235+0000","last_fullsized":"2024-09-13T19:37:38.481235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:38.480942+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:38.480942+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.480942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:38.661510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.067867+0000","last_change":"2024-09-13T19:37:35.067867+0000","last_active":"2024-09-13T19:37:35.067867+0000","last_peered":"2024-09-13T19:37:35.067867+0000","last_clean":"2024-09-13T19:37:35.067867+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:37:35.067867+0000","last_undegraded":"2024-09-13T19:37:35.067867+0000","last_fullsized":"2024-09-13T19:37:35.067867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:35.067634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:35.067634+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.067634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:35.696369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.247615+0000","last_change":"2024-09-13T19:37:23.247615+0000","last_active":"2024-09-13T19:37:23.247615+0000","last_peered":"2024-09-13T19:37:23.247615+0000","last_clean":"2024-09-13T19:37:23.247615+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:37:23.247615+0000","last_undegraded":"2024-09-13T19:37:23.247615+0000","last_fullsized":"2024-09-13T19:37:23.247615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:23.247331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:23.247331+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.247331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:14.966141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.020012+0000","last_change":"2024-09-13T19:37:28.020012+0000","last_active":"2024-09-13T19:37:28.020012+0000","last_peered":"2024-09-13T19:37:28.020012+0000","last_clean":"2024-09-13T19:37:28.020012+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:37:28.020012+0000","last_undegraded":"2024-09-13T19:37:28.020012+0000","last_fullsized":"2024-09-13T19:37:28.020012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:28.019573+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:28.019573+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.019573+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:49.017132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.277843+0000","last_change":"2024-09-13T19:37:01.277843+0000","last_active":"2024-09-13T19:37:01.277843+0000","last_peered":"2024-09-13T19:37:01.277843+0000","last_clean":"2024-09-13T19:37:01.277843+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:37:01.277843+0000","last_undegraded":"2024-09-13T19:37:01.277843+0000","last_fullsized":"2024-09-13T19:37:01.277843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.277591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:47.650563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.546916+0000","last_change":"2024-09-13T19:37:28.546916+0000","last_active":"2024-09-13T19:37:28.546916+0000","last_peered":"2024-09-13T19:37:28.546916+0000","last_clean":"2024-09-13T19:37:28.546916+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:37:28.546916+0000","last_undegraded":"2024-09-13T19:37:28.546916+0000","last_fullsized":"2024-09-13T19:37:28.546916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:28.546498+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:28.546498+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.546498+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.520168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.887692+0000","last_change":"2024-09-13T19:37:22.887692+0000","last_active":"2024-09-13T19:37:22.887692+0000","last_peered":"2024-09-13T19:37:22.887692+0000","last_clean":"2024-09-13T19:37:22.887692+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:37:22.887692+0000","last_undegraded":"2024-09-13T19:37:22.887692+0000","last_fullsized":"2024-09-13T19:37:22.887692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:22.887344+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:22.887344+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.887344+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:40.009897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.727579+0000","last_change":"2024-09-13T19:37:55.727632+0000","last_active":"2024-09-13T19:37:55.727579+0000","last_peered":"2024-09-13T19:37:55.727579+0000","last_clean":"2024-09-13T19:37:55.727579+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:37:55.727579+0000","last_undegraded":"2024-09-13T19:37:55.727579+0000","last_fullsized":"2024-09-13T19:37:55.727579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:55.727386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:55.727386+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.727386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:43.901184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.272682+0000","last_change":"2024-09-13T19:37:22.272682+0000","last_active":"2024-09-13T19:37:22.272682+0000","last_peered":"2024-09-13T19:37:22.272682+0000","last_clean":"2024-09-13T19:37:22.272682+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:37:22.272682+0000","last_undegraded":"2024-09-13T19:37:22.272682+0000","last_fullsized":"2024-09-13T19:37:22.272682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:22.272435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:22.272435+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.272435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:06.134902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.088355+0000","last_change":"2024-09-13T19:37:03.088355+0000","last_active":"2024-09-13T19:37:03.088355+0000","last_peered":"2024-09-13T19:37:03.088355+0000","last_clean":"2024-09-13T19:37:03.088355+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:37:03.088355+0000","last_undegraded":"2024-09-13T19:37:03.088355+0000","last_fullsized":"2024-09-13T19:37:03.088355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.087975+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:03.716710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.338036+0000","last_change":"2024-09-13T19:37:05.338036+0000","last_active":"2024-09-13T19:37:05.338036+0000","last_peered":"2024-09-13T19:37:05.338036+0000","last_clean":"2024-09-13T19:37:05.338036+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:37:05.338036+0000","last_undegraded":"2024-09-13T19:37:05.338036+0000","last_fullsized":"2024-09-13T19:37:05.338036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.337780+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.947112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:58.911165+0000","last_change":"2024-09-13T19:33:18.416155+0000","last_active":"2024-09-13T19:36:58.911165+0000","last_peered":"2024-09-13T19:36:58.911165+0000","last_clean":"2024-09-13T19:36:58.911165+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:36:58.911165+0000","last_undegraded":"2024-09-13T19:36:58.911165+0000","last_fullsized":"2024-09-13T19:36:58.911165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.095511+0000","last_change":"2024-09-13T19:37:36.095511+0000","last_active":"2024-09-13T19:37:36.095511+0000","last_peered":"2024-09-13T19:37:36.095511+0000","last_clean":"2024-09-13T19:37:36.095511+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:37:36.095511+0000","last_undegraded":"2024-09-13T19:37:36.095511+0000","last_fullsized":"2024-09-13T19:37:36.095511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:36.095267+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:36.095267+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.095267+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:11.327700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.595782+0000","last_change":"2024-09-13T19:37:59.595896+0000","last_active":"2024-09-13T19:37:59.595782+0000","last_peered":"2024-09-13T19:37:59.595782+0000","last_clean":"2024-09-13T19:37:59.595782+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:37:59.595782+0000","last_undegraded":"2024-09-13T19:37:59.595782+0000","last_fullsized":"2024-09-13T19:37:59.595782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:59.595453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:59.595453+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.595453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:11.042084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.198989+0000","last_change":"2024-09-13T19:37:24.198989+0000","last_active":"2024-09-13T19:37:24.198989+0000","last_peered":"2024-09-13T19:37:24.198989+0000","last_clean":"2024-09-13T19:37:24.198989+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:37:24.198989+0000","last_undegraded":"2024-09-13T19:37:24.198989+0000","last_fullsized":"2024-09-13T19:37:24.198989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:24.198733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:24.198733+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.198733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.431165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'64","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.075367+0000","last_change":"2024-09-13T19:37:07.075367+0000","last_active":"2024-09-13T19:37:07.075367+0000","last_peered":"2024-09-13T19:37:07.075367+0000","last_clean":"2024-09-13T19:37:07.075367+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:37:07.075367+0000","last_undegraded":"2024-09-13T19:37:07.075367+0000","last_fullsized":"2024-09-13T19:37:07.075367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'64","last_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_deep_scrub":"32'64","last_deep_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.075082+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:36.529696+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.200714+0000","last_change":"2024-09-13T19:37:13.200714+0000","last_active":"2024-09-13T19:37:13.200714+0000","last_peered":"2024-09-13T19:37:13.200714+0000","last_clean":"2024-09-13T19:37:13.200714+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:37:13.200714+0000","last_undegraded":"2024-09-13T19:37:13.200714+0000","last_fullsized":"2024-09-13T19:37:13.200714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.200465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:35.576125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'23","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.239795+0000","last_change":"2024-09-13T19:37:29.239795+0000","last_active":"2024-09-13T19:37:29.239795+0000","last_peered":"2024-09-13T19:37:29.239795+0000","last_clean":"2024-09-13T19:37:29.239795+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:37:29.239795+0000","last_undegraded":"2024-09-13T19:37:29.239795+0000","last_fullsized":"2024-09-13T19:37:29.239795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-09-13T19:37:29.239551+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-09-13T19:37:29.239551+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.239551+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:37.517834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.384380+0000","last_change":"2024-09-13T19:33:49.534836+0000","last_active":"2024-09-13T19:36:59.384380+0000","last_peered":"2024-09-13T19:36:59.384380+0000","last_clean":"2024-09-13T19:36:59.384380+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:36:59.384380+0000","last_undegraded":"2024-09-13T19:36:59.384380+0000","last_fullsized":"2024-09-13T19:36:59.384380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:09.306612+0000","last_clean_scrub_stamp":"2024-09-13T19:33:09.306612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.046281+0000","last_change":"2024-09-13T19:37:53.046344+0000","last_active":"2024-09-13T19:37:53.046281+0000","last_peered":"2024-09-13T19:37:53.046281+0000","last_clean":"2024-09-13T19:37:53.046281+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:37:53.046281+0000","last_undegraded":"2024-09-13T19:37:53.046281+0000","last_fullsized":"2024-09-13T19:37:53.046281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:53.046085+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:53.046085+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.046085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.907868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.831206+0000","last_change":"2024-09-13T19:37:13.831206+0000","last_active":"2024-09-13T19:37:13.831206+0000","last_peered":"2024-09-13T19:37:13.831206+0000","last_clean":"2024-09-13T19:37:13.831206+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:37:13.831206+0000","last_undegraded":"2024-09-13T19:37:13.831206+0000","last_fullsized":"2024-09-13T19:37:13.831206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.830975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:27.492677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.520047+0000","last_change":"2024-09-13T19:37:09.520047+0000","last_active":"2024-09-13T19:37:09.520047+0000","last_peered":"2024-09-13T19:37:09.520047+0000","last_clean":"2024-09-13T19:37:09.520047+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:37:09.520047+0000","last_undegraded":"2024-09-13T19:37:09.520047+0000","last_fullsized":"2024-09-13T19:37:09.520047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.519587+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:50.509060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.886815+0000","last_change":"2024-09-13T19:37:34.886815+0000","last_active":"2024-09-13T19:37:34.886815+0000","last_peered":"2024-09-13T19:37:34.886815+0000","last_clean":"2024-09-13T19:37:34.886815+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:37:34.886815+0000","last_undegraded":"2024-09-13T19:37:34.886815+0000","last_fullsized":"2024-09-13T19:37:34.886815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:34.886569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:34.886569+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.886569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:58.702803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.355187+0000","last_change":"2024-09-13T19:33:18.415707+0000","last_active":"2024-09-13T19:37:00.355187+0000","last_peered":"2024-09-13T19:37:00.355187+0000","last_clean":"2024-09-13T19:37:00.355187+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:37:00.355187+0000","last_undegraded":"2024-09-13T19:37:00.355187+0000","last_fullsized":"2024-09-13T19:37:00.355187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.160708+0000","last_change":"2024-09-13T19:37:14.160708+0000","last_active":"2024-09-13T19:37:14.160708+0000","last_peered":"2024-09-13T19:37:14.160708+0000","last_clean":"2024-09-13T19:37:14.160708+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:37:14.160708+0000","last_undegraded":"2024-09-13T19:37:14.160708+0000","last_fullsized":"2024-09-13T19:37:14.160708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.160448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:32.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.773000+0000","last_change":"2024-09-13T19:37:54.773065+0000","last_active":"2024-09-13T19:37:54.773000+0000","last_peered":"2024-09-13T19:37:54.773000+0000","last_clean":"2024-09-13T19:37:54.773000+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:37:54.773000+0000","last_undegraded":"2024-09-13T19:37:54.773000+0000","last_fullsized":"2024-09-13T19:37:54.773000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:54.772792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:54.772792+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.772792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:07.999598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.282076+0000","last_change":"2024-09-13T19:37:20.282076+0000","last_active":"2024-09-13T19:37:20.282076+0000","last_peered":"2024-09-13T19:37:20.282076+0000","last_clean":"2024-09-13T19:37:20.282076+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:37:20.282076+0000","last_undegraded":"2024-09-13T19:37:20.282076+0000","last_fullsized":"2024-09-13T19:37:20.282076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:20.281828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:20.281828+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.281828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:26.429181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.844787+0000","last_change":"2024-09-13T19:37:10.844787+0000","last_active":"2024-09-13T19:37:10.844787+0000","last_peered":"2024-09-13T19:37:10.844787+0000","last_clean":"2024-09-13T19:37:10.844787+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:37:10.844787+0000","last_undegraded":"2024-09-13T19:37:10.844787+0000","last_fullsized":"2024-09-13T19:37:10.844787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.844519+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:16.097647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.934519+0000","last_change":"2024-09-13T19:37:07.934519+0000","last_active":"2024-09-13T19:37:07.934519+0000","last_peered":"2024-09-13T19:37:07.934519+0000","last_clean":"2024-09-13T19:37:07.934519+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:37:07.934519+0000","last_undegraded":"2024-09-13T19:37:07.934519+0000","last_fullsized":"2024-09-13T19:37:07.934519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.934270+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:17.446351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.190148+0000","last_change":"2024-09-13T19:37:59.190217+0000","last_active":"2024-09-13T19:37:59.190148+0000","last_peered":"2024-09-13T19:37:59.190148+0000","last_clean":"2024-09-13T19:37:59.190148+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:37:59.190148+0000","last_undegraded":"2024-09-13T19:37:59.190148+0000","last_fullsized":"2024-09-13T19:37:59.190148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:59.189958+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:59.189958+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.189958+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:51.359000+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.897513+0000","last_change":"2024-09-13T19:37:23.897513+0000","last_active":"2024-09-13T19:37:23.897513+0000","last_peered":"2024-09-13T19:37:23.897513+0000","last_clean":"2024-09-13T19:37:23.897513+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:37:23.897513+0000","last_undegraded":"2024-09-13T19:37:23.897513+0000","last_fullsized":"2024-09-13T19:37:23.897513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:23.897240+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:23.897240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.897240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:28.019969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.816139+0000","last_change":"2024-09-13T19:37:51.816204+0000","last_active":"2024-09-13T19:37:51.816139+0000","last_peered":"2024-09-13T19:37:51.816139+0000","last_clean":"2024-09-13T19:37:51.816139+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:37:51.816139+0000","last_undegraded":"2024-09-13T19:37:51.816139+0000","last_fullsized":"2024-09-13T19:37:51.816139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:51.815920+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:51.815920+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.815920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:01.692044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.585204+0000","last_change":"2024-09-13T19:37:17.585204+0000","last_active":"2024-09-13T19:37:17.585204+0000","last_peered":"2024-09-13T19:37:17.585204+0000","last_clean":"2024-09-13T19:37:17.585204+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:37:17.585204+0000","last_undegraded":"2024-09-13T19:37:17.585204+0000","last_fullsized":"2024-09-13T19:37:17.585204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:17.584949+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:17.584949+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.584949+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:44.456695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.992249+0000","last_change":"2024-09-13T19:37:25.992249+0000","last_active":"2024-09-13T19:37:25.992249+0000","last_peered":"2024-09-13T19:37:25.992249+0000","last_clean":"2024-09-13T19:37:25.992249+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:37:25.992249+0000","last_undegraded":"2024-09-13T19:37:25.992249+0000","last_fullsized":"2024-09-13T19:37:25.992249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:25.991984+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:25.991984+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.991984+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:34.178024+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":473,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.467344+0000","last_change":"2024-09-13T19:37:01.467344+0000","last_active":"2024-09-13T19:37:01.467344+0000","last_peered":"2024-09-13T19:37:01.467344+0000","last_clean":"2024-09-13T19:37:01.467344+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:37:01.467344+0000","last_undegraded":"2024-09-13T19:37:01.467344+0000","last_fullsized":"2024-09-13T19:37:01.467344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.467091+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:04.385381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.905199+0000","last_change":"2024-09-13T19:37:19.905199+0000","last_active":"2024-09-13T19:37:19.905199+0000","last_peered":"2024-09-13T19:37:19.905199+0000","last_clean":"2024-09-13T19:37:19.905199+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:37:19.905199+0000","last_undegraded":"2024-09-13T19:37:19.905199+0000","last_fullsized":"2024-09-13T19:37:19.905199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.904819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:30.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.439047+0000","last_change":"2024-09-13T19:37:36.439047+0000","last_active":"2024-09-13T19:37:36.439047+0000","last_peered":"2024-09-13T19:37:36.439047+0000","last_clean":"2024-09-13T19:37:36.439047+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:37:36.439047+0000","last_undegraded":"2024-09-13T19:37:36.439047+0000","last_fullsized":"2024-09-13T19:37:36.439047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:36.438801+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:36.438801+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.438801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:08.256631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.798837+0000","last_change":"2024-09-13T19:37:53.798900+0000","last_active":"2024-09-13T19:37:53.798837+0000","last_peered":"2024-09-13T19:37:53.798837+0000","last_clean":"2024-09-13T19:37:53.798837+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:37:53.798837+0000","last_undegraded":"2024-09-13T19:37:53.798837+0000","last_fullsized":"2024-09-13T19:37:53.798837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:53.798611+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:53.798611+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.798611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:54.032519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.118554+0000","last_change":"2024-09-13T19:37:02.118554+0000","last_active":"2024-09-13T19:37:02.118554+0000","last_peered":"2024-09-13T19:37:02.118554+0000","last_clean":"2024-09-13T19:37:02.118554+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:37:02.118554+0000","last_undegraded":"2024-09-13T19:37:02.118554+0000","last_fullsized":"2024-09-13T19:37:02.118554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.118290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:01.693866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.542034+0000","last_change":"2024-09-13T19:37:11.542034+0000","last_active":"2024-09-13T19:37:11.542034+0000","last_peered":"2024-09-13T19:37:11.542034+0000","last_clean":"2024-09-13T19:37:11.542034+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:37:11.542034+0000","last_undegraded":"2024-09-13T19:37:11.542034+0000","last_fullsized":"2024-09-13T19:37:11.542034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.541770+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:28.664323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.819618+0000","last_change":"2024-09-13T19:37:15.819618+0000","last_active":"2024-09-13T19:37:15.819618+0000","last_peered":"2024-09-13T19:37:15.819618+0000","last_clean":"2024-09-13T19:37:15.819618+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:37:15.819618+0000","last_undegraded":"2024-09-13T19:37:15.819618+0000","last_fullsized":"2024-09-13T19:37:15.819618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.819343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:17.226606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.492524+0000","last_change":"2024-09-13T19:37:08.492524+0000","last_active":"2024-09-13T19:37:08.492524+0000","last_peered":"2024-09-13T19:37:08.492524+0000","last_clean":"2024-09-13T19:37:08.492524+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:37:08.492524+0000","last_undegraded":"2024-09-13T19:37:08.492524+0000","last_fullsized":"2024-09-13T19:37:08.492524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.492240+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.753771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.119769+0000","last_change":"2024-09-13T19:37:17.119769+0000","last_active":"2024-09-13T19:37:17.119769+0000","last_peered":"2024-09-13T19:37:17.119769+0000","last_clean":"2024-09-13T19:37:17.119769+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:37:17.119769+0000","last_undegraded":"2024-09-13T19:37:17.119769+0000","last_fullsized":"2024-09-13T19:37:17.119769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.119389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.119389+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.119389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:39.478375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":213,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.502371+0000","last_change":"2024-09-13T19:37:46.502551+0000","last_active":"2024-09-13T19:37:46.502371+0000","last_peered":"2024-09-13T19:37:46.502371+0000","last_clean":"2024-09-13T19:37:46.502371+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:37:46.502371+0000","last_undegraded":"2024-09-13T19:37:46.502371+0000","last_fullsized":"2024-09-13T19:37:46.502371+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-09-13T19:37:46.502154+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-09-13T19:37:46.502154+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.502154+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:49.502193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351769+0000","last_change":"2024-09-13T19:33:02.523597+0000","last_active":"2024-09-13T19:37:00.351769+0000","last_peered":"2024-09-13T19:37:00.351769+0000","last_clean":"2024-09-13T19:37:00.351769+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:37:00.351769+0000","last_undegraded":"2024-09-13T19:37:00.351769+0000","last_fullsized":"2024-09-13T19:37:00.351769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.688999+0000","last_change":"2024-09-13T19:37:56.689057+0000","last_active":"2024-09-13T19:37:56.688999+0000","last_peered":"2024-09-13T19:37:56.688999+0000","last_clean":"2024-09-13T19:37:56.688999+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:37:56.688999+0000","last_undegraded":"2024-09-13T19:37:56.688999+0000","last_fullsized":"2024-09-13T19:37:56.688999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:56.688803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:56.688803+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.688803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:31.856369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.618879+0000","last_change":"2024-09-13T19:37:58.618932+0000","last_active":"2024-09-13T19:37:58.618879+0000","last_peered":"2024-09-13T19:37:58.618879+0000","last_clean":"2024-09-13T19:37:58.618879+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:37:58.618879+0000","last_undegraded":"2024-09-13T19:37:58.618879+0000","last_fullsized":"2024-09-13T19:37:58.618879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:58.618686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:58.618686+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.618686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:23.977888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'87","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.130003+0000","last_change":"2024-09-13T19:37:15.130003+0000","last_active":"2024-09-13T19:37:15.130003+0000","last_peered":"2024-09-13T19:37:15.130003+0000","last_clean":"2024-09-13T19:37:15.130003+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:37:15.130003+0000","last_undegraded":"2024-09-13T19:37:15.130003+0000","last_fullsized":"2024-09-13T19:37:15.130003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.129728+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:51:47.372002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.228695+0000","last_change":"2024-09-13T19:37:09.228695+0000","last_active":"2024-09-13T19:37:09.228695+0000","last_peered":"2024-09-13T19:37:09.228695+0000","last_clean":"2024-09-13T19:37:09.228695+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:37:09.228695+0000","last_undegraded":"2024-09-13T19:37:09.228695+0000","last_fullsized":"2024-09-13T19:37:09.228695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.228417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:56.994751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.945992+0000","last_change":"2024-09-13T19:37:46.946134+0000","last_active":"2024-09-13T19:37:46.945992+0000","last_peered":"2024-09-13T19:37:46.945992+0000","last_clean":"2024-09-13T19:37:46.945992+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:37:46.945992+0000","last_undegraded":"2024-09-13T19:37:46.945992+0000","last_fullsized":"2024-09-13T19:37:46.945992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-09-13T19:37:46.945750+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-09-13T19:37:46.945750+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.945750+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:08.676021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.965056+0000","last_change":"2024-09-13T19:37:51.965119+0000","last_active":"2024-09-13T19:37:51.965056+0000","last_peered":"2024-09-13T19:37:51.965056+0000","last_clean":"2024-09-13T19:37:51.965056+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:37:51.965056+0000","last_undegraded":"2024-09-13T19:37:51.965056+0000","last_fullsized":"2024-09-13T19:37:51.965056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:51.964860+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:51.964860+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.964860+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:57.695590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351712+0000","last_change":"2024-09-13T19:33:02.523582+0000","last_active":"2024-09-13T19:37:00.351712+0000","last_peered":"2024-09-13T19:37:00.351712+0000","last_clean":"2024-09-13T19:37:00.351712+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:37:00.351712+0000","last_undegraded":"2024-09-13T19:37:00.351712+0000","last_fullsized":"2024-09-13T19:37:00.351712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.161972+0000","last_change":"2024-09-13T19:37:36.162036+0000","last_active":"2024-09-13T19:37:36.161972+0000","last_peered":"2024-09-13T19:37:36.161972+0000","last_clean":"2024-09-13T19:37:36.161972+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:37:36.161972+0000","last_undegraded":"2024-09-13T19:37:36.161972+0000","last_fullsized":"2024-09-13T19:37:36.161972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:36.161776+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:36.161776+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.161776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.979606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.147263+0000","last_change":"2024-09-13T19:37:09.147263+0000","last_active":"2024-09-13T19:37:09.147263+0000","last_peered":"2024-09-13T19:37:09.147263+0000","last_clean":"2024-09-13T19:37:09.147263+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:37:09.147263+0000","last_undegraded":"2024-09-13T19:37:09.147263+0000","last_fullsized":"2024-09-13T19:37:09.147263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.147011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:17.425294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":517,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.504345+0000","last_change":"2024-09-13T19:37:06.504345+0000","last_active":"2024-09-13T19:37:06.504345+0000","last_peered":"2024-09-13T19:37:06.504345+0000","last_clean":"2024-09-13T19:37:06.504345+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:37:06.504345+0000","last_undegraded":"2024-09-13T19:37:06.504345+0000","last_fullsized":"2024-09-13T19:37:06.504345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.503927+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:35.014112+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.089943+0000","last_change":"2024-09-13T19:37:21.089943+0000","last_active":"2024-09-13T19:37:21.089943+0000","last_peered":"2024-09-13T19:37:21.089943+0000","last_clean":"2024-09-13T19:37:21.089943+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:37:21.089943+0000","last_undegraded":"2024-09-13T19:37:21.089943+0000","last_fullsized":"2024-09-13T19:37:21.089943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:21.089650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:21.089650+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.089650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:32.669122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.574914+0000","last_change":"2024-09-13T19:37:55.574987+0000","last_active":"2024-09-13T19:37:55.574914+0000","last_peered":"2024-09-13T19:37:55.574914+0000","last_clean":"2024-09-13T19:37:55.574914+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:37:55.574914+0000","last_undegraded":"2024-09-13T19:37:55.574914+0000","last_fullsized":"2024-09-13T19:37:55.574914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:55.574705+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:55.574705+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.574705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:58.226960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.074650+0000","last_change":"2024-09-13T19:37:39.074710+0000","last_active":"2024-09-13T19:37:39.074650+0000","last_peered":"2024-09-13T19:37:39.074650+0000","last_clean":"2024-09-13T19:37:39.074650+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:37:39.074650+0000","last_undegraded":"2024-09-13T19:37:39.074650+0000","last_fullsized":"2024-09-13T19:37:39.074650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:39.074462+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:39.074462+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.074462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:20.601071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.093185+0000","last_change":"2024-09-13T19:37:38.093238+0000","last_active":"2024-09-13T19:37:38.093185+0000","last_peered":"2024-09-13T19:37:38.093185+0000","last_clean":"2024-09-13T19:37:38.093185+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:37:38.093185+0000","last_undegraded":"2024-09-13T19:37:38.093185+0000","last_fullsized":"2024-09-13T19:37:38.093185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:38.092962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:38.092962+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.092962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:20.037272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.054805+0000","last_change":"2024-09-13T19:37:42.054873+0000","last_active":"2024-09-13T19:37:42.054805+0000","last_peered":"2024-09-13T19:37:42.054805+0000","last_clean":"2024-09-13T19:37:42.054805+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:37:42.054805+0000","last_undegraded":"2024-09-13T19:37:42.054805+0000","last_fullsized":"2024-09-13T19:37:42.054805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:42.054613+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:42.054613+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.054613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:20.890654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.849196+0000","last_change":"2024-09-13T19:37:16.849196+0000","last_active":"2024-09-13T19:37:16.849196+0000","last_peered":"2024-09-13T19:37:16.849196+0000","last_clean":"2024-09-13T19:37:16.849196+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:37:16.849196+0000","last_undegraded":"2024-09-13T19:37:16.849196+0000","last_fullsized":"2024-09-13T19:37:16.849196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.848911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:35.095041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.900571+0000","last_change":"2024-09-13T19:37:08.900571+0000","last_active":"2024-09-13T19:37:08.900571+0000","last_peered":"2024-09-13T19:37:08.900571+0000","last_clean":"2024-09-13T19:37:08.900571+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:37:08.900571+0000","last_undegraded":"2024-09-13T19:37:08.900571+0000","last_fullsized":"2024-09-13T19:37:08.900571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.900272+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:29.326850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.306113+0000","last_change":"2024-09-13T19:37:00.306113+0000","last_active":"2024-09-13T19:37:00.306113+0000","last_peered":"2024-09-13T19:37:00.306113+0000","last_clean":"2024-09-13T19:37:00.306113+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:37:00.306113+0000","last_undegraded":"2024-09-13T19:37:00.306113+0000","last_fullsized":"2024-09-13T19:37:00.306113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.305866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:41.036690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.899913+0000","last_change":"2024-09-13T19:37:46.899913+0000","last_active":"2024-09-13T19:37:46.899913+0000","last_peered":"2024-09-13T19:37:46.899913+0000","last_clean":"2024-09-13T19:37:46.899913+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:37:46.899913+0000","last_undegraded":"2024-09-13T19:37:46.899913+0000","last_fullsized":"2024-09-13T19:37:46.899913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.899651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.899651+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.899651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:52.737320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.212375+0000","last_change":"2024-09-13T19:37:28.212520+0000","last_active":"2024-09-13T19:37:28.212375+0000","last_peered":"2024-09-13T19:37:28.212375+0000","last_clean":"2024-09-13T19:37:28.212375+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:37:28.212375+0000","last_undegraded":"2024-09-13T19:37:28.212375+0000","last_fullsized":"2024-09-13T19:37:28.212375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-13T19:37:28.212060+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-13T19:37:28.212060+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.212060+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.185729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351734+0000","last_change":"2024-09-13T19:33:02.524797+0000","last_active":"2024-09-13T19:37:00.351734+0000","last_peered":"2024-09-13T19:37:00.351734+0000","last_clean":"2024-09-13T19:37:00.351734+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:37:00.351734+0000","last_undegraded":"2024-09-13T19:37:00.351734+0000","last_fullsized":"2024-09-13T19:37:00.351734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.029039+0000","last_change":"2024-09-13T19:37:42.029092+0000","last_active":"2024-09-13T19:37:42.029039+0000","last_peered":"2024-09-13T19:37:42.029039+0000","last_clean":"2024-09-13T19:37:42.029039+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:37:42.029039+0000","last_undegraded":"2024-09-13T19:37:42.029039+0000","last_fullsized":"2024-09-13T19:37:42.029039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:42.028813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:42.028813+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.028813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:44.895289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.316430+0000","last_change":"2024-09-13T19:37:18.316430+0000","last_active":"2024-09-13T19:37:18.316430+0000","last_peered":"2024-09-13T19:37:18.316430+0000","last_clean":"2024-09-13T19:37:18.316430+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:37:18.316430+0000","last_undegraded":"2024-09-13T19:37:18.316430+0000","last_fullsized":"2024-09-13T19:37:18.316430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.316023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:53.513548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.034575+0000","last_change":"2024-09-13T19:37:25.034575+0000","last_active":"2024-09-13T19:37:25.034575+0000","last_peered":"2024-09-13T19:37:25.034575+0000","last_clean":"2024-09-13T19:37:25.034575+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:37:25.034575+0000","last_undegraded":"2024-09-13T19:37:25.034575+0000","last_fullsized":"2024-09-13T19:37:25.034575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-13T19:37:25.034296+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-13T19:37:25.034296+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.034296+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:16.184148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.084251+0000","last_change":"2024-09-13T19:37:23.084251+0000","last_active":"2024-09-13T19:37:23.084251+0000","last_peered":"2024-09-13T19:37:23.084251+0000","last_clean":"2024-09-13T19:37:23.084251+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:37:23.084251+0000","last_undegraded":"2024-09-13T19:37:23.084251+0000","last_fullsized":"2024-09-13T19:37:23.084251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:23.083834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:23.083834+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.083834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:08.356001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.665709+0000","last_change":"2024-09-13T19:37:20.665709+0000","last_active":"2024-09-13T19:37:20.665709+0000","last_peered":"2024-09-13T19:37:20.665709+0000","last_clean":"2024-09-13T19:37:20.665709+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:37:20.665709+0000","last_undegraded":"2024-09-13T19:37:20.665709+0000","last_fullsized":"2024-09-13T19:37:20.665709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:20.665452+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:20.665452+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.665452+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:26.812805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.605404+0000","last_change":"2024-09-13T19:37:23.605471+0000","last_active":"2024-09-13T19:37:23.605404+0000","last_peered":"2024-09-13T19:37:23.605404+0000","last_clean":"2024-09-13T19:37:23.605404+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:37:23.605404+0000","last_undegraded":"2024-09-13T19:37:23.605404+0000","last_fullsized":"2024-09-13T19:37:23.605404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:23.605199+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:23.605199+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.605199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:24.233934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.053088+0000","last_change":"2024-09-13T19:37:39.053139+0000","last_active":"2024-09-13T19:37:39.053088+0000","last_peered":"2024-09-13T19:37:39.053088+0000","last_clean":"2024-09-13T19:37:39.053088+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:37:39.053088+0000","last_undegraded":"2024-09-13T19:37:39.053088+0000","last_fullsized":"2024-09-13T19:37:39.053088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:39.052897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:39.052897+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.052897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:08.507511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.999985+0000","last_change":"2024-09-13T19:37:47.000092+0000","last_active":"2024-09-13T19:37:46.999985+0000","last_peered":"2024-09-13T19:37:46.999985+0000","last_clean":"2024-09-13T19:37:46.999985+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:37:46.999985+0000","last_undegraded":"2024-09-13T19:37:46.999985+0000","last_fullsized":"2024-09-13T19:37:46.999985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.999754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.999754+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.999754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:08.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.275009+0000","last_change":"2024-09-13T19:37:15.275009+0000","last_active":"2024-09-13T19:37:15.275009+0000","last_peered":"2024-09-13T19:37:15.275009+0000","last_clean":"2024-09-13T19:37:15.275009+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:37:15.275009+0000","last_undegraded":"2024-09-13T19:37:15.275009+0000","last_fullsized":"2024-09-13T19:37:15.275009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.274757+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:13.076733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'74","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.172215+0000","last_change":"2024-09-13T19:37:11.172215+0000","last_active":"2024-09-13T19:37:11.172215+0000","last_peered":"2024-09-13T19:37:11.172215+0000","last_clean":"2024-09-13T19:37:11.172215+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:37:11.172215+0000","last_undegraded":"2024-09-13T19:37:11.172215+0000","last_fullsized":"2024-09-13T19:37:11.172215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.171938+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:48.364805+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.934769+0000","last_change":"2024-09-13T19:37:03.934769+0000","last_active":"2024-09-13T19:37:03.934769+0000","last_peered":"2024-09-13T19:37:03.934769+0000","last_clean":"2024-09-13T19:37:03.934769+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:37:03.934769+0000","last_undegraded":"2024-09-13T19:37:03.934769+0000","last_fullsized":"2024-09-13T19:37:03.934769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.934524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:27.912903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.133974+0000","last_change":"2024-09-13T19:37:56.134038+0000","last_active":"2024-09-13T19:37:56.133974+0000","last_peered":"2024-09-13T19:37:56.133974+0000","last_clean":"2024-09-13T19:37:56.133974+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:37:56.133974+0000","last_undegraded":"2024-09-13T19:37:56.133974+0000","last_fullsized":"2024-09-13T19:37:56.133974+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-13T19:37:56.133788+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-13T19:37:56.133788+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.133788+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:33.961585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.540294+0000","last_change":"2024-09-13T19:37:26.540356+0000","last_active":"2024-09-13T19:37:26.540294+0000","last_peered":"2024-09-13T19:37:26.540294+0000","last_clean":"2024-09-13T19:37:26.540294+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:37:26.540294+0000","last_undegraded":"2024-09-13T19:37:26.540294+0000","last_fullsized":"2024-09-13T19:37:26.540294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:26.540098+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:26.540098+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.540098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:08.484408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.018027+0000","last_change":"2024-09-13T19:37:46.018158+0000","last_active":"2024-09-13T19:37:46.018027+0000","last_peered":"2024-09-13T19:37:46.018027+0000","last_clean":"2024-09-13T19:37:46.018027+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:37:46.018027+0000","last_undegraded":"2024-09-13T19:37:46.018027+0000","last_fullsized":"2024-09-13T19:37:46.018027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.017778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.017778+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.017778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:49.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351746+0000","last_change":"2024-09-13T19:33:02.524228+0000","last_active":"2024-09-13T19:37:00.351746+0000","last_peered":"2024-09-13T19:37:00.351746+0000","last_clean":"2024-09-13T19:37:00.351746+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:37:00.351746+0000","last_undegraded":"2024-09-13T19:37:00.351746+0000","last_fullsized":"2024-09-13T19:37:00.351746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.079813+0000","last_change":"2024-09-13T19:37:06.079813+0000","last_active":"2024-09-13T19:37:06.079813+0000","last_peered":"2024-09-13T19:37:06.079813+0000","last_clean":"2024-09-13T19:37:06.079813+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:37:06.079813+0000","last_undegraded":"2024-09-13T19:37:06.079813+0000","last_fullsized":"2024-09-13T19:37:06.079813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.079564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:35.654908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.552224+0000","last_change":"2024-09-13T19:37:05.552224+0000","last_active":"2024-09-13T19:37:05.552224+0000","last_peered":"2024-09-13T19:37:05.552224+0000","last_clean":"2024-09-13T19:37:05.552224+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:37:05.552224+0000","last_undegraded":"2024-09-13T19:37:05.552224+0000","last_fullsized":"2024-09-13T19:37:05.552224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.551819+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:23.797950+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.523331+0000","last_change":"2024-09-13T19:36:59.523331+0000","last_active":"2024-09-13T19:36:59.523331+0000","last_peered":"2024-09-13T19:36:59.523331+0000","last_clean":"2024-09-13T19:36:59.523331+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:59.523331+0000","last_undegraded":"2024-09-13T19:36:59.523331+0000","last_fullsized":"2024-09-13T19:36:59.523331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.522965+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:04.776093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.956223+0000","last_change":"2024-09-13T19:37:38.956223+0000","last_active":"2024-09-13T19:37:38.956223+0000","last_peered":"2024-09-13T19:37:38.956223+0000","last_clean":"2024-09-13T19:37:38.956223+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:37:38.956223+0000","last_undegraded":"2024-09-13T19:37:38.956223+0000","last_fullsized":"2024-09-13T19:37:38.956223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:38.955963+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:38.955963+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.955963+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:04.315165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.875790+0000","last_change":"2024-09-13T19:37:40.875856+0000","last_active":"2024-09-13T19:37:40.875790+0000","last_peered":"2024-09-13T19:37:40.875790+0000","last_clean":"2024-09-13T19:37:40.875790+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:37:40.875790+0000","last_undegraded":"2024-09-13T19:37:40.875790+0000","last_fullsized":"2024-09-13T19:37:40.875790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:40.875571+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:40.875571+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.875571+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.018867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351981+0000","last_change":"2024-09-13T19:33:08.335852+0000","last_active":"2024-09-13T19:37:00.351981+0000","last_peered":"2024-09-13T19:37:00.351981+0000","last_clean":"2024-09-13T19:37:00.351981+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:37:00.351981+0000","last_undegraded":"2024-09-13T19:37:00.351981+0000","last_fullsized":"2024-09-13T19:37:00.351981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.023259+0000","last_change":"2024-09-13T19:37:48.023319+0000","last_active":"2024-09-13T19:37:48.023259+0000","last_peered":"2024-09-13T19:37:48.023259+0000","last_clean":"2024-09-13T19:37:48.023259+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:37:48.023259+0000","last_undegraded":"2024-09-13T19:37:48.023259+0000","last_fullsized":"2024-09-13T19:37:48.023259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:48.023063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:48.023063+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.023063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:42.107507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.076438+0000","last_change":"2024-09-13T19:37:04.076438+0000","last_active":"2024-09-13T19:37:04.076438+0000","last_peered":"2024-09-13T19:37:04.076438+0000","last_clean":"2024-09-13T19:37:04.076438+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:37:04.076438+0000","last_undegraded":"2024-09-13T19:37:04.076438+0000","last_fullsized":"2024-09-13T19:37:04.076438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.076154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:39.308586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.094198+0000","last_change":"2024-09-13T19:37:19.094198+0000","last_active":"2024-09-13T19:37:19.094198+0000","last_peered":"2024-09-13T19:37:19.094198+0000","last_clean":"2024-09-13T19:37:19.094198+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:37:19.094198+0000","last_undegraded":"2024-09-13T19:37:19.094198+0000","last_fullsized":"2024-09-13T19:37:19.094198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:19.093865+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:19.093865+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.093865+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:00.620474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.358816+0000","last_change":"2024-09-13T19:37:03.358816+0000","last_active":"2024-09-13T19:37:03.358816+0000","last_peered":"2024-09-13T19:37:03.358816+0000","last_clean":"2024-09-13T19:37:03.358816+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:37:03.358816+0000","last_undegraded":"2024-09-13T19:37:03.358816+0000","last_fullsized":"2024-09-13T19:37:03.358816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.358562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.021089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.557231+0000","last_change":"2024-09-13T19:37:12.557231+0000","last_active":"2024-09-13T19:37:12.557231+0000","last_peered":"2024-09-13T19:37:12.557231+0000","last_clean":"2024-09-13T19:37:12.557231+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:37:12.557231+0000","last_undegraded":"2024-09-13T19:37:12.557231+0000","last_fullsized":"2024-09-13T19:37:12.557231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.556957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.679686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.029314+0000","last_change":"2024-09-13T19:37:34.029405+0000","last_active":"2024-09-13T19:37:34.029314+0000","last_peered":"2024-09-13T19:37:34.029314+0000","last_clean":"2024-09-13T19:37:34.029314+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:37:34.029314+0000","last_undegraded":"2024-09-13T19:37:34.029314+0000","last_fullsized":"2024-09-13T19:37:34.029314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:34.029094+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:34.029094+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.029094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:33.604670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.451967+0000","last_change":"2024-09-13T19:37:37.452031+0000","last_active":"2024-09-13T19:37:37.451967+0000","last_peered":"2024-09-13T19:37:37.451967+0000","last_clean":"2024-09-13T19:37:37.451967+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:37:37.451967+0000","last_undegraded":"2024-09-13T19:37:37.451967+0000","last_fullsized":"2024-09-13T19:37:37.451967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:37.451769+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:37.451769+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.451769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:59.810756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.351796+0000","last_change":"2024-09-13T19:33:02.524914+0000","last_active":"2024-09-13T19:37:00.351796+0000","last_peered":"2024-09-13T19:37:00.351796+0000","last_clean":"2024-09-13T19:37:00.351796+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:37:00.351796+0000","last_undegraded":"2024-09-13T19:37:00.351796+0000","last_fullsized":"2024-09-13T19:37:00.351796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:32:59.486586+0000","last_clean_scrub_stamp":"2024-09-13T19:32:59.486586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.142377+0000","last_change":"2024-09-13T19:37:12.142377+0000","last_active":"2024-09-13T19:37:12.142377+0000","last_peered":"2024-09-13T19:37:12.142377+0000","last_clean":"2024-09-13T19:37:12.142377+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:37:12.142377+0000","last_undegraded":"2024-09-13T19:37:12.142377+0000","last_fullsized":"2024-09-13T19:37:12.142377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.142129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:18.473708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'97","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.931606+0000","last_change":"2024-09-13T19:37:05.931606+0000","last_active":"2024-09-13T19:37:05.931606+0000","last_peered":"2024-09-13T19:37:05.931606+0000","last_clean":"2024-09-13T19:37:05.931606+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:37:05.931606+0000","last_undegraded":"2024-09-13T19:37:05.931606+0000","last_fullsized":"2024-09-13T19:37:05.931606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.931238+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:45.454573+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.298133+0000","last_change":"2024-09-13T19:37:06.298133+0000","last_active":"2024-09-13T19:37:06.298133+0000","last_peered":"2024-09-13T19:37:06.298133+0000","last_clean":"2024-09-13T19:37:06.298133+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:37:06.298133+0000","last_undegraded":"2024-09-13T19:37:06.298133+0000","last_fullsized":"2024-09-13T19:37:06.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:34.808071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.951529+0000","last_change":"2024-09-13T19:37:50.951589+0000","last_active":"2024-09-13T19:37:50.951529+0000","last_peered":"2024-09-13T19:37:50.951529+0000","last_clean":"2024-09-13T19:37:50.951529+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:37:50.951529+0000","last_undegraded":"2024-09-13T19:37:50.951529+0000","last_fullsized":"2024-09-13T19:37:50.951529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:50.951320+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:50.951320+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.951320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:33.076198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.911889+0000","last_change":"2024-09-13T19:37:47.912039+0000","last_active":"2024-09-13T19:37:47.911889+0000","last_peered":"2024-09-13T19:37:47.911889+0000","last_clean":"2024-09-13T19:37:47.911889+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:37:47.911889+0000","last_undegraded":"2024-09-13T19:37:47.911889+0000","last_fullsized":"2024-09-13T19:37:47.911889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:47.911667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:47.911667+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.911667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:14.853018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.934942+0000","last_change":"2024-09-13T19:37:29.934942+0000","last_active":"2024-09-13T19:37:29.934942+0000","last_peered":"2024-09-13T19:37:29.934942+0000","last_clean":"2024-09-13T19:37:29.934942+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:37:29.934942+0000","last_undegraded":"2024-09-13T19:37:29.934942+0000","last_fullsized":"2024-09-13T19:37:29.934942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:29.934579+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:29.934579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.934579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:05.520975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.691055+0000","last_change":"2024-09-13T19:37:58.691122+0000","last_active":"2024-09-13T19:37:58.691055+0000","last_peered":"2024-09-13T19:37:58.691055+0000","last_clean":"2024-09-13T19:37:58.691055+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:37:58.691055+0000","last_undegraded":"2024-09-13T19:37:58.691055+0000","last_fullsized":"2024-09-13T19:37:58.691055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:58.690864+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:58.690864+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.690864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:13.639132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.615290+0000","last_change":"2024-09-13T19:37:19.615290+0000","last_active":"2024-09-13T19:37:19.615290+0000","last_peered":"2024-09-13T19:37:19.615290+0000","last_clean":"2024-09-13T19:37:19.615290+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:37:19.615290+0000","last_undegraded":"2024-09-13T19:37:19.615290+0000","last_fullsized":"2024-09-13T19:37:19.615290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:19.615030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:19.615030+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.615030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:23.322720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.156055+0000","last_change":"2024-09-13T19:37:11.156055+0000","last_active":"2024-09-13T19:37:11.156055+0000","last_peered":"2024-09-13T19:37:11.156055+0000","last_clean":"2024-09-13T19:37:11.156055+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:37:11.156055+0000","last_undegraded":"2024-09-13T19:37:11.156055+0000","last_fullsized":"2024-09-13T19:37:11.156055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.155624+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:30.748402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.008931+0000","last_change":"2024-09-13T19:37:31.008931+0000","last_active":"2024-09-13T19:37:31.008931+0000","last_peered":"2024-09-13T19:37:31.008931+0000","last_clean":"2024-09-13T19:37:31.008931+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:37:31.008931+0000","last_undegraded":"2024-09-13T19:37:31.008931+0000","last_fullsized":"2024-09-13T19:37:31.008931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:31.008661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:31.008661+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.008661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:00.939978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.163660+0000","last_change":"2024-09-13T19:37:25.163723+0000","last_active":"2024-09-13T19:37:25.163660+0000","last_peered":"2024-09-13T19:37:25.163660+0000","last_clean":"2024-09-13T19:37:25.163660+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:37:25.163660+0000","last_undegraded":"2024-09-13T19:37:25.163660+0000","last_fullsized":"2024-09-13T19:37:25.163660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-13T19:37:25.163440+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-13T19:37:25.163440+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.163440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:32.363103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.618900+0000","last_change":"2024-09-13T19:37:22.618900+0000","last_active":"2024-09-13T19:37:22.618900+0000","last_peered":"2024-09-13T19:37:22.618900+0000","last_clean":"2024-09-13T19:37:22.618900+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:37:22.618900+0000","last_undegraded":"2024-09-13T19:37:22.618900+0000","last_fullsized":"2024-09-13T19:37:22.618900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:22.618647+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:22.618647+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.618647+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:22.194223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.922798+0000","last_change":"2024-09-13T19:37:24.922798+0000","last_active":"2024-09-13T19:37:24.922798+0000","last_peered":"2024-09-13T19:37:24.922798+0000","last_clean":"2024-09-13T19:37:24.922798+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:37:24.922798+0000","last_undegraded":"2024-09-13T19:37:24.922798+0000","last_fullsized":"2024-09-13T19:37:24.922798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:24.922556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:24.922556+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.922556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:12.432860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.353882+0000","last_change":"2024-09-13T19:33:49.530881+0000","last_active":"2024-09-13T19:37:00.353882+0000","last_peered":"2024-09-13T19:37:00.353882+0000","last_clean":"2024-09-13T19:37:00.353882+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:37:00.353882+0000","last_undegraded":"2024-09-13T19:37:00.353882+0000","last_fullsized":"2024-09-13T19:37:00.353882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.197029+0000","last_change":"2024-09-13T19:37:10.197029+0000","last_active":"2024-09-13T19:37:10.197029+0000","last_peered":"2024-09-13T19:37:10.197029+0000","last_clean":"2024-09-13T19:37:10.197029+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:37:10.197029+0000","last_undegraded":"2024-09-13T19:37:10.197029+0000","last_fullsized":"2024-09-13T19:37:10.197029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.196773+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:26.963041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.867223+0000","last_change":"2024-09-13T19:37:00.867223+0000","last_active":"2024-09-13T19:37:00.867223+0000","last_peered":"2024-09-13T19:37:00.867223+0000","last_clean":"2024-09-13T19:37:00.867223+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:37:00.867223+0000","last_undegraded":"2024-09-13T19:37:00.867223+0000","last_fullsized":"2024-09-13T19:37:00.867223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.866964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:18.237819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:49.502868+0000","last_change":"2024-09-13T19:33:18.415711+0000","last_active":"2024-09-13T19:35:49.502868+0000","last_peered":"2024-09-13T19:35:49.502868+0000","last_clean":"2024-09-13T19:35:49.502868+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:35:49.502868+0000","last_undegraded":"2024-09-13T19:35:49.502868+0000","last_fullsized":"2024-09-13T19:35:49.502868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.069534+0000","last_change":"2024-09-13T19:37:41.069534+0000","last_active":"2024-09-13T19:37:41.069534+0000","last_peered":"2024-09-13T19:37:41.069534+0000","last_clean":"2024-09-13T19:37:41.069534+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:37:41.069534+0000","last_undegraded":"2024-09-13T19:37:41.069534+0000","last_fullsized":"2024-09-13T19:37:41.069534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-13T19:37:41.069170+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-13T19:37:41.069170+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.069170+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:18.063054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.060765+0000","last_change":"2024-09-13T19:37:37.060765+0000","last_active":"2024-09-13T19:37:37.060765+0000","last_peered":"2024-09-13T19:37:37.060765+0000","last_clean":"2024-09-13T19:37:37.060765+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:37:37.060765+0000","last_undegraded":"2024-09-13T19:37:37.060765+0000","last_fullsized":"2024-09-13T19:37:37.060765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:37.060494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:37.060494+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.060494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:44.260157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.795551+0000","last_change":"2024-09-13T19:37:14.795551+0000","last_active":"2024-09-13T19:37:14.795551+0000","last_peered":"2024-09-13T19:37:14.795551+0000","last_clean":"2024-09-13T19:37:14.795551+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:37:14.795551+0000","last_undegraded":"2024-09-13T19:37:14.795551+0000","last_fullsized":"2024-09-13T19:37:14.795551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.795303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:39.429169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'48","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.298241+0000","last_change":"2024-09-13T19:37:07.298241+0000","last_active":"2024-09-13T19:37:07.298241+0000","last_peered":"2024-09-13T19:37:07.298241+0000","last_clean":"2024-09-13T19:37:07.298241+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:37:07.298241+0000","last_undegraded":"2024-09-13T19:37:07.298241+0000","last_fullsized":"2024-09-13T19:37:07.298241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.297980+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.187946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.510102+0000","last_change":"2024-09-13T19:37:03.510102+0000","last_active":"2024-09-13T19:37:03.510102+0000","last_peered":"2024-09-13T19:37:03.510102+0000","last_clean":"2024-09-13T19:37:03.510102+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:37:03.510102+0000","last_undegraded":"2024-09-13T19:37:03.510102+0000","last_fullsized":"2024-09-13T19:37:03.510102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.509824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.172352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:50.510224+0000","last_change":"2024-09-13T19:33:18.420341+0000","last_active":"2024-09-13T19:35:50.510224+0000","last_peered":"2024-09-13T19:35:50.510224+0000","last_clean":"2024-09-13T19:35:50.510224+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:35:50.510224+0000","last_undegraded":"2024-09-13T19:35:50.510224+0000","last_fullsized":"2024-09-13T19:35:50.510224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.850067+0000","last_change":"2024-09-13T19:37:44.850067+0000","last_active":"2024-09-13T19:37:44.850067+0000","last_peered":"2024-09-13T19:37:44.850067+0000","last_clean":"2024-09-13T19:37:44.850067+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:37:44.850067+0000","last_undegraded":"2024-09-13T19:37:44.850067+0000","last_fullsized":"2024-09-13T19:37:44.850067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:44.849657+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:44.849657+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.849657+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:25.922372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.578287+0000","last_change":"2024-09-13T19:37:57.578287+0000","last_active":"2024-09-13T19:37:57.578287+0000","last_peered":"2024-09-13T19:37:57.578287+0000","last_clean":"2024-09-13T19:37:57.578287+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:37:57.578287+0000","last_undegraded":"2024-09-13T19:37:57.578287+0000","last_fullsized":"2024-09-13T19:37:57.578287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:57.578043+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:57.578043+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.578043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:23.544482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.122142+0000","last_change":"2024-09-13T19:37:01.122142+0000","last_active":"2024-09-13T19:37:01.122142+0000","last_peered":"2024-09-13T19:37:01.122142+0000","last_clean":"2024-09-13T19:37:01.122142+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:37:01.122142+0000","last_undegraded":"2024-09-13T19:37:01.122142+0000","last_fullsized":"2024-09-13T19:37:01.122142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.121885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:18.346905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.862096+0000","last_change":"2024-09-13T19:37:09.862096+0000","last_active":"2024-09-13T19:37:09.862096+0000","last_peered":"2024-09-13T19:37:09.862096+0000","last_clean":"2024-09-13T19:37:09.862096+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:37:09.862096+0000","last_undegraded":"2024-09-13T19:37:09.862096+0000","last_fullsized":"2024-09-13T19:37:09.862096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.861787+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:30.468598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.893029+0000","last_change":"2024-09-13T19:36:59.893029+0000","last_active":"2024-09-13T19:36:59.893029+0000","last_peered":"2024-09-13T19:36:59.893029+0000","last_clean":"2024-09-13T19:36:59.893029+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:36:59.893029+0000","last_undegraded":"2024-09-13T19:36:59.893029+0000","last_fullsized":"2024-09-13T19:36:59.893029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.892784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:26.796881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.922723+0000","last_change":"2024-09-13T19:37:33.922792+0000","last_active":"2024-09-13T19:37:33.922723+0000","last_peered":"2024-09-13T19:37:33.922723+0000","last_clean":"2024-09-13T19:37:33.922723+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:37:33.922723+0000","last_undegraded":"2024-09-13T19:37:33.922723+0000","last_fullsized":"2024-09-13T19:37:33.922723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:33.922489+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:33.922489+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.922489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:49.484234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352062+0000","last_change":"2024-09-13T19:33:08.338446+0000","last_active":"2024-09-13T19:37:00.352062+0000","last_peered":"2024-09-13T19:37:00.352062+0000","last_clean":"2024-09-13T19:37:00.352062+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:37:00.352062+0000","last_undegraded":"2024-09-13T19:37:00.352062+0000","last_fullsized":"2024-09-13T19:37:00.352062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.250956+0000","last_change":"2024-09-13T19:37:16.251010+0000","last_active":"2024-09-13T19:37:16.250956+0000","last_peered":"2024-09-13T19:37:16.250956+0000","last_clean":"2024-09-13T19:37:16.250956+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:37:16.250956+0000","last_undegraded":"2024-09-13T19:37:16.250956+0000","last_fullsized":"2024-09-13T19:37:16.250956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.250752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:17.682001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'66","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.201407+0000","last_change":"2024-09-13T19:37:12.201490+0000","last_active":"2024-09-13T19:37:12.201407+0000","last_peered":"2024-09-13T19:37:12.201407+0000","last_clean":"2024-09-13T19:37:12.201407+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:37:12.201407+0000","last_undegraded":"2024-09-13T19:37:12.201407+0000","last_fullsized":"2024-09-13T19:37:12.201407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.201193+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:16.321625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.836414+0000","last_change":"2024-09-13T19:37:11.836514+0000","last_active":"2024-09-13T19:37:11.836414+0000","last_peered":"2024-09-13T19:37:11.836414+0000","last_clean":"2024-09-13T19:37:11.836414+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:37:11.836414+0000","last_undegraded":"2024-09-13T19:37:11.836414+0000","last_fullsized":"2024-09-13T19:37:11.836414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.836187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:55.223762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.222153+0000","last_change":"2024-09-13T19:37:58.222153+0000","last_active":"2024-09-13T19:37:58.222153+0000","last_peered":"2024-09-13T19:37:58.222153+0000","last_clean":"2024-09-13T19:37:58.222153+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:37:58.222153+0000","last_undegraded":"2024-09-13T19:37:58.222153+0000","last_fullsized":"2024-09-13T19:37:58.222153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:58.221901+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:58.221901+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.221901+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:01.482512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.164238+0000","last_change":"2024-09-13T19:37:26.164322+0000","last_active":"2024-09-13T19:37:26.164238+0000","last_peered":"2024-09-13T19:37:26.164238+0000","last_clean":"2024-09-13T19:37:26.164238+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:37:26.164238+0000","last_undegraded":"2024-09-13T19:37:26.164238+0000","last_fullsized":"2024-09-13T19:37:26.164238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:26.164044+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:26.164044+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.164044+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:08.108354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.551251+0000","last_change":"2024-09-13T19:37:50.551251+0000","last_active":"2024-09-13T19:37:50.551251+0000","last_peered":"2024-09-13T19:37:50.551251+0000","last_clean":"2024-09-13T19:37:50.551251+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:37:50.551251+0000","last_undegraded":"2024-09-13T19:37:50.551251+0000","last_fullsized":"2024-09-13T19:37:50.551251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:50.550963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:50.550963+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.550963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:20.482280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.878321+0000","last_change":"2024-09-13T19:37:18.878321+0000","last_active":"2024-09-13T19:37:18.878321+0000","last_peered":"2024-09-13T19:37:18.878321+0000","last_clean":"2024-09-13T19:37:18.878321+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:37:18.878321+0000","last_undegraded":"2024-09-13T19:37:18.878321+0000","last_fullsized":"2024-09-13T19:37:18.878321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.878068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.266511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.006283+0000","last_change":"2024-09-13T19:37:30.006370+0000","last_active":"2024-09-13T19:37:30.006283+0000","last_peered":"2024-09-13T19:37:30.006283+0000","last_clean":"2024-09-13T19:37:30.006283+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:37:30.006283+0000","last_undegraded":"2024-09-13T19:37:30.006283+0000","last_fullsized":"2024-09-13T19:37:30.006283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:30.006093+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:30.006093+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.006093+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:55.908367+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.465555+0000","last_change":"2024-09-13T19:37:02.465714+0000","last_active":"2024-09-13T19:37:02.465555+0000","last_peered":"2024-09-13T19:37:02.465555+0000","last_clean":"2024-09-13T19:37:02.465555+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:37:02.465555+0000","last_undegraded":"2024-09-13T19:37:02.465555+0000","last_fullsized":"2024-09-13T19:37:02.465555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.465336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.671030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.824868+0000","last_change":"2024-09-13T19:37:50.824868+0000","last_active":"2024-09-13T19:37:50.824868+0000","last_peered":"2024-09-13T19:37:50.824868+0000","last_clean":"2024-09-13T19:37:50.824868+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:37:50.824868+0000","last_undegraded":"2024-09-13T19:37:50.824868+0000","last_fullsized":"2024-09-13T19:37:50.824868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:50.824629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:50.824629+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.824629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:16.055391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.118164+0000","last_change":"2024-09-13T19:37:16.118224+0000","last_active":"2024-09-13T19:37:16.118164+0000","last_peered":"2024-09-13T19:37:16.118164+0000","last_clean":"2024-09-13T19:37:16.118164+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:37:16.118164+0000","last_undegraded":"2024-09-13T19:37:16.118164+0000","last_fullsized":"2024-09-13T19:37:16.118164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:16.117977+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:16.117977+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.117977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.935807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.533155+0000","last_change":"2024-09-13T19:37:49.533216+0000","last_active":"2024-09-13T19:37:49.533155+0000","last_peered":"2024-09-13T19:37:49.533155+0000","last_clean":"2024-09-13T19:37:49.533155+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:37:49.533155+0000","last_undegraded":"2024-09-13T19:37:49.533155+0000","last_fullsized":"2024-09-13T19:37:49.533155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:49.532974+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.532974+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.532974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:15.435248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.846935+0000","last_change":"2024-09-13T19:37:17.846985+0000","last_active":"2024-09-13T19:37:17.846935+0000","last_peered":"2024-09-13T19:37:17.846935+0000","last_clean":"2024-09-13T19:37:17.846935+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:37:17.846935+0000","last_undegraded":"2024-09-13T19:37:17.846935+0000","last_fullsized":"2024-09-13T19:37:17.846935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.846741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:49.584937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.250550+0000","last_change":"2024-09-13T19:37:08.250550+0000","last_active":"2024-09-13T19:37:08.250550+0000","last_peered":"2024-09-13T19:37:08.250550+0000","last_clean":"2024-09-13T19:37:08.250550+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:37:08.250550+0000","last_undegraded":"2024-09-13T19:37:08.250550+0000","last_fullsized":"2024-09-13T19:37:08.250550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.250286+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.511817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.299423+0000","last_change":"2024-09-13T19:37:17.299423+0000","last_active":"2024-09-13T19:37:17.299423+0000","last_peered":"2024-09-13T19:37:17.299423+0000","last_clean":"2024-09-13T19:37:17.299423+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:37:17.299423+0000","last_undegraded":"2024-09-13T19:37:17.299423+0000","last_fullsized":"2024-09-13T19:37:17.299423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.299176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:11.887369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.867645+0000","last_change":"2024-09-13T19:37:42.867645+0000","last_active":"2024-09-13T19:37:42.867645+0000","last_peered":"2024-09-13T19:37:42.867645+0000","last_clean":"2024-09-13T19:37:42.867645+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:37:42.867645+0000","last_undegraded":"2024-09-13T19:37:42.867645+0000","last_fullsized":"2024-09-13T19:37:42.867645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:42.867391+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:42.867391+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.867391+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:28.444269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.170269+0000","last_change":"2024-09-13T19:37:27.170330+0000","last_active":"2024-09-13T19:37:27.170269+0000","last_peered":"2024-09-13T19:37:27.170269+0000","last_clean":"2024-09-13T19:37:27.170269+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:37:27.170269+0000","last_undegraded":"2024-09-13T19:37:27.170269+0000","last_fullsized":"2024-09-13T19:37:27.170269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:27.170072+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:27.170072+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.170072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:51.374174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'5","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.660295+0000","last_change":"2024-09-13T19:37:59.660359+0000","last_active":"2024-09-13T19:37:59.660295+0000","last_peered":"2024-09-13T19:37:59.660295+0000","last_clean":"2024-09-13T19:37:59.660295+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:37:59.660295+0000","last_undegraded":"2024-09-13T19:37:59.660295+0000","last_fullsized":"2024-09-13T19:37:59.660295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:59.660109+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:59.660109+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.660109+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.572890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.667220+0000","last_change":"2024-09-13T19:37:21.667320+0000","last_active":"2024-09-13T19:37:21.667220+0000","last_peered":"2024-09-13T19:37:21.667220+0000","last_clean":"2024-09-13T19:37:21.667220+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:37:21.667220+0000","last_undegraded":"2024-09-13T19:37:21.667220+0000","last_fullsized":"2024-09-13T19:37:21.667220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:21.666993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:21.666993+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.666993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:40.253116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.027267+0000","last_change":"2024-09-13T19:37:29.027432+0000","last_active":"2024-09-13T19:37:29.027267+0000","last_peered":"2024-09-13T19:37:29.027267+0000","last_clean":"2024-09-13T19:37:29.027267+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:37:29.027267+0000","last_undegraded":"2024-09-13T19:37:29.027267+0000","last_fullsized":"2024-09-13T19:37:29.027267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:29.027005+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:29.027005+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.027005+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:23.111450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":420,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.871065+0000","last_change":"2024-09-13T19:37:01.871065+0000","last_active":"2024-09-13T19:37:01.871065+0000","last_peered":"2024-09-13T19:37:01.871065+0000","last_clean":"2024-09-13T19:37:01.871065+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:37:01.871065+0000","last_undegraded":"2024-09-13T19:37:01.871065+0000","last_fullsized":"2024-09-13T19:37:01.871065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.870803+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:04.118178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.355393+0000","last_change":"2024-09-13T19:33:18.419381+0000","last_active":"2024-09-13T19:37:00.355393+0000","last_peered":"2024-09-13T19:37:00.355393+0000","last_clean":"2024-09-13T19:37:00.355393+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:37:00.355393+0000","last_undegraded":"2024-09-13T19:37:00.355393+0000","last_fullsized":"2024-09-13T19:37:00.355393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.914455+0000","last_change":"2024-09-13T19:37:25.914489+0000","last_active":"2024-09-13T19:37:25.914455+0000","last_peered":"2024-09-13T19:37:25.914455+0000","last_clean":"2024-09-13T19:37:25.914455+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:37:25.914455+0000","last_undegraded":"2024-09-13T19:37:25.914455+0000","last_fullsized":"2024-09-13T19:37:25.914455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:25.914351+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:25.914351+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.914351+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:13.683898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.472332+0000","last_change":"2024-09-13T19:37:45.472385+0000","last_active":"2024-09-13T19:37:45.472332+0000","last_peered":"2024-09-13T19:37:45.472332+0000","last_clean":"2024-09-13T19:37:45.472332+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:37:45.472332+0000","last_undegraded":"2024-09-13T19:37:45.472332+0000","last_fullsized":"2024-09-13T19:37:45.472332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:45.472142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:45.472142+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.472142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:11.674746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.580786+0000","last_change":"2024-09-13T19:37:18.580839+0000","last_active":"2024-09-13T19:37:18.580786+0000","last_peered":"2024-09-13T19:37:18.580786+0000","last_clean":"2024-09-13T19:37:18.580786+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:37:18.580786+0000","last_undegraded":"2024-09-13T19:37:18.580786+0000","last_fullsized":"2024-09-13T19:37:18.580786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.580585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.580585+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.580585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:54.166980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.503996+0000","last_change":"2024-09-13T19:37:07.504071+0000","last_active":"2024-09-13T19:37:07.503996+0000","last_peered":"2024-09-13T19:37:07.503996+0000","last_clean":"2024-09-13T19:37:07.503996+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:37:07.503996+0000","last_undegraded":"2024-09-13T19:37:07.503996+0000","last_fullsized":"2024-09-13T19:37:07.503996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.503821+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.393786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.318408+0000","last_change":"2024-09-13T19:37:02.318463+0000","last_active":"2024-09-13T19:37:02.318408+0000","last_peered":"2024-09-13T19:37:02.318408+0000","last_clean":"2024-09-13T19:37:02.318408+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:37:02.318408+0000","last_undegraded":"2024-09-13T19:37:02.318408+0000","last_fullsized":"2024-09-13T19:37:02.318408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.318220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:12.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.553390+0000","last_change":"2024-09-13T19:37:56.553453+0000","last_active":"2024-09-13T19:37:56.553390+0000","last_peered":"2024-09-13T19:37:56.553390+0000","last_clean":"2024-09-13T19:37:56.553390+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:37:56.553390+0000","last_undegraded":"2024-09-13T19:37:56.553390+0000","last_fullsized":"2024-09-13T19:37:56.553390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:56.553171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:56.553171+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.553171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:57.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.014355+0000","last_change":"2024-09-13T19:37:32.014422+0000","last_active":"2024-09-13T19:37:32.014355+0000","last_peered":"2024-09-13T19:37:32.014355+0000","last_clean":"2024-09-13T19:37:32.014355+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:37:32.014355+0000","last_undegraded":"2024-09-13T19:37:32.014355+0000","last_fullsized":"2024-09-13T19:37:32.014355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:32.014177+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:32.014177+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.014177+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.161530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.864572+0000","last_change":"2024-09-13T19:37:49.864702+0000","last_active":"2024-09-13T19:37:49.864572+0000","last_peered":"2024-09-13T19:37:49.864572+0000","last_clean":"2024-09-13T19:37:49.864572+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:37:49.864572+0000","last_undegraded":"2024-09-13T19:37:49.864572+0000","last_fullsized":"2024-09-13T19:37:49.864572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:49.864324+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.864324+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.864324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:22.170482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.865865+0000","last_change":"2024-09-13T19:37:12.865947+0000","last_active":"2024-09-13T19:37:12.865865+0000","last_peered":"2024-09-13T19:37:12.865865+0000","last_clean":"2024-09-13T19:37:12.865865+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:37:12.865865+0000","last_undegraded":"2024-09-13T19:37:12.865865+0000","last_fullsized":"2024-09-13T19:37:12.865865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.865683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.157355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.251983+0000","last_change":"2024-09-13T19:37:14.252058+0000","last_active":"2024-09-13T19:37:14.251983+0000","last_peered":"2024-09-13T19:37:14.251983+0000","last_clean":"2024-09-13T19:37:14.251983+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:37:14.251983+0000","last_undegraded":"2024-09-13T19:37:14.251983+0000","last_fullsized":"2024-09-13T19:37:14.251983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.251796+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.000429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.120244+0000","last_change":"2024-09-13T19:37:22.120297+0000","last_active":"2024-09-13T19:37:22.120244+0000","last_peered":"2024-09-13T19:37:22.120244+0000","last_clean":"2024-09-13T19:37:22.120244+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:37:22.120244+0000","last_undegraded":"2024-09-13T19:37:22.120244+0000","last_fullsized":"2024-09-13T19:37:22.120244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:22.120047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:22.120047+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.120047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:39.824427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509143+0000","last_change":"2024-09-13T19:33:18.424633+0000","last_active":"2024-09-13T19:35:45.509143+0000","last_peered":"2024-09-13T19:35:45.509143+0000","last_clean":"2024-09-13T19:35:45.509143+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:35:45.509143+0000","last_undegraded":"2024-09-13T19:35:45.509143+0000","last_fullsized":"2024-09-13T19:35:45.509143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.876192+0000","last_change":"2024-09-13T19:37:48.876192+0000","last_active":"2024-09-13T19:37:48.876192+0000","last_peered":"2024-09-13T19:37:48.876192+0000","last_clean":"2024-09-13T19:37:48.876192+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:37:48.876192+0000","last_undegraded":"2024-09-13T19:37:48.876192+0000","last_fullsized":"2024-09-13T19:37:48.876192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:48.875767+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:48.875767+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.875767+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:54.957655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.148982+0000","last_change":"2024-09-13T19:37:34.149044+0000","last_active":"2024-09-13T19:37:34.148982+0000","last_peered":"2024-09-13T19:37:34.148982+0000","last_clean":"2024-09-13T19:37:34.148982+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:37:34.148982+0000","last_undegraded":"2024-09-13T19:37:34.148982+0000","last_fullsized":"2024-09-13T19:37:34.148982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:34.148784+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:34.148784+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.148784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:52.146325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.541565+0000","last_change":"2024-09-13T19:37:15.541626+0000","last_active":"2024-09-13T19:37:15.541565+0000","last_peered":"2024-09-13T19:37:15.541565+0000","last_clean":"2024-09-13T19:37:15.541565+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:37:15.541565+0000","last_undegraded":"2024-09-13T19:37:15.541565+0000","last_fullsized":"2024-09-13T19:37:15.541565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.541376+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.541376+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.541376+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.495683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.117221+0000","last_change":"2024-09-13T19:37:13.117296+0000","last_active":"2024-09-13T19:37:13.117221+0000","last_peered":"2024-09-13T19:37:13.117221+0000","last_clean":"2024-09-13T19:37:13.117221+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:37:13.117221+0000","last_undegraded":"2024-09-13T19:37:13.117221+0000","last_fullsized":"2024-09-13T19:37:13.117221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.117012+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:54.888683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.982704+0000","last_change":"2024-09-13T19:37:26.982763+0000","last_active":"2024-09-13T19:37:26.982704+0000","last_peered":"2024-09-13T19:37:26.982704+0000","last_clean":"2024-09-13T19:37:26.982704+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:37:26.982704+0000","last_undegraded":"2024-09-13T19:37:26.982704+0000","last_fullsized":"2024-09-13T19:37:26.982704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:26.982499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:26.982499+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.982499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:34.956774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:35:45.509079+0000","last_change":"2024-09-13T19:33:18.420238+0000","last_active":"2024-09-13T19:35:45.509079+0000","last_peered":"2024-09-13T19:35:45.509079+0000","last_clean":"2024-09-13T19:35:45.509079+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:35:45.509079+0000","last_undegraded":"2024-09-13T19:35:45.509079+0000","last_fullsized":"2024-09-13T19:35:45.509079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.942239+0000","last_change":"2024-09-13T19:37:27.942239+0000","last_active":"2024-09-13T19:37:27.942239+0000","last_peered":"2024-09-13T19:37:27.942239+0000","last_clean":"2024-09-13T19:37:27.942239+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:37:27.942239+0000","last_undegraded":"2024-09-13T19:37:27.942239+0000","last_fullsized":"2024-09-13T19:37:27.942239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:27.941988+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:27.941988+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.941988+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:53.406471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.478392+0000","last_change":"2024-09-13T19:37:47.478452+0000","last_active":"2024-09-13T19:37:47.478392+0000","last_peered":"2024-09-13T19:37:47.478392+0000","last_clean":"2024-09-13T19:37:47.478392+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:37:47.478392+0000","last_undegraded":"2024-09-13T19:37:47.478392+0000","last_fullsized":"2024-09-13T19:37:47.478392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:47.478174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:47.478174+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.478174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:08.475733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.532624+0000","last_change":"2024-09-13T19:37:13.532693+0000","last_active":"2024-09-13T19:37:13.532624+0000","last_peered":"2024-09-13T19:37:13.532624+0000","last_clean":"2024-09-13T19:37:13.532624+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:37:13.532624+0000","last_undegraded":"2024-09-13T19:37:13.532624+0000","last_fullsized":"2024-09-13T19:37:13.532624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.532406+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:58.383662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.062342+0000","last_change":"2024-09-13T19:37:05.062437+0000","last_active":"2024-09-13T19:37:05.062342+0000","last_peered":"2024-09-13T19:37:05.062342+0000","last_clean":"2024-09-13T19:37:05.062342+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:37:05.062342+0000","last_undegraded":"2024-09-13T19:37:05.062342+0000","last_fullsized":"2024-09-13T19:37:05.062342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.062147+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:44.414993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.301505+0000","last_change":"2024-09-13T19:36:59.301555+0000","last_active":"2024-09-13T19:36:59.301505+0000","last_peered":"2024-09-13T19:36:59.301505+0000","last_clean":"2024-09-13T19:36:59.301505+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:36:59.301505+0000","last_undegraded":"2024-09-13T19:36:59.301505+0000","last_fullsized":"2024-09-13T19:36:59.301505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.301322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:26.231205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.355738+0000","last_change":"2024-09-13T19:33:18.420946+0000","last_active":"2024-09-13T19:37:00.355738+0000","last_peered":"2024-09-13T19:37:00.355738+0000","last_clean":"2024-09-13T19:37:00.355738+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:37:00.355738+0000","last_undegraded":"2024-09-13T19:37:00.355738+0000","last_fullsized":"2024-09-13T19:37:00.355738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.963933+0000","last_change":"2024-09-13T19:37:52.964064+0000","last_active":"2024-09-13T19:37:52.963933+0000","last_peered":"2024-09-13T19:37:52.963933+0000","last_clean":"2024-09-13T19:37:52.963933+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:37:52.963933+0000","last_undegraded":"2024-09-13T19:37:52.963933+0000","last_fullsized":"2024-09-13T19:37:52.963933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:52.963719+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:52.963719+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.963719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:29.957603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.052768+0000","last_change":"2024-09-13T19:37:40.052825+0000","last_active":"2024-09-13T19:37:40.052768+0000","last_peered":"2024-09-13T19:37:40.052768+0000","last_clean":"2024-09-13T19:37:40.052768+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:37:40.052768+0000","last_undegraded":"2024-09-13T19:37:40.052768+0000","last_fullsized":"2024-09-13T19:37:40.052768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:40.052581+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:40.052581+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.052581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:52.026250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.200561+0000","last_change":"2024-09-13T19:37:31.200618+0000","last_active":"2024-09-13T19:37:31.200561+0000","last_peered":"2024-09-13T19:37:31.200561+0000","last_clean":"2024-09-13T19:37:31.200561+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:37:31.200561+0000","last_undegraded":"2024-09-13T19:37:31.200561+0000","last_fullsized":"2024-09-13T19:37:31.200561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:31.200373+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:31.200373+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.200373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:01.945557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.084630+0000","last_change":"2024-09-13T19:37:50.084689+0000","last_active":"2024-09-13T19:37:50.084630+0000","last_peered":"2024-09-13T19:37:50.084630+0000","last_clean":"2024-09-13T19:37:50.084630+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:37:50.084630+0000","last_undegraded":"2024-09-13T19:37:50.084630+0000","last_fullsized":"2024-09-13T19:37:50.084630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:50.084429+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:50.084429+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.084429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:13.245839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.954921+0000","last_change":"2024-09-13T19:37:36.955053+0000","last_active":"2024-09-13T19:37:36.954921+0000","last_peered":"2024-09-13T19:37:36.954921+0000","last_clean":"2024-09-13T19:37:36.954921+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:37:36.954921+0000","last_undegraded":"2024-09-13T19:37:36.954921+0000","last_fullsized":"2024-09-13T19:37:36.954921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:36.954674+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:36.954674+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.954674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:38.360824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352403+0000","last_change":"2024-09-13T19:33:08.334993+0000","last_active":"2024-09-13T19:37:00.352403+0000","last_peered":"2024-09-13T19:37:00.352403+0000","last_clean":"2024-09-13T19:37:00.352403+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:37:00.352403+0000","last_undegraded":"2024-09-13T19:37:00.352403+0000","last_fullsized":"2024-09-13T19:37:00.352403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.167479+0000","last_change":"2024-09-13T19:37:33.167544+0000","last_active":"2024-09-13T19:37:33.167479+0000","last_peered":"2024-09-13T19:37:33.167479+0000","last_clean":"2024-09-13T19:37:33.167479+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:37:33.167479+0000","last_undegraded":"2024-09-13T19:37:33.167479+0000","last_fullsized":"2024-09-13T19:37:33.167479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.167253+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.167253+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.167253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:45.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.086624+0000","last_change":"2024-09-13T19:37:54.086685+0000","last_active":"2024-09-13T19:37:54.086624+0000","last_peered":"2024-09-13T19:37:54.086624+0000","last_clean":"2024-09-13T19:37:54.086624+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:37:54.086624+0000","last_undegraded":"2024-09-13T19:37:54.086624+0000","last_fullsized":"2024-09-13T19:37:54.086624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:54.086427+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:54.086427+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.086427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:06.678941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.163622+0000","last_change":"2024-09-13T19:37:35.163796+0000","last_active":"2024-09-13T19:37:35.163622+0000","last_peered":"2024-09-13T19:37:35.163622+0000","last_clean":"2024-09-13T19:37:35.163622+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:37:35.163622+0000","last_undegraded":"2024-09-13T19:37:35.163622+0000","last_fullsized":"2024-09-13T19:37:35.163622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:35.163395+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:35.163395+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.163395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:10.385936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.052353+0000","last_change":"2024-09-13T19:37:49.052481+0000","last_active":"2024-09-13T19:37:49.052353+0000","last_peered":"2024-09-13T19:37:49.052353+0000","last_clean":"2024-09-13T19:37:49.052353+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:37:49.052353+0000","last_undegraded":"2024-09-13T19:37:49.052353+0000","last_fullsized":"2024-09-13T19:37:49.052353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:49.052106+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.052106+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.052106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:56.624456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.483093+0000","last_change":"2024-09-13T19:37:42.483164+0000","last_active":"2024-09-13T19:37:42.483093+0000","last_peered":"2024-09-13T19:37:42.483093+0000","last_clean":"2024-09-13T19:37:42.483093+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:37:42.483093+0000","last_undegraded":"2024-09-13T19:37:42.483093+0000","last_fullsized":"2024-09-13T19:37:42.483093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:42.482866+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:42.482866+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.482866+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:21.318908+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.483639+0000","last_change":"2024-09-13T19:37:43.483707+0000","last_active":"2024-09-13T19:37:43.483639+0000","last_peered":"2024-09-13T19:37:43.483639+0000","last_clean":"2024-09-13T19:37:43.483639+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:37:43.483639+0000","last_undegraded":"2024-09-13T19:37:43.483639+0000","last_fullsized":"2024-09-13T19:37:43.483639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:43.483442+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:43.483442+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.483442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:14.592719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.150134+0000","last_change":"2024-09-13T19:37:37.150197+0000","last_active":"2024-09-13T19:37:37.150134+0000","last_peered":"2024-09-13T19:37:37.150134+0000","last_clean":"2024-09-13T19:37:37.150134+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:37:37.150134+0000","last_undegraded":"2024-09-13T19:37:37.150134+0000","last_fullsized":"2024-09-13T19:37:37.150134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:37.149953+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:37.149953+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.149953+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.044893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.905881+0000","last_change":"2024-09-13T19:37:28.905881+0000","last_active":"2024-09-13T19:37:28.905881+0000","last_peered":"2024-09-13T19:37:28.905881+0000","last_clean":"2024-09-13T19:37:28.905881+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:37:28.905881+0000","last_undegraded":"2024-09-13T19:37:28.905881+0000","last_fullsized":"2024-09-13T19:37:28.905881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:28.905626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:28.905626+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.905626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:55.777372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.430872+0000","last_change":"2024-09-13T19:37:35.430941+0000","last_active":"2024-09-13T19:37:35.430872+0000","last_peered":"2024-09-13T19:37:35.430872+0000","last_clean":"2024-09-13T19:37:35.430872+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:37:35.430872+0000","last_undegraded":"2024-09-13T19:37:35.430872+0000","last_fullsized":"2024-09-13T19:37:35.430872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:35.430664+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:35.430664+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.430664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.672938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.038487+0000","last_change":"2024-09-13T19:37:51.038544+0000","last_active":"2024-09-13T19:37:51.038487+0000","last_peered":"2024-09-13T19:37:51.038487+0000","last_clean":"2024-09-13T19:37:51.038487+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:37:51.038487+0000","last_undegraded":"2024-09-13T19:37:51.038487+0000","last_fullsized":"2024-09-13T19:37:51.038487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:51.038289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:51.038289+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.038289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:38.835483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.512846+0000","last_change":"2024-09-13T19:37:30.512846+0000","last_active":"2024-09-13T19:37:30.512846+0000","last_peered":"2024-09-13T19:37:30.512846+0000","last_clean":"2024-09-13T19:37:30.512846+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:37:30.512846+0000","last_undegraded":"2024-09-13T19:37:30.512846+0000","last_fullsized":"2024-09-13T19:37:30.512846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:30.512571+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:30.512571+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.512571+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:33.379047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352168+0000","last_change":"2024-09-13T19:33:08.332434+0000","last_active":"2024-09-13T19:37:00.352168+0000","last_peered":"2024-09-13T19:37:00.352168+0000","last_clean":"2024-09-13T19:37:00.352168+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:37:00.352168+0000","last_undegraded":"2024-09-13T19:37:00.352168+0000","last_fullsized":"2024-09-13T19:37:00.352168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'14","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.104875+0000","last_change":"2024-09-13T19:37:18.104875+0000","last_active":"2024-09-13T19:37:18.104875+0000","last_peered":"2024-09-13T19:37:18.104875+0000","last_clean":"2024-09-13T19:37:18.104875+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:37:18.104875+0000","last_undegraded":"2024-09-13T19:37:18.104875+0000","last_fullsized":"2024-09-13T19:37:18.104875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:18.104473+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:18.104473+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.104473+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:20.278237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.025172+0000","last_change":"2024-09-13T19:37:40.025225+0000","last_active":"2024-09-13T19:37:40.025172+0000","last_peered":"2024-09-13T19:37:40.025172+0000","last_clean":"2024-09-13T19:37:40.025172+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:37:40.025172+0000","last_undegraded":"2024-09-13T19:37:40.025172+0000","last_fullsized":"2024-09-13T19:37:40.025172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:40.024986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:40.024986+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.024986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:45.755716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.244707+0000","last_change":"2024-09-13T19:37:30.244707+0000","last_active":"2024-09-13T19:37:30.244707+0000","last_peered":"2024-09-13T19:37:30.244707+0000","last_clean":"2024-09-13T19:37:30.244707+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:37:30.244707+0000","last_undegraded":"2024-09-13T19:37:30.244707+0000","last_fullsized":"2024-09-13T19:37:30.244707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:30.244451+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:30.244451+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.244451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:22.965504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.440228+0000","last_change":"2024-09-13T19:37:41.440287+0000","last_active":"2024-09-13T19:37:41.440228+0000","last_peered":"2024-09-13T19:37:41.440228+0000","last_clean":"2024-09-13T19:37:41.440228+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:37:41.440228+0000","last_undegraded":"2024-09-13T19:37:41.440228+0000","last_fullsized":"2024-09-13T19:37:41.440228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:41.440043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:41.440043+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.440043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:18.433927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.500426+0000","last_change":"2024-09-13T19:37:31.500426+0000","last_active":"2024-09-13T19:37:31.500426+0000","last_peered":"2024-09-13T19:37:31.500426+0000","last_clean":"2024-09-13T19:37:31.500426+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:37:31.500426+0000","last_undegraded":"2024-09-13T19:37:31.500426+0000","last_fullsized":"2024-09-13T19:37:31.500426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:31.500107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:31.500107+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.500107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:51.092885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.528643+0000","last_change":"2024-09-13T19:37:39.528643+0000","last_active":"2024-09-13T19:37:39.528643+0000","last_peered":"2024-09-13T19:37:39.528643+0000","last_clean":"2024-09-13T19:37:39.528643+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:37:39.528643+0000","last_undegraded":"2024-09-13T19:37:39.528643+0000","last_fullsized":"2024-09-13T19:37:39.528643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:39.528373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:39.528373+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.528373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:21.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.501778+0000","last_change":"2024-09-13T19:37:27.501778+0000","last_active":"2024-09-13T19:37:27.501778+0000","last_peered":"2024-09-13T19:37:27.501778+0000","last_clean":"2024-09-13T19:37:27.501778+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:37:27.501778+0000","last_undegraded":"2024-09-13T19:37:27.501778+0000","last_fullsized":"2024-09-13T19:37:27.501778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:27.501537+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:27.501537+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.501537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:56.956150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.848065+0000","last_change":"2024-09-13T19:37:52.848193+0000","last_active":"2024-09-13T19:37:52.848065+0000","last_peered":"2024-09-13T19:37:52.848065+0000","last_clean":"2024-09-13T19:37:52.848065+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:37:52.848065+0000","last_undegraded":"2024-09-13T19:37:52.848065+0000","last_fullsized":"2024-09-13T19:37:52.848065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:52.847823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:52.847823+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.847823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:10:54.892989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.493010+0000","last_change":"2024-09-13T19:37:32.493010+0000","last_active":"2024-09-13T19:37:32.493010+0000","last_peered":"2024-09-13T19:37:32.493010+0000","last_clean":"2024-09-13T19:37:32.493010+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:37:32.493010+0000","last_undegraded":"2024-09-13T19:37:32.493010+0000","last_fullsized":"2024-09-13T19:37:32.493010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:32.492604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:32.492604+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.492604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:38.824183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352486+0000","last_change":"2024-09-13T19:33:08.335544+0000","last_active":"2024-09-13T19:37:00.352486+0000","last_peered":"2024-09-13T19:37:00.352486+0000","last_clean":"2024-09-13T19:37:00.352486+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:37:00.352486+0000","last_undegraded":"2024-09-13T19:37:00.352486+0000","last_fullsized":"2024-09-13T19:37:00.352486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.937555+0000","last_change":"2024-09-13T19:37:37.937555+0000","last_active":"2024-09-13T19:37:37.937555+0000","last_peered":"2024-09-13T19:37:37.937555+0000","last_clean":"2024-09-13T19:37:37.937555+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:37:37.937555+0000","last_undegraded":"2024-09-13T19:37:37.937555+0000","last_fullsized":"2024-09-13T19:37:37.937555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:37.937265+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:37.937265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.937265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:03.903704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.965052+0000","last_change":"2024-09-13T19:37:30.965052+0000","last_active":"2024-09-13T19:37:30.965052+0000","last_peered":"2024-09-13T19:37:30.965052+0000","last_clean":"2024-09-13T19:37:30.965052+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:37:30.965052+0000","last_undegraded":"2024-09-13T19:37:30.965052+0000","last_fullsized":"2024-09-13T19:37:30.965052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:30.964823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:30.964823+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.964823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:34.672513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.479987+0000","last_change":"2024-09-13T19:37:33.480053+0000","last_active":"2024-09-13T19:37:33.479987+0000","last_peered":"2024-09-13T19:37:33.479987+0000","last_clean":"2024-09-13T19:37:33.479987+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:37:33.479987+0000","last_undegraded":"2024-09-13T19:37:33.479987+0000","last_fullsized":"2024-09-13T19:37:33.479987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.479793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.479793+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.479793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:15.251464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352136+0000","last_change":"2024-09-13T19:33:08.354921+0000","last_active":"2024-09-13T19:37:00.352136+0000","last_peered":"2024-09-13T19:37:00.352136+0000","last_clean":"2024-09-13T19:37:00.352136+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:37:00.352136+0000","last_undegraded":"2024-09-13T19:37:00.352136+0000","last_fullsized":"2024-09-13T19:37:00.352136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.352242+0000","last_change":"2024-09-13T19:33:08.354409+0000","last_active":"2024-09-13T19:37:00.352242+0000","last_peered":"2024-09-13T19:37:00.352242+0000","last_clean":"2024-09-13T19:37:00.352242+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:37:00.352242+0000","last_undegraded":"2024-09-13T19:37:00.352242+0000","last_fullsized":"2024-09-13T19:37:00.352242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:07.521010+0000","last_clean_scrub_stamp":"2024-09-13T19:33:07.521010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.049275+0000","last_change":"2024-09-13T19:37:43.049275+0000","last_active":"2024-09-13T19:37:43.049275+0000","last_peered":"2024-09-13T19:37:43.049275+0000","last_clean":"2024-09-13T19:37:43.049275+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:37:43.049275+0000","last_undegraded":"2024-09-13T19:37:43.049275+0000","last_fullsized":"2024-09-13T19:37:43.049275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:43.049024+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:43.049024+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.049024+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:14.158302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.117918+0000","last_change":"2024-09-13T19:37:38.117918+0000","last_active":"2024-09-13T19:37:38.117918+0000","last_peered":"2024-09-13T19:37:38.117918+0000","last_clean":"2024-09-13T19:37:38.117918+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:37:38.117918+0000","last_undegraded":"2024-09-13T19:37:38.117918+0000","last_fullsized":"2024-09-13T19:37:38.117918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:38.117676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:38.117676+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.117676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:38.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.574599+0000","last_change":"2024-09-13T19:37:25.574599+0000","last_active":"2024-09-13T19:37:25.574599+0000","last_peered":"2024-09-13T19:37:25.574599+0000","last_clean":"2024-09-13T19:37:25.574599+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:37:25.574599+0000","last_undegraded":"2024-09-13T19:37:25.574599+0000","last_fullsized":"2024-09-13T19:37:25.574599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:25.574184+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:25.574184+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.574184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:32.773848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1527,"ondisk_log_size":1527,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673025,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40460,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331380,"statfs":{"total":96636764160,"available":96595333120,"internally_reserved":0,"allocated":978944,"data_stored":724012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673024,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1015808,"data_stored":726198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":135923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:38:02.004 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.004 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.004 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.004 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.005 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.005 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.005 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.006 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.006 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T19:33:09.306612+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=9, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.006 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.007 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.007 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.007 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.007 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.008 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.008 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:32:59.486586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=32, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.008 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.008 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.009 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.009 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.009 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.010 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.010 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.010 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.010 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.010 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.011 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.011 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.011 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:33:07.521010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=7, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:02.011 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:38:22.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:38:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.141+0000 7fb4553e2640 1 Processor -- start 2024-09-13T19:38:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb4553e2640 1 -- start start 2024-09-13T19:38:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb4553e2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb45006d0e0 0x7fb45006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb4553e2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb450071c10 con 0x7fb45006da00 2024-09-13T19:38:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb4553e2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb450072230 con 0x7fb45006d0e0 2024-09-13T19:38:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb44effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb45006d0e0 0x7fb45006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb44e7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb45006da00 0x7fb45012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35636/0 (socket says 172.21.15.18:35636) 2024-09-13T19:38:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb44e7fc640 1 -- 172.21.15.18:0/2406646573 learned_addr learned my addr 172.21.15.18:0/2406646573 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:38:22.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb44effd640 1 -- 172.21.15.18:0/2406646573 >> v1:172.21.15.18:6789/0 conn(0x7fb45006da00 legacy=0x7fb45012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:22.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.145+0000 7fb44effd640 1 -- 172.21.15.18:0/2406646573 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4500709e0 con 0x7fb45006d0e0 2024-09-13T19:38:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44effd640 1 --2- 172.21.15.18:0/2406646573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb45006d4c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb440009d90 tx=0x7fb44001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab141ad0bdc45e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44dffb640 1 -- 172.21.15.18:0/2406646573 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4400a6560 con 0x7fb45006d0e0 2024-09-13T19:38:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44dffb640 1 -- 172.21.15.18:0/2406646573 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4400a6700 con 0x7fb45006d0e0 2024-09-13T19:38:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44dffb640 1 -- 172.21.15.18:0/2406646573 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4400a6a00 con 0x7fb45006d0e0 2024-09-13T19:38:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- 172.21.15.18:0/2406646573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 msgr2=0x7fb45006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 --2- 172.21.15.18:0/2406646573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb45006d4c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb440009d90 tx=0x7fb44001c8c0 comp rx=0 tx=0).stop 2024-09-13T19:38:22.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- 172.21.15.18:0/2406646573 shutdown_connections 2024-09-13T19:38:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 --2- 172.21.15.18:0/2406646573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb45006d4c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- 172.21.15.18:0/2406646573 >> 172.21.15.18:0/2406646573 conn(0x7fb450099a50 msgr2=0x7fb4500972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:38:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- 172.21.15.18:0/2406646573 shutdown_connections 2024-09-13T19:38:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- 172.21.15.18:0/2406646573 wait complete. 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 Processor -- start 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- start start 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb4501c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb450134e80 con 0x7fb45006d0e0 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb4501c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb4501c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42382/0 (socket says 172.21.15.18:42382) 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44effd640 1 -- 172.21.15.18:0/4154138729 learned_addr learned my addr 172.21.15.18:0/4154138729 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44effd640 1 -- 172.21.15.18:0/4154138729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45012bfc0 con 0x7fb45006d0e0 2024-09-13T19:38:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb44effd640 1 --2- 172.21.15.18:0/4154138729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb4501c6360 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb44001a4f0 tx=0x7fb440019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4377fe640 1 -- 172.21.15.18:0/4154138729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4400bb570 con 0x7fb45006d0e0 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4377fe640 1 -- 172.21.15.18:0/4154138729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4400c0070 con 0x7fb45006d0e0 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45006f660 con 0x7fb45006d0e0 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4377fe640 1 -- 172.21.15.18:0/4154138729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4400bb860 con 0x7fb45006d0e0 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.149+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4501c68a0 con 0x7fb45006d0e0 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.153+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45006d4c0 con 0x7fb45006d0e0 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.153+0000 7fb4377fe640 1 -- 172.21.15.18:0/4154138729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb4400bba00 con 0x7fb45006d0e0 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.153+0000 7fb4377fe640 1 --2- 172.21.15.18:0/4154138729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb43c035db0 0x7fb43c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.153+0000 7fb4377fe640 1 -- 172.21.15.18:0/4154138729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb4400e4410 con 0x7fb45006d0e0 2024-09-13T19:38:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.153+0000 7fb44e7fc640 1 --2- 172.21.15.18:0/4154138729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb43c035db0 0x7fb43c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.153+0000 7fb44e7fc640 1 --2- 172.21.15.18:0/4154138729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb43c035db0 0x7fb43c038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb444001610 tx=0x7fb444007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.157+0000 7fb4377fe640 1 -- 172.21.15.18:0/4154138729 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb4400ac030 con 0x7fb45006d0e0 2024-09-13T19:38:22.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.313+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb450073790 con 0x7fb43c035db0 2024-09-13T19:38:22.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.365+0000 7fb4377fe640 1 -- 172.21.15.18:0/4154138729 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665846 (secure 0 0 0) 0x7fb450073790 con 0x7fb43c035db0 2024-09-13T19:38:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:38:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:38:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb43c035db0 msgr2=0x7fb43c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 --2- 172.21.15.18:0/4154138729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb43c035db0 0x7fb43c038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb444001610 tx=0x7fb444007ad0 comp rx=0 tx=0).stop 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 msgr2=0x7fb4501c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 --2- 172.21.15.18:0/4154138729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb4501c6360 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb44001a4f0 tx=0x7fb440019660 comp rx=0 tx=0).stop 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 shutdown_connections 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 --2- 172.21.15.18:0/4154138729 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7fb43c035db0 0x7fb43c038270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 --2- 172.21.15.18:0/4154138729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45006d0e0 0x7fb4501c6360 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 >> 172.21.15.18:0/4154138729 conn(0x7fb450099a50 msgr2=0x7fb45009b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 shutdown_connections 2024-09-13T19:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:22.373+0000 7fb4553e2640 1 -- 172.21.15.18:0/4154138729 wait complete. 2024-09-13T19:38:22.401 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-13T19:38:20.559626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5103,"num_read_kb":4688,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4794,"ondisk_log_size":4794,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148352,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339008,"statfs":{"total":386547056640,"available":386395144192,"internally_reserved":0,"allocated":2883584,"data_stored":1722916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006218"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.048263+0000","last_change":"2024-09-13T19:37:33.048322+0000","last_active":"2024-09-13T19:37:33.048263+0000","last_peered":"2024-09-13T19:37:33.048263+0000","last_clean":"2024-09-13T19:37:33.048263+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:37:33.048263+0000","last_undegraded":"2024-09-13T19:37:33.048263+0000","last_fullsized":"2024-09-13T19:37:33.048263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.048081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.048081+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.048081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:51.634204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.602314+0000","last_change":"2024-09-13T19:37:54.602314+0000","last_active":"2024-09-13T19:37:54.602314+0000","last_peered":"2024-09-13T19:37:54.602314+0000","last_clean":"2024-09-13T19:37:54.602314+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:37:54.602314+0000","last_undegraded":"2024-09-13T19:37:54.602314+0000","last_fullsized":"2024-09-13T19:37:54.602314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:54.602013+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:54.602013+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.602013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:18.418246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.210640+0000","last_change":"2024-09-13T19:37:32.210703+0000","last_active":"2024-09-13T19:37:32.210640+0000","last_peered":"2024-09-13T19:37:32.210640+0000","last_clean":"2024-09-13T19:37:32.210640+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:37:32.210640+0000","last_undegraded":"2024-09-13T19:37:32.210640+0000","last_fullsized":"2024-09-13T19:37:32.210640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:32.210444+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:32.210444+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.210444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:10.274425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:02.175942+0000","last_change":"2024-09-13T19:38:02.176010+0000","last_active":"2024-09-13T19:38:02.175942+0000","last_peered":"2024-09-13T19:38:02.175942+0000","last_clean":"2024-09-13T19:38:02.175942+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:38:02.175942+0000","last_undegraded":"2024-09-13T19:38:02.175942+0000","last_fullsized":"2024-09-13T19:38:02.175942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:38:02.175762+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:38:02.175762+0000","last_clean_scrub_stamp":"2024-09-13T19:38:02.175762+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:29.549029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:04.663847+0000","last_change":"2024-09-13T19:38:04.663907+0000","last_active":"2024-09-13T19:38:04.663847+0000","last_peered":"2024-09-13T19:38:04.663847+0000","last_clean":"2024-09-13T19:38:04.663847+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:38:04.663847+0000","last_undegraded":"2024-09-13T19:38:04.663847+0000","last_fullsized":"2024-09-13T19:38:04.663847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:04.663651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:04.663651+0000","last_clean_scrub_stamp":"2024-09-13T19:38:04.663651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:17.798240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.874219+0000","last_change":"2024-09-13T19:37:43.874219+0000","last_active":"2024-09-13T19:37:43.874219+0000","last_peered":"2024-09-13T19:37:43.874219+0000","last_clean":"2024-09-13T19:37:43.874219+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:37:43.874219+0000","last_undegraded":"2024-09-13T19:37:43.874219+0000","last_fullsized":"2024-09-13T19:37:43.874219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:43.873952+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:43.873952+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.873952+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:37.149472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.942566+0000","last_change":"2024-09-13T19:37:43.942694+0000","last_active":"2024-09-13T19:37:43.942566+0000","last_peered":"2024-09-13T19:37:43.942566+0000","last_clean":"2024-09-13T19:37:43.942566+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:37:43.942566+0000","last_undegraded":"2024-09-13T19:37:43.942566+0000","last_fullsized":"2024-09-13T19:37:43.942566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:43.942314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:43.942314+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.942314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:55.792500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.872136+0000","last_change":"2024-09-13T19:37:47.872136+0000","last_active":"2024-09-13T19:37:47.872136+0000","last_peered":"2024-09-13T19:37:47.872136+0000","last_clean":"2024-09-13T19:37:47.872136+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:37:47.872136+0000","last_undegraded":"2024-09-13T19:37:47.872136+0000","last_fullsized":"2024-09-13T19:37:47.872136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:47.871853+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:47.871853+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.871853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:41.399592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:05.676649+0000","last_change":"2024-09-13T19:38:05.676649+0000","last_active":"2024-09-13T19:38:05.676649+0000","last_peered":"2024-09-13T19:38:05.676649+0000","last_clean":"2024-09-13T19:38:05.676649+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:38:05.676649+0000","last_undegraded":"2024-09-13T19:38:05.676649+0000","last_fullsized":"2024-09-13T19:38:05.676649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:05.676397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:05.676397+0000","last_clean_scrub_stamp":"2024-09-13T19:38:05.676397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:50.685654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.501820+0000","last_change":"2024-09-13T19:37:44.501917+0000","last_active":"2024-09-13T19:37:44.501820+0000","last_peered":"2024-09-13T19:37:44.501820+0000","last_clean":"2024-09-13T19:37:44.501820+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:37:44.501820+0000","last_undegraded":"2024-09-13T19:37:44.501820+0000","last_fullsized":"2024-09-13T19:37:44.501820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:44.501619+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:44.501619+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.501619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:32.640242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.068228+0000","last_change":"2024-09-13T19:37:41.068228+0000","last_active":"2024-09-13T19:37:41.068228+0000","last_peered":"2024-09-13T19:37:41.068228+0000","last_clean":"2024-09-13T19:37:41.068228+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:37:41.068228+0000","last_undegraded":"2024-09-13T19:37:41.068228+0000","last_fullsized":"2024-09-13T19:37:41.068228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:41.067989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:41.067989+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.067989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:54.472887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.052391+0000","last_change":"2024-09-13T19:37:20.052391+0000","last_active":"2024-09-13T19:37:20.052391+0000","last_peered":"2024-09-13T19:37:20.052391+0000","last_clean":"2024-09-13T19:37:20.052391+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:37:20.052391+0000","last_undegraded":"2024-09-13T19:37:20.052391+0000","last_fullsized":"2024-09-13T19:37:20.052391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:20.052114+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:20.052114+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.052114+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:18.722062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:03.683076+0000","last_change":"2024-09-13T19:38:03.683076+0000","last_active":"2024-09-13T19:38:03.683076+0000","last_peered":"2024-09-13T19:38:03.683076+0000","last_clean":"2024-09-13T19:38:03.683076+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:38:03.683076+0000","last_undegraded":"2024-09-13T19:38:03.683076+0000","last_fullsized":"2024-09-13T19:38:03.683076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:03.682720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:03.682720+0000","last_clean_scrub_stamp":"2024-09-13T19:38:03.682720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:10.301822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.891639+0000","last_change":"2024-09-13T19:37:20.891706+0000","last_active":"2024-09-13T19:37:20.891639+0000","last_peered":"2024-09-13T19:37:20.891639+0000","last_clean":"2024-09-13T19:37:20.891639+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:37:20.891639+0000","last_undegraded":"2024-09-13T19:37:20.891639+0000","last_fullsized":"2024-09-13T19:37:20.891639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:20.891432+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:20.891432+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.891432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:01.880905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.014562+0000","last_change":"2024-09-13T19:37:52.014562+0000","last_active":"2024-09-13T19:37:52.014562+0000","last_peered":"2024-09-13T19:37:52.014562+0000","last_clean":"2024-09-13T19:37:52.014562+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:37:52.014562+0000","last_undegraded":"2024-09-13T19:37:52.014562+0000","last_fullsized":"2024-09-13T19:37:52.014562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:52.014296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:52.014296+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.014296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:22.126180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.934911+0000","last_change":"2024-09-13T19:37:21.934969+0000","last_active":"2024-09-13T19:37:21.934911+0000","last_peered":"2024-09-13T19:37:21.934911+0000","last_clean":"2024-09-13T19:37:21.934911+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:37:21.934911+0000","last_undegraded":"2024-09-13T19:37:21.934911+0000","last_fullsized":"2024-09-13T19:37:21.934911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:21.934729+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:21.934729+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.934729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:12.436264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.894788+0000","last_change":"2024-09-13T19:37:45.894788+0000","last_active":"2024-09-13T19:37:45.894788+0000","last_peered":"2024-09-13T19:37:45.894788+0000","last_clean":"2024-09-13T19:37:45.894788+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:37:45.894788+0000","last_undegraded":"2024-09-13T19:37:45.894788+0000","last_fullsized":"2024-09-13T19:37:45.894788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:45.894519+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:45.894519+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.894519+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:39.495425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.580592+0000","last_change":"2024-09-13T19:37:53.580592+0000","last_active":"2024-09-13T19:37:53.580592+0000","last_peered":"2024-09-13T19:37:53.580592+0000","last_clean":"2024-09-13T19:37:53.580592+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:37:53.580592+0000","last_undegraded":"2024-09-13T19:37:53.580592+0000","last_fullsized":"2024-09-13T19:37:53.580592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:53.580309+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:53.580309+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.580309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:09.142055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.477714+0000","last_change":"2024-09-13T19:37:34.477714+0000","last_active":"2024-09-13T19:37:34.477714+0000","last_peered":"2024-09-13T19:37:34.477714+0000","last_clean":"2024-09-13T19:37:34.477714+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:37:34.477714+0000","last_undegraded":"2024-09-13T19:37:34.477714+0000","last_fullsized":"2024-09-13T19:37:34.477714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:34.477463+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:34.477463+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.477463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:52.475004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.910580+0000","last_change":"2024-09-13T19:37:26.910580+0000","last_active":"2024-09-13T19:37:26.910580+0000","last_peered":"2024-09-13T19:37:26.910580+0000","last_clean":"2024-09-13T19:37:26.910580+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:37:26.910580+0000","last_undegraded":"2024-09-13T19:37:26.910580+0000","last_fullsized":"2024-09-13T19:37:26.910580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:26.910211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:26.910211+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.910211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:56.864518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.506434+0000","last_change":"2024-09-13T19:37:29.506434+0000","last_active":"2024-09-13T19:37:29.506434+0000","last_peered":"2024-09-13T19:37:29.506434+0000","last_clean":"2024-09-13T19:37:29.506434+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:37:29.506434+0000","last_undegraded":"2024-09-13T19:37:29.506434+0000","last_fullsized":"2024-09-13T19:37:29.506434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:29.506176+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:29.506176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.506176+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:37.784459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.561591+0000","last_change":"2024-09-13T19:37:52.561591+0000","last_active":"2024-09-13T19:37:52.561591+0000","last_peered":"2024-09-13T19:37:52.561591+0000","last_clean":"2024-09-13T19:37:52.561591+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:37:52.561591+0000","last_undegraded":"2024-09-13T19:37:52.561591+0000","last_fullsized":"2024-09-13T19:37:52.561591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:52.561338+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:52.561338+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.561338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.056750+0000","last_change":"2024-09-13T19:37:45.056750+0000","last_active":"2024-09-13T19:37:45.056750+0000","last_peered":"2024-09-13T19:37:45.056750+0000","last_clean":"2024-09-13T19:37:45.056750+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:37:45.056750+0000","last_undegraded":"2024-09-13T19:37:45.056750+0000","last_fullsized":"2024-09-13T19:37:45.056750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:45.056474+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:45.056474+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.056474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:36.206327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.504678+0000","last_change":"2024-09-13T19:37:48.504678+0000","last_active":"2024-09-13T19:37:48.504678+0000","last_peered":"2024-09-13T19:37:48.504678+0000","last_clean":"2024-09-13T19:37:48.504678+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:37:48.504678+0000","last_undegraded":"2024-09-13T19:37:48.504678+0000","last_fullsized":"2024-09-13T19:37:48.504678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:48.504384+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:48.504384+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.504384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:42.588829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.955812+0000","last_change":"2024-09-13T19:37:45.955812+0000","last_active":"2024-09-13T19:37:45.955812+0000","last_peered":"2024-09-13T19:37:45.955812+0000","last_clean":"2024-09-13T19:37:45.955812+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:37:45.955812+0000","last_undegraded":"2024-09-13T19:37:45.955812+0000","last_fullsized":"2024-09-13T19:37:45.955812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:45.955540+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:45.955540+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.955540+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:18.197814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.033559+0000","last_change":"2024-09-13T19:37:44.033559+0000","last_active":"2024-09-13T19:37:44.033559+0000","last_peered":"2024-09-13T19:37:44.033559+0000","last_clean":"2024-09-13T19:37:44.033559+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:37:44.033559+0000","last_undegraded":"2024-09-13T19:37:44.033559+0000","last_fullsized":"2024-09-13T19:37:44.033559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:44.033185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:44.033185+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.033185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:32.171808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.487343+0000","last_change":"2024-09-13T19:37:40.487343+0000","last_active":"2024-09-13T19:37:40.487343+0000","last_peered":"2024-09-13T19:37:40.487343+0000","last_clean":"2024-09-13T19:37:40.487343+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:37:40.487343+0000","last_undegraded":"2024-09-13T19:37:40.487343+0000","last_fullsized":"2024-09-13T19:37:40.487343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-13T19:37:40.486977+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-13T19:37:40.486977+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.486977+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:46.217708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.707576+0000","last_change":"2024-09-13T19:37:57.707631+0000","last_active":"2024-09-13T19:37:57.707576+0000","last_peered":"2024-09-13T19:37:57.707576+0000","last_clean":"2024-09-13T19:37:57.707576+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:37:57.707576+0000","last_undegraded":"2024-09-13T19:37:57.707576+0000","last_fullsized":"2024-09-13T19:37:57.707576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:57.707380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:57.707380+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.707380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:31.582933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'38","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.620329+0000","last_change":"2024-09-13T19:37:24.620329+0000","last_active":"2024-09-13T19:37:24.620329+0000","last_peered":"2024-09-13T19:37:24.620329+0000","last_clean":"2024-09-13T19:37:24.620329+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:37:24.620329+0000","last_undegraded":"2024-09-13T19:37:24.620329+0000","last_fullsized":"2024-09-13T19:37:24.620329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:24.620070+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:24.620070+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.620070+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.852503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.924828+0000","last_change":"2024-09-13T19:37:35.924828+0000","last_active":"2024-09-13T19:37:35.924828+0000","last_peered":"2024-09-13T19:37:35.924828+0000","last_clean":"2024-09-13T19:37:35.924828+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:37:35.924828+0000","last_undegraded":"2024-09-13T19:37:35.924828+0000","last_fullsized":"2024-09-13T19:37:35.924828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:35.924562+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:35.924562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.924562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:06.221435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:00.644322+0000","last_change":"2024-09-13T19:38:00.644382+0000","last_active":"2024-09-13T19:38:00.644322+0000","last_peered":"2024-09-13T19:38:00.644322+0000","last_clean":"2024-09-13T19:38:00.644322+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:38:00.644322+0000","last_undegraded":"2024-09-13T19:38:00.644322+0000","last_fullsized":"2024-09-13T19:38:00.644322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:38:00.644125+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:38:00.644125+0000","last_clean_scrub_stamp":"2024-09-13T19:38:00.644125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.303207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.123297+0000","last_change":"2024-09-13T19:37:10.123297+0000","last_active":"2024-09-13T19:37:10.123297+0000","last_peered":"2024-09-13T19:37:10.123297+0000","last_clean":"2024-09-13T19:37:10.123297+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:37:10.123297+0000","last_undegraded":"2024-09-13T19:37:10.123297+0000","last_fullsized":"2024-09-13T19:37:10.123297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.123041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:12.989516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.993844+0000","last_change":"2024-09-13T19:37:31.993844+0000","last_active":"2024-09-13T19:37:31.993844+0000","last_peered":"2024-09-13T19:37:31.993844+0000","last_clean":"2024-09-13T19:37:31.993844+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:37:31.993844+0000","last_undegraded":"2024-09-13T19:37:31.993844+0000","last_fullsized":"2024-09-13T19:37:31.993844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:31.993552+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:31.993552+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.993552+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.328726+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.502515+0000","last_change":"2024-09-13T19:37:00.502515+0000","last_active":"2024-09-13T19:37:00.502515+0000","last_peered":"2024-09-13T19:37:00.502515+0000","last_clean":"2024-09-13T19:37:00.502515+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:37:00.502515+0000","last_undegraded":"2024-09-13T19:37:00.502515+0000","last_fullsized":"2024-09-13T19:37:00.502515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.502274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:43.889848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.582272+0000","last_change":"2024-09-13T19:37:16.582272+0000","last_active":"2024-09-13T19:37:16.582272+0000","last_peered":"2024-09-13T19:37:16.582272+0000","last_clean":"2024-09-13T19:37:16.582272+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:37:16.582272+0000","last_undegraded":"2024-09-13T19:37:16.582272+0000","last_fullsized":"2024-09-13T19:37:16.582272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-13T19:37:16.582006+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-13T19:37:16.582006+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.582006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:42.046488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.917995+0000","last_change":"2024-09-13T19:37:39.917995+0000","last_active":"2024-09-13T19:37:39.917995+0000","last_peered":"2024-09-13T19:37:39.917995+0000","last_clean":"2024-09-13T19:37:39.917995+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:37:39.917995+0000","last_undegraded":"2024-09-13T19:37:39.917995+0000","last_fullsized":"2024-09-13T19:37:39.917995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:39.917704+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:39.917704+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.917704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:51.364335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.969945+0000","last_change":"2024-09-13T19:37:44.969945+0000","last_active":"2024-09-13T19:37:44.969945+0000","last_peered":"2024-09-13T19:37:44.969945+0000","last_clean":"2024-09-13T19:37:44.969945+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:37:44.969945+0000","last_undegraded":"2024-09-13T19:37:44.969945+0000","last_fullsized":"2024-09-13T19:37:44.969945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:44.969547+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:44.969547+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.969547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:09:58.625718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:00.550480+0000","last_change":"2024-09-13T19:38:00.550537+0000","last_active":"2024-09-13T19:38:00.550480+0000","last_peered":"2024-09-13T19:38:00.550480+0000","last_clean":"2024-09-13T19:38:00.550480+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:38:00.550480+0000","last_undegraded":"2024-09-13T19:38:00.550480+0000","last_fullsized":"2024-09-13T19:38:00.550480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:00.550264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:00.550264+0000","last_clean_scrub_stamp":"2024-09-13T19:38:00.550264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:00.693560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.502701+0000","last_change":"2024-09-13T19:37:10.502701+0000","last_active":"2024-09-13T19:37:10.502701+0000","last_peered":"2024-09-13T19:37:10.502701+0000","last_clean":"2024-09-13T19:37:10.502701+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:37:10.502701+0000","last_undegraded":"2024-09-13T19:37:10.502701+0000","last_fullsized":"2024-09-13T19:37:10.502701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.502401+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:01.003936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.551561+0000","last_change":"2024-09-13T19:37:04.551561+0000","last_active":"2024-09-13T19:37:04.551561+0000","last_peered":"2024-09-13T19:37:04.551561+0000","last_clean":"2024-09-13T19:37:04.551561+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:37:04.551561+0000","last_undegraded":"2024-09-13T19:37:04.551561+0000","last_fullsized":"2024-09-13T19:37:04.551561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.551265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.460322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.175506+0000","last_change":"2024-09-13T19:37:57.175506+0000","last_active":"2024-09-13T19:37:57.175506+0000","last_peered":"2024-09-13T19:37:57.175506+0000","last_clean":"2024-09-13T19:37:57.175506+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:37:57.175506+0000","last_undegraded":"2024-09-13T19:37:57.175506+0000","last_fullsized":"2024-09-13T19:37:57.175506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:57.175229+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:57.175229+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.175229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:31.384558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.904559+0000","last_change":"2024-09-13T19:37:41.904559+0000","last_active":"2024-09-13T19:37:41.904559+0000","last_peered":"2024-09-13T19:37:41.904559+0000","last_clean":"2024-09-13T19:37:41.904559+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:37:41.904559+0000","last_undegraded":"2024-09-13T19:37:41.904559+0000","last_fullsized":"2024-09-13T19:37:41.904559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:41.904294+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:41.904294+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.904294+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:31.261094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:16.492533+0000","last_change":"2024-09-13T19:38:16.492687+0000","last_active":"2024-09-13T19:38:16.492533+0000","last_peered":"2024-09-13T19:38:16.492533+0000","last_clean":"2024-09-13T19:38:16.492533+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:38:16.492533+0000","last_undegraded":"2024-09-13T19:38:16.492533+0000","last_fullsized":"2024-09-13T19:38:16.492533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:16.492302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:16.492302+0000","last_clean_scrub_stamp":"2024-09-13T19:38:16.492302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:06.570958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.320730+0000","last_change":"2024-09-13T19:37:19.320730+0000","last_active":"2024-09-13T19:37:19.320730+0000","last_peered":"2024-09-13T19:37:19.320730+0000","last_clean":"2024-09-13T19:37:19.320730+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:37:19.320730+0000","last_undegraded":"2024-09-13T19:37:19.320730+0000","last_fullsized":"2024-09-13T19:37:19.320730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.320446+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:11.577834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.894258+0000","last_change":"2024-09-13T19:37:02.894258+0000","last_active":"2024-09-13T19:37:02.894258+0000","last_peered":"2024-09-13T19:37:02.894258+0000","last_clean":"2024-09-13T19:37:02.894258+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:37:02.894258+0000","last_undegraded":"2024-09-13T19:37:02.894258+0000","last_fullsized":"2024-09-13T19:37:02.894258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.893973+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:18.869439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.036435+0000","last_change":"2024-09-13T19:37:24.036435+0000","last_active":"2024-09-13T19:37:24.036435+0000","last_peered":"2024-09-13T19:37:24.036435+0000","last_clean":"2024-09-13T19:37:24.036435+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:37:24.036435+0000","last_undegraded":"2024-09-13T19:37:24.036435+0000","last_fullsized":"2024-09-13T19:37:24.036435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:24.036142+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:24.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.036142+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:55.593216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.949535+0000","last_change":"2024-09-13T19:37:48.949535+0000","last_active":"2024-09-13T19:37:48.949535+0000","last_peered":"2024-09-13T19:37:48.949535+0000","last_clean":"2024-09-13T19:37:48.949535+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:37:48.949535+0000","last_undegraded":"2024-09-13T19:37:48.949535+0000","last_fullsized":"2024-09-13T19:37:48.949535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:48.949281+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:48.949281+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.949281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:51.123045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.092390+0000","last_change":"2024-09-13T19:37:55.092390+0000","last_active":"2024-09-13T19:37:55.092390+0000","last_peered":"2024-09-13T19:37:55.092390+0000","last_clean":"2024-09-13T19:37:55.092390+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:37:55.092390+0000","last_undegraded":"2024-09-13T19:37:55.092390+0000","last_fullsized":"2024-09-13T19:37:55.092390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:55.092086+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:55.092086+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.092086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:47.647736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.552036+0000","last_change":"2024-09-13T19:37:51.552097+0000","last_active":"2024-09-13T19:37:51.552036+0000","last_peered":"2024-09-13T19:37:51.552036+0000","last_clean":"2024-09-13T19:37:51.552036+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:37:51.552036+0000","last_undegraded":"2024-09-13T19:37:51.552036+0000","last_fullsized":"2024-09-13T19:37:51.552036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:51.551850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:51.551850+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.551850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:16.887024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.109820+0000","last_change":"2024-09-13T19:37:08.109820+0000","last_active":"2024-09-13T19:37:08.109820+0000","last_peered":"2024-09-13T19:37:08.109820+0000","last_clean":"2024-09-13T19:37:08.109820+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:37:08.109820+0000","last_undegraded":"2024-09-13T19:37:08.109820+0000","last_fullsized":"2024-09-13T19:37:08.109820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.109562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.916276+0000","last_change":"2024-09-13T19:37:04.916276+0000","last_active":"2024-09-13T19:37:04.916276+0000","last_peered":"2024-09-13T19:37:04.916276+0000","last_clean":"2024-09-13T19:37:04.916276+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:37:04.916276+0000","last_undegraded":"2024-09-13T19:37:04.916276+0000","last_fullsized":"2024-09-13T19:37:04.916276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.915985+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:53.420288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.239330+0000","last_change":"2024-09-13T19:37:21.239330+0000","last_active":"2024-09-13T19:37:21.239330+0000","last_peered":"2024-09-13T19:37:21.239330+0000","last_clean":"2024-09-13T19:37:21.239330+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:37:21.239330+0000","last_undegraded":"2024-09-13T19:37:21.239330+0000","last_fullsized":"2024-09-13T19:37:21.239330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:21.239082+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:21.239082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.239082+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:39.825205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.937814+0000","last_change":"2024-09-13T19:37:32.937966+0000","last_active":"2024-09-13T19:37:32.937814+0000","last_peered":"2024-09-13T19:37:32.937814+0000","last_clean":"2024-09-13T19:37:32.937814+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:37:32.937814+0000","last_undegraded":"2024-09-13T19:37:32.937814+0000","last_fullsized":"2024-09-13T19:37:32.937814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:32.937538+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:32.937538+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.937538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:49.829336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.990830+0000","last_change":"2024-09-13T19:37:42.990896+0000","last_active":"2024-09-13T19:37:42.990830+0000","last_peered":"2024-09-13T19:37:42.990830+0000","last_clean":"2024-09-13T19:37:42.990830+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:37:42.990830+0000","last_undegraded":"2024-09-13T19:37:42.990830+0000","last_fullsized":"2024-09-13T19:37:42.990830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:42.990615+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:42.990615+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.990615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:21.054596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.520028+0000","last_change":"2024-09-13T19:37:14.520028+0000","last_active":"2024-09-13T19:37:14.520028+0000","last_peered":"2024-09-13T19:37:14.520028+0000","last_clean":"2024-09-13T19:37:14.520028+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:37:14.520028+0000","last_undegraded":"2024-09-13T19:37:14.520028+0000","last_fullsized":"2024-09-13T19:37:14.520028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.519779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:02.289326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.958861+0000","last_change":"2024-09-13T19:37:06.958861+0000","last_active":"2024-09-13T19:37:06.958861+0000","last_peered":"2024-09-13T19:37:06.958861+0000","last_clean":"2024-09-13T19:37:06.958861+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:37:06.958861+0000","last_undegraded":"2024-09-13T19:37:06.958861+0000","last_fullsized":"2024-09-13T19:37:06.958861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.958579+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:36.686521+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.385193+0000","last_change":"2024-09-13T19:37:04.385193+0000","last_active":"2024-09-13T19:37:04.385193+0000","last_peered":"2024-09-13T19:37:04.385193+0000","last_clean":"2024-09-13T19:37:04.385193+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:37:04.385193+0000","last_undegraded":"2024-09-13T19:37:04.385193+0000","last_fullsized":"2024-09-13T19:37:04.385193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.384941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.293998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.904564+0000","last_change":"2024-09-13T19:37:49.904631+0000","last_active":"2024-09-13T19:37:49.904564+0000","last_peered":"2024-09-13T19:37:49.904564+0000","last_clean":"2024-09-13T19:37:49.904564+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:37:49.904564+0000","last_undegraded":"2024-09-13T19:37:49.904564+0000","last_fullsized":"2024-09-13T19:37:49.904564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:49.904383+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:49.904383+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.904383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:18.998987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.481235+0000","last_change":"2024-09-13T19:37:38.481358+0000","last_active":"2024-09-13T19:37:38.481235+0000","last_peered":"2024-09-13T19:37:38.481235+0000","last_clean":"2024-09-13T19:37:38.481235+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:37:38.481235+0000","last_undegraded":"2024-09-13T19:37:38.481235+0000","last_fullsized":"2024-09-13T19:37:38.481235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:38.480942+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:38.480942+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.480942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:38.661510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.067867+0000","last_change":"2024-09-13T19:37:35.067867+0000","last_active":"2024-09-13T19:37:35.067867+0000","last_peered":"2024-09-13T19:37:35.067867+0000","last_clean":"2024-09-13T19:37:35.067867+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:37:35.067867+0000","last_undegraded":"2024-09-13T19:37:35.067867+0000","last_fullsized":"2024-09-13T19:37:35.067867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:35.067634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:35.067634+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.067634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:35.696369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.247615+0000","last_change":"2024-09-13T19:37:23.247615+0000","last_active":"2024-09-13T19:37:23.247615+0000","last_peered":"2024-09-13T19:37:23.247615+0000","last_clean":"2024-09-13T19:37:23.247615+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:37:23.247615+0000","last_undegraded":"2024-09-13T19:37:23.247615+0000","last_fullsized":"2024-09-13T19:37:23.247615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:23.247331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:23.247331+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.247331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:14.966141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.020012+0000","last_change":"2024-09-13T19:37:28.020012+0000","last_active":"2024-09-13T19:37:28.020012+0000","last_peered":"2024-09-13T19:37:28.020012+0000","last_clean":"2024-09-13T19:37:28.020012+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:37:28.020012+0000","last_undegraded":"2024-09-13T19:37:28.020012+0000","last_fullsized":"2024-09-13T19:37:28.020012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:28.019573+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:28.019573+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.019573+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:49.017132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.277843+0000","last_change":"2024-09-13T19:37:01.277843+0000","last_active":"2024-09-13T19:37:01.277843+0000","last_peered":"2024-09-13T19:37:01.277843+0000","last_clean":"2024-09-13T19:37:01.277843+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:37:01.277843+0000","last_undegraded":"2024-09-13T19:37:01.277843+0000","last_fullsized":"2024-09-13T19:37:01.277843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.277591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:47.650563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.546916+0000","last_change":"2024-09-13T19:37:28.546916+0000","last_active":"2024-09-13T19:37:28.546916+0000","last_peered":"2024-09-13T19:37:28.546916+0000","last_clean":"2024-09-13T19:37:28.546916+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:37:28.546916+0000","last_undegraded":"2024-09-13T19:37:28.546916+0000","last_fullsized":"2024-09-13T19:37:28.546916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:28.546498+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:28.546498+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.546498+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.520168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.887692+0000","last_change":"2024-09-13T19:37:22.887692+0000","last_active":"2024-09-13T19:37:22.887692+0000","last_peered":"2024-09-13T19:37:22.887692+0000","last_clean":"2024-09-13T19:37:22.887692+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:37:22.887692+0000","last_undegraded":"2024-09-13T19:37:22.887692+0000","last_fullsized":"2024-09-13T19:37:22.887692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:22.887344+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:22.887344+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.887344+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:40.009897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.727579+0000","last_change":"2024-09-13T19:37:55.727632+0000","last_active":"2024-09-13T19:37:55.727579+0000","last_peered":"2024-09-13T19:37:55.727579+0000","last_clean":"2024-09-13T19:37:55.727579+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:37:55.727579+0000","last_undegraded":"2024-09-13T19:37:55.727579+0000","last_fullsized":"2024-09-13T19:37:55.727579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:55.727386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:55.727386+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.727386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:43.901184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.272682+0000","last_change":"2024-09-13T19:37:22.272682+0000","last_active":"2024-09-13T19:37:22.272682+0000","last_peered":"2024-09-13T19:37:22.272682+0000","last_clean":"2024-09-13T19:37:22.272682+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:37:22.272682+0000","last_undegraded":"2024-09-13T19:37:22.272682+0000","last_fullsized":"2024-09-13T19:37:22.272682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:22.272435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:22.272435+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.272435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:06.134902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.088355+0000","last_change":"2024-09-13T19:37:03.088355+0000","last_active":"2024-09-13T19:37:03.088355+0000","last_peered":"2024-09-13T19:37:03.088355+0000","last_clean":"2024-09-13T19:37:03.088355+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:37:03.088355+0000","last_undegraded":"2024-09-13T19:37:03.088355+0000","last_fullsized":"2024-09-13T19:37:03.088355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.087975+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:03.716710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.338036+0000","last_change":"2024-09-13T19:37:05.338036+0000","last_active":"2024-09-13T19:37:05.338036+0000","last_peered":"2024-09-13T19:37:05.338036+0000","last_clean":"2024-09-13T19:37:05.338036+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:37:05.338036+0000","last_undegraded":"2024-09-13T19:37:05.338036+0000","last_fullsized":"2024-09-13T19:37:05.338036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.337780+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.947112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:01.220459+0000","last_change":"2024-09-13T19:38:01.220527+0000","last_active":"2024-09-13T19:38:01.220459+0000","last_peered":"2024-09-13T19:38:01.220459+0000","last_clean":"2024-09-13T19:38:01.220459+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:38:01.220459+0000","last_undegraded":"2024-09-13T19:38:01.220459+0000","last_fullsized":"2024-09-13T19:38:01.220459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:38:01.220244+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:38:01.220244+0000","last_clean_scrub_stamp":"2024-09-13T19:38:01.220244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:50.577043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.095511+0000","last_change":"2024-09-13T19:37:36.095511+0000","last_active":"2024-09-13T19:37:36.095511+0000","last_peered":"2024-09-13T19:37:36.095511+0000","last_clean":"2024-09-13T19:37:36.095511+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:37:36.095511+0000","last_undegraded":"2024-09-13T19:37:36.095511+0000","last_fullsized":"2024-09-13T19:37:36.095511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:36.095267+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:36.095267+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.095267+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:11.327700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.595896+0000","last_change":"2024-09-13T19:37:59.595896+0000","last_active":"2024-09-13T19:37:59.595896+0000","last_peered":"2024-09-13T19:37:59.595896+0000","last_clean":"2024-09-13T19:37:59.595896+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:37:59.595896+0000","last_undegraded":"2024-09-13T19:37:59.595896+0000","last_fullsized":"2024-09-13T19:37:59.595896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:59.595453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:59.595453+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.595453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:11.042084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.198989+0000","last_change":"2024-09-13T19:37:24.198989+0000","last_active":"2024-09-13T19:37:24.198989+0000","last_peered":"2024-09-13T19:37:24.198989+0000","last_clean":"2024-09-13T19:37:24.198989+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:37:24.198989+0000","last_undegraded":"2024-09-13T19:37:24.198989+0000","last_fullsized":"2024-09-13T19:37:24.198989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:24.198733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:24.198733+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.198733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.431165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'64","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.075367+0000","last_change":"2024-09-13T19:37:07.075367+0000","last_active":"2024-09-13T19:37:07.075367+0000","last_peered":"2024-09-13T19:37:07.075367+0000","last_clean":"2024-09-13T19:37:07.075367+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:37:07.075367+0000","last_undegraded":"2024-09-13T19:37:07.075367+0000","last_fullsized":"2024-09-13T19:37:07.075367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'64","last_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_deep_scrub":"32'64","last_deep_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.075082+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:36.529696+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.200714+0000","last_change":"2024-09-13T19:37:13.200714+0000","last_active":"2024-09-13T19:37:13.200714+0000","last_peered":"2024-09-13T19:37:13.200714+0000","last_clean":"2024-09-13T19:37:13.200714+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:37:13.200714+0000","last_undegraded":"2024-09-13T19:37:13.200714+0000","last_fullsized":"2024-09-13T19:37:13.200714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.200465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:35.576125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'23","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.239795+0000","last_change":"2024-09-13T19:37:29.239795+0000","last_active":"2024-09-13T19:37:29.239795+0000","last_peered":"2024-09-13T19:37:29.239795+0000","last_clean":"2024-09-13T19:37:29.239795+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:37:29.239795+0000","last_undegraded":"2024-09-13T19:37:29.239795+0000","last_fullsized":"2024-09-13T19:37:29.239795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-09-13T19:37:29.239551+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-09-13T19:37:29.239551+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.239551+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:37.517834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:01.517105+0000","last_change":"2024-09-13T19:38:01.517166+0000","last_active":"2024-09-13T19:38:01.517105+0000","last_peered":"2024-09-13T19:38:01.517105+0000","last_clean":"2024-09-13T19:38:01.517105+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:38:01.517105+0000","last_undegraded":"2024-09-13T19:38:01.517105+0000","last_fullsized":"2024-09-13T19:38:01.517105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:38:01.516920+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:38:01.516920+0000","last_clean_scrub_stamp":"2024-09-13T19:38:01.516920+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:47.502295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.046281+0000","last_change":"2024-09-13T19:37:53.046344+0000","last_active":"2024-09-13T19:37:53.046281+0000","last_peered":"2024-09-13T19:37:53.046281+0000","last_clean":"2024-09-13T19:37:53.046281+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:37:53.046281+0000","last_undegraded":"2024-09-13T19:37:53.046281+0000","last_fullsized":"2024-09-13T19:37:53.046281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:53.046085+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:53.046085+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.046085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.907868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.831206+0000","last_change":"2024-09-13T19:37:13.831206+0000","last_active":"2024-09-13T19:37:13.831206+0000","last_peered":"2024-09-13T19:37:13.831206+0000","last_clean":"2024-09-13T19:37:13.831206+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:37:13.831206+0000","last_undegraded":"2024-09-13T19:37:13.831206+0000","last_fullsized":"2024-09-13T19:37:13.831206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.830975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:27.492677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.520047+0000","last_change":"2024-09-13T19:37:09.520047+0000","last_active":"2024-09-13T19:37:09.520047+0000","last_peered":"2024-09-13T19:37:09.520047+0000","last_clean":"2024-09-13T19:37:09.520047+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:37:09.520047+0000","last_undegraded":"2024-09-13T19:37:09.520047+0000","last_fullsized":"2024-09-13T19:37:09.520047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.519587+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:50.509060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.886815+0000","last_change":"2024-09-13T19:37:34.886815+0000","last_active":"2024-09-13T19:37:34.886815+0000","last_peered":"2024-09-13T19:37:34.886815+0000","last_clean":"2024-09-13T19:37:34.886815+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:37:34.886815+0000","last_undegraded":"2024-09-13T19:37:34.886815+0000","last_fullsized":"2024-09-13T19:37:34.886815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:34.886569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:34.886569+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.886569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:58.702803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:17.479809+0000","last_change":"2024-09-13T19:38:17.479891+0000","last_active":"2024-09-13T19:38:17.479809+0000","last_peered":"2024-09-13T19:38:17.479809+0000","last_clean":"2024-09-13T19:38:17.479809+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:38:17.479809+0000","last_undegraded":"2024-09-13T19:38:17.479809+0000","last_fullsized":"2024-09-13T19:38:17.479809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:38:17.479603+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:38:17.479603+0000","last_clean_scrub_stamp":"2024-09-13T19:38:17.479603+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:18.487609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.160708+0000","last_change":"2024-09-13T19:37:14.160708+0000","last_active":"2024-09-13T19:37:14.160708+0000","last_peered":"2024-09-13T19:37:14.160708+0000","last_clean":"2024-09-13T19:37:14.160708+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:37:14.160708+0000","last_undegraded":"2024-09-13T19:37:14.160708+0000","last_fullsized":"2024-09-13T19:37:14.160708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.160448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:32.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.773000+0000","last_change":"2024-09-13T19:37:54.773065+0000","last_active":"2024-09-13T19:37:54.773000+0000","last_peered":"2024-09-13T19:37:54.773000+0000","last_clean":"2024-09-13T19:37:54.773000+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:37:54.773000+0000","last_undegraded":"2024-09-13T19:37:54.773000+0000","last_fullsized":"2024-09-13T19:37:54.773000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:54.772792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:54.772792+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.772792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:07.999598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.282076+0000","last_change":"2024-09-13T19:37:20.282076+0000","last_active":"2024-09-13T19:37:20.282076+0000","last_peered":"2024-09-13T19:37:20.282076+0000","last_clean":"2024-09-13T19:37:20.282076+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:37:20.282076+0000","last_undegraded":"2024-09-13T19:37:20.282076+0000","last_fullsized":"2024-09-13T19:37:20.282076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:20.281828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:20.281828+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.281828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:26.429181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.844787+0000","last_change":"2024-09-13T19:37:10.844787+0000","last_active":"2024-09-13T19:37:10.844787+0000","last_peered":"2024-09-13T19:37:10.844787+0000","last_clean":"2024-09-13T19:37:10.844787+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:37:10.844787+0000","last_undegraded":"2024-09-13T19:37:10.844787+0000","last_fullsized":"2024-09-13T19:37:10.844787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.844519+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:16.097647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.934519+0000","last_change":"2024-09-13T19:37:07.934519+0000","last_active":"2024-09-13T19:37:07.934519+0000","last_peered":"2024-09-13T19:37:07.934519+0000","last_clean":"2024-09-13T19:37:07.934519+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:37:07.934519+0000","last_undegraded":"2024-09-13T19:37:07.934519+0000","last_fullsized":"2024-09-13T19:37:07.934519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.934270+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:17.446351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.190148+0000","last_change":"2024-09-13T19:37:59.190217+0000","last_active":"2024-09-13T19:37:59.190148+0000","last_peered":"2024-09-13T19:37:59.190148+0000","last_clean":"2024-09-13T19:37:59.190148+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:37:59.190148+0000","last_undegraded":"2024-09-13T19:37:59.190148+0000","last_fullsized":"2024-09-13T19:37:59.190148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:59.189958+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:59.189958+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.189958+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:51.359000+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.897513+0000","last_change":"2024-09-13T19:37:23.897513+0000","last_active":"2024-09-13T19:37:23.897513+0000","last_peered":"2024-09-13T19:37:23.897513+0000","last_clean":"2024-09-13T19:37:23.897513+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:37:23.897513+0000","last_undegraded":"2024-09-13T19:37:23.897513+0000","last_fullsized":"2024-09-13T19:37:23.897513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:23.897240+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:23.897240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.897240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:28.019969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.816139+0000","last_change":"2024-09-13T19:37:51.816204+0000","last_active":"2024-09-13T19:37:51.816139+0000","last_peered":"2024-09-13T19:37:51.816139+0000","last_clean":"2024-09-13T19:37:51.816139+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:37:51.816139+0000","last_undegraded":"2024-09-13T19:37:51.816139+0000","last_fullsized":"2024-09-13T19:37:51.816139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:51.815920+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:51.815920+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.815920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:01.692044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.585204+0000","last_change":"2024-09-13T19:37:17.585204+0000","last_active":"2024-09-13T19:37:17.585204+0000","last_peered":"2024-09-13T19:37:17.585204+0000","last_clean":"2024-09-13T19:37:17.585204+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:37:17.585204+0000","last_undegraded":"2024-09-13T19:37:17.585204+0000","last_fullsized":"2024-09-13T19:37:17.585204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:17.584949+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:17.584949+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.584949+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:44.456695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.992249+0000","last_change":"2024-09-13T19:37:25.992249+0000","last_active":"2024-09-13T19:37:25.992249+0000","last_peered":"2024-09-13T19:37:25.992249+0000","last_clean":"2024-09-13T19:37:25.992249+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:37:25.992249+0000","last_undegraded":"2024-09-13T19:37:25.992249+0000","last_fullsized":"2024-09-13T19:37:25.992249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:25.991984+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:25.991984+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.991984+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:34.178024+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":473,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.467344+0000","last_change":"2024-09-13T19:37:01.467344+0000","last_active":"2024-09-13T19:37:01.467344+0000","last_peered":"2024-09-13T19:37:01.467344+0000","last_clean":"2024-09-13T19:37:01.467344+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:37:01.467344+0000","last_undegraded":"2024-09-13T19:37:01.467344+0000","last_fullsized":"2024-09-13T19:37:01.467344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.467091+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:04.385381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.905199+0000","last_change":"2024-09-13T19:37:19.905199+0000","last_active":"2024-09-13T19:37:19.905199+0000","last_peered":"2024-09-13T19:37:19.905199+0000","last_clean":"2024-09-13T19:37:19.905199+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:37:19.905199+0000","last_undegraded":"2024-09-13T19:37:19.905199+0000","last_fullsized":"2024-09-13T19:37:19.905199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.904819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:30.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.439047+0000","last_change":"2024-09-13T19:37:36.439047+0000","last_active":"2024-09-13T19:37:36.439047+0000","last_peered":"2024-09-13T19:37:36.439047+0000","last_clean":"2024-09-13T19:37:36.439047+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:37:36.439047+0000","last_undegraded":"2024-09-13T19:37:36.439047+0000","last_fullsized":"2024-09-13T19:37:36.439047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:36.438801+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:36.438801+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.438801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:08.256631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.798837+0000","last_change":"2024-09-13T19:37:53.798900+0000","last_active":"2024-09-13T19:37:53.798837+0000","last_peered":"2024-09-13T19:37:53.798837+0000","last_clean":"2024-09-13T19:37:53.798837+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:37:53.798837+0000","last_undegraded":"2024-09-13T19:37:53.798837+0000","last_fullsized":"2024-09-13T19:37:53.798837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:53.798611+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:53.798611+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.798611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:54.032519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.118554+0000","last_change":"2024-09-13T19:37:02.118554+0000","last_active":"2024-09-13T19:37:02.118554+0000","last_peered":"2024-09-13T19:37:02.118554+0000","last_clean":"2024-09-13T19:37:02.118554+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:37:02.118554+0000","last_undegraded":"2024-09-13T19:37:02.118554+0000","last_fullsized":"2024-09-13T19:37:02.118554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.118290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:01.693866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.542034+0000","last_change":"2024-09-13T19:37:11.542034+0000","last_active":"2024-09-13T19:37:11.542034+0000","last_peered":"2024-09-13T19:37:11.542034+0000","last_clean":"2024-09-13T19:37:11.542034+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:37:11.542034+0000","last_undegraded":"2024-09-13T19:37:11.542034+0000","last_fullsized":"2024-09-13T19:37:11.542034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.541770+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:28.664323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.819618+0000","last_change":"2024-09-13T19:37:15.819618+0000","last_active":"2024-09-13T19:37:15.819618+0000","last_peered":"2024-09-13T19:37:15.819618+0000","last_clean":"2024-09-13T19:37:15.819618+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:37:15.819618+0000","last_undegraded":"2024-09-13T19:37:15.819618+0000","last_fullsized":"2024-09-13T19:37:15.819618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.819343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:17.226606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.492524+0000","last_change":"2024-09-13T19:37:08.492524+0000","last_active":"2024-09-13T19:37:08.492524+0000","last_peered":"2024-09-13T19:37:08.492524+0000","last_clean":"2024-09-13T19:37:08.492524+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:37:08.492524+0000","last_undegraded":"2024-09-13T19:37:08.492524+0000","last_fullsized":"2024-09-13T19:37:08.492524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.492240+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.753771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.119769+0000","last_change":"2024-09-13T19:37:17.119769+0000","last_active":"2024-09-13T19:37:17.119769+0000","last_peered":"2024-09-13T19:37:17.119769+0000","last_clean":"2024-09-13T19:37:17.119769+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:37:17.119769+0000","last_undegraded":"2024-09-13T19:37:17.119769+0000","last_fullsized":"2024-09-13T19:37:17.119769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.119389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.119389+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.119389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:39.478375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":213,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.502371+0000","last_change":"2024-09-13T19:37:46.502551+0000","last_active":"2024-09-13T19:37:46.502371+0000","last_peered":"2024-09-13T19:37:46.502371+0000","last_clean":"2024-09-13T19:37:46.502371+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:37:46.502371+0000","last_undegraded":"2024-09-13T19:37:46.502371+0000","last_fullsized":"2024-09-13T19:37:46.502371+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-09-13T19:37:46.502154+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-09-13T19:37:46.502154+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.502154+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:49.502193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:10.629937+0000","last_change":"2024-09-13T19:38:10.630007+0000","last_active":"2024-09-13T19:38:10.629937+0000","last_peered":"2024-09-13T19:38:10.629937+0000","last_clean":"2024-09-13T19:38:10.629937+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:38:10.629937+0000","last_undegraded":"2024-09-13T19:38:10.629937+0000","last_fullsized":"2024-09-13T19:38:10.629937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:38:10.629675+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:38:10.629675+0000","last_clean_scrub_stamp":"2024-09-13T19:38:10.629675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:04.536948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.688999+0000","last_change":"2024-09-13T19:37:56.689057+0000","last_active":"2024-09-13T19:37:56.688999+0000","last_peered":"2024-09-13T19:37:56.688999+0000","last_clean":"2024-09-13T19:37:56.688999+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:37:56.688999+0000","last_undegraded":"2024-09-13T19:37:56.688999+0000","last_fullsized":"2024-09-13T19:37:56.688999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:56.688803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:56.688803+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.688803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:31.856369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.618879+0000","last_change":"2024-09-13T19:37:58.618932+0000","last_active":"2024-09-13T19:37:58.618879+0000","last_peered":"2024-09-13T19:37:58.618879+0000","last_clean":"2024-09-13T19:37:58.618879+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:37:58.618879+0000","last_undegraded":"2024-09-13T19:37:58.618879+0000","last_fullsized":"2024-09-13T19:37:58.618879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:58.618686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:58.618686+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.618686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:23.977888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'87","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.130003+0000","last_change":"2024-09-13T19:37:15.130003+0000","last_active":"2024-09-13T19:37:15.130003+0000","last_peered":"2024-09-13T19:37:15.130003+0000","last_clean":"2024-09-13T19:37:15.130003+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:37:15.130003+0000","last_undegraded":"2024-09-13T19:37:15.130003+0000","last_fullsized":"2024-09-13T19:37:15.130003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.129728+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:51:47.372002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.228695+0000","last_change":"2024-09-13T19:37:09.228695+0000","last_active":"2024-09-13T19:37:09.228695+0000","last_peered":"2024-09-13T19:37:09.228695+0000","last_clean":"2024-09-13T19:37:09.228695+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:37:09.228695+0000","last_undegraded":"2024-09-13T19:37:09.228695+0000","last_fullsized":"2024-09-13T19:37:09.228695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.228417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:56.994751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.945992+0000","last_change":"2024-09-13T19:37:46.946134+0000","last_active":"2024-09-13T19:37:46.945992+0000","last_peered":"2024-09-13T19:37:46.945992+0000","last_clean":"2024-09-13T19:37:46.945992+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:37:46.945992+0000","last_undegraded":"2024-09-13T19:37:46.945992+0000","last_fullsized":"2024-09-13T19:37:46.945992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-09-13T19:37:46.945750+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-09-13T19:37:46.945750+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.945750+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:08.676021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.965119+0000","last_change":"2024-09-13T19:37:51.965119+0000","last_active":"2024-09-13T19:37:51.965119+0000","last_peered":"2024-09-13T19:37:51.965119+0000","last_clean":"2024-09-13T19:37:51.965119+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:37:51.965119+0000","last_undegraded":"2024-09-13T19:37:51.965119+0000","last_fullsized":"2024-09-13T19:37:51.965119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:51.964860+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:51.964860+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.964860+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:57.695590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:08.642259+0000","last_change":"2024-09-13T19:38:08.642315+0000","last_active":"2024-09-13T19:38:08.642259+0000","last_peered":"2024-09-13T19:38:08.642259+0000","last_clean":"2024-09-13T19:38:08.642259+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:38:08.642259+0000","last_undegraded":"2024-09-13T19:38:08.642259+0000","last_fullsized":"2024-09-13T19:38:08.642259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:08.642071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:08.642071+0000","last_clean_scrub_stamp":"2024-09-13T19:38:08.642071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:52.395902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.161972+0000","last_change":"2024-09-13T19:37:36.162036+0000","last_active":"2024-09-13T19:37:36.161972+0000","last_peered":"2024-09-13T19:37:36.161972+0000","last_clean":"2024-09-13T19:37:36.161972+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:37:36.161972+0000","last_undegraded":"2024-09-13T19:37:36.161972+0000","last_fullsized":"2024-09-13T19:37:36.161972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:36.161776+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:36.161776+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.161776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.979606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.147263+0000","last_change":"2024-09-13T19:37:09.147263+0000","last_active":"2024-09-13T19:37:09.147263+0000","last_peered":"2024-09-13T19:37:09.147263+0000","last_clean":"2024-09-13T19:37:09.147263+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:37:09.147263+0000","last_undegraded":"2024-09-13T19:37:09.147263+0000","last_fullsized":"2024-09-13T19:37:09.147263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.147011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:17.425294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":517,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.504345+0000","last_change":"2024-09-13T19:37:06.504345+0000","last_active":"2024-09-13T19:37:06.504345+0000","last_peered":"2024-09-13T19:37:06.504345+0000","last_clean":"2024-09-13T19:37:06.504345+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:37:06.504345+0000","last_undegraded":"2024-09-13T19:37:06.504345+0000","last_fullsized":"2024-09-13T19:37:06.504345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.503927+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:35.014112+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.089943+0000","last_change":"2024-09-13T19:37:21.089943+0000","last_active":"2024-09-13T19:37:21.089943+0000","last_peered":"2024-09-13T19:37:21.089943+0000","last_clean":"2024-09-13T19:37:21.089943+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:37:21.089943+0000","last_undegraded":"2024-09-13T19:37:21.089943+0000","last_fullsized":"2024-09-13T19:37:21.089943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:21.089650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:21.089650+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.089650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:32.669122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.574914+0000","last_change":"2024-09-13T19:37:55.574987+0000","last_active":"2024-09-13T19:37:55.574914+0000","last_peered":"2024-09-13T19:37:55.574914+0000","last_clean":"2024-09-13T19:37:55.574914+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:37:55.574914+0000","last_undegraded":"2024-09-13T19:37:55.574914+0000","last_fullsized":"2024-09-13T19:37:55.574914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:55.574705+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:55.574705+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.574705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:58.226960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.074650+0000","last_change":"2024-09-13T19:37:39.074710+0000","last_active":"2024-09-13T19:37:39.074650+0000","last_peered":"2024-09-13T19:37:39.074650+0000","last_clean":"2024-09-13T19:37:39.074650+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:37:39.074650+0000","last_undegraded":"2024-09-13T19:37:39.074650+0000","last_fullsized":"2024-09-13T19:37:39.074650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:39.074462+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:39.074462+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.074462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:20.601071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.093185+0000","last_change":"2024-09-13T19:37:38.093238+0000","last_active":"2024-09-13T19:37:38.093185+0000","last_peered":"2024-09-13T19:37:38.093185+0000","last_clean":"2024-09-13T19:37:38.093185+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:37:38.093185+0000","last_undegraded":"2024-09-13T19:37:38.093185+0000","last_fullsized":"2024-09-13T19:37:38.093185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:38.092962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:38.092962+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.092962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:20.037272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.054805+0000","last_change":"2024-09-13T19:37:42.054873+0000","last_active":"2024-09-13T19:37:42.054805+0000","last_peered":"2024-09-13T19:37:42.054805+0000","last_clean":"2024-09-13T19:37:42.054805+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:37:42.054805+0000","last_undegraded":"2024-09-13T19:37:42.054805+0000","last_fullsized":"2024-09-13T19:37:42.054805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:42.054613+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:42.054613+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.054613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:20.890654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.849196+0000","last_change":"2024-09-13T19:37:16.849196+0000","last_active":"2024-09-13T19:37:16.849196+0000","last_peered":"2024-09-13T19:37:16.849196+0000","last_clean":"2024-09-13T19:37:16.849196+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:37:16.849196+0000","last_undegraded":"2024-09-13T19:37:16.849196+0000","last_fullsized":"2024-09-13T19:37:16.849196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.848911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:35.095041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.900571+0000","last_change":"2024-09-13T19:37:08.900571+0000","last_active":"2024-09-13T19:37:08.900571+0000","last_peered":"2024-09-13T19:37:08.900571+0000","last_clean":"2024-09-13T19:37:08.900571+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:37:08.900571+0000","last_undegraded":"2024-09-13T19:37:08.900571+0000","last_fullsized":"2024-09-13T19:37:08.900571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.900272+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:29.326850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.306113+0000","last_change":"2024-09-13T19:37:00.306113+0000","last_active":"2024-09-13T19:37:00.306113+0000","last_peered":"2024-09-13T19:37:00.306113+0000","last_clean":"2024-09-13T19:37:00.306113+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:37:00.306113+0000","last_undegraded":"2024-09-13T19:37:00.306113+0000","last_fullsized":"2024-09-13T19:37:00.306113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.305866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:41.036690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.899913+0000","last_change":"2024-09-13T19:37:46.899913+0000","last_active":"2024-09-13T19:37:46.899913+0000","last_peered":"2024-09-13T19:37:46.899913+0000","last_clean":"2024-09-13T19:37:46.899913+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:37:46.899913+0000","last_undegraded":"2024-09-13T19:37:46.899913+0000","last_fullsized":"2024-09-13T19:37:46.899913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.899651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.899651+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.899651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:52.737320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.212375+0000","last_change":"2024-09-13T19:37:28.212520+0000","last_active":"2024-09-13T19:37:28.212375+0000","last_peered":"2024-09-13T19:37:28.212375+0000","last_clean":"2024-09-13T19:37:28.212375+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:37:28.212375+0000","last_undegraded":"2024-09-13T19:37:28.212375+0000","last_fullsized":"2024-09-13T19:37:28.212375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-13T19:37:28.212060+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-13T19:37:28.212060+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.212060+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.185729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:09.619586+0000","last_change":"2024-09-13T19:38:09.619656+0000","last_active":"2024-09-13T19:38:09.619586+0000","last_peered":"2024-09-13T19:38:09.619586+0000","last_clean":"2024-09-13T19:38:09.619586+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:38:09.619586+0000","last_undegraded":"2024-09-13T19:38:09.619586+0000","last_fullsized":"2024-09-13T19:38:09.619586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:38:09.619377+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:38:09.619377+0000","last_clean_scrub_stamp":"2024-09-13T19:38:09.619377+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:10.064984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.029039+0000","last_change":"2024-09-13T19:37:42.029092+0000","last_active":"2024-09-13T19:37:42.029039+0000","last_peered":"2024-09-13T19:37:42.029039+0000","last_clean":"2024-09-13T19:37:42.029039+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:37:42.029039+0000","last_undegraded":"2024-09-13T19:37:42.029039+0000","last_fullsized":"2024-09-13T19:37:42.029039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:42.028813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:42.028813+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.028813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:44.895289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.316430+0000","last_change":"2024-09-13T19:37:18.316430+0000","last_active":"2024-09-13T19:37:18.316430+0000","last_peered":"2024-09-13T19:37:18.316430+0000","last_clean":"2024-09-13T19:37:18.316430+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:37:18.316430+0000","last_undegraded":"2024-09-13T19:37:18.316430+0000","last_fullsized":"2024-09-13T19:37:18.316430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.316023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:53.513548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.034575+0000","last_change":"2024-09-13T19:37:25.034575+0000","last_active":"2024-09-13T19:37:25.034575+0000","last_peered":"2024-09-13T19:37:25.034575+0000","last_clean":"2024-09-13T19:37:25.034575+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:37:25.034575+0000","last_undegraded":"2024-09-13T19:37:25.034575+0000","last_fullsized":"2024-09-13T19:37:25.034575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-13T19:37:25.034296+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-13T19:37:25.034296+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.034296+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:16.184148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.084251+0000","last_change":"2024-09-13T19:37:23.084251+0000","last_active":"2024-09-13T19:37:23.084251+0000","last_peered":"2024-09-13T19:37:23.084251+0000","last_clean":"2024-09-13T19:37:23.084251+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:37:23.084251+0000","last_undegraded":"2024-09-13T19:37:23.084251+0000","last_fullsized":"2024-09-13T19:37:23.084251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:23.083834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:23.083834+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.083834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:08.356001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.665709+0000","last_change":"2024-09-13T19:37:20.665709+0000","last_active":"2024-09-13T19:37:20.665709+0000","last_peered":"2024-09-13T19:37:20.665709+0000","last_clean":"2024-09-13T19:37:20.665709+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:37:20.665709+0000","last_undegraded":"2024-09-13T19:37:20.665709+0000","last_fullsized":"2024-09-13T19:37:20.665709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:20.665452+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:20.665452+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.665452+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:26.812805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.605404+0000","last_change":"2024-09-13T19:37:23.605471+0000","last_active":"2024-09-13T19:37:23.605404+0000","last_peered":"2024-09-13T19:37:23.605404+0000","last_clean":"2024-09-13T19:37:23.605404+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:37:23.605404+0000","last_undegraded":"2024-09-13T19:37:23.605404+0000","last_fullsized":"2024-09-13T19:37:23.605404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:23.605199+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:23.605199+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.605199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:24.233934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.053088+0000","last_change":"2024-09-13T19:37:39.053139+0000","last_active":"2024-09-13T19:37:39.053088+0000","last_peered":"2024-09-13T19:37:39.053088+0000","last_clean":"2024-09-13T19:37:39.053088+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:37:39.053088+0000","last_undegraded":"2024-09-13T19:37:39.053088+0000","last_fullsized":"2024-09-13T19:37:39.053088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:39.052897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:39.052897+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.052897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:08.507511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.999985+0000","last_change":"2024-09-13T19:37:47.000092+0000","last_active":"2024-09-13T19:37:46.999985+0000","last_peered":"2024-09-13T19:37:46.999985+0000","last_clean":"2024-09-13T19:37:46.999985+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:37:46.999985+0000","last_undegraded":"2024-09-13T19:37:46.999985+0000","last_fullsized":"2024-09-13T19:37:46.999985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.999754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.999754+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.999754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:08.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.275009+0000","last_change":"2024-09-13T19:37:15.275009+0000","last_active":"2024-09-13T19:37:15.275009+0000","last_peered":"2024-09-13T19:37:15.275009+0000","last_clean":"2024-09-13T19:37:15.275009+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:37:15.275009+0000","last_undegraded":"2024-09-13T19:37:15.275009+0000","last_fullsized":"2024-09-13T19:37:15.275009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.274757+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:13.076733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'74","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.172215+0000","last_change":"2024-09-13T19:37:11.172215+0000","last_active":"2024-09-13T19:37:11.172215+0000","last_peered":"2024-09-13T19:37:11.172215+0000","last_clean":"2024-09-13T19:37:11.172215+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:37:11.172215+0000","last_undegraded":"2024-09-13T19:37:11.172215+0000","last_fullsized":"2024-09-13T19:37:11.172215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.171938+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:48.364805+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.934769+0000","last_change":"2024-09-13T19:37:03.934769+0000","last_active":"2024-09-13T19:37:03.934769+0000","last_peered":"2024-09-13T19:37:03.934769+0000","last_clean":"2024-09-13T19:37:03.934769+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:37:03.934769+0000","last_undegraded":"2024-09-13T19:37:03.934769+0000","last_fullsized":"2024-09-13T19:37:03.934769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.934524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:27.912903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.133974+0000","last_change":"2024-09-13T19:37:56.134038+0000","last_active":"2024-09-13T19:37:56.133974+0000","last_peered":"2024-09-13T19:37:56.133974+0000","last_clean":"2024-09-13T19:37:56.133974+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:37:56.133974+0000","last_undegraded":"2024-09-13T19:37:56.133974+0000","last_fullsized":"2024-09-13T19:37:56.133974+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-13T19:37:56.133788+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-13T19:37:56.133788+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.133788+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:33.961585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.540294+0000","last_change":"2024-09-13T19:37:26.540356+0000","last_active":"2024-09-13T19:37:26.540294+0000","last_peered":"2024-09-13T19:37:26.540294+0000","last_clean":"2024-09-13T19:37:26.540294+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:37:26.540294+0000","last_undegraded":"2024-09-13T19:37:26.540294+0000","last_fullsized":"2024-09-13T19:37:26.540294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:26.540098+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:26.540098+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.540098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:08.484408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.018027+0000","last_change":"2024-09-13T19:37:46.018158+0000","last_active":"2024-09-13T19:37:46.018027+0000","last_peered":"2024-09-13T19:37:46.018027+0000","last_clean":"2024-09-13T19:37:46.018027+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:37:46.018027+0000","last_undegraded":"2024-09-13T19:37:46.018027+0000","last_fullsized":"2024-09-13T19:37:46.018027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.017778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.017778+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.017778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:49.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:11.578280+0000","last_change":"2024-09-13T19:38:11.578336+0000","last_active":"2024-09-13T19:38:11.578280+0000","last_peered":"2024-09-13T19:38:11.578280+0000","last_clean":"2024-09-13T19:38:11.578280+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:38:11.578280+0000","last_undegraded":"2024-09-13T19:38:11.578280+0000","last_fullsized":"2024-09-13T19:38:11.578280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:11.578081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:11.578081+0000","last_clean_scrub_stamp":"2024-09-13T19:38:11.578081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:44.155714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.079813+0000","last_change":"2024-09-13T19:37:06.079813+0000","last_active":"2024-09-13T19:37:06.079813+0000","last_peered":"2024-09-13T19:37:06.079813+0000","last_clean":"2024-09-13T19:37:06.079813+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:37:06.079813+0000","last_undegraded":"2024-09-13T19:37:06.079813+0000","last_fullsized":"2024-09-13T19:37:06.079813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.079564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:35.654908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.552224+0000","last_change":"2024-09-13T19:37:05.552224+0000","last_active":"2024-09-13T19:37:05.552224+0000","last_peered":"2024-09-13T19:37:05.552224+0000","last_clean":"2024-09-13T19:37:05.552224+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:37:05.552224+0000","last_undegraded":"2024-09-13T19:37:05.552224+0000","last_fullsized":"2024-09-13T19:37:05.552224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.551819+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:23.797950+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.523331+0000","last_change":"2024-09-13T19:36:59.523331+0000","last_active":"2024-09-13T19:36:59.523331+0000","last_peered":"2024-09-13T19:36:59.523331+0000","last_clean":"2024-09-13T19:36:59.523331+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:59.523331+0000","last_undegraded":"2024-09-13T19:36:59.523331+0000","last_fullsized":"2024-09-13T19:36:59.523331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.522965+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:04.776093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.956223+0000","last_change":"2024-09-13T19:37:38.956223+0000","last_active":"2024-09-13T19:37:38.956223+0000","last_peered":"2024-09-13T19:37:38.956223+0000","last_clean":"2024-09-13T19:37:38.956223+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:37:38.956223+0000","last_undegraded":"2024-09-13T19:37:38.956223+0000","last_fullsized":"2024-09-13T19:37:38.956223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:38.955963+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:38.955963+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.955963+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:04.315165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.875790+0000","last_change":"2024-09-13T19:37:40.875856+0000","last_active":"2024-09-13T19:37:40.875790+0000","last_peered":"2024-09-13T19:37:40.875790+0000","last_clean":"2024-09-13T19:37:40.875790+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:37:40.875790+0000","last_undegraded":"2024-09-13T19:37:40.875790+0000","last_fullsized":"2024-09-13T19:37:40.875790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:40.875571+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:40.875571+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.875571+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.018867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:07.628595+0000","last_change":"2024-09-13T19:38:07.628651+0000","last_active":"2024-09-13T19:38:07.628595+0000","last_peered":"2024-09-13T19:38:07.628595+0000","last_clean":"2024-09-13T19:38:07.628595+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:38:07.628595+0000","last_undegraded":"2024-09-13T19:38:07.628595+0000","last_fullsized":"2024-09-13T19:38:07.628595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:07.628360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:07.628360+0000","last_clean_scrub_stamp":"2024-09-13T19:38:07.628360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:10.782158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.023259+0000","last_change":"2024-09-13T19:37:48.023319+0000","last_active":"2024-09-13T19:37:48.023259+0000","last_peered":"2024-09-13T19:37:48.023259+0000","last_clean":"2024-09-13T19:37:48.023259+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:37:48.023259+0000","last_undegraded":"2024-09-13T19:37:48.023259+0000","last_fullsized":"2024-09-13T19:37:48.023259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:48.023063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:48.023063+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.023063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:42.107507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.076438+0000","last_change":"2024-09-13T19:37:04.076438+0000","last_active":"2024-09-13T19:37:04.076438+0000","last_peered":"2024-09-13T19:37:04.076438+0000","last_clean":"2024-09-13T19:37:04.076438+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:37:04.076438+0000","last_undegraded":"2024-09-13T19:37:04.076438+0000","last_fullsized":"2024-09-13T19:37:04.076438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.076154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:39.308586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.094198+0000","last_change":"2024-09-13T19:37:19.094198+0000","last_active":"2024-09-13T19:37:19.094198+0000","last_peered":"2024-09-13T19:37:19.094198+0000","last_clean":"2024-09-13T19:37:19.094198+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:37:19.094198+0000","last_undegraded":"2024-09-13T19:37:19.094198+0000","last_fullsized":"2024-09-13T19:37:19.094198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:19.093865+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:19.093865+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.093865+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:00.620474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.358816+0000","last_change":"2024-09-13T19:37:03.358816+0000","last_active":"2024-09-13T19:37:03.358816+0000","last_peered":"2024-09-13T19:37:03.358816+0000","last_clean":"2024-09-13T19:37:03.358816+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:37:03.358816+0000","last_undegraded":"2024-09-13T19:37:03.358816+0000","last_fullsized":"2024-09-13T19:37:03.358816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.358562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.021089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.557231+0000","last_change":"2024-09-13T19:37:12.557231+0000","last_active":"2024-09-13T19:37:12.557231+0000","last_peered":"2024-09-13T19:37:12.557231+0000","last_clean":"2024-09-13T19:37:12.557231+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:37:12.557231+0000","last_undegraded":"2024-09-13T19:37:12.557231+0000","last_fullsized":"2024-09-13T19:37:12.557231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.556957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.679686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.029314+0000","last_change":"2024-09-13T19:37:34.029405+0000","last_active":"2024-09-13T19:37:34.029314+0000","last_peered":"2024-09-13T19:37:34.029314+0000","last_clean":"2024-09-13T19:37:34.029314+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:37:34.029314+0000","last_undegraded":"2024-09-13T19:37:34.029314+0000","last_fullsized":"2024-09-13T19:37:34.029314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:34.029094+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:34.029094+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.029094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:33.604670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.451967+0000","last_change":"2024-09-13T19:37:37.452031+0000","last_active":"2024-09-13T19:37:37.451967+0000","last_peered":"2024-09-13T19:37:37.451967+0000","last_clean":"2024-09-13T19:37:37.451967+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:37:37.451967+0000","last_undegraded":"2024-09-13T19:37:37.451967+0000","last_fullsized":"2024-09-13T19:37:37.451967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:37.451769+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:37.451769+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.451769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:59.810756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:12.608547+0000","last_change":"2024-09-13T19:38:12.608609+0000","last_active":"2024-09-13T19:38:12.608547+0000","last_peered":"2024-09-13T19:38:12.608547+0000","last_clean":"2024-09-13T19:38:12.608547+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:38:12.608547+0000","last_undegraded":"2024-09-13T19:38:12.608547+0000","last_fullsized":"2024-09-13T19:38:12.608547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:12.608344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:12.608344+0000","last_clean_scrub_stamp":"2024-09-13T19:38:12.608344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:17.095849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.142377+0000","last_change":"2024-09-13T19:37:12.142377+0000","last_active":"2024-09-13T19:37:12.142377+0000","last_peered":"2024-09-13T19:37:12.142377+0000","last_clean":"2024-09-13T19:37:12.142377+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:37:12.142377+0000","last_undegraded":"2024-09-13T19:37:12.142377+0000","last_fullsized":"2024-09-13T19:37:12.142377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.142129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:18.473708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'97","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.931606+0000","last_change":"2024-09-13T19:37:05.931606+0000","last_active":"2024-09-13T19:37:05.931606+0000","last_peered":"2024-09-13T19:37:05.931606+0000","last_clean":"2024-09-13T19:37:05.931606+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:37:05.931606+0000","last_undegraded":"2024-09-13T19:37:05.931606+0000","last_fullsized":"2024-09-13T19:37:05.931606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.931238+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:45.454573+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.298133+0000","last_change":"2024-09-13T19:37:06.298133+0000","last_active":"2024-09-13T19:37:06.298133+0000","last_peered":"2024-09-13T19:37:06.298133+0000","last_clean":"2024-09-13T19:37:06.298133+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:37:06.298133+0000","last_undegraded":"2024-09-13T19:37:06.298133+0000","last_fullsized":"2024-09-13T19:37:06.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:34.808071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.951529+0000","last_change":"2024-09-13T19:37:50.951589+0000","last_active":"2024-09-13T19:37:50.951529+0000","last_peered":"2024-09-13T19:37:50.951529+0000","last_clean":"2024-09-13T19:37:50.951529+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:37:50.951529+0000","last_undegraded":"2024-09-13T19:37:50.951529+0000","last_fullsized":"2024-09-13T19:37:50.951529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:50.951320+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:50.951320+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.951320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:33.076198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.911889+0000","last_change":"2024-09-13T19:37:47.912039+0000","last_active":"2024-09-13T19:37:47.911889+0000","last_peered":"2024-09-13T19:37:47.911889+0000","last_clean":"2024-09-13T19:37:47.911889+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:37:47.911889+0000","last_undegraded":"2024-09-13T19:37:47.911889+0000","last_fullsized":"2024-09-13T19:37:47.911889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:47.911667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:47.911667+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.911667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:14.853018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.934942+0000","last_change":"2024-09-13T19:37:29.934942+0000","last_active":"2024-09-13T19:37:29.934942+0000","last_peered":"2024-09-13T19:37:29.934942+0000","last_clean":"2024-09-13T19:37:29.934942+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:37:29.934942+0000","last_undegraded":"2024-09-13T19:37:29.934942+0000","last_fullsized":"2024-09-13T19:37:29.934942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:29.934579+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:29.934579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.934579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:05.520975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.691055+0000","last_change":"2024-09-13T19:37:58.691122+0000","last_active":"2024-09-13T19:37:58.691055+0000","last_peered":"2024-09-13T19:37:58.691055+0000","last_clean":"2024-09-13T19:37:58.691055+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:37:58.691055+0000","last_undegraded":"2024-09-13T19:37:58.691055+0000","last_fullsized":"2024-09-13T19:37:58.691055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:58.690864+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:58.690864+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.690864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:13.639132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.615290+0000","last_change":"2024-09-13T19:37:19.615290+0000","last_active":"2024-09-13T19:37:19.615290+0000","last_peered":"2024-09-13T19:37:19.615290+0000","last_clean":"2024-09-13T19:37:19.615290+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:37:19.615290+0000","last_undegraded":"2024-09-13T19:37:19.615290+0000","last_fullsized":"2024-09-13T19:37:19.615290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:19.615030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:19.615030+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.615030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:23.322720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.156055+0000","last_change":"2024-09-13T19:37:11.156055+0000","last_active":"2024-09-13T19:37:11.156055+0000","last_peered":"2024-09-13T19:37:11.156055+0000","last_clean":"2024-09-13T19:37:11.156055+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:37:11.156055+0000","last_undegraded":"2024-09-13T19:37:11.156055+0000","last_fullsized":"2024-09-13T19:37:11.156055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.155624+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:30.748402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.008931+0000","last_change":"2024-09-13T19:37:31.008931+0000","last_active":"2024-09-13T19:37:31.008931+0000","last_peered":"2024-09-13T19:37:31.008931+0000","last_clean":"2024-09-13T19:37:31.008931+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:37:31.008931+0000","last_undegraded":"2024-09-13T19:37:31.008931+0000","last_fullsized":"2024-09-13T19:37:31.008931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:31.008661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:31.008661+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.008661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:00.939978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.163660+0000","last_change":"2024-09-13T19:37:25.163723+0000","last_active":"2024-09-13T19:37:25.163660+0000","last_peered":"2024-09-13T19:37:25.163660+0000","last_clean":"2024-09-13T19:37:25.163660+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:37:25.163660+0000","last_undegraded":"2024-09-13T19:37:25.163660+0000","last_fullsized":"2024-09-13T19:37:25.163660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-13T19:37:25.163440+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-13T19:37:25.163440+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.163440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:32.363103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.618900+0000","last_change":"2024-09-13T19:37:22.618900+0000","last_active":"2024-09-13T19:37:22.618900+0000","last_peered":"2024-09-13T19:37:22.618900+0000","last_clean":"2024-09-13T19:37:22.618900+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:37:22.618900+0000","last_undegraded":"2024-09-13T19:37:22.618900+0000","last_fullsized":"2024-09-13T19:37:22.618900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:22.618647+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:22.618647+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.618647+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:22.194223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.922798+0000","last_change":"2024-09-13T19:37:24.922798+0000","last_active":"2024-09-13T19:37:24.922798+0000","last_peered":"2024-09-13T19:37:24.922798+0000","last_clean":"2024-09-13T19:37:24.922798+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:37:24.922798+0000","last_undegraded":"2024-09-13T19:37:24.922798+0000","last_fullsized":"2024-09-13T19:37:24.922798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:24.922556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:24.922556+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.922556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:12.432860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.353882+0000","last_change":"2024-09-13T19:33:49.530881+0000","last_active":"2024-09-13T19:37:00.353882+0000","last_peered":"2024-09-13T19:37:00.353882+0000","last_clean":"2024-09-13T19:37:00.353882+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:37:00.353882+0000","last_undegraded":"2024-09-13T19:37:00.353882+0000","last_fullsized":"2024-09-13T19:37:00.353882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:11.315067+0000","last_clean_scrub_stamp":"2024-09-13T19:33:11.315067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.197029+0000","last_change":"2024-09-13T19:37:10.197029+0000","last_active":"2024-09-13T19:37:10.197029+0000","last_peered":"2024-09-13T19:37:10.197029+0000","last_clean":"2024-09-13T19:37:10.197029+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:37:10.197029+0000","last_undegraded":"2024-09-13T19:37:10.197029+0000","last_fullsized":"2024-09-13T19:37:10.197029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.196773+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:26.963041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.867223+0000","last_change":"2024-09-13T19:37:00.867223+0000","last_active":"2024-09-13T19:37:00.867223+0000","last_peered":"2024-09-13T19:37:00.867223+0000","last_clean":"2024-09-13T19:37:00.867223+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:37:00.867223+0000","last_undegraded":"2024-09-13T19:37:00.867223+0000","last_fullsized":"2024-09-13T19:37:00.867223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.866964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:18.237819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:00.200351+0000","last_change":"2024-09-13T19:38:00.200351+0000","last_active":"2024-09-13T19:38:00.200351+0000","last_peered":"2024-09-13T19:38:00.200351+0000","last_clean":"2024-09-13T19:38:00.200351+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:38:00.200351+0000","last_undegraded":"2024-09-13T19:38:00.200351+0000","last_fullsized":"2024-09-13T19:38:00.200351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:00.200003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:00.200003+0000","last_clean_scrub_stamp":"2024-09-13T19:38:00.200003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:00.343300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.069534+0000","last_change":"2024-09-13T19:37:41.069534+0000","last_active":"2024-09-13T19:37:41.069534+0000","last_peered":"2024-09-13T19:37:41.069534+0000","last_clean":"2024-09-13T19:37:41.069534+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:37:41.069534+0000","last_undegraded":"2024-09-13T19:37:41.069534+0000","last_fullsized":"2024-09-13T19:37:41.069534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-13T19:37:41.069170+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-13T19:37:41.069170+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.069170+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:18.063054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.060765+0000","last_change":"2024-09-13T19:37:37.060765+0000","last_active":"2024-09-13T19:37:37.060765+0000","last_peered":"2024-09-13T19:37:37.060765+0000","last_clean":"2024-09-13T19:37:37.060765+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:37:37.060765+0000","last_undegraded":"2024-09-13T19:37:37.060765+0000","last_fullsized":"2024-09-13T19:37:37.060765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:37.060494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:37.060494+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.060494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:44.260157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.795551+0000","last_change":"2024-09-13T19:37:14.795551+0000","last_active":"2024-09-13T19:37:14.795551+0000","last_peered":"2024-09-13T19:37:14.795551+0000","last_clean":"2024-09-13T19:37:14.795551+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:37:14.795551+0000","last_undegraded":"2024-09-13T19:37:14.795551+0000","last_fullsized":"2024-09-13T19:37:14.795551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.795303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:39.429169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'48","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.298241+0000","last_change":"2024-09-13T19:37:07.298241+0000","last_active":"2024-09-13T19:37:07.298241+0000","last_peered":"2024-09-13T19:37:07.298241+0000","last_clean":"2024-09-13T19:37:07.298241+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:37:07.298241+0000","last_undegraded":"2024-09-13T19:37:07.298241+0000","last_fullsized":"2024-09-13T19:37:07.298241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.297980+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.187946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.510102+0000","last_change":"2024-09-13T19:37:03.510102+0000","last_active":"2024-09-13T19:37:03.510102+0000","last_peered":"2024-09-13T19:37:03.510102+0000","last_clean":"2024-09-13T19:37:03.510102+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:37:03.510102+0000","last_undegraded":"2024-09-13T19:37:03.510102+0000","last_fullsized":"2024-09-13T19:37:03.510102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.509824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.172352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.355961+0000","last_change":"2024-09-13T19:33:18.420341+0000","last_active":"2024-09-13T19:37:00.355961+0000","last_peered":"2024-09-13T19:37:00.355961+0000","last_clean":"2024-09-13T19:37:00.355961+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:37:00.355961+0000","last_undegraded":"2024-09-13T19:37:00.355961+0000","last_fullsized":"2024-09-13T19:37:00.355961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.850067+0000","last_change":"2024-09-13T19:37:44.850067+0000","last_active":"2024-09-13T19:37:44.850067+0000","last_peered":"2024-09-13T19:37:44.850067+0000","last_clean":"2024-09-13T19:37:44.850067+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:37:44.850067+0000","last_undegraded":"2024-09-13T19:37:44.850067+0000","last_fullsized":"2024-09-13T19:37:44.850067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:44.849657+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:44.849657+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.849657+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:25.922372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.578287+0000","last_change":"2024-09-13T19:37:57.578287+0000","last_active":"2024-09-13T19:37:57.578287+0000","last_peered":"2024-09-13T19:37:57.578287+0000","last_clean":"2024-09-13T19:37:57.578287+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:37:57.578287+0000","last_undegraded":"2024-09-13T19:37:57.578287+0000","last_fullsized":"2024-09-13T19:37:57.578287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:57.578043+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:57.578043+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.578043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:23.544482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.122142+0000","last_change":"2024-09-13T19:37:01.122142+0000","last_active":"2024-09-13T19:37:01.122142+0000","last_peered":"2024-09-13T19:37:01.122142+0000","last_clean":"2024-09-13T19:37:01.122142+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:37:01.122142+0000","last_undegraded":"2024-09-13T19:37:01.122142+0000","last_fullsized":"2024-09-13T19:37:01.122142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.121885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:18.346905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.862096+0000","last_change":"2024-09-13T19:37:09.862096+0000","last_active":"2024-09-13T19:37:09.862096+0000","last_peered":"2024-09-13T19:37:09.862096+0000","last_clean":"2024-09-13T19:37:09.862096+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:37:09.862096+0000","last_undegraded":"2024-09-13T19:37:09.862096+0000","last_fullsized":"2024-09-13T19:37:09.862096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.861787+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:30.468598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.893029+0000","last_change":"2024-09-13T19:36:59.893029+0000","last_active":"2024-09-13T19:36:59.893029+0000","last_peered":"2024-09-13T19:36:59.893029+0000","last_clean":"2024-09-13T19:36:59.893029+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:36:59.893029+0000","last_undegraded":"2024-09-13T19:36:59.893029+0000","last_fullsized":"2024-09-13T19:36:59.893029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.892784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:26.796881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.922723+0000","last_change":"2024-09-13T19:37:33.922792+0000","last_active":"2024-09-13T19:37:33.922723+0000","last_peered":"2024-09-13T19:37:33.922723+0000","last_clean":"2024-09-13T19:37:33.922723+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:37:33.922723+0000","last_undegraded":"2024-09-13T19:37:33.922723+0000","last_fullsized":"2024-09-13T19:37:33.922723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:33.922489+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:33.922489+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.922489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:49.484234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:01.606826+0000","last_change":"2024-09-13T19:38:01.606889+0000","last_active":"2024-09-13T19:38:01.606826+0000","last_peered":"2024-09-13T19:38:01.606826+0000","last_clean":"2024-09-13T19:38:01.606826+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:38:01.606826+0000","last_undegraded":"2024-09-13T19:38:01.606826+0000","last_fullsized":"2024-09-13T19:38:01.606826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:38:01.606632+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:38:01.606632+0000","last_clean_scrub_stamp":"2024-09-13T19:38:01.606632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.048934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.250956+0000","last_change":"2024-09-13T19:37:16.251010+0000","last_active":"2024-09-13T19:37:16.250956+0000","last_peered":"2024-09-13T19:37:16.250956+0000","last_clean":"2024-09-13T19:37:16.250956+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:37:16.250956+0000","last_undegraded":"2024-09-13T19:37:16.250956+0000","last_fullsized":"2024-09-13T19:37:16.250956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.250752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:17.682001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'66","reported_seq":140,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.201490+0000","last_change":"2024-09-13T19:37:12.201490+0000","last_active":"2024-09-13T19:37:12.201490+0000","last_peered":"2024-09-13T19:37:12.201490+0000","last_clean":"2024-09-13T19:37:12.201490+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:37:12.201490+0000","last_undegraded":"2024-09-13T19:37:12.201490+0000","last_fullsized":"2024-09-13T19:37:12.201490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.201193+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:16.321625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.836514+0000","last_change":"2024-09-13T19:37:11.836514+0000","last_active":"2024-09-13T19:37:11.836514+0000","last_peered":"2024-09-13T19:37:11.836514+0000","last_clean":"2024-09-13T19:37:11.836514+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:37:11.836514+0000","last_undegraded":"2024-09-13T19:37:11.836514+0000","last_fullsized":"2024-09-13T19:37:11.836514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.836187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:55.223762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.222153+0000","last_change":"2024-09-13T19:37:58.222153+0000","last_active":"2024-09-13T19:37:58.222153+0000","last_peered":"2024-09-13T19:37:58.222153+0000","last_clean":"2024-09-13T19:37:58.222153+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:37:58.222153+0000","last_undegraded":"2024-09-13T19:37:58.222153+0000","last_fullsized":"2024-09-13T19:37:58.222153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:58.221901+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:58.221901+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.221901+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:01.482512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.164238+0000","last_change":"2024-09-13T19:37:26.164322+0000","last_active":"2024-09-13T19:37:26.164238+0000","last_peered":"2024-09-13T19:37:26.164238+0000","last_clean":"2024-09-13T19:37:26.164238+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:37:26.164238+0000","last_undegraded":"2024-09-13T19:37:26.164238+0000","last_fullsized":"2024-09-13T19:37:26.164238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:26.164044+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:26.164044+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.164044+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:08.108354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.551251+0000","last_change":"2024-09-13T19:37:50.551251+0000","last_active":"2024-09-13T19:37:50.551251+0000","last_peered":"2024-09-13T19:37:50.551251+0000","last_clean":"2024-09-13T19:37:50.551251+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:37:50.551251+0000","last_undegraded":"2024-09-13T19:37:50.551251+0000","last_fullsized":"2024-09-13T19:37:50.551251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:50.550963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:50.550963+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.550963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:20.482280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.878321+0000","last_change":"2024-09-13T19:37:18.878321+0000","last_active":"2024-09-13T19:37:18.878321+0000","last_peered":"2024-09-13T19:37:18.878321+0000","last_clean":"2024-09-13T19:37:18.878321+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:37:18.878321+0000","last_undegraded":"2024-09-13T19:37:18.878321+0000","last_fullsized":"2024-09-13T19:37:18.878321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.878068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.266511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.006370+0000","last_change":"2024-09-13T19:37:30.006370+0000","last_active":"2024-09-13T19:37:30.006370+0000","last_peered":"2024-09-13T19:37:30.006370+0000","last_clean":"2024-09-13T19:37:30.006370+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:37:30.006370+0000","last_undegraded":"2024-09-13T19:37:30.006370+0000","last_fullsized":"2024-09-13T19:37:30.006370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:30.006093+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:30.006093+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.006093+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:55.908367+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.465714+0000","last_change":"2024-09-13T19:37:02.465714+0000","last_active":"2024-09-13T19:37:02.465714+0000","last_peered":"2024-09-13T19:37:02.465714+0000","last_clean":"2024-09-13T19:37:02.465714+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:37:02.465714+0000","last_undegraded":"2024-09-13T19:37:02.465714+0000","last_fullsized":"2024-09-13T19:37:02.465714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.465336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.671030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.824868+0000","last_change":"2024-09-13T19:37:50.824868+0000","last_active":"2024-09-13T19:37:50.824868+0000","last_peered":"2024-09-13T19:37:50.824868+0000","last_clean":"2024-09-13T19:37:50.824868+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:37:50.824868+0000","last_undegraded":"2024-09-13T19:37:50.824868+0000","last_fullsized":"2024-09-13T19:37:50.824868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:50.824629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:50.824629+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.824629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:16.055391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.118224+0000","last_change":"2024-09-13T19:37:16.118224+0000","last_active":"2024-09-13T19:37:16.118224+0000","last_peered":"2024-09-13T19:37:16.118224+0000","last_clean":"2024-09-13T19:37:16.118224+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:37:16.118224+0000","last_undegraded":"2024-09-13T19:37:16.118224+0000","last_fullsized":"2024-09-13T19:37:16.118224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:16.117977+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:16.117977+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.117977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.935807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.533216+0000","last_change":"2024-09-13T19:37:49.533216+0000","last_active":"2024-09-13T19:37:49.533216+0000","last_peered":"2024-09-13T19:37:49.533216+0000","last_clean":"2024-09-13T19:37:49.533216+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:37:49.533216+0000","last_undegraded":"2024-09-13T19:37:49.533216+0000","last_fullsized":"2024-09-13T19:37:49.533216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:49.532974+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.532974+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.532974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:15.435248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.846985+0000","last_change":"2024-09-13T19:37:17.846985+0000","last_active":"2024-09-13T19:37:17.846985+0000","last_peered":"2024-09-13T19:37:17.846985+0000","last_clean":"2024-09-13T19:37:17.846985+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:37:17.846985+0000","last_undegraded":"2024-09-13T19:37:17.846985+0000","last_fullsized":"2024-09-13T19:37:17.846985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.846741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:49.584937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.250550+0000","last_change":"2024-09-13T19:37:08.250550+0000","last_active":"2024-09-13T19:37:08.250550+0000","last_peered":"2024-09-13T19:37:08.250550+0000","last_clean":"2024-09-13T19:37:08.250550+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:37:08.250550+0000","last_undegraded":"2024-09-13T19:37:08.250550+0000","last_fullsized":"2024-09-13T19:37:08.250550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.250286+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.511817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.299423+0000","last_change":"2024-09-13T19:37:17.299423+0000","last_active":"2024-09-13T19:37:17.299423+0000","last_peered":"2024-09-13T19:37:17.299423+0000","last_clean":"2024-09-13T19:37:17.299423+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:37:17.299423+0000","last_undegraded":"2024-09-13T19:37:17.299423+0000","last_fullsized":"2024-09-13T19:37:17.299423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.299176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:11.887369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.867645+0000","last_change":"2024-09-13T19:37:42.867645+0000","last_active":"2024-09-13T19:37:42.867645+0000","last_peered":"2024-09-13T19:37:42.867645+0000","last_clean":"2024-09-13T19:37:42.867645+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:37:42.867645+0000","last_undegraded":"2024-09-13T19:37:42.867645+0000","last_fullsized":"2024-09-13T19:37:42.867645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:42.867391+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:42.867391+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.867391+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:28.444269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.170330+0000","last_change":"2024-09-13T19:37:27.170330+0000","last_active":"2024-09-13T19:37:27.170330+0000","last_peered":"2024-09-13T19:37:27.170330+0000","last_clean":"2024-09-13T19:37:27.170330+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:37:27.170330+0000","last_undegraded":"2024-09-13T19:37:27.170330+0000","last_fullsized":"2024-09-13T19:37:27.170330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:27.170072+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:27.170072+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.170072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:51.374174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.660359+0000","last_change":"2024-09-13T19:37:59.660359+0000","last_active":"2024-09-13T19:37:59.660359+0000","last_peered":"2024-09-13T19:37:59.660359+0000","last_clean":"2024-09-13T19:37:59.660359+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:37:59.660359+0000","last_undegraded":"2024-09-13T19:37:59.660359+0000","last_fullsized":"2024-09-13T19:37:59.660359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:59.660109+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:59.660109+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.660109+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.572890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.667320+0000","last_change":"2024-09-13T19:37:21.667320+0000","last_active":"2024-09-13T19:37:21.667320+0000","last_peered":"2024-09-13T19:37:21.667320+0000","last_clean":"2024-09-13T19:37:21.667320+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:37:21.667320+0000","last_undegraded":"2024-09-13T19:37:21.667320+0000","last_fullsized":"2024-09-13T19:37:21.667320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:21.666993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:21.666993+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.666993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:40.253116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.027267+0000","last_change":"2024-09-13T19:37:29.027432+0000","last_active":"2024-09-13T19:37:29.027267+0000","last_peered":"2024-09-13T19:37:29.027267+0000","last_clean":"2024-09-13T19:37:29.027267+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:37:29.027267+0000","last_undegraded":"2024-09-13T19:37:29.027267+0000","last_fullsized":"2024-09-13T19:37:29.027267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:29.027005+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:29.027005+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.027005+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:23.111450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":420,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.871065+0000","last_change":"2024-09-13T19:37:01.871065+0000","last_active":"2024-09-13T19:37:01.871065+0000","last_peered":"2024-09-13T19:37:01.871065+0000","last_clean":"2024-09-13T19:37:01.871065+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:37:01.871065+0000","last_undegraded":"2024-09-13T19:37:01.871065+0000","last_fullsized":"2024-09-13T19:37:01.871065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.870803+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:04.118178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:19.479692+0000","last_change":"2024-09-13T19:38:19.479756+0000","last_active":"2024-09-13T19:38:19.479692+0000","last_peered":"2024-09-13T19:38:19.479692+0000","last_clean":"2024-09-13T19:38:19.479692+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:38:19.479692+0000","last_undegraded":"2024-09-13T19:38:19.479692+0000","last_fullsized":"2024-09-13T19:38:19.479692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:38:19.479475+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:38:19.479475+0000","last_clean_scrub_stamp":"2024-09-13T19:38:19.479475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:15.019171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.914489+0000","last_change":"2024-09-13T19:37:25.914489+0000","last_active":"2024-09-13T19:37:25.914489+0000","last_peered":"2024-09-13T19:37:25.914489+0000","last_clean":"2024-09-13T19:37:25.914489+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:37:25.914489+0000","last_undegraded":"2024-09-13T19:37:25.914489+0000","last_fullsized":"2024-09-13T19:37:25.914489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:25.914351+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:25.914351+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.914351+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:13.683898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.472385+0000","last_change":"2024-09-13T19:37:45.472385+0000","last_active":"2024-09-13T19:37:45.472385+0000","last_peered":"2024-09-13T19:37:45.472385+0000","last_clean":"2024-09-13T19:37:45.472385+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:37:45.472385+0000","last_undegraded":"2024-09-13T19:37:45.472385+0000","last_fullsized":"2024-09-13T19:37:45.472385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:45.472142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:45.472142+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.472142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:11.674746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.580839+0000","last_change":"2024-09-13T19:37:18.580839+0000","last_active":"2024-09-13T19:37:18.580839+0000","last_peered":"2024-09-13T19:37:18.580839+0000","last_clean":"2024-09-13T19:37:18.580839+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:37:18.580839+0000","last_undegraded":"2024-09-13T19:37:18.580839+0000","last_fullsized":"2024-09-13T19:37:18.580839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.580585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.580585+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.580585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:54.166980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.504071+0000","last_change":"2024-09-13T19:37:07.504071+0000","last_active":"2024-09-13T19:37:07.504071+0000","last_peered":"2024-09-13T19:37:07.504071+0000","last_clean":"2024-09-13T19:37:07.504071+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:37:07.504071+0000","last_undegraded":"2024-09-13T19:37:07.504071+0000","last_fullsized":"2024-09-13T19:37:07.504071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.503821+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.393786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.318463+0000","last_change":"2024-09-13T19:37:02.318463+0000","last_active":"2024-09-13T19:37:02.318463+0000","last_peered":"2024-09-13T19:37:02.318463+0000","last_clean":"2024-09-13T19:37:02.318463+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:37:02.318463+0000","last_undegraded":"2024-09-13T19:37:02.318463+0000","last_fullsized":"2024-09-13T19:37:02.318463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.318220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:12.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.553453+0000","last_change":"2024-09-13T19:37:56.553453+0000","last_active":"2024-09-13T19:37:56.553453+0000","last_peered":"2024-09-13T19:37:56.553453+0000","last_clean":"2024-09-13T19:37:56.553453+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:37:56.553453+0000","last_undegraded":"2024-09-13T19:37:56.553453+0000","last_fullsized":"2024-09-13T19:37:56.553453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:56.553171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:56.553171+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.553171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:57.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.014422+0000","last_change":"2024-09-13T19:37:32.014422+0000","last_active":"2024-09-13T19:37:32.014422+0000","last_peered":"2024-09-13T19:37:32.014422+0000","last_clean":"2024-09-13T19:37:32.014422+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:37:32.014422+0000","last_undegraded":"2024-09-13T19:37:32.014422+0000","last_fullsized":"2024-09-13T19:37:32.014422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:32.014177+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:32.014177+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.014177+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.161530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.864702+0000","last_change":"2024-09-13T19:37:49.864702+0000","last_active":"2024-09-13T19:37:49.864702+0000","last_peered":"2024-09-13T19:37:49.864702+0000","last_clean":"2024-09-13T19:37:49.864702+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:37:49.864702+0000","last_undegraded":"2024-09-13T19:37:49.864702+0000","last_fullsized":"2024-09-13T19:37:49.864702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:49.864324+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.864324+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.864324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:22.170482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.865947+0000","last_change":"2024-09-13T19:37:12.865947+0000","last_active":"2024-09-13T19:37:12.865947+0000","last_peered":"2024-09-13T19:37:12.865947+0000","last_clean":"2024-09-13T19:37:12.865947+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:37:12.865947+0000","last_undegraded":"2024-09-13T19:37:12.865947+0000","last_fullsized":"2024-09-13T19:37:12.865947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.865683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.157355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.252058+0000","last_change":"2024-09-13T19:37:14.252058+0000","last_active":"2024-09-13T19:37:14.252058+0000","last_peered":"2024-09-13T19:37:14.252058+0000","last_clean":"2024-09-13T19:37:14.252058+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:37:14.252058+0000","last_undegraded":"2024-09-13T19:37:14.252058+0000","last_fullsized":"2024-09-13T19:37:14.252058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.251796+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.000429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.120297+0000","last_change":"2024-09-13T19:37:22.120297+0000","last_active":"2024-09-13T19:37:22.120297+0000","last_peered":"2024-09-13T19:37:22.120297+0000","last_clean":"2024-09-13T19:37:22.120297+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:37:22.120297+0000","last_undegraded":"2024-09-13T19:37:22.120297+0000","last_fullsized":"2024-09-13T19:37:22.120297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:22.120047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:22.120047+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.120047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:39.824427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.355502+0000","last_change":"2024-09-13T19:33:18.424633+0000","last_active":"2024-09-13T19:37:00.355502+0000","last_peered":"2024-09-13T19:37:00.355502+0000","last_clean":"2024-09-13T19:37:00.355502+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:37:00.355502+0000","last_undegraded":"2024-09-13T19:37:00.355502+0000","last_fullsized":"2024-09-13T19:37:00.355502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:33:17.354442+0000","last_clean_scrub_stamp":"2024-09-13T19:33:17.354442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.876192+0000","last_change":"2024-09-13T19:37:48.876192+0000","last_active":"2024-09-13T19:37:48.876192+0000","last_peered":"2024-09-13T19:37:48.876192+0000","last_clean":"2024-09-13T19:37:48.876192+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:37:48.876192+0000","last_undegraded":"2024-09-13T19:37:48.876192+0000","last_fullsized":"2024-09-13T19:37:48.876192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:48.875767+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:48.875767+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.875767+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:54.957655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.148982+0000","last_change":"2024-09-13T19:37:34.149044+0000","last_active":"2024-09-13T19:37:34.148982+0000","last_peered":"2024-09-13T19:37:34.148982+0000","last_clean":"2024-09-13T19:37:34.148982+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:37:34.148982+0000","last_undegraded":"2024-09-13T19:37:34.148982+0000","last_fullsized":"2024-09-13T19:37:34.148982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:34.148784+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:34.148784+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.148784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:52.146325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.541626+0000","last_change":"2024-09-13T19:37:15.541626+0000","last_active":"2024-09-13T19:37:15.541626+0000","last_peered":"2024-09-13T19:37:15.541626+0000","last_clean":"2024-09-13T19:37:15.541626+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:37:15.541626+0000","last_undegraded":"2024-09-13T19:37:15.541626+0000","last_fullsized":"2024-09-13T19:37:15.541626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.541376+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.541376+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.541376+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.495683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.117296+0000","last_change":"2024-09-13T19:37:13.117296+0000","last_active":"2024-09-13T19:37:13.117296+0000","last_peered":"2024-09-13T19:37:13.117296+0000","last_clean":"2024-09-13T19:37:13.117296+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:37:13.117296+0000","last_undegraded":"2024-09-13T19:37:13.117296+0000","last_fullsized":"2024-09-13T19:37:13.117296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.117012+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:54.888683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.982763+0000","last_change":"2024-09-13T19:37:26.982763+0000","last_active":"2024-09-13T19:37:26.982763+0000","last_peered":"2024-09-13T19:37:26.982763+0000","last_clean":"2024-09-13T19:37:26.982763+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:37:26.982763+0000","last_undegraded":"2024-09-13T19:37:26.982763+0000","last_fullsized":"2024-09-13T19:37:26.982763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:26.982499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:26.982499+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.982499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:34.956774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:20.483248+0000","last_change":"2024-09-13T19:38:20.483307+0000","last_active":"2024-09-13T19:38:20.483248+0000","last_peered":"2024-09-13T19:38:20.483248+0000","last_clean":"2024-09-13T19:38:20.483248+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:38:20.483248+0000","last_undegraded":"2024-09-13T19:38:20.483248+0000","last_fullsized":"2024-09-13T19:38:20.483248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:38:20.483061+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:38:20.483061+0000","last_clean_scrub_stamp":"2024-09-13T19:38:20.483061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:53.948747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.942239+0000","last_change":"2024-09-13T19:37:27.942239+0000","last_active":"2024-09-13T19:37:27.942239+0000","last_peered":"2024-09-13T19:37:27.942239+0000","last_clean":"2024-09-13T19:37:27.942239+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:37:27.942239+0000","last_undegraded":"2024-09-13T19:37:27.942239+0000","last_fullsized":"2024-09-13T19:37:27.942239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:27.941988+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:27.941988+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.941988+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:53.406471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.478392+0000","last_change":"2024-09-13T19:37:47.478452+0000","last_active":"2024-09-13T19:37:47.478392+0000","last_peered":"2024-09-13T19:37:47.478392+0000","last_clean":"2024-09-13T19:37:47.478392+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:37:47.478392+0000","last_undegraded":"2024-09-13T19:37:47.478392+0000","last_fullsized":"2024-09-13T19:37:47.478392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:47.478174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:47.478174+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.478174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:08.475733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.532693+0000","last_change":"2024-09-13T19:37:13.532693+0000","last_active":"2024-09-13T19:37:13.532693+0000","last_peered":"2024-09-13T19:37:13.532693+0000","last_clean":"2024-09-13T19:37:13.532693+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:37:13.532693+0000","last_undegraded":"2024-09-13T19:37:13.532693+0000","last_fullsized":"2024-09-13T19:37:13.532693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.532406+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:58.383662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.062437+0000","last_change":"2024-09-13T19:37:05.062437+0000","last_active":"2024-09-13T19:37:05.062437+0000","last_peered":"2024-09-13T19:37:05.062437+0000","last_clean":"2024-09-13T19:37:05.062437+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:37:05.062437+0000","last_undegraded":"2024-09-13T19:37:05.062437+0000","last_fullsized":"2024-09-13T19:37:05.062437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.062147+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:44.414993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.301555+0000","last_change":"2024-09-13T19:36:59.301555+0000","last_active":"2024-09-13T19:36:59.301555+0000","last_peered":"2024-09-13T19:36:59.301555+0000","last_clean":"2024-09-13T19:36:59.301555+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:36:59.301555+0000","last_undegraded":"2024-09-13T19:36:59.301555+0000","last_fullsized":"2024-09-13T19:36:59.301555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.301322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:26.231205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:18.500104+0000","last_change":"2024-09-13T19:38:18.500166+0000","last_active":"2024-09-13T19:38:18.500104+0000","last_peered":"2024-09-13T19:38:18.500104+0000","last_clean":"2024-09-13T19:38:18.500104+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:38:18.500104+0000","last_undegraded":"2024-09-13T19:38:18.500104+0000","last_fullsized":"2024-09-13T19:38:18.500104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:38:18.499901+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:38:18.499901+0000","last_clean_scrub_stamp":"2024-09-13T19:38:18.499901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:29.496915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.964064+0000","last_change":"2024-09-13T19:37:52.964064+0000","last_active":"2024-09-13T19:37:52.964064+0000","last_peered":"2024-09-13T19:37:52.964064+0000","last_clean":"2024-09-13T19:37:52.964064+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:37:52.964064+0000","last_undegraded":"2024-09-13T19:37:52.964064+0000","last_fullsized":"2024-09-13T19:37:52.964064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:52.963719+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:52.963719+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.963719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:29.957603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.052768+0000","last_change":"2024-09-13T19:37:40.052825+0000","last_active":"2024-09-13T19:37:40.052768+0000","last_peered":"2024-09-13T19:37:40.052768+0000","last_clean":"2024-09-13T19:37:40.052768+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:37:40.052768+0000","last_undegraded":"2024-09-13T19:37:40.052768+0000","last_fullsized":"2024-09-13T19:37:40.052768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:40.052581+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:40.052581+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.052581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:52.026250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.200561+0000","last_change":"2024-09-13T19:37:31.200618+0000","last_active":"2024-09-13T19:37:31.200561+0000","last_peered":"2024-09-13T19:37:31.200561+0000","last_clean":"2024-09-13T19:37:31.200561+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:37:31.200561+0000","last_undegraded":"2024-09-13T19:37:31.200561+0000","last_fullsized":"2024-09-13T19:37:31.200561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:31.200373+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:31.200373+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.200373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:01.945557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.084630+0000","last_change":"2024-09-13T19:37:50.084689+0000","last_active":"2024-09-13T19:37:50.084630+0000","last_peered":"2024-09-13T19:37:50.084630+0000","last_clean":"2024-09-13T19:37:50.084630+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:37:50.084630+0000","last_undegraded":"2024-09-13T19:37:50.084630+0000","last_fullsized":"2024-09-13T19:37:50.084630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:50.084429+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:50.084429+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.084429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:13.245839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.954921+0000","last_change":"2024-09-13T19:37:36.955053+0000","last_active":"2024-09-13T19:37:36.954921+0000","last_peered":"2024-09-13T19:37:36.954921+0000","last_clean":"2024-09-13T19:37:36.954921+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:37:36.954921+0000","last_undegraded":"2024-09-13T19:37:36.954921+0000","last_fullsized":"2024-09-13T19:37:36.954921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:36.954674+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:36.954674+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.954674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:38.360824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:14.550464+0000","last_change":"2024-09-13T19:38:14.550529+0000","last_active":"2024-09-13T19:38:14.550464+0000","last_peered":"2024-09-13T19:38:14.550464+0000","last_clean":"2024-09-13T19:38:14.550464+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:38:14.550464+0000","last_undegraded":"2024-09-13T19:38:14.550464+0000","last_fullsized":"2024-09-13T19:38:14.550464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:38:14.550263+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:38:14.550263+0000","last_clean_scrub_stamp":"2024-09-13T19:38:14.550263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:17.793700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.167479+0000","last_change":"2024-09-13T19:37:33.167544+0000","last_active":"2024-09-13T19:37:33.167479+0000","last_peered":"2024-09-13T19:37:33.167479+0000","last_clean":"2024-09-13T19:37:33.167479+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:37:33.167479+0000","last_undegraded":"2024-09-13T19:37:33.167479+0000","last_fullsized":"2024-09-13T19:37:33.167479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.167253+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.167253+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.167253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:45.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.086624+0000","last_change":"2024-09-13T19:37:54.086685+0000","last_active":"2024-09-13T19:37:54.086624+0000","last_peered":"2024-09-13T19:37:54.086624+0000","last_clean":"2024-09-13T19:37:54.086624+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:37:54.086624+0000","last_undegraded":"2024-09-13T19:37:54.086624+0000","last_fullsized":"2024-09-13T19:37:54.086624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:54.086427+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:54.086427+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.086427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:06.678941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.163622+0000","last_change":"2024-09-13T19:37:35.163796+0000","last_active":"2024-09-13T19:37:35.163622+0000","last_peered":"2024-09-13T19:37:35.163622+0000","last_clean":"2024-09-13T19:37:35.163622+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:37:35.163622+0000","last_undegraded":"2024-09-13T19:37:35.163622+0000","last_fullsized":"2024-09-13T19:37:35.163622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:35.163395+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:35.163395+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.163395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:10.385936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.052353+0000","last_change":"2024-09-13T19:37:49.052481+0000","last_active":"2024-09-13T19:37:49.052353+0000","last_peered":"2024-09-13T19:37:49.052353+0000","last_clean":"2024-09-13T19:37:49.052353+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:37:49.052353+0000","last_undegraded":"2024-09-13T19:37:49.052353+0000","last_fullsized":"2024-09-13T19:37:49.052353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:49.052106+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.052106+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.052106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:56.624456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.483093+0000","last_change":"2024-09-13T19:37:42.483164+0000","last_active":"2024-09-13T19:37:42.483093+0000","last_peered":"2024-09-13T19:37:42.483093+0000","last_clean":"2024-09-13T19:37:42.483093+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:37:42.483093+0000","last_undegraded":"2024-09-13T19:37:42.483093+0000","last_fullsized":"2024-09-13T19:37:42.483093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:42.482866+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:42.482866+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.482866+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:21.318908+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.483639+0000","last_change":"2024-09-13T19:37:43.483707+0000","last_active":"2024-09-13T19:37:43.483639+0000","last_peered":"2024-09-13T19:37:43.483639+0000","last_clean":"2024-09-13T19:37:43.483639+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:37:43.483639+0000","last_undegraded":"2024-09-13T19:37:43.483639+0000","last_fullsized":"2024-09-13T19:37:43.483639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:43.483442+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:43.483442+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.483442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:14.592719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.150134+0000","last_change":"2024-09-13T19:37:37.150197+0000","last_active":"2024-09-13T19:37:37.150134+0000","last_peered":"2024-09-13T19:37:37.150134+0000","last_clean":"2024-09-13T19:37:37.150134+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:37:37.150134+0000","last_undegraded":"2024-09-13T19:37:37.150134+0000","last_fullsized":"2024-09-13T19:37:37.150134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:37.149953+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:37.149953+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.149953+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.044893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.905881+0000","last_change":"2024-09-13T19:37:28.905881+0000","last_active":"2024-09-13T19:37:28.905881+0000","last_peered":"2024-09-13T19:37:28.905881+0000","last_clean":"2024-09-13T19:37:28.905881+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:37:28.905881+0000","last_undegraded":"2024-09-13T19:37:28.905881+0000","last_fullsized":"2024-09-13T19:37:28.905881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:28.905626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:28.905626+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.905626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:55.777372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.430872+0000","last_change":"2024-09-13T19:37:35.430941+0000","last_active":"2024-09-13T19:37:35.430872+0000","last_peered":"2024-09-13T19:37:35.430872+0000","last_clean":"2024-09-13T19:37:35.430872+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:37:35.430872+0000","last_undegraded":"2024-09-13T19:37:35.430872+0000","last_fullsized":"2024-09-13T19:37:35.430872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:35.430664+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:35.430664+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.430664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.672938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.038487+0000","last_change":"2024-09-13T19:37:51.038544+0000","last_active":"2024-09-13T19:37:51.038487+0000","last_peered":"2024-09-13T19:37:51.038487+0000","last_clean":"2024-09-13T19:37:51.038487+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:37:51.038487+0000","last_undegraded":"2024-09-13T19:37:51.038487+0000","last_fullsized":"2024-09-13T19:37:51.038487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:51.038289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:51.038289+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.038289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:38.835483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.512846+0000","last_change":"2024-09-13T19:37:30.512846+0000","last_active":"2024-09-13T19:37:30.512846+0000","last_peered":"2024-09-13T19:37:30.512846+0000","last_clean":"2024-09-13T19:37:30.512846+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:37:30.512846+0000","last_undegraded":"2024-09-13T19:37:30.512846+0000","last_fullsized":"2024-09-13T19:37:30.512846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:30.512571+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:30.512571+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.512571+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:33.379047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:13.562323+0000","last_change":"2024-09-13T19:38:13.562383+0000","last_active":"2024-09-13T19:38:13.562323+0000","last_peered":"2024-09-13T19:38:13.562323+0000","last_clean":"2024-09-13T19:38:13.562323+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:38:13.562323+0000","last_undegraded":"2024-09-13T19:38:13.562323+0000","last_fullsized":"2024-09-13T19:38:13.562323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:13.562124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:13.562124+0000","last_clean_scrub_stamp":"2024-09-13T19:38:13.562124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:22.708712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'14","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.104875+0000","last_change":"2024-09-13T19:37:18.104875+0000","last_active":"2024-09-13T19:37:18.104875+0000","last_peered":"2024-09-13T19:37:18.104875+0000","last_clean":"2024-09-13T19:37:18.104875+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:37:18.104875+0000","last_undegraded":"2024-09-13T19:37:18.104875+0000","last_fullsized":"2024-09-13T19:37:18.104875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:18.104473+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:18.104473+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.104473+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:20.278237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.025172+0000","last_change":"2024-09-13T19:37:40.025225+0000","last_active":"2024-09-13T19:37:40.025172+0000","last_peered":"2024-09-13T19:37:40.025172+0000","last_clean":"2024-09-13T19:37:40.025172+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:37:40.025172+0000","last_undegraded":"2024-09-13T19:37:40.025172+0000","last_fullsized":"2024-09-13T19:37:40.025172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:40.024986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:40.024986+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.024986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:45.755716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.244707+0000","last_change":"2024-09-13T19:37:30.244707+0000","last_active":"2024-09-13T19:37:30.244707+0000","last_peered":"2024-09-13T19:37:30.244707+0000","last_clean":"2024-09-13T19:37:30.244707+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:37:30.244707+0000","last_undegraded":"2024-09-13T19:37:30.244707+0000","last_fullsized":"2024-09-13T19:37:30.244707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:30.244451+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:30.244451+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.244451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:22.965504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.440228+0000","last_change":"2024-09-13T19:37:41.440287+0000","last_active":"2024-09-13T19:37:41.440228+0000","last_peered":"2024-09-13T19:37:41.440228+0000","last_clean":"2024-09-13T19:37:41.440228+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:37:41.440228+0000","last_undegraded":"2024-09-13T19:37:41.440228+0000","last_fullsized":"2024-09-13T19:37:41.440228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:41.440043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:41.440043+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.440043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:18.433927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.500426+0000","last_change":"2024-09-13T19:37:31.500426+0000","last_active":"2024-09-13T19:37:31.500426+0000","last_peered":"2024-09-13T19:37:31.500426+0000","last_clean":"2024-09-13T19:37:31.500426+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:37:31.500426+0000","last_undegraded":"2024-09-13T19:37:31.500426+0000","last_fullsized":"2024-09-13T19:37:31.500426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:31.500107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:31.500107+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.500107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:51.092885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.528643+0000","last_change":"2024-09-13T19:37:39.528643+0000","last_active":"2024-09-13T19:37:39.528643+0000","last_peered":"2024-09-13T19:37:39.528643+0000","last_clean":"2024-09-13T19:37:39.528643+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:37:39.528643+0000","last_undegraded":"2024-09-13T19:37:39.528643+0000","last_fullsized":"2024-09-13T19:37:39.528643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:39.528373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:39.528373+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.528373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:21.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.501778+0000","last_change":"2024-09-13T19:37:27.501778+0000","last_active":"2024-09-13T19:37:27.501778+0000","last_peered":"2024-09-13T19:37:27.501778+0000","last_clean":"2024-09-13T19:37:27.501778+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:37:27.501778+0000","last_undegraded":"2024-09-13T19:37:27.501778+0000","last_fullsized":"2024-09-13T19:37:27.501778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:27.501537+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:27.501537+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.501537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:56.956150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.848065+0000","last_change":"2024-09-13T19:37:52.848193+0000","last_active":"2024-09-13T19:37:52.848065+0000","last_peered":"2024-09-13T19:37:52.848065+0000","last_clean":"2024-09-13T19:37:52.848065+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:37:52.848065+0000","last_undegraded":"2024-09-13T19:37:52.848065+0000","last_fullsized":"2024-09-13T19:37:52.848065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:52.847823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:52.847823+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.847823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:10:54.892989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.493010+0000","last_change":"2024-09-13T19:37:32.493010+0000","last_active":"2024-09-13T19:37:32.493010+0000","last_peered":"2024-09-13T19:37:32.493010+0000","last_clean":"2024-09-13T19:37:32.493010+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:37:32.493010+0000","last_undegraded":"2024-09-13T19:37:32.493010+0000","last_fullsized":"2024-09-13T19:37:32.493010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:32.492604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:32.492604+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.492604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:38.824183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:15.508768+0000","last_change":"2024-09-13T19:38:15.508835+0000","last_active":"2024-09-13T19:38:15.508768+0000","last_peered":"2024-09-13T19:38:15.508768+0000","last_clean":"2024-09-13T19:38:15.508768+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:38:15.508768+0000","last_undegraded":"2024-09-13T19:38:15.508768+0000","last_fullsized":"2024-09-13T19:38:15.508768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:38:15.508570+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:38:15.508570+0000","last_clean_scrub_stamp":"2024-09-13T19:38:15.508570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:35:59.958973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.937555+0000","last_change":"2024-09-13T19:37:37.937555+0000","last_active":"2024-09-13T19:37:37.937555+0000","last_peered":"2024-09-13T19:37:37.937555+0000","last_clean":"2024-09-13T19:37:37.937555+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:37:37.937555+0000","last_undegraded":"2024-09-13T19:37:37.937555+0000","last_fullsized":"2024-09-13T19:37:37.937555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:37.937265+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:37.937265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.937265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:03.903704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.965052+0000","last_change":"2024-09-13T19:37:30.965052+0000","last_active":"2024-09-13T19:37:30.965052+0000","last_peered":"2024-09-13T19:37:30.965052+0000","last_clean":"2024-09-13T19:37:30.965052+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:37:30.965052+0000","last_undegraded":"2024-09-13T19:37:30.965052+0000","last_fullsized":"2024-09-13T19:37:30.965052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:30.964823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:30.964823+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.964823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:34.672513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.479987+0000","last_change":"2024-09-13T19:37:33.480053+0000","last_active":"2024-09-13T19:37:33.479987+0000","last_peered":"2024-09-13T19:37:33.479987+0000","last_clean":"2024-09-13T19:37:33.479987+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:37:33.479987+0000","last_undegraded":"2024-09-13T19:37:33.479987+0000","last_fullsized":"2024-09-13T19:37:33.479987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.479793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.479793+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.479793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:15.251464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:06.630551+0000","last_change":"2024-09-13T19:38:06.630609+0000","last_active":"2024-09-13T19:38:06.630551+0000","last_peered":"2024-09-13T19:38:06.630551+0000","last_clean":"2024-09-13T19:38:06.630551+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:38:06.630551+0000","last_undegraded":"2024-09-13T19:38:06.630551+0000","last_fullsized":"2024-09-13T19:38:06.630551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:06.630360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:06.630360+0000","last_clean_scrub_stamp":"2024-09-13T19:38:06.630360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:56.557373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:02.636122+0000","last_change":"2024-09-13T19:38:02.636181+0000","last_active":"2024-09-13T19:38:02.636122+0000","last_peered":"2024-09-13T19:38:02.636122+0000","last_clean":"2024-09-13T19:38:02.636122+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:38:02.636122+0000","last_undegraded":"2024-09-13T19:38:02.636122+0000","last_fullsized":"2024-09-13T19:38:02.636122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:02.635915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:02.635915+0000","last_clean_scrub_stamp":"2024-09-13T19:38:02.635915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:35.156843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.049275+0000","last_change":"2024-09-13T19:37:43.049275+0000","last_active":"2024-09-13T19:37:43.049275+0000","last_peered":"2024-09-13T19:37:43.049275+0000","last_clean":"2024-09-13T19:37:43.049275+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:37:43.049275+0000","last_undegraded":"2024-09-13T19:37:43.049275+0000","last_fullsized":"2024-09-13T19:37:43.049275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:43.049024+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:43.049024+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.049024+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:14.158302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.117918+0000","last_change":"2024-09-13T19:37:38.117918+0000","last_active":"2024-09-13T19:37:38.117918+0000","last_peered":"2024-09-13T19:37:38.117918+0000","last_clean":"2024-09-13T19:37:38.117918+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:37:38.117918+0000","last_undegraded":"2024-09-13T19:37:38.117918+0000","last_fullsized":"2024-09-13T19:37:38.117918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:38.117676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:38.117676+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.117676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:38.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.574599+0000","last_change":"2024-09-13T19:37:25.574599+0000","last_active":"2024-09-13T19:37:25.574599+0000","last_peered":"2024-09-13T19:37:25.574599+0000","last_clean":"2024-09-13T19:37:25.574599+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:37:25.574599+0000","last_undegraded":"2024-09-13T19:37:25.574599+0000","last_fullsized":"2024-09-13T19:37:25.574599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:25.574184+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:25.574184+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.574184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:32.773848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1527,"ondisk_log_size":1527,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673028,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673029,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40460,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331380,"statfs":{"total":96636764160,"available":96595333120,"internally_reserved":0,"allocated":978944,"data_stored":724012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673028,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1015808,"data_stored":726198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":135923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:38:22.421 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T19:33:11.315067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:22.422 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:22.422 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:33:17.354442+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=33, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=36, tm_sec=57, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:38:22.423 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:38:42.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:38:42.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.552+0000 7f1fcf1e7640 1 Processor -- start 2024-09-13T19:38:42.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.552+0000 7f1fcf1e7640 1 -- start start 2024-09-13T19:38:42.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.552+0000 7f1fcf1e7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1fc8095280 0x7f1fc8095660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:42.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.552+0000 7f1fcf1e7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc80964e0 con 0x7f1fc8095ba0 2024-09-13T19:38:42.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.552+0000 7f1fcf1e7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc8050f50 con 0x7f1fc8095280 2024-09-13T19:38:42.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fccf83640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1fc8095280 0x7f1fc8095660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:42.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fc7fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1fc8095ba0 0x7f1fc8093050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60906/0 (socket says 172.21.15.18:60906) 2024-09-13T19:38:42.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fc7fff640 1 -- 172.21.15.18:0/3931166300 learned_addr learned my addr 172.21.15.18:0/3931166300 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:38:42.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fccf83640 1 -- 172.21.15.18:0/3931166300 >> v1:172.21.15.18:6789/0 conn(0x7f1fc8095ba0 legacy=0x7f1fc8093050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:42.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fccf83640 1 -- 172.21.15.18:0/3931166300 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc8096920 con 0x7f1fc8095280 2024-09-13T19:38:42.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fccf83640 1 --2- 172.21.15.18:0/3931166300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8095660 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009740 tx=0x7f1fb801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef7fbe23994cced server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:42.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fc77fe640 1 -- 172.21.15.18:0/3931166300 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb80b0070 con 0x7f1fc8095280 2024-09-13T19:38:42.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fc77fe640 1 -- 172.21.15.18:0/3931166300 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb80ab530 con 0x7f1fc8095280 2024-09-13T19:38:42.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fc77fe640 1 -- 172.21.15.18:0/3931166300 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb80ab830 con 0x7f1fc8095280 2024-09-13T19:38:42.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3931166300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 msgr2=0x7f1fc8095660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:42.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fcf1e7640 1 --2- 172.21.15.18:0/3931166300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8095660 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009740 tx=0x7f1fb801c370 comp rx=0 tx=0).stop 2024-09-13T19:38:42.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3931166300 shutdown_connections 2024-09-13T19:38:42.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fcf1e7640 1 --2- 172.21.15.18:0/3931166300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8095660 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:42.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3931166300 >> 172.21.15.18:0/3931166300 conn(0x7f1fc809d300 msgr2=0x7f1fc8099800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:38:42.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3931166300 shutdown_connections 2024-09-13T19:38:42.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.556+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3931166300 wait complete. 2024-09-13T19:38:42.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fcf1e7640 1 Processor -- start 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fcf1e7640 1 -- start start 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fcf1e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fcf1e7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc8134d40 con 0x7f1fc8095280 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fccf83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fccf83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35994/0 (socket says 172.21.15.18:35994) 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fccf83640 1 -- 172.21.15.18:0/3010982760 learned_addr learned my addr 172.21.15.18:0/3010982760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fccf83640 1 -- 172.21.15.18:0/3010982760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc806e6c0 con 0x7f1fc8095280 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fccf83640 1 --2- 172.21.15.18:0/3010982760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8072d10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80ae040 tx=0x7f1fb8019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fc57fa640 1 -- 172.21.15.18:0/3010982760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb80b8020 con 0x7f1fc8095280 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fc57fa640 1 -- 172.21.15.18:0/3010982760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb80b4410 con 0x7f1fc8095280 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fc57fa640 1 -- 172.21.15.18:0/3010982760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb80b0040 con 0x7f1fc8095280 2024-09-13T19:38:42.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc806eb40 con 0x7f1fc8095280 2024-09-13T19:38:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc8070380 con 0x7f1fc8095280 2024-09-13T19:38:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc8095660 con 0x7f1fc8095280 2024-09-13T19:38:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fc57fa640 1 -- 172.21.15.18:0/3010982760 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1fb80bb020 con 0x7f1fc8095280 2024-09-13T19:38:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fc57fa640 1 --2- 172.21.15.18:0/3010982760 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1fb4035db0 0x7f1fb4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:42.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fc57fa640 1 -- 172.21.15.18:0/3010982760 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1fb80e2c70 con 0x7f1fc8095280 2024-09-13T19:38:42.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.560+0000 7f1fc7fff640 1 --2- 172.21.15.18:0/3010982760 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1fb4035db0 0x7f1fb4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:42.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.564+0000 7f1fc7fff640 1 --2- 172.21.15.18:0/3010982760 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1fb4035db0 0x7f1fb4038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc001610 tx=0x7f1fbc007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.564+0000 7f1fc57fa640 1 -- 172.21.15.18:0/3010982760 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1fb80c2030 con 0x7f1fc8095280 2024-09-13T19:38:42.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.728+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 --> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fc806f310 con 0x7f1fb4035db0 2024-09-13T19:38:42.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.776+0000 7f1fc57fa640 1 -- 172.21.15.18:0/3010982760 <== mgr.4100 v2:172.21.15.144:6824/4073212006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665957 (secure 0 0 0) 0x7f1fc806f310 con 0x7f1fb4035db0 2024-09-13T19:38:42.787 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-13T19:38:42.793 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1fb4035db0 msgr2=0x7f1fb4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 --2- 172.21.15.18:0/3010982760 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1fb4035db0 0x7f1fb4038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc001610 tx=0x7f1fbc007ad0 comp rx=0 tx=0).stop 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 msgr2=0x7f1fc8072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 --2- 172.21.15.18:0/3010982760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8072d10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80ae040 tx=0x7f1fb8019110 comp rx=0 tx=0).stop 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 shutdown_connections 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 --2- 172.21.15.18:0/3010982760 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f1fb4035db0 0x7f1fb4038270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 --2- 172.21.15.18:0/3010982760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fc8095280 0x7f1fc8072d10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 >> 172.21.15.18:0/3010982760 conn(0x7f1fc809d300 msgr2=0x7f1fc8098db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 shutdown_connections 2024-09-13T19:38:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.780+0000 7f1fcf1e7640 1 -- 172.21.15.18:0/3010982760 wait complete. 2024-09-13T19:38:42.806 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-13T19:38:42.572178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5103,"num_read_kb":4688,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4794,"ondisk_log_size":4794,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148352,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339008,"statfs":{"total":386547056640,"available":386395144192,"internally_reserved":0,"allocated":2883584,"data_stored":1722916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007010"},"pg_stats":[{"pgid":"3.3f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.048263+0000","last_change":"2024-09-13T19:37:33.048322+0000","last_active":"2024-09-13T19:37:33.048263+0000","last_peered":"2024-09-13T19:37:33.048263+0000","last_clean":"2024-09-13T19:37:33.048263+0000","last_became_active":"2024-09-13T19:33:08.351489+0000","last_became_peered":"2024-09-13T19:33:08.351489+0000","last_unstale":"2024-09-13T19:37:33.048263+0000","last_undegraded":"2024-09-13T19:37:33.048263+0000","last_fullsized":"2024-09-13T19:37:33.048263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.048081+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.048081+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.048081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:51.634204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.602314+0000","last_change":"2024-09-13T19:37:54.602314+0000","last_active":"2024-09-13T19:37:54.602314+0000","last_peered":"2024-09-13T19:37:54.602314+0000","last_clean":"2024-09-13T19:37:54.602314+0000","last_became_active":"2024-09-13T19:33:10.354279+0000","last_became_peered":"2024-09-13T19:33:10.354279+0000","last_unstale":"2024-09-13T19:37:54.602314+0000","last_undegraded":"2024-09-13T19:37:54.602314+0000","last_fullsized":"2024-09-13T19:37:54.602314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:54.602013+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:54.602013+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.602013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:18.418246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.210640+0000","last_change":"2024-09-13T19:37:32.210703+0000","last_active":"2024-09-13T19:37:32.210640+0000","last_peered":"2024-09-13T19:37:32.210640+0000","last_clean":"2024-09-13T19:37:32.210640+0000","last_became_active":"2024-09-13T19:33:08.349071+0000","last_became_peered":"2024-09-13T19:33:08.349071+0000","last_unstale":"2024-09-13T19:37:32.210640+0000","last_undegraded":"2024-09-13T19:37:32.210640+0000","last_fullsized":"2024-09-13T19:37:32.210640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:32.210444+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:32.210444+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.210444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:10.274425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:02.175942+0000","last_change":"2024-09-13T19:38:02.176010+0000","last_active":"2024-09-13T19:38:02.175942+0000","last_peered":"2024-09-13T19:38:02.175942+0000","last_clean":"2024-09-13T19:38:02.175942+0000","last_became_active":"2024-09-13T19:33:49.508127+0000","last_became_peered":"2024-09-13T19:33:49.508127+0000","last_unstale":"2024-09-13T19:38:02.175942+0000","last_undegraded":"2024-09-13T19:38:02.175942+0000","last_fullsized":"2024-09-13T19:38:02.175942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:38:02.175762+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:38:02.175762+0000","last_clean_scrub_stamp":"2024-09-13T19:38:02.175762+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:29.549029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:04.663847+0000","last_change":"2024-09-13T19:38:04.663907+0000","last_active":"2024-09-13T19:38:04.663847+0000","last_peered":"2024-09-13T19:38:04.663847+0000","last_clean":"2024-09-13T19:38:04.663847+0000","last_became_active":"2024-09-13T19:33:08.354422+0000","last_became_peered":"2024-09-13T19:33:08.354422+0000","last_unstale":"2024-09-13T19:38:04.663847+0000","last_undegraded":"2024-09-13T19:38:04.663847+0000","last_fullsized":"2024-09-13T19:38:04.663847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:04.663651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:04.663651+0000","last_clean_scrub_stamp":"2024-09-13T19:38:04.663651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:17.798240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.874219+0000","last_change":"2024-09-13T19:37:43.874219+0000","last_active":"2024-09-13T19:37:43.874219+0000","last_peered":"2024-09-13T19:37:43.874219+0000","last_clean":"2024-09-13T19:37:43.874219+0000","last_became_active":"2024-09-13T19:33:10.349117+0000","last_became_peered":"2024-09-13T19:33:10.349117+0000","last_unstale":"2024-09-13T19:37:43.874219+0000","last_undegraded":"2024-09-13T19:37:43.874219+0000","last_fullsized":"2024-09-13T19:37:43.874219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:43.873952+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:43.873952+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.873952+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:37.149472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.942566+0000","last_change":"2024-09-13T19:37:43.942694+0000","last_active":"2024-09-13T19:37:43.942566+0000","last_peered":"2024-09-13T19:37:43.942566+0000","last_clean":"2024-09-13T19:37:43.942566+0000","last_became_active":"2024-09-13T19:33:08.347279+0000","last_became_peered":"2024-09-13T19:33:08.347279+0000","last_unstale":"2024-09-13T19:37:43.942566+0000","last_undegraded":"2024-09-13T19:37:43.942566+0000","last_fullsized":"2024-09-13T19:37:43.942566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:43.942314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:43.942314+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.942314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:55.792500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.872136+0000","last_change":"2024-09-13T19:37:47.872136+0000","last_active":"2024-09-13T19:37:47.872136+0000","last_peered":"2024-09-13T19:37:47.872136+0000","last_clean":"2024-09-13T19:37:47.872136+0000","last_became_active":"2024-09-13T19:33:10.346161+0000","last_became_peered":"2024-09-13T19:33:10.346161+0000","last_unstale":"2024-09-13T19:37:47.872136+0000","last_undegraded":"2024-09-13T19:37:47.872136+0000","last_fullsized":"2024-09-13T19:37:47.872136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:47.871853+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:47.871853+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.871853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:41.399592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:05.676649+0000","last_change":"2024-09-13T19:38:05.676649+0000","last_active":"2024-09-13T19:38:05.676649+0000","last_peered":"2024-09-13T19:38:05.676649+0000","last_clean":"2024-09-13T19:38:05.676649+0000","last_became_active":"2024-09-13T19:33:08.336140+0000","last_became_peered":"2024-09-13T19:33:08.336140+0000","last_unstale":"2024-09-13T19:38:05.676649+0000","last_undegraded":"2024-09-13T19:38:05.676649+0000","last_fullsized":"2024-09-13T19:38:05.676649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:05.676397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:05.676397+0000","last_clean_scrub_stamp":"2024-09-13T19:38:05.676397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:50.685654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.501820+0000","last_change":"2024-09-13T19:37:44.501917+0000","last_active":"2024-09-13T19:37:44.501820+0000","last_peered":"2024-09-13T19:37:44.501820+0000","last_clean":"2024-09-13T19:37:44.501820+0000","last_became_active":"2024-09-13T19:33:10.353148+0000","last_became_peered":"2024-09-13T19:33:10.353148+0000","last_unstale":"2024-09-13T19:37:44.501820+0000","last_undegraded":"2024-09-13T19:37:44.501820+0000","last_fullsized":"2024-09-13T19:37:44.501820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:44.501619+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:44.501619+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.501619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:32.640242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.068228+0000","last_change":"2024-09-13T19:37:41.068228+0000","last_active":"2024-09-13T19:37:41.068228+0000","last_peered":"2024-09-13T19:37:41.068228+0000","last_clean":"2024-09-13T19:37:41.068228+0000","last_became_active":"2024-09-13T19:33:08.332754+0000","last_became_peered":"2024-09-13T19:33:08.332754+0000","last_unstale":"2024-09-13T19:37:41.068228+0000","last_undegraded":"2024-09-13T19:37:41.068228+0000","last_fullsized":"2024-09-13T19:37:41.068228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:41.067989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:41.067989+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.067989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:54.472887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.052391+0000","last_change":"2024-09-13T19:37:20.052391+0000","last_active":"2024-09-13T19:37:20.052391+0000","last_peered":"2024-09-13T19:37:20.052391+0000","last_clean":"2024-09-13T19:37:20.052391+0000","last_became_active":"2024-09-13T19:33:10.357044+0000","last_became_peered":"2024-09-13T19:33:10.357044+0000","last_unstale":"2024-09-13T19:37:20.052391+0000","last_undegraded":"2024-09-13T19:37:20.052391+0000","last_fullsized":"2024-09-13T19:37:20.052391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:20.052114+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:20.052114+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.052114+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:18.722062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:03.683076+0000","last_change":"2024-09-13T19:38:03.683076+0000","last_active":"2024-09-13T19:38:03.683076+0000","last_peered":"2024-09-13T19:38:03.683076+0000","last_clean":"2024-09-13T19:38:03.683076+0000","last_became_active":"2024-09-13T19:33:08.337854+0000","last_became_peered":"2024-09-13T19:33:08.337854+0000","last_unstale":"2024-09-13T19:38:03.683076+0000","last_undegraded":"2024-09-13T19:38:03.683076+0000","last_fullsized":"2024-09-13T19:38:03.683076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:03.682720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:03.682720+0000","last_clean_scrub_stamp":"2024-09-13T19:38:03.682720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:10.301822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.891639+0000","last_change":"2024-09-13T19:37:20.891706+0000","last_active":"2024-09-13T19:37:20.891639+0000","last_peered":"2024-09-13T19:37:20.891639+0000","last_clean":"2024-09-13T19:37:20.891639+0000","last_became_active":"2024-09-13T19:33:10.354174+0000","last_became_peered":"2024-09-13T19:33:10.354174+0000","last_unstale":"2024-09-13T19:37:20.891639+0000","last_undegraded":"2024-09-13T19:37:20.891639+0000","last_fullsized":"2024-09-13T19:37:20.891639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:20.891432+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:20.891432+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.891432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:01.880905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.014562+0000","last_change":"2024-09-13T19:37:52.014562+0000","last_active":"2024-09-13T19:37:52.014562+0000","last_peered":"2024-09-13T19:37:52.014562+0000","last_clean":"2024-09-13T19:37:52.014562+0000","last_became_active":"2024-09-13T19:33:08.330946+0000","last_became_peered":"2024-09-13T19:33:08.330946+0000","last_unstale":"2024-09-13T19:37:52.014562+0000","last_undegraded":"2024-09-13T19:37:52.014562+0000","last_fullsized":"2024-09-13T19:37:52.014562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:52.014296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:52.014296+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.014296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:22.126180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.934911+0000","last_change":"2024-09-13T19:37:21.934969+0000","last_active":"2024-09-13T19:37:21.934911+0000","last_peered":"2024-09-13T19:37:21.934911+0000","last_clean":"2024-09-13T19:37:21.934911+0000","last_became_active":"2024-09-13T19:33:10.331932+0000","last_became_peered":"2024-09-13T19:33:10.331932+0000","last_unstale":"2024-09-13T19:37:21.934911+0000","last_undegraded":"2024-09-13T19:37:21.934911+0000","last_fullsized":"2024-09-13T19:37:21.934911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:21.934729+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:21.934729+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.934729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:12.436264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.894788+0000","last_change":"2024-09-13T19:37:45.894788+0000","last_active":"2024-09-13T19:37:45.894788+0000","last_peered":"2024-09-13T19:37:45.894788+0000","last_clean":"2024-09-13T19:37:45.894788+0000","last_became_active":"2024-09-13T19:33:10.348159+0000","last_became_peered":"2024-09-13T19:33:10.348159+0000","last_unstale":"2024-09-13T19:37:45.894788+0000","last_undegraded":"2024-09-13T19:37:45.894788+0000","last_fullsized":"2024-09-13T19:37:45.894788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:45.894519+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:45.894519+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.894519+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:39.495425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.580592+0000","last_change":"2024-09-13T19:37:53.580592+0000","last_active":"2024-09-13T19:37:53.580592+0000","last_peered":"2024-09-13T19:37:53.580592+0000","last_clean":"2024-09-13T19:37:53.580592+0000","last_became_active":"2024-09-13T19:33:08.337161+0000","last_became_peered":"2024-09-13T19:33:08.337161+0000","last_unstale":"2024-09-13T19:37:53.580592+0000","last_undegraded":"2024-09-13T19:37:53.580592+0000","last_fullsized":"2024-09-13T19:37:53.580592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:53.580309+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:53.580309+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.580309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:09.142055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.477714+0000","last_change":"2024-09-13T19:37:34.477714+0000","last_active":"2024-09-13T19:37:34.477714+0000","last_peered":"2024-09-13T19:37:34.477714+0000","last_clean":"2024-09-13T19:37:34.477714+0000","last_became_active":"2024-09-13T19:33:10.350427+0000","last_became_peered":"2024-09-13T19:33:10.350427+0000","last_unstale":"2024-09-13T19:37:34.477714+0000","last_undegraded":"2024-09-13T19:37:34.477714+0000","last_fullsized":"2024-09-13T19:37:34.477714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:34.477463+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:34.477463+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.477463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:52.475004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.910580+0000","last_change":"2024-09-13T19:37:26.910580+0000","last_active":"2024-09-13T19:37:26.910580+0000","last_peered":"2024-09-13T19:37:26.910580+0000","last_clean":"2024-09-13T19:37:26.910580+0000","last_became_active":"2024-09-13T19:33:08.350652+0000","last_became_peered":"2024-09-13T19:33:08.350652+0000","last_unstale":"2024-09-13T19:37:26.910580+0000","last_undegraded":"2024-09-13T19:37:26.910580+0000","last_fullsized":"2024-09-13T19:37:26.910580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:26.910211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:26.910211+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.910211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:56.864518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.506434+0000","last_change":"2024-09-13T19:37:29.506434+0000","last_active":"2024-09-13T19:37:29.506434+0000","last_peered":"2024-09-13T19:37:29.506434+0000","last_clean":"2024-09-13T19:37:29.506434+0000","last_became_active":"2024-09-13T19:33:10.354415+0000","last_became_peered":"2024-09-13T19:33:10.354415+0000","last_unstale":"2024-09-13T19:37:29.506434+0000","last_undegraded":"2024-09-13T19:37:29.506434+0000","last_fullsized":"2024-09-13T19:37:29.506434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:29.506176+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:29.506176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.506176+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:37.784459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.561591+0000","last_change":"2024-09-13T19:37:52.561591+0000","last_active":"2024-09-13T19:37:52.561591+0000","last_peered":"2024-09-13T19:37:52.561591+0000","last_clean":"2024-09-13T19:37:52.561591+0000","last_became_active":"2024-09-13T19:33:08.336953+0000","last_became_peered":"2024-09-13T19:33:08.336953+0000","last_unstale":"2024-09-13T19:37:52.561591+0000","last_undegraded":"2024-09-13T19:37:52.561591+0000","last_fullsized":"2024-09-13T19:37:52.561591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:52.561338+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:52.561338+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.561338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.056750+0000","last_change":"2024-09-13T19:37:45.056750+0000","last_active":"2024-09-13T19:37:45.056750+0000","last_peered":"2024-09-13T19:37:45.056750+0000","last_clean":"2024-09-13T19:37:45.056750+0000","last_became_active":"2024-09-13T19:33:10.340071+0000","last_became_peered":"2024-09-13T19:33:10.340071+0000","last_unstale":"2024-09-13T19:37:45.056750+0000","last_undegraded":"2024-09-13T19:37:45.056750+0000","last_fullsized":"2024-09-13T19:37:45.056750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:45.056474+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:45.056474+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.056474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:36.206327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.504678+0000","last_change":"2024-09-13T19:37:48.504678+0000","last_active":"2024-09-13T19:37:48.504678+0000","last_peered":"2024-09-13T19:37:48.504678+0000","last_clean":"2024-09-13T19:37:48.504678+0000","last_became_active":"2024-09-13T19:33:08.334437+0000","last_became_peered":"2024-09-13T19:33:08.334437+0000","last_unstale":"2024-09-13T19:37:48.504678+0000","last_undegraded":"2024-09-13T19:37:48.504678+0000","last_fullsized":"2024-09-13T19:37:48.504678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:48.504384+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:48.504384+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.504384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:42.588829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.955812+0000","last_change":"2024-09-13T19:37:45.955812+0000","last_active":"2024-09-13T19:37:45.955812+0000","last_peered":"2024-09-13T19:37:45.955812+0000","last_clean":"2024-09-13T19:37:45.955812+0000","last_became_active":"2024-09-13T19:33:10.337292+0000","last_became_peered":"2024-09-13T19:33:10.337292+0000","last_unstale":"2024-09-13T19:37:45.955812+0000","last_undegraded":"2024-09-13T19:37:45.955812+0000","last_fullsized":"2024-09-13T19:37:45.955812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:45.955540+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:45.955540+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.955540+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:18.197814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.033559+0000","last_change":"2024-09-13T19:37:44.033559+0000","last_active":"2024-09-13T19:37:44.033559+0000","last_peered":"2024-09-13T19:37:44.033559+0000","last_clean":"2024-09-13T19:37:44.033559+0000","last_became_active":"2024-09-13T19:33:08.344989+0000","last_became_peered":"2024-09-13T19:33:08.344989+0000","last_unstale":"2024-09-13T19:37:44.033559+0000","last_undegraded":"2024-09-13T19:37:44.033559+0000","last_fullsized":"2024-09-13T19:37:44.033559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:44.033185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:44.033185+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.033185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:32.171808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.487343+0000","last_change":"2024-09-13T19:37:40.487343+0000","last_active":"2024-09-13T19:37:40.487343+0000","last_peered":"2024-09-13T19:37:40.487343+0000","last_clean":"2024-09-13T19:37:40.487343+0000","last_became_active":"2024-09-13T19:33:10.352427+0000","last_became_peered":"2024-09-13T19:33:10.352427+0000","last_unstale":"2024-09-13T19:37:40.487343+0000","last_undegraded":"2024-09-13T19:37:40.487343+0000","last_fullsized":"2024-09-13T19:37:40.487343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-13T19:37:40.486977+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-13T19:37:40.486977+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.486977+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:46.217708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.707576+0000","last_change":"2024-09-13T19:37:57.707631+0000","last_active":"2024-09-13T19:37:57.707576+0000","last_peered":"2024-09-13T19:37:57.707576+0000","last_clean":"2024-09-13T19:37:57.707576+0000","last_became_active":"2024-09-13T19:33:08.340395+0000","last_became_peered":"2024-09-13T19:33:08.340395+0000","last_unstale":"2024-09-13T19:37:57.707576+0000","last_undegraded":"2024-09-13T19:37:57.707576+0000","last_fullsized":"2024-09-13T19:37:57.707576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:57.707380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:57.707380+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.707380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:31.582933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'38","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.620329+0000","last_change":"2024-09-13T19:37:24.620329+0000","last_active":"2024-09-13T19:37:24.620329+0000","last_peered":"2024-09-13T19:37:24.620329+0000","last_clean":"2024-09-13T19:37:24.620329+0000","last_became_active":"2024-09-13T19:33:18.417855+0000","last_became_peered":"2024-09-13T19:33:18.417855+0000","last_unstale":"2024-09-13T19:37:24.620329+0000","last_undegraded":"2024-09-13T19:37:24.620329+0000","last_fullsized":"2024-09-13T19:37:24.620329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:24.620070+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:24.620070+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.620070+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.852503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.924828+0000","last_change":"2024-09-13T19:37:35.924828+0000","last_active":"2024-09-13T19:37:35.924828+0000","last_peered":"2024-09-13T19:37:35.924828+0000","last_clean":"2024-09-13T19:37:35.924828+0000","last_became_active":"2024-09-13T19:33:10.354229+0000","last_became_peered":"2024-09-13T19:33:10.354229+0000","last_unstale":"2024-09-13T19:37:35.924828+0000","last_undegraded":"2024-09-13T19:37:35.924828+0000","last_fullsized":"2024-09-13T19:37:35.924828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:35.924562+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:35.924562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.924562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:06.221435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:00.644322+0000","last_change":"2024-09-13T19:38:00.644382+0000","last_active":"2024-09-13T19:38:00.644322+0000","last_peered":"2024-09-13T19:38:00.644322+0000","last_clean":"2024-09-13T19:38:00.644322+0000","last_became_active":"2024-09-13T19:33:08.353780+0000","last_became_peered":"2024-09-13T19:33:08.353780+0000","last_unstale":"2024-09-13T19:38:00.644322+0000","last_undegraded":"2024-09-13T19:38:00.644322+0000","last_fullsized":"2024-09-13T19:38:00.644322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:38:00.644125+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:38:00.644125+0000","last_clean_scrub_stamp":"2024-09-13T19:38:00.644125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.303207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.123297+0000","last_change":"2024-09-13T19:37:10.123297+0000","last_active":"2024-09-13T19:37:10.123297+0000","last_peered":"2024-09-13T19:37:10.123297+0000","last_clean":"2024-09-13T19:37:10.123297+0000","last_became_active":"2024-09-13T19:33:12.347358+0000","last_became_peered":"2024-09-13T19:33:12.347358+0000","last_unstale":"2024-09-13T19:37:10.123297+0000","last_undegraded":"2024-09-13T19:37:10.123297+0000","last_fullsized":"2024-09-13T19:37:10.123297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:10.123041+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.123041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:12.989516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.993844+0000","last_change":"2024-09-13T19:37:31.993844+0000","last_active":"2024-09-13T19:37:31.993844+0000","last_peered":"2024-09-13T19:37:31.993844+0000","last_clean":"2024-09-13T19:37:31.993844+0000","last_became_active":"2024-09-13T19:33:14.384732+0000","last_became_peered":"2024-09-13T19:33:14.384732+0000","last_unstale":"2024-09-13T19:37:31.993844+0000","last_undegraded":"2024-09-13T19:37:31.993844+0000","last_fullsized":"2024-09-13T19:37:31.993844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:31.993552+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:31.993552+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.993552+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.328726+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.502515+0000","last_change":"2024-09-13T19:37:00.502515+0000","last_active":"2024-09-13T19:37:00.502515+0000","last_peered":"2024-09-13T19:37:00.502515+0000","last_clean":"2024-09-13T19:37:00.502515+0000","last_became_active":"2024-09-13T19:33:16.393537+0000","last_became_peered":"2024-09-13T19:33:16.393537+0000","last_unstale":"2024-09-13T19:37:00.502515+0000","last_undegraded":"2024-09-13T19:37:00.502515+0000","last_fullsized":"2024-09-13T19:37:00.502515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.502274+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.502274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:43.889848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.582272+0000","last_change":"2024-09-13T19:37:16.582272+0000","last_active":"2024-09-13T19:37:16.582272+0000","last_peered":"2024-09-13T19:37:16.582272+0000","last_clean":"2024-09-13T19:37:16.582272+0000","last_became_active":"2024-09-13T19:33:18.411830+0000","last_became_peered":"2024-09-13T19:33:18.411830+0000","last_unstale":"2024-09-13T19:37:16.582272+0000","last_undegraded":"2024-09-13T19:37:16.582272+0000","last_fullsized":"2024-09-13T19:37:16.582272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-13T19:37:16.582006+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-13T19:37:16.582006+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.582006+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:42.046488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.917995+0000","last_change":"2024-09-13T19:37:39.917995+0000","last_active":"2024-09-13T19:37:39.917995+0000","last_peered":"2024-09-13T19:37:39.917995+0000","last_clean":"2024-09-13T19:37:39.917995+0000","last_became_active":"2024-09-13T19:33:10.352720+0000","last_became_peered":"2024-09-13T19:33:10.352720+0000","last_unstale":"2024-09-13T19:37:39.917995+0000","last_undegraded":"2024-09-13T19:37:39.917995+0000","last_fullsized":"2024-09-13T19:37:39.917995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:39.917704+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:39.917704+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.917704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:51.364335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.969945+0000","last_change":"2024-09-13T19:37:44.969945+0000","last_active":"2024-09-13T19:37:44.969945+0000","last_peered":"2024-09-13T19:37:44.969945+0000","last_clean":"2024-09-13T19:37:44.969945+0000","last_became_active":"2024-09-13T19:33:08.348092+0000","last_became_peered":"2024-09-13T19:33:08.348092+0000","last_unstale":"2024-09-13T19:37:44.969945+0000","last_undegraded":"2024-09-13T19:37:44.969945+0000","last_fullsized":"2024-09-13T19:37:44.969945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:44.969547+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:44.969547+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.969547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:09:58.625718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:00.550537+0000","last_change":"2024-09-13T19:38:00.550537+0000","last_active":"2024-09-13T19:38:00.550537+0000","last_peered":"2024-09-13T19:38:00.550537+0000","last_clean":"2024-09-13T19:38:00.550537+0000","last_became_active":"2024-09-13T19:33:49.520381+0000","last_became_peered":"2024-09-13T19:33:49.520381+0000","last_unstale":"2024-09-13T19:38:00.550537+0000","last_undegraded":"2024-09-13T19:38:00.550537+0000","last_fullsized":"2024-09-13T19:38:00.550537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:00.550264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:00.550264+0000","last_clean_scrub_stamp":"2024-09-13T19:38:00.550264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:00.693560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.502701+0000","last_change":"2024-09-13T19:37:10.502701+0000","last_active":"2024-09-13T19:37:10.502701+0000","last_peered":"2024-09-13T19:37:10.502701+0000","last_clean":"2024-09-13T19:37:10.502701+0000","last_became_active":"2024-09-13T19:33:14.363474+0000","last_became_peered":"2024-09-13T19:33:14.363474+0000","last_unstale":"2024-09-13T19:37:10.502701+0000","last_undegraded":"2024-09-13T19:37:10.502701+0000","last_fullsized":"2024-09-13T19:37:10.502701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-13T19:37:10.502401+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.502401+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:01.003936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.551561+0000","last_change":"2024-09-13T19:37:04.551561+0000","last_active":"2024-09-13T19:37:04.551561+0000","last_peered":"2024-09-13T19:37:04.551561+0000","last_clean":"2024-09-13T19:37:04.551561+0000","last_became_active":"2024-09-13T19:33:16.394019+0000","last_became_peered":"2024-09-13T19:33:16.394019+0000","last_unstale":"2024-09-13T19:37:04.551561+0000","last_undegraded":"2024-09-13T19:37:04.551561+0000","last_fullsized":"2024-09-13T19:37:04.551561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.551265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.551265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.460322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.175506+0000","last_change":"2024-09-13T19:37:57.175506+0000","last_active":"2024-09-13T19:37:57.175506+0000","last_peered":"2024-09-13T19:37:57.175506+0000","last_clean":"2024-09-13T19:37:57.175506+0000","last_became_active":"2024-09-13T19:33:18.406706+0000","last_became_peered":"2024-09-13T19:33:18.406706+0000","last_unstale":"2024-09-13T19:37:57.175506+0000","last_undegraded":"2024-09-13T19:37:57.175506+0000","last_fullsized":"2024-09-13T19:37:57.175506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:57.175229+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:57.175229+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.175229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:31.384558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.904559+0000","last_change":"2024-09-13T19:37:41.904559+0000","last_active":"2024-09-13T19:37:41.904559+0000","last_peered":"2024-09-13T19:37:41.904559+0000","last_clean":"2024-09-13T19:37:41.904559+0000","last_became_active":"2024-09-13T19:33:10.350219+0000","last_became_peered":"2024-09-13T19:33:10.350219+0000","last_unstale":"2024-09-13T19:37:41.904559+0000","last_undegraded":"2024-09-13T19:37:41.904559+0000","last_fullsized":"2024-09-13T19:37:41.904559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:41.904294+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:41.904294+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.904294+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:31.261094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:16.492533+0000","last_change":"2024-09-13T19:38:16.492687+0000","last_active":"2024-09-13T19:38:16.492533+0000","last_peered":"2024-09-13T19:38:16.492533+0000","last_clean":"2024-09-13T19:38:16.492533+0000","last_became_active":"2024-09-13T19:33:08.353908+0000","last_became_peered":"2024-09-13T19:33:08.353908+0000","last_unstale":"2024-09-13T19:38:16.492533+0000","last_undegraded":"2024-09-13T19:38:16.492533+0000","last_fullsized":"2024-09-13T19:38:16.492533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:16.492302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:16.492302+0000","last_clean_scrub_stamp":"2024-09-13T19:38:16.492302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:06.570958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.320730+0000","last_change":"2024-09-13T19:37:19.320730+0000","last_active":"2024-09-13T19:37:19.320730+0000","last_peered":"2024-09-13T19:37:19.320730+0000","last_clean":"2024-09-13T19:37:19.320730+0000","last_became_active":"2024-09-13T19:33:12.349691+0000","last_became_peered":"2024-09-13T19:33:12.349691+0000","last_unstale":"2024-09-13T19:37:19.320730+0000","last_undegraded":"2024-09-13T19:37:19.320730+0000","last_fullsized":"2024-09-13T19:37:19.320730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:19.320446+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.320446+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:11.577834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.894258+0000","last_change":"2024-09-13T19:37:02.894258+0000","last_active":"2024-09-13T19:37:02.894258+0000","last_peered":"2024-09-13T19:37:02.894258+0000","last_clean":"2024-09-13T19:37:02.894258+0000","last_became_active":"2024-09-13T19:33:14.369652+0000","last_became_peered":"2024-09-13T19:33:14.369652+0000","last_unstale":"2024-09-13T19:37:02.894258+0000","last_undegraded":"2024-09-13T19:37:02.894258+0000","last_fullsized":"2024-09-13T19:37:02.894258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-13T19:37:02.893973+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.893973+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:18.869439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.036435+0000","last_change":"2024-09-13T19:37:24.036435+0000","last_active":"2024-09-13T19:37:24.036435+0000","last_peered":"2024-09-13T19:37:24.036435+0000","last_clean":"2024-09-13T19:37:24.036435+0000","last_became_active":"2024-09-13T19:33:16.400316+0000","last_became_peered":"2024-09-13T19:33:16.400316+0000","last_unstale":"2024-09-13T19:37:24.036435+0000","last_undegraded":"2024-09-13T19:37:24.036435+0000","last_fullsized":"2024-09-13T19:37:24.036435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:24.036142+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:24.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.036142+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:55.593216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.949535+0000","last_change":"2024-09-13T19:37:48.949535+0000","last_active":"2024-09-13T19:37:48.949535+0000","last_peered":"2024-09-13T19:37:48.949535+0000","last_clean":"2024-09-13T19:37:48.949535+0000","last_became_active":"2024-09-13T19:33:18.412784+0000","last_became_peered":"2024-09-13T19:33:18.412784+0000","last_unstale":"2024-09-13T19:37:48.949535+0000","last_undegraded":"2024-09-13T19:37:48.949535+0000","last_fullsized":"2024-09-13T19:37:48.949535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:48.949281+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:48.949281+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.949281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:51.123045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.092390+0000","last_change":"2024-09-13T19:37:55.092390+0000","last_active":"2024-09-13T19:37:55.092390+0000","last_peered":"2024-09-13T19:37:55.092390+0000","last_clean":"2024-09-13T19:37:55.092390+0000","last_became_active":"2024-09-13T19:33:10.336847+0000","last_became_peered":"2024-09-13T19:33:10.336847+0000","last_unstale":"2024-09-13T19:37:55.092390+0000","last_undegraded":"2024-09-13T19:37:55.092390+0000","last_fullsized":"2024-09-13T19:37:55.092390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:55.092086+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:55.092086+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.092086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:47.647736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.552036+0000","last_change":"2024-09-13T19:37:51.552097+0000","last_active":"2024-09-13T19:37:51.552036+0000","last_peered":"2024-09-13T19:37:51.552036+0000","last_clean":"2024-09-13T19:37:51.552036+0000","last_became_active":"2024-09-13T19:33:08.336903+0000","last_became_peered":"2024-09-13T19:33:08.336903+0000","last_unstale":"2024-09-13T19:37:51.552036+0000","last_undegraded":"2024-09-13T19:37:51.552036+0000","last_fullsized":"2024-09-13T19:37:51.552036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:51.551850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:51.551850+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.551850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:16.887024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.109820+0000","last_change":"2024-09-13T19:37:08.109820+0000","last_active":"2024-09-13T19:37:08.109820+0000","last_peered":"2024-09-13T19:37:08.109820+0000","last_clean":"2024-09-13T19:37:08.109820+0000","last_became_active":"2024-09-13T19:33:12.355869+0000","last_became_peered":"2024-09-13T19:33:12.355869+0000","last_unstale":"2024-09-13T19:37:08.109820+0000","last_undegraded":"2024-09-13T19:37:08.109820+0000","last_fullsized":"2024-09-13T19:37:08.109820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:08.109562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.109562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.916276+0000","last_change":"2024-09-13T19:37:04.916276+0000","last_active":"2024-09-13T19:37:04.916276+0000","last_peered":"2024-09-13T19:37:04.916276+0000","last_clean":"2024-09-13T19:37:04.916276+0000","last_became_active":"2024-09-13T19:33:14.369576+0000","last_became_peered":"2024-09-13T19:33:14.369576+0000","last_unstale":"2024-09-13T19:37:04.916276+0000","last_undegraded":"2024-09-13T19:37:04.916276+0000","last_fullsized":"2024-09-13T19:37:04.916276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-13T19:37:04.915985+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.915985+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:53.420288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.239330+0000","last_change":"2024-09-13T19:37:21.239330+0000","last_active":"2024-09-13T19:37:21.239330+0000","last_peered":"2024-09-13T19:37:21.239330+0000","last_clean":"2024-09-13T19:37:21.239330+0000","last_became_active":"2024-09-13T19:33:16.391498+0000","last_became_peered":"2024-09-13T19:33:16.391498+0000","last_unstale":"2024-09-13T19:37:21.239330+0000","last_undegraded":"2024-09-13T19:37:21.239330+0000","last_fullsized":"2024-09-13T19:37:21.239330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:21.239082+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:21.239082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.239082+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:39.825205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.937814+0000","last_change":"2024-09-13T19:37:32.937966+0000","last_active":"2024-09-13T19:37:32.937814+0000","last_peered":"2024-09-13T19:37:32.937814+0000","last_clean":"2024-09-13T19:37:32.937814+0000","last_became_active":"2024-09-13T19:33:10.355996+0000","last_became_peered":"2024-09-13T19:33:10.355996+0000","last_unstale":"2024-09-13T19:37:32.937814+0000","last_undegraded":"2024-09-13T19:37:32.937814+0000","last_fullsized":"2024-09-13T19:37:32.937814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:32.937538+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:32.937538+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.937538+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:49.829336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.990830+0000","last_change":"2024-09-13T19:37:42.990896+0000","last_active":"2024-09-13T19:37:42.990830+0000","last_peered":"2024-09-13T19:37:42.990830+0000","last_clean":"2024-09-13T19:37:42.990830+0000","last_became_active":"2024-09-13T19:33:08.347109+0000","last_became_peered":"2024-09-13T19:33:08.347109+0000","last_unstale":"2024-09-13T19:37:42.990830+0000","last_undegraded":"2024-09-13T19:37:42.990830+0000","last_fullsized":"2024-09-13T19:37:42.990830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:42.990615+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:42.990615+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.990615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:21.054596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.520028+0000","last_change":"2024-09-13T19:37:14.520028+0000","last_active":"2024-09-13T19:37:14.520028+0000","last_peered":"2024-09-13T19:37:14.520028+0000","last_clean":"2024-09-13T19:37:14.520028+0000","last_became_active":"2024-09-13T19:33:12.360028+0000","last_became_peered":"2024-09-13T19:33:12.360028+0000","last_unstale":"2024-09-13T19:37:14.520028+0000","last_undegraded":"2024-09-13T19:37:14.520028+0000","last_fullsized":"2024-09-13T19:37:14.520028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.519779+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.519779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:02.289326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.958861+0000","last_change":"2024-09-13T19:37:06.958861+0000","last_active":"2024-09-13T19:37:06.958861+0000","last_peered":"2024-09-13T19:37:06.958861+0000","last_clean":"2024-09-13T19:37:06.958861+0000","last_became_active":"2024-09-13T19:33:14.366298+0000","last_became_peered":"2024-09-13T19:33:14.366298+0000","last_unstale":"2024-09-13T19:37:06.958861+0000","last_undegraded":"2024-09-13T19:37:06.958861+0000","last_fullsized":"2024-09-13T19:37:06.958861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-09-13T19:37:06.958579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.958579+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:36.686521+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.385193+0000","last_change":"2024-09-13T19:37:04.385193+0000","last_active":"2024-09-13T19:37:04.385193+0000","last_peered":"2024-09-13T19:37:04.385193+0000","last_clean":"2024-09-13T19:37:04.385193+0000","last_became_active":"2024-09-13T19:33:16.371781+0000","last_became_peered":"2024-09-13T19:33:16.371781+0000","last_unstale":"2024-09-13T19:37:04.385193+0000","last_undegraded":"2024-09-13T19:37:04.385193+0000","last_fullsized":"2024-09-13T19:37:04.385193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.384941+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.384941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:20.293998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.904564+0000","last_change":"2024-09-13T19:37:49.904631+0000","last_active":"2024-09-13T19:37:49.904564+0000","last_peered":"2024-09-13T19:37:49.904564+0000","last_clean":"2024-09-13T19:37:49.904564+0000","last_became_active":"2024-09-13T19:33:18.416497+0000","last_became_peered":"2024-09-13T19:33:18.416497+0000","last_unstale":"2024-09-13T19:37:49.904564+0000","last_undegraded":"2024-09-13T19:37:49.904564+0000","last_fullsized":"2024-09-13T19:37:49.904564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:49.904383+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:49.904383+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.904383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:18.998987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.481235+0000","last_change":"2024-09-13T19:37:38.481358+0000","last_active":"2024-09-13T19:37:38.481235+0000","last_peered":"2024-09-13T19:37:38.481235+0000","last_clean":"2024-09-13T19:37:38.481235+0000","last_became_active":"2024-09-13T19:33:10.351772+0000","last_became_peered":"2024-09-13T19:33:10.351772+0000","last_unstale":"2024-09-13T19:37:38.481235+0000","last_undegraded":"2024-09-13T19:37:38.481235+0000","last_fullsized":"2024-09-13T19:37:38.481235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:38.480942+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:38.480942+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.480942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:38.661510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.067867+0000","last_change":"2024-09-13T19:37:35.067867+0000","last_active":"2024-09-13T19:37:35.067867+0000","last_peered":"2024-09-13T19:37:35.067867+0000","last_clean":"2024-09-13T19:37:35.067867+0000","last_became_active":"2024-09-13T19:33:08.347668+0000","last_became_peered":"2024-09-13T19:33:08.347668+0000","last_unstale":"2024-09-13T19:37:35.067867+0000","last_undegraded":"2024-09-13T19:37:35.067867+0000","last_fullsized":"2024-09-13T19:37:35.067867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:35.067634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:35.067634+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.067634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:35.696369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.247615+0000","last_change":"2024-09-13T19:37:23.247615+0000","last_active":"2024-09-13T19:37:23.247615+0000","last_peered":"2024-09-13T19:37:23.247615+0000","last_clean":"2024-09-13T19:37:23.247615+0000","last_became_active":"2024-09-13T19:33:12.345388+0000","last_became_peered":"2024-09-13T19:33:12.345388+0000","last_unstale":"2024-09-13T19:37:23.247615+0000","last_undegraded":"2024-09-13T19:37:23.247615+0000","last_fullsized":"2024-09-13T19:37:23.247615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:23.247331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:23.247331+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.247331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:14.966141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.020012+0000","last_change":"2024-09-13T19:37:28.020012+0000","last_active":"2024-09-13T19:37:28.020012+0000","last_peered":"2024-09-13T19:37:28.020012+0000","last_clean":"2024-09-13T19:37:28.020012+0000","last_became_active":"2024-09-13T19:33:14.390770+0000","last_became_peered":"2024-09-13T19:33:14.390770+0000","last_unstale":"2024-09-13T19:37:28.020012+0000","last_undegraded":"2024-09-13T19:37:28.020012+0000","last_fullsized":"2024-09-13T19:37:28.020012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:28.019573+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:28.019573+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.019573+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:49.017132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.277843+0000","last_change":"2024-09-13T19:37:01.277843+0000","last_active":"2024-09-13T19:37:01.277843+0000","last_peered":"2024-09-13T19:37:01.277843+0000","last_clean":"2024-09-13T19:37:01.277843+0000","last_became_active":"2024-09-13T19:33:16.374605+0000","last_became_peered":"2024-09-13T19:33:16.374605+0000","last_unstale":"2024-09-13T19:37:01.277843+0000","last_undegraded":"2024-09-13T19:37:01.277843+0000","last_fullsized":"2024-09-13T19:37:01.277843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.277591+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.277591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:47.650563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.546916+0000","last_change":"2024-09-13T19:37:28.546916+0000","last_active":"2024-09-13T19:37:28.546916+0000","last_peered":"2024-09-13T19:37:28.546916+0000","last_clean":"2024-09-13T19:37:28.546916+0000","last_became_active":"2024-09-13T19:33:18.419648+0000","last_became_peered":"2024-09-13T19:33:18.419648+0000","last_unstale":"2024-09-13T19:37:28.546916+0000","last_undegraded":"2024-09-13T19:37:28.546916+0000","last_fullsized":"2024-09-13T19:37:28.546916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:28.546498+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:28.546498+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.546498+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.520168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.887692+0000","last_change":"2024-09-13T19:37:22.887692+0000","last_active":"2024-09-13T19:37:22.887692+0000","last_peered":"2024-09-13T19:37:22.887692+0000","last_clean":"2024-09-13T19:37:22.887692+0000","last_became_active":"2024-09-13T19:33:10.330055+0000","last_became_peered":"2024-09-13T19:33:10.330055+0000","last_unstale":"2024-09-13T19:37:22.887692+0000","last_undegraded":"2024-09-13T19:37:22.887692+0000","last_fullsized":"2024-09-13T19:37:22.887692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:22.887344+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:22.887344+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.887344+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:40.009897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.727579+0000","last_change":"2024-09-13T19:37:55.727632+0000","last_active":"2024-09-13T19:37:55.727579+0000","last_peered":"2024-09-13T19:37:55.727579+0000","last_clean":"2024-09-13T19:37:55.727579+0000","last_became_active":"2024-09-13T19:33:08.341548+0000","last_became_peered":"2024-09-13T19:33:08.341548+0000","last_unstale":"2024-09-13T19:37:55.727579+0000","last_undegraded":"2024-09-13T19:37:55.727579+0000","last_fullsized":"2024-09-13T19:37:55.727579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:55.727386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:55.727386+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.727386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:43.901184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.272682+0000","last_change":"2024-09-13T19:37:22.272682+0000","last_active":"2024-09-13T19:37:22.272682+0000","last_peered":"2024-09-13T19:37:22.272682+0000","last_clean":"2024-09-13T19:37:22.272682+0000","last_became_active":"2024-09-13T19:33:12.345807+0000","last_became_peered":"2024-09-13T19:33:12.345807+0000","last_unstale":"2024-09-13T19:37:22.272682+0000","last_undegraded":"2024-09-13T19:37:22.272682+0000","last_fullsized":"2024-09-13T19:37:22.272682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:22.272435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:22.272435+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.272435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:06.134902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.088355+0000","last_change":"2024-09-13T19:37:03.088355+0000","last_active":"2024-09-13T19:37:03.088355+0000","last_peered":"2024-09-13T19:37:03.088355+0000","last_clean":"2024-09-13T19:37:03.088355+0000","last_became_active":"2024-09-13T19:33:14.365820+0000","last_became_peered":"2024-09-13T19:33:14.365820+0000","last_unstale":"2024-09-13T19:37:03.088355+0000","last_undegraded":"2024-09-13T19:37:03.088355+0000","last_fullsized":"2024-09-13T19:37:03.088355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:03.087975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.087975+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:03.716710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.338036+0000","last_change":"2024-09-13T19:37:05.338036+0000","last_active":"2024-09-13T19:37:05.338036+0000","last_peered":"2024-09-13T19:37:05.338036+0000","last_clean":"2024-09-13T19:37:05.338036+0000","last_became_active":"2024-09-13T19:33:16.376205+0000","last_became_peered":"2024-09-13T19:33:16.376205+0000","last_unstale":"2024-09-13T19:37:05.338036+0000","last_undegraded":"2024-09-13T19:37:05.338036+0000","last_fullsized":"2024-09-13T19:37:05.338036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:05.337780+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.337780+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.947112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:01.220459+0000","last_change":"2024-09-13T19:38:01.220527+0000","last_active":"2024-09-13T19:38:01.220459+0000","last_peered":"2024-09-13T19:38:01.220459+0000","last_clean":"2024-09-13T19:38:01.220459+0000","last_became_active":"2024-09-13T19:33:18.415350+0000","last_became_peered":"2024-09-13T19:33:18.415350+0000","last_unstale":"2024-09-13T19:38:01.220459+0000","last_undegraded":"2024-09-13T19:38:01.220459+0000","last_fullsized":"2024-09-13T19:38:01.220459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:38:01.220244+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:38:01.220244+0000","last_clean_scrub_stamp":"2024-09-13T19:38:01.220244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:50.577043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.095511+0000","last_change":"2024-09-13T19:37:36.095511+0000","last_active":"2024-09-13T19:37:36.095511+0000","last_peered":"2024-09-13T19:37:36.095511+0000","last_clean":"2024-09-13T19:37:36.095511+0000","last_became_active":"2024-09-13T19:33:10.336288+0000","last_became_peered":"2024-09-13T19:33:10.336288+0000","last_unstale":"2024-09-13T19:37:36.095511+0000","last_undegraded":"2024-09-13T19:37:36.095511+0000","last_fullsized":"2024-09-13T19:37:36.095511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:36.095267+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:36.095267+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.095267+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:11.327700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.595896+0000","last_change":"2024-09-13T19:37:59.595896+0000","last_active":"2024-09-13T19:37:59.595896+0000","last_peered":"2024-09-13T19:37:59.595896+0000","last_clean":"2024-09-13T19:37:59.595896+0000","last_became_active":"2024-09-13T19:33:49.522469+0000","last_became_peered":"2024-09-13T19:33:49.522469+0000","last_unstale":"2024-09-13T19:37:59.595896+0000","last_undegraded":"2024-09-13T19:37:59.595896+0000","last_fullsized":"2024-09-13T19:37:59.595896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:59.595453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:59.595453+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.595453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:11.042084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.198989+0000","last_change":"2024-09-13T19:37:24.198989+0000","last_active":"2024-09-13T19:37:24.198989+0000","last_peered":"2024-09-13T19:37:24.198989+0000","last_clean":"2024-09-13T19:37:24.198989+0000","last_became_active":"2024-09-13T19:33:12.345410+0000","last_became_peered":"2024-09-13T19:33:12.345410+0000","last_unstale":"2024-09-13T19:37:24.198989+0000","last_undegraded":"2024-09-13T19:37:24.198989+0000","last_fullsized":"2024-09-13T19:37:24.198989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:24.198733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:24.198733+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.198733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.431165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'64","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.075367+0000","last_change":"2024-09-13T19:37:07.075367+0000","last_active":"2024-09-13T19:37:07.075367+0000","last_peered":"2024-09-13T19:37:07.075367+0000","last_clean":"2024-09-13T19:37:07.075367+0000","last_became_active":"2024-09-13T19:33:14.375432+0000","last_became_peered":"2024-09-13T19:33:14.375432+0000","last_unstale":"2024-09-13T19:37:07.075367+0000","last_undegraded":"2024-09-13T19:37:07.075367+0000","last_fullsized":"2024-09-13T19:37:07.075367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'64","last_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_deep_scrub":"32'64","last_deep_scrub_stamp":"2024-09-13T19:37:07.075082+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.075082+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:36.529696+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.200714+0000","last_change":"2024-09-13T19:37:13.200714+0000","last_active":"2024-09-13T19:37:13.200714+0000","last_peered":"2024-09-13T19:37:13.200714+0000","last_clean":"2024-09-13T19:37:13.200714+0000","last_became_active":"2024-09-13T19:33:16.379781+0000","last_became_peered":"2024-09-13T19:33:16.379781+0000","last_unstale":"2024-09-13T19:37:13.200714+0000","last_undegraded":"2024-09-13T19:37:13.200714+0000","last_fullsized":"2024-09-13T19:37:13.200714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.200465+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.200465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:35.576125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'23","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.239795+0000","last_change":"2024-09-13T19:37:29.239795+0000","last_active":"2024-09-13T19:37:29.239795+0000","last_peered":"2024-09-13T19:37:29.239795+0000","last_clean":"2024-09-13T19:37:29.239795+0000","last_became_active":"2024-09-13T19:33:18.396424+0000","last_became_peered":"2024-09-13T19:33:18.396424+0000","last_unstale":"2024-09-13T19:37:29.239795+0000","last_undegraded":"2024-09-13T19:37:29.239795+0000","last_fullsized":"2024-09-13T19:37:29.239795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-09-13T19:37:29.239551+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-09-13T19:37:29.239551+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.239551+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:37.517834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:01.517105+0000","last_change":"2024-09-13T19:38:01.517166+0000","last_active":"2024-09-13T19:38:01.517105+0000","last_peered":"2024-09-13T19:38:01.517105+0000","last_clean":"2024-09-13T19:38:01.517105+0000","last_became_active":"2024-09-13T19:33:49.521379+0000","last_became_peered":"2024-09-13T19:33:49.521379+0000","last_unstale":"2024-09-13T19:38:01.517105+0000","last_undegraded":"2024-09-13T19:38:01.517105+0000","last_fullsized":"2024-09-13T19:38:01.517105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:38:01.516920+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:38:01.516920+0000","last_clean_scrub_stamp":"2024-09-13T19:38:01.516920+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:47.502295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.046281+0000","last_change":"2024-09-13T19:37:53.046344+0000","last_active":"2024-09-13T19:37:53.046281+0000","last_peered":"2024-09-13T19:37:53.046281+0000","last_clean":"2024-09-13T19:37:53.046281+0000","last_became_active":"2024-09-13T19:33:08.331225+0000","last_became_peered":"2024-09-13T19:33:08.331225+0000","last_unstale":"2024-09-13T19:37:53.046281+0000","last_undegraded":"2024-09-13T19:37:53.046281+0000","last_fullsized":"2024-09-13T19:37:53.046281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:53.046085+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:53.046085+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.046085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:59.907868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.831206+0000","last_change":"2024-09-13T19:37:13.831206+0000","last_active":"2024-09-13T19:37:13.831206+0000","last_peered":"2024-09-13T19:37:13.831206+0000","last_clean":"2024-09-13T19:37:13.831206+0000","last_became_active":"2024-09-13T19:33:12.357492+0000","last_became_peered":"2024-09-13T19:33:12.357492+0000","last_unstale":"2024-09-13T19:37:13.831206+0000","last_undegraded":"2024-09-13T19:37:13.831206+0000","last_fullsized":"2024-09-13T19:37:13.831206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:13.830975+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.830975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:27.492677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.520047+0000","last_change":"2024-09-13T19:37:09.520047+0000","last_active":"2024-09-13T19:37:09.520047+0000","last_peered":"2024-09-13T19:37:09.520047+0000","last_clean":"2024-09-13T19:37:09.520047+0000","last_became_active":"2024-09-13T19:33:14.363316+0000","last_became_peered":"2024-09-13T19:33:14.363316+0000","last_unstale":"2024-09-13T19:37:09.520047+0000","last_undegraded":"2024-09-13T19:37:09.520047+0000","last_fullsized":"2024-09-13T19:37:09.520047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:09.519587+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.519587+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:50.509060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.886815+0000","last_change":"2024-09-13T19:37:34.886815+0000","last_active":"2024-09-13T19:37:34.886815+0000","last_peered":"2024-09-13T19:37:34.886815+0000","last_clean":"2024-09-13T19:37:34.886815+0000","last_became_active":"2024-09-13T19:33:16.403126+0000","last_became_peered":"2024-09-13T19:33:16.403126+0000","last_unstale":"2024-09-13T19:37:34.886815+0000","last_undegraded":"2024-09-13T19:37:34.886815+0000","last_fullsized":"2024-09-13T19:37:34.886815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:34.886569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:34.886569+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.886569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:58.702803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:17.479809+0000","last_change":"2024-09-13T19:38:17.479891+0000","last_active":"2024-09-13T19:38:17.479809+0000","last_peered":"2024-09-13T19:38:17.479809+0000","last_clean":"2024-09-13T19:38:17.479809+0000","last_became_active":"2024-09-13T19:33:18.414103+0000","last_became_peered":"2024-09-13T19:33:18.414103+0000","last_unstale":"2024-09-13T19:38:17.479809+0000","last_undegraded":"2024-09-13T19:38:17.479809+0000","last_fullsized":"2024-09-13T19:38:17.479809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:38:17.479603+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:38:17.479603+0000","last_clean_scrub_stamp":"2024-09-13T19:38:17.479603+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:18.487609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.160708+0000","last_change":"2024-09-13T19:37:14.160708+0000","last_active":"2024-09-13T19:37:14.160708+0000","last_peered":"2024-09-13T19:37:14.160708+0000","last_clean":"2024-09-13T19:37:14.160708+0000","last_became_active":"2024-09-13T19:33:10.358555+0000","last_became_peered":"2024-09-13T19:33:10.358555+0000","last_unstale":"2024-09-13T19:37:14.160708+0000","last_undegraded":"2024-09-13T19:37:14.160708+0000","last_fullsized":"2024-09-13T19:37:14.160708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:14.160448+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.160448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:32.157988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.773000+0000","last_change":"2024-09-13T19:37:54.773065+0000","last_active":"2024-09-13T19:37:54.773000+0000","last_peered":"2024-09-13T19:37:54.773000+0000","last_clean":"2024-09-13T19:37:54.773000+0000","last_became_active":"2024-09-13T19:33:08.341486+0000","last_became_peered":"2024-09-13T19:33:08.341486+0000","last_unstale":"2024-09-13T19:37:54.773000+0000","last_undegraded":"2024-09-13T19:37:54.773000+0000","last_fullsized":"2024-09-13T19:37:54.773000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:54.772792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:54.772792+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.772792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:07.999598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.282076+0000","last_change":"2024-09-13T19:37:20.282076+0000","last_active":"2024-09-13T19:37:20.282076+0000","last_peered":"2024-09-13T19:37:20.282076+0000","last_clean":"2024-09-13T19:37:20.282076+0000","last_became_active":"2024-09-13T19:33:12.347404+0000","last_became_peered":"2024-09-13T19:33:12.347404+0000","last_unstale":"2024-09-13T19:37:20.282076+0000","last_undegraded":"2024-09-13T19:37:20.282076+0000","last_fullsized":"2024-09-13T19:37:20.282076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:20.281828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:20.281828+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.281828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:26.429181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.844787+0000","last_change":"2024-09-13T19:37:10.844787+0000","last_active":"2024-09-13T19:37:10.844787+0000","last_peered":"2024-09-13T19:37:10.844787+0000","last_clean":"2024-09-13T19:37:10.844787+0000","last_became_active":"2024-09-13T19:33:14.353740+0000","last_became_peered":"2024-09-13T19:33:14.353740+0000","last_unstale":"2024-09-13T19:37:10.844787+0000","last_undegraded":"2024-09-13T19:37:10.844787+0000","last_fullsized":"2024-09-13T19:37:10.844787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:10.844519+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.844519+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:16.097647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.934519+0000","last_change":"2024-09-13T19:37:07.934519+0000","last_active":"2024-09-13T19:37:07.934519+0000","last_peered":"2024-09-13T19:37:07.934519+0000","last_clean":"2024-09-13T19:37:07.934519+0000","last_became_active":"2024-09-13T19:33:16.390165+0000","last_became_peered":"2024-09-13T19:33:16.390165+0000","last_unstale":"2024-09-13T19:37:07.934519+0000","last_undegraded":"2024-09-13T19:37:07.934519+0000","last_fullsized":"2024-09-13T19:37:07.934519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:07.934270+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.934270+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:17.446351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.190148+0000","last_change":"2024-09-13T19:37:59.190217+0000","last_active":"2024-09-13T19:37:59.190148+0000","last_peered":"2024-09-13T19:37:59.190148+0000","last_clean":"2024-09-13T19:37:59.190148+0000","last_became_active":"2024-09-13T19:33:18.414898+0000","last_became_peered":"2024-09-13T19:33:18.414898+0000","last_unstale":"2024-09-13T19:37:59.190148+0000","last_undegraded":"2024-09-13T19:37:59.190148+0000","last_fullsized":"2024-09-13T19:37:59.190148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:59.189958+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:59.189958+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.189958+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:51.359000+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.897513+0000","last_change":"2024-09-13T19:37:23.897513+0000","last_active":"2024-09-13T19:37:23.897513+0000","last_peered":"2024-09-13T19:37:23.897513+0000","last_clean":"2024-09-13T19:37:23.897513+0000","last_became_active":"2024-09-13T19:33:10.332893+0000","last_became_peered":"2024-09-13T19:33:10.332893+0000","last_unstale":"2024-09-13T19:37:23.897513+0000","last_undegraded":"2024-09-13T19:37:23.897513+0000","last_fullsized":"2024-09-13T19:37:23.897513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:23.897240+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:23.897240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.897240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:28.019969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.816139+0000","last_change":"2024-09-13T19:37:51.816204+0000","last_active":"2024-09-13T19:37:51.816139+0000","last_peered":"2024-09-13T19:37:51.816139+0000","last_clean":"2024-09-13T19:37:51.816139+0000","last_became_active":"2024-09-13T19:33:08.353998+0000","last_became_peered":"2024-09-13T19:33:08.353998+0000","last_unstale":"2024-09-13T19:37:51.816139+0000","last_undegraded":"2024-09-13T19:37:51.816139+0000","last_fullsized":"2024-09-13T19:37:51.816139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:51.815920+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:51.815920+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.815920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:01.692044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.585204+0000","last_change":"2024-09-13T19:37:17.585204+0000","last_active":"2024-09-13T19:37:17.585204+0000","last_peered":"2024-09-13T19:37:17.585204+0000","last_clean":"2024-09-13T19:37:17.585204+0000","last_became_active":"2024-09-13T19:33:12.353980+0000","last_became_peered":"2024-09-13T19:33:12.353980+0000","last_unstale":"2024-09-13T19:37:17.585204+0000","last_undegraded":"2024-09-13T19:37:17.585204+0000","last_fullsized":"2024-09-13T19:37:17.585204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:17.584949+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:17.584949+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.584949+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:44.456695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.992249+0000","last_change":"2024-09-13T19:37:25.992249+0000","last_active":"2024-09-13T19:37:25.992249+0000","last_peered":"2024-09-13T19:37:25.992249+0000","last_clean":"2024-09-13T19:37:25.992249+0000","last_became_active":"2024-09-13T19:33:14.390994+0000","last_became_peered":"2024-09-13T19:33:14.390994+0000","last_unstale":"2024-09-13T19:37:25.992249+0000","last_undegraded":"2024-09-13T19:37:25.992249+0000","last_fullsized":"2024-09-13T19:37:25.992249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:25.991984+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:25.991984+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.991984+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:34.178024+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":473,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.467344+0000","last_change":"2024-09-13T19:37:01.467344+0000","last_active":"2024-09-13T19:37:01.467344+0000","last_peered":"2024-09-13T19:37:01.467344+0000","last_clean":"2024-09-13T19:37:01.467344+0000","last_became_active":"2024-09-13T19:33:16.380942+0000","last_became_peered":"2024-09-13T19:33:16.380942+0000","last_unstale":"2024-09-13T19:37:01.467344+0000","last_undegraded":"2024-09-13T19:37:01.467344+0000","last_fullsized":"2024-09-13T19:37:01.467344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.467091+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.467091+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:04.385381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.905199+0000","last_change":"2024-09-13T19:37:19.905199+0000","last_active":"2024-09-13T19:37:19.905199+0000","last_peered":"2024-09-13T19:37:19.905199+0000","last_clean":"2024-09-13T19:37:19.905199+0000","last_became_active":"2024-09-13T19:33:18.404133+0000","last_became_peered":"2024-09-13T19:33:18.404133+0000","last_unstale":"2024-09-13T19:37:19.905199+0000","last_undegraded":"2024-09-13T19:37:19.905199+0000","last_fullsized":"2024-09-13T19:37:19.905199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:19.904819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.904819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:30.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.439047+0000","last_change":"2024-09-13T19:37:36.439047+0000","last_active":"2024-09-13T19:37:36.439047+0000","last_peered":"2024-09-13T19:37:36.439047+0000","last_clean":"2024-09-13T19:37:36.439047+0000","last_became_active":"2024-09-13T19:33:10.350941+0000","last_became_peered":"2024-09-13T19:33:10.350941+0000","last_unstale":"2024-09-13T19:37:36.439047+0000","last_undegraded":"2024-09-13T19:37:36.439047+0000","last_fullsized":"2024-09-13T19:37:36.439047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:36.438801+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:36.438801+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.438801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:08.256631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:53.798837+0000","last_change":"2024-09-13T19:37:53.798900+0000","last_active":"2024-09-13T19:37:53.798837+0000","last_peered":"2024-09-13T19:37:53.798837+0000","last_clean":"2024-09-13T19:37:53.798837+0000","last_became_active":"2024-09-13T19:33:08.341503+0000","last_became_peered":"2024-09-13T19:33:08.341503+0000","last_unstale":"2024-09-13T19:37:53.798837+0000","last_undegraded":"2024-09-13T19:37:53.798837+0000","last_fullsized":"2024-09-13T19:37:53.798837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:53.798611+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:53.798611+0000","last_clean_scrub_stamp":"2024-09-13T19:37:53.798611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:54.032519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.118554+0000","last_change":"2024-09-13T19:37:02.118554+0000","last_active":"2024-09-13T19:37:02.118554+0000","last_peered":"2024-09-13T19:37:02.118554+0000","last_clean":"2024-09-13T19:37:02.118554+0000","last_became_active":"2024-09-13T19:33:12.359590+0000","last_became_peered":"2024-09-13T19:33:12.359590+0000","last_unstale":"2024-09-13T19:37:02.118554+0000","last_undegraded":"2024-09-13T19:37:02.118554+0000","last_fullsized":"2024-09-13T19:37:02.118554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.118290+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.118290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:01.693866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.542034+0000","last_change":"2024-09-13T19:37:11.542034+0000","last_active":"2024-09-13T19:37:11.542034+0000","last_peered":"2024-09-13T19:37:11.542034+0000","last_clean":"2024-09-13T19:37:11.542034+0000","last_became_active":"2024-09-13T19:33:14.363134+0000","last_became_peered":"2024-09-13T19:33:14.363134+0000","last_unstale":"2024-09-13T19:37:11.542034+0000","last_undegraded":"2024-09-13T19:37:11.542034+0000","last_fullsized":"2024-09-13T19:37:11.542034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:11.541770+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.541770+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:28.664323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.819618+0000","last_change":"2024-09-13T19:37:15.819618+0000","last_active":"2024-09-13T19:37:15.819618+0000","last_peered":"2024-09-13T19:37:15.819618+0000","last_clean":"2024-09-13T19:37:15.819618+0000","last_became_active":"2024-09-13T19:33:16.391737+0000","last_became_peered":"2024-09-13T19:33:16.391737+0000","last_unstale":"2024-09-13T19:37:15.819618+0000","last_undegraded":"2024-09-13T19:37:15.819618+0000","last_fullsized":"2024-09-13T19:37:15.819618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:15.819343+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.819343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:17.226606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.492524+0000","last_change":"2024-09-13T19:37:08.492524+0000","last_active":"2024-09-13T19:37:08.492524+0000","last_peered":"2024-09-13T19:37:08.492524+0000","last_clean":"2024-09-13T19:37:08.492524+0000","last_became_active":"2024-09-13T19:33:18.408807+0000","last_became_peered":"2024-09-13T19:33:18.408807+0000","last_unstale":"2024-09-13T19:37:08.492524+0000","last_undegraded":"2024-09-13T19:37:08.492524+0000","last_fullsized":"2024-09-13T19:37:08.492524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:08.492240+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.492240+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.753771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.119769+0000","last_change":"2024-09-13T19:37:17.119769+0000","last_active":"2024-09-13T19:37:17.119769+0000","last_peered":"2024-09-13T19:37:17.119769+0000","last_clean":"2024-09-13T19:37:17.119769+0000","last_became_active":"2024-09-13T19:33:10.358264+0000","last_became_peered":"2024-09-13T19:33:10.358264+0000","last_unstale":"2024-09-13T19:37:17.119769+0000","last_undegraded":"2024-09-13T19:37:17.119769+0000","last_fullsized":"2024-09-13T19:37:17.119769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.119389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.119389+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.119389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:39.478375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":213,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.502371+0000","last_change":"2024-09-13T19:37:46.502551+0000","last_active":"2024-09-13T19:37:46.502371+0000","last_peered":"2024-09-13T19:37:46.502371+0000","last_clean":"2024-09-13T19:37:46.502371+0000","last_became_active":"2024-09-13T19:32:57.875581+0000","last_became_peered":"2024-09-13T19:32:57.875581+0000","last_unstale":"2024-09-13T19:37:46.502371+0000","last_undegraded":"2024-09-13T19:37:46.502371+0000","last_fullsized":"2024-09-13T19:37:46.502371+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-09-13T19:37:46.502154+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-09-13T19:37:46.502154+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.502154+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:49.502193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:10.629937+0000","last_change":"2024-09-13T19:38:10.630007+0000","last_active":"2024-09-13T19:38:10.629937+0000","last_peered":"2024-09-13T19:38:10.629937+0000","last_clean":"2024-09-13T19:38:10.629937+0000","last_became_active":"2024-09-13T19:33:00.514732+0000","last_became_peered":"2024-09-13T19:33:00.514732+0000","last_unstale":"2024-09-13T19:38:10.629937+0000","last_undegraded":"2024-09-13T19:38:10.629937+0000","last_fullsized":"2024-09-13T19:38:10.629937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:38:10.629675+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:38:10.629675+0000","last_clean_scrub_stamp":"2024-09-13T19:38:10.629675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:04.536948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082348700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.688999+0000","last_change":"2024-09-13T19:37:56.689057+0000","last_active":"2024-09-13T19:37:56.688999+0000","last_peered":"2024-09-13T19:37:56.688999+0000","last_clean":"2024-09-13T19:37:56.688999+0000","last_became_active":"2024-09-13T19:33:08.353318+0000","last_became_peered":"2024-09-13T19:33:08.353318+0000","last_unstale":"2024-09-13T19:37:56.688999+0000","last_undegraded":"2024-09-13T19:37:56.688999+0000","last_fullsized":"2024-09-13T19:37:56.688999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:56.688803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:56.688803+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.688803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:31.856369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.618879+0000","last_change":"2024-09-13T19:37:58.618932+0000","last_active":"2024-09-13T19:37:58.618879+0000","last_peered":"2024-09-13T19:37:58.618879+0000","last_clean":"2024-09-13T19:37:58.618879+0000","last_became_active":"2024-09-13T19:33:49.522366+0000","last_became_peered":"2024-09-13T19:33:49.522366+0000","last_unstale":"2024-09-13T19:37:58.618879+0000","last_undegraded":"2024-09-13T19:37:58.618879+0000","last_fullsized":"2024-09-13T19:37:58.618879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:58.618686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:58.618686+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.618686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:23.977888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'87","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.130003+0000","last_change":"2024-09-13T19:37:15.130003+0000","last_active":"2024-09-13T19:37:15.130003+0000","last_peered":"2024-09-13T19:37:15.130003+0000","last_clean":"2024-09-13T19:37:15.130003+0000","last_became_active":"2024-09-13T19:33:14.383645+0000","last_became_peered":"2024-09-13T19:33:14.383645+0000","last_unstale":"2024-09-13T19:37:15.130003+0000","last_undegraded":"2024-09-13T19:37:15.130003+0000","last_fullsized":"2024-09-13T19:37:15.130003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-09-13T19:37:15.129728+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.129728+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:51:47.372002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.228695+0000","last_change":"2024-09-13T19:37:09.228695+0000","last_active":"2024-09-13T19:37:09.228695+0000","last_peered":"2024-09-13T19:37:09.228695+0000","last_clean":"2024-09-13T19:37:09.228695+0000","last_became_active":"2024-09-13T19:33:16.377588+0000","last_became_peered":"2024-09-13T19:33:16.377588+0000","last_unstale":"2024-09-13T19:37:09.228695+0000","last_undegraded":"2024-09-13T19:37:09.228695+0000","last_fullsized":"2024-09-13T19:37:09.228695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.228417+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.228417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:56.994751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.945992+0000","last_change":"2024-09-13T19:37:46.946134+0000","last_active":"2024-09-13T19:37:46.945992+0000","last_peered":"2024-09-13T19:37:46.945992+0000","last_clean":"2024-09-13T19:37:46.945992+0000","last_became_active":"2024-09-13T19:33:18.399824+0000","last_became_peered":"2024-09-13T19:33:18.399824+0000","last_unstale":"2024-09-13T19:37:46.945992+0000","last_undegraded":"2024-09-13T19:37:46.945992+0000","last_fullsized":"2024-09-13T19:37:46.945992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-09-13T19:37:46.945750+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-09-13T19:37:46.945750+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.945750+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:08.676021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'10","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.965119+0000","last_change":"2024-09-13T19:37:51.965119+0000","last_active":"2024-09-13T19:37:51.965119+0000","last_peered":"2024-09-13T19:37:51.965119+0000","last_clean":"2024-09-13T19:37:51.965119+0000","last_became_active":"2024-09-13T19:33:49.515459+0000","last_became_peered":"2024-09-13T19:33:49.515459+0000","last_unstale":"2024-09-13T19:37:51.965119+0000","last_undegraded":"2024-09-13T19:37:51.965119+0000","last_fullsized":"2024-09-13T19:37:51.965119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:51.964860+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:51.964860+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.964860+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:57.695590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:08.642259+0000","last_change":"2024-09-13T19:38:08.642315+0000","last_active":"2024-09-13T19:38:08.642259+0000","last_peered":"2024-09-13T19:38:08.642259+0000","last_clean":"2024-09-13T19:38:08.642259+0000","last_became_active":"2024-09-13T19:33:00.515422+0000","last_became_peered":"2024-09-13T19:33:00.515422+0000","last_unstale":"2024-09-13T19:38:08.642259+0000","last_undegraded":"2024-09-13T19:38:08.642259+0000","last_fullsized":"2024-09-13T19:38:08.642259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:08.642071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:08.642071+0000","last_clean_scrub_stamp":"2024-09-13T19:38:08.642071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:52.395902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00085901,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.161972+0000","last_change":"2024-09-13T19:37:36.162036+0000","last_active":"2024-09-13T19:37:36.161972+0000","last_peered":"2024-09-13T19:37:36.161972+0000","last_clean":"2024-09-13T19:37:36.161972+0000","last_became_active":"2024-09-13T19:33:08.348384+0000","last_became_peered":"2024-09-13T19:33:08.348384+0000","last_unstale":"2024-09-13T19:37:36.161972+0000","last_undegraded":"2024-09-13T19:37:36.161972+0000","last_fullsized":"2024-09-13T19:37:36.161972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:36.161776+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:36.161776+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.161776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.979606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.147263+0000","last_change":"2024-09-13T19:37:09.147263+0000","last_active":"2024-09-13T19:37:09.147263+0000","last_peered":"2024-09-13T19:37:09.147263+0000","last_clean":"2024-09-13T19:37:09.147263+0000","last_became_active":"2024-09-13T19:33:12.347275+0000","last_became_peered":"2024-09-13T19:33:12.347275+0000","last_unstale":"2024-09-13T19:37:09.147263+0000","last_undegraded":"2024-09-13T19:37:09.147263+0000","last_fullsized":"2024-09-13T19:37:09.147263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:09.147011+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.147011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:17.425294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":517,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.504345+0000","last_change":"2024-09-13T19:37:06.504345+0000","last_active":"2024-09-13T19:37:06.504345+0000","last_peered":"2024-09-13T19:37:06.504345+0000","last_clean":"2024-09-13T19:37:06.504345+0000","last_became_active":"2024-09-13T19:33:14.367670+0000","last_became_peered":"2024-09-13T19:33:14.367670+0000","last_unstale":"2024-09-13T19:37:06.504345+0000","last_undegraded":"2024-09-13T19:37:06.504345+0000","last_fullsized":"2024-09-13T19:37:06.504345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-09-13T19:37:06.503927+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.503927+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:35.014112+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.089943+0000","last_change":"2024-09-13T19:37:21.089943+0000","last_active":"2024-09-13T19:37:21.089943+0000","last_peered":"2024-09-13T19:37:21.089943+0000","last_clean":"2024-09-13T19:37:21.089943+0000","last_became_active":"2024-09-13T19:33:16.401350+0000","last_became_peered":"2024-09-13T19:33:16.401350+0000","last_unstale":"2024-09-13T19:37:21.089943+0000","last_undegraded":"2024-09-13T19:37:21.089943+0000","last_fullsized":"2024-09-13T19:37:21.089943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:21.089650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:21.089650+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.089650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:32.669122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:55.574914+0000","last_change":"2024-09-13T19:37:55.574987+0000","last_active":"2024-09-13T19:37:55.574914+0000","last_peered":"2024-09-13T19:37:55.574914+0000","last_clean":"2024-09-13T19:37:55.574914+0000","last_became_active":"2024-09-13T19:33:18.423461+0000","last_became_peered":"2024-09-13T19:33:18.423461+0000","last_unstale":"2024-09-13T19:37:55.574914+0000","last_undegraded":"2024-09-13T19:37:55.574914+0000","last_fullsized":"2024-09-13T19:37:55.574914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:55.574705+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:55.574705+0000","last_clean_scrub_stamp":"2024-09-13T19:37:55.574705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:58.226960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.074650+0000","last_change":"2024-09-13T19:37:39.074710+0000","last_active":"2024-09-13T19:37:39.074650+0000","last_peered":"2024-09-13T19:37:39.074650+0000","last_clean":"2024-09-13T19:37:39.074650+0000","last_became_active":"2024-09-13T19:33:10.336701+0000","last_became_peered":"2024-09-13T19:33:10.336701+0000","last_unstale":"2024-09-13T19:37:39.074650+0000","last_undegraded":"2024-09-13T19:37:39.074650+0000","last_fullsized":"2024-09-13T19:37:39.074650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:39.074462+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:39.074462+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.074462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:20.601071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.093185+0000","last_change":"2024-09-13T19:37:38.093238+0000","last_active":"2024-09-13T19:37:38.093185+0000","last_peered":"2024-09-13T19:37:38.093185+0000","last_clean":"2024-09-13T19:37:38.093185+0000","last_became_active":"2024-09-13T19:33:00.517806+0000","last_became_peered":"2024-09-13T19:33:00.517806+0000","last_unstale":"2024-09-13T19:37:38.093185+0000","last_undegraded":"2024-09-13T19:37:38.093185+0000","last_fullsized":"2024-09-13T19:37:38.093185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:38.092962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:38.092962+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.092962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:20.037272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090857299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.054805+0000","last_change":"2024-09-13T19:37:42.054873+0000","last_active":"2024-09-13T19:37:42.054805+0000","last_peered":"2024-09-13T19:37:42.054805+0000","last_clean":"2024-09-13T19:37:42.054805+0000","last_became_active":"2024-09-13T19:33:08.345173+0000","last_became_peered":"2024-09-13T19:33:08.345173+0000","last_unstale":"2024-09-13T19:37:42.054805+0000","last_undegraded":"2024-09-13T19:37:42.054805+0000","last_fullsized":"2024-09-13T19:37:42.054805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:42.054613+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:42.054613+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.054613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:20.890654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.849196+0000","last_change":"2024-09-13T19:37:16.849196+0000","last_active":"2024-09-13T19:37:16.849196+0000","last_peered":"2024-09-13T19:37:16.849196+0000","last_clean":"2024-09-13T19:37:16.849196+0000","last_became_active":"2024-09-13T19:33:12.351621+0000","last_became_peered":"2024-09-13T19:33:12.351621+0000","last_unstale":"2024-09-13T19:37:16.849196+0000","last_undegraded":"2024-09-13T19:37:16.849196+0000","last_fullsized":"2024-09-13T19:37:16.849196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:16.848911+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.848911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:35.095041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'24","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.900571+0000","last_change":"2024-09-13T19:37:08.900571+0000","last_active":"2024-09-13T19:37:08.900571+0000","last_peered":"2024-09-13T19:37:08.900571+0000","last_clean":"2024-09-13T19:37:08.900571+0000","last_became_active":"2024-09-13T19:33:14.366182+0000","last_became_peered":"2024-09-13T19:33:14.366182+0000","last_unstale":"2024-09-13T19:37:08.900571+0000","last_undegraded":"2024-09-13T19:37:08.900571+0000","last_fullsized":"2024-09-13T19:37:08.900571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-09-13T19:37:08.900272+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.900272+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:29.326850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.306113+0000","last_change":"2024-09-13T19:37:00.306113+0000","last_active":"2024-09-13T19:37:00.306113+0000","last_peered":"2024-09-13T19:37:00.306113+0000","last_clean":"2024-09-13T19:37:00.306113+0000","last_became_active":"2024-09-13T19:33:16.374648+0000","last_became_peered":"2024-09-13T19:33:16.374648+0000","last_unstale":"2024-09-13T19:37:00.306113+0000","last_undegraded":"2024-09-13T19:37:00.306113+0000","last_fullsized":"2024-09-13T19:37:00.306113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.305866+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.305866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:41.036690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.899913+0000","last_change":"2024-09-13T19:37:46.899913+0000","last_active":"2024-09-13T19:37:46.899913+0000","last_peered":"2024-09-13T19:37:46.899913+0000","last_clean":"2024-09-13T19:37:46.899913+0000","last_became_active":"2024-09-13T19:33:18.413910+0000","last_became_peered":"2024-09-13T19:33:18.413910+0000","last_unstale":"2024-09-13T19:37:46.899913+0000","last_undegraded":"2024-09-13T19:37:46.899913+0000","last_fullsized":"2024-09-13T19:37:46.899913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.899651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.899651+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.899651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:52.737320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.212375+0000","last_change":"2024-09-13T19:37:28.212520+0000","last_active":"2024-09-13T19:37:28.212375+0000","last_peered":"2024-09-13T19:37:28.212375+0000","last_clean":"2024-09-13T19:37:28.212375+0000","last_became_active":"2024-09-13T19:33:10.345300+0000","last_became_peered":"2024-09-13T19:33:10.345300+0000","last_unstale":"2024-09-13T19:37:28.212375+0000","last_undegraded":"2024-09-13T19:37:28.212375+0000","last_fullsized":"2024-09-13T19:37:28.212375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-13T19:37:28.212060+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-13T19:37:28.212060+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.212060+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.185729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:09.619586+0000","last_change":"2024-09-13T19:38:09.619656+0000","last_active":"2024-09-13T19:38:09.619586+0000","last_peered":"2024-09-13T19:38:09.619586+0000","last_clean":"2024-09-13T19:38:09.619586+0000","last_became_active":"2024-09-13T19:33:00.516668+0000","last_became_peered":"2024-09-13T19:33:00.516668+0000","last_unstale":"2024-09-13T19:38:09.619586+0000","last_undegraded":"2024-09-13T19:38:09.619586+0000","last_fullsized":"2024-09-13T19:38:09.619586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:38:09.619377+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:38:09.619377+0000","last_clean_scrub_stamp":"2024-09-13T19:38:09.619377+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:10.064984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020349439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.029039+0000","last_change":"2024-09-13T19:37:42.029092+0000","last_active":"2024-09-13T19:37:42.029039+0000","last_peered":"2024-09-13T19:37:42.029039+0000","last_clean":"2024-09-13T19:37:42.029039+0000","last_became_active":"2024-09-13T19:33:08.333059+0000","last_became_peered":"2024-09-13T19:33:08.333059+0000","last_unstale":"2024-09-13T19:37:42.029039+0000","last_undegraded":"2024-09-13T19:37:42.029039+0000","last_fullsized":"2024-09-13T19:37:42.029039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:42.028813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:42.028813+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.028813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:44.895289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.316430+0000","last_change":"2024-09-13T19:37:18.316430+0000","last_active":"2024-09-13T19:37:18.316430+0000","last_peered":"2024-09-13T19:37:18.316430+0000","last_clean":"2024-09-13T19:37:18.316430+0000","last_became_active":"2024-09-13T19:33:12.352934+0000","last_became_peered":"2024-09-13T19:33:12.352934+0000","last_unstale":"2024-09-13T19:37:18.316430+0000","last_undegraded":"2024-09-13T19:37:18.316430+0000","last_fullsized":"2024-09-13T19:37:18.316430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.316023+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.316023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:53.513548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.034575+0000","last_change":"2024-09-13T19:37:25.034575+0000","last_active":"2024-09-13T19:37:25.034575+0000","last_peered":"2024-09-13T19:37:25.034575+0000","last_clean":"2024-09-13T19:37:25.034575+0000","last_became_active":"2024-09-13T19:33:14.392003+0000","last_became_peered":"2024-09-13T19:33:14.392003+0000","last_unstale":"2024-09-13T19:37:25.034575+0000","last_undegraded":"2024-09-13T19:37:25.034575+0000","last_fullsized":"2024-09-13T19:37:25.034575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-13T19:37:25.034296+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-13T19:37:25.034296+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.034296+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:16.184148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.084251+0000","last_change":"2024-09-13T19:37:23.084251+0000","last_active":"2024-09-13T19:37:23.084251+0000","last_peered":"2024-09-13T19:37:23.084251+0000","last_clean":"2024-09-13T19:37:23.084251+0000","last_became_active":"2024-09-13T19:33:16.402027+0000","last_became_peered":"2024-09-13T19:33:16.402027+0000","last_unstale":"2024-09-13T19:37:23.084251+0000","last_undegraded":"2024-09-13T19:37:23.084251+0000","last_fullsized":"2024-09-13T19:37:23.084251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:23.083834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:23.083834+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.083834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:08.356001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:20.665709+0000","last_change":"2024-09-13T19:37:20.665709+0000","last_active":"2024-09-13T19:37:20.665709+0000","last_peered":"2024-09-13T19:37:20.665709+0000","last_clean":"2024-09-13T19:37:20.665709+0000","last_became_active":"2024-09-13T19:33:18.417444+0000","last_became_peered":"2024-09-13T19:33:18.417444+0000","last_unstale":"2024-09-13T19:37:20.665709+0000","last_undegraded":"2024-09-13T19:37:20.665709+0000","last_fullsized":"2024-09-13T19:37:20.665709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-13T19:37:20.665452+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-13T19:37:20.665452+0000","last_clean_scrub_stamp":"2024-09-13T19:37:20.665452+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:26.812805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:23.605404+0000","last_change":"2024-09-13T19:37:23.605471+0000","last_active":"2024-09-13T19:37:23.605404+0000","last_peered":"2024-09-13T19:37:23.605404+0000","last_clean":"2024-09-13T19:37:23.605404+0000","last_became_active":"2024-09-13T19:33:10.357516+0000","last_became_peered":"2024-09-13T19:33:10.357516+0000","last_unstale":"2024-09-13T19:37:23.605404+0000","last_undegraded":"2024-09-13T19:37:23.605404+0000","last_fullsized":"2024-09-13T19:37:23.605404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:23.605199+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:23.605199+0000","last_clean_scrub_stamp":"2024-09-13T19:37:23.605199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:24.233934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.053088+0000","last_change":"2024-09-13T19:37:39.053139+0000","last_active":"2024-09-13T19:37:39.053088+0000","last_peered":"2024-09-13T19:37:39.053088+0000","last_clean":"2024-09-13T19:37:39.053088+0000","last_became_active":"2024-09-13T19:33:08.331374+0000","last_became_peered":"2024-09-13T19:33:08.331374+0000","last_unstale":"2024-09-13T19:37:39.053088+0000","last_undegraded":"2024-09-13T19:37:39.053088+0000","last_fullsized":"2024-09-13T19:37:39.053088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:39.052897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:39.052897+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.052897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:08.507511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.999985+0000","last_change":"2024-09-13T19:37:47.000092+0000","last_active":"2024-09-13T19:37:46.999985+0000","last_peered":"2024-09-13T19:37:46.999985+0000","last_clean":"2024-09-13T19:37:46.999985+0000","last_became_active":"2024-09-13T19:33:00.509814+0000","last_became_peered":"2024-09-13T19:33:00.509814+0000","last_unstale":"2024-09-13T19:37:46.999985+0000","last_undegraded":"2024-09-13T19:37:46.999985+0000","last_fullsized":"2024-09-13T19:37:46.999985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.999754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.999754+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.999754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:08.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001099671,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.275009+0000","last_change":"2024-09-13T19:37:15.275009+0000","last_active":"2024-09-13T19:37:15.275009+0000","last_peered":"2024-09-13T19:37:15.275009+0000","last_clean":"2024-09-13T19:37:15.275009+0000","last_became_active":"2024-09-13T19:33:12.352587+0000","last_became_peered":"2024-09-13T19:33:12.352587+0000","last_unstale":"2024-09-13T19:37:15.275009+0000","last_undegraded":"2024-09-13T19:37:15.275009+0000","last_fullsized":"2024-09-13T19:37:15.275009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.274757+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.274757+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:13.076733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'74","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.172215+0000","last_change":"2024-09-13T19:37:11.172215+0000","last_active":"2024-09-13T19:37:11.172215+0000","last_peered":"2024-09-13T19:37:11.172215+0000","last_clean":"2024-09-13T19:37:11.172215+0000","last_became_active":"2024-09-13T19:33:14.352486+0000","last_became_peered":"2024-09-13T19:33:14.352486+0000","last_unstale":"2024-09-13T19:37:11.172215+0000","last_undegraded":"2024-09-13T19:37:11.172215+0000","last_fullsized":"2024-09-13T19:37:11.172215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-13T19:37:11.171938+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.171938+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:48.364805+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.934769+0000","last_change":"2024-09-13T19:37:03.934769+0000","last_active":"2024-09-13T19:37:03.934769+0000","last_peered":"2024-09-13T19:37:03.934769+0000","last_clean":"2024-09-13T19:37:03.934769+0000","last_became_active":"2024-09-13T19:33:16.389998+0000","last_became_peered":"2024-09-13T19:33:16.389998+0000","last_unstale":"2024-09-13T19:37:03.934769+0000","last_undegraded":"2024-09-13T19:37:03.934769+0000","last_fullsized":"2024-09-13T19:37:03.934769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.934524+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.934524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:27.912903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.133974+0000","last_change":"2024-09-13T19:37:56.134038+0000","last_active":"2024-09-13T19:37:56.133974+0000","last_peered":"2024-09-13T19:37:56.133974+0000","last_clean":"2024-09-13T19:37:56.133974+0000","last_became_active":"2024-09-13T19:33:18.401018+0000","last_became_peered":"2024-09-13T19:33:18.401018+0000","last_unstale":"2024-09-13T19:37:56.133974+0000","last_undegraded":"2024-09-13T19:37:56.133974+0000","last_fullsized":"2024-09-13T19:37:56.133974+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-09-13T19:37:56.133788+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-09-13T19:37:56.133788+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.133788+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:33.961585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.540294+0000","last_change":"2024-09-13T19:37:26.540356+0000","last_active":"2024-09-13T19:37:26.540294+0000","last_peered":"2024-09-13T19:37:26.540294+0000","last_clean":"2024-09-13T19:37:26.540294+0000","last_became_active":"2024-09-13T19:33:10.356352+0000","last_became_peered":"2024-09-13T19:33:10.356352+0000","last_unstale":"2024-09-13T19:37:26.540294+0000","last_undegraded":"2024-09-13T19:37:26.540294+0000","last_fullsized":"2024-09-13T19:37:26.540294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:26.540098+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:26.540098+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.540098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:08.484408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:46.018027+0000","last_change":"2024-09-13T19:37:46.018158+0000","last_active":"2024-09-13T19:37:46.018027+0000","last_peered":"2024-09-13T19:37:46.018027+0000","last_clean":"2024-09-13T19:37:46.018027+0000","last_became_active":"2024-09-13T19:33:08.344982+0000","last_became_peered":"2024-09-13T19:33:08.344982+0000","last_unstale":"2024-09-13T19:37:46.018027+0000","last_undegraded":"2024-09-13T19:37:46.018027+0000","last_fullsized":"2024-09-13T19:37:46.018027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:46.017778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:46.017778+0000","last_clean_scrub_stamp":"2024-09-13T19:37:46.017778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:49.017817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:11.578280+0000","last_change":"2024-09-13T19:38:11.578336+0000","last_active":"2024-09-13T19:38:11.578280+0000","last_peered":"2024-09-13T19:38:11.578280+0000","last_clean":"2024-09-13T19:38:11.578280+0000","last_became_active":"2024-09-13T19:33:00.516355+0000","last_became_peered":"2024-09-13T19:33:00.516355+0000","last_unstale":"2024-09-13T19:38:11.578280+0000","last_undegraded":"2024-09-13T19:38:11.578280+0000","last_fullsized":"2024-09-13T19:38:11.578280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:11.578081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:11.578081+0000","last_clean_scrub_stamp":"2024-09-13T19:38:11.578081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:44.155714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014507879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.079813+0000","last_change":"2024-09-13T19:37:06.079813+0000","last_active":"2024-09-13T19:37:06.079813+0000","last_peered":"2024-09-13T19:37:06.079813+0000","last_clean":"2024-09-13T19:37:06.079813+0000","last_became_active":"2024-09-13T19:33:12.355683+0000","last_became_peered":"2024-09-13T19:33:12.355683+0000","last_unstale":"2024-09-13T19:37:06.079813+0000","last_undegraded":"2024-09-13T19:37:06.079813+0000","last_fullsized":"2024-09-13T19:37:06.079813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.079564+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.079564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:35.654908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.552224+0000","last_change":"2024-09-13T19:37:05.552224+0000","last_active":"2024-09-13T19:37:05.552224+0000","last_peered":"2024-09-13T19:37:05.552224+0000","last_clean":"2024-09-13T19:37:05.552224+0000","last_became_active":"2024-09-13T19:33:14.367622+0000","last_became_peered":"2024-09-13T19:33:14.367622+0000","last_unstale":"2024-09-13T19:37:05.552224+0000","last_undegraded":"2024-09-13T19:37:05.552224+0000","last_fullsized":"2024-09-13T19:37:05.552224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-13T19:37:05.551819+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.551819+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:23.797950+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.523331+0000","last_change":"2024-09-13T19:36:59.523331+0000","last_active":"2024-09-13T19:36:59.523331+0000","last_peered":"2024-09-13T19:36:59.523331+0000","last_clean":"2024-09-13T19:36:59.523331+0000","last_became_active":"2024-09-13T19:33:16.383344+0000","last_became_peered":"2024-09-13T19:33:16.383344+0000","last_unstale":"2024-09-13T19:36:59.523331+0000","last_undegraded":"2024-09-13T19:36:59.523331+0000","last_fullsized":"2024-09-13T19:36:59.523331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:36:59.522965+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.522965+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:04.776093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.956223+0000","last_change":"2024-09-13T19:37:38.956223+0000","last_active":"2024-09-13T19:37:38.956223+0000","last_peered":"2024-09-13T19:37:38.956223+0000","last_clean":"2024-09-13T19:37:38.956223+0000","last_became_active":"2024-09-13T19:33:18.409942+0000","last_became_peered":"2024-09-13T19:33:18.409942+0000","last_unstale":"2024-09-13T19:37:38.956223+0000","last_undegraded":"2024-09-13T19:37:38.956223+0000","last_fullsized":"2024-09-13T19:37:38.956223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:38.955963+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:38.955963+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.955963+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:04.315165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":63,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.875790+0000","last_change":"2024-09-13T19:37:40.875856+0000","last_active":"2024-09-13T19:37:40.875790+0000","last_peered":"2024-09-13T19:37:40.875790+0000","last_clean":"2024-09-13T19:37:40.875790+0000","last_became_active":"2024-09-13T19:33:10.351608+0000","last_became_peered":"2024-09-13T19:33:10.351608+0000","last_unstale":"2024-09-13T19:37:40.875790+0000","last_undegraded":"2024-09-13T19:37:40.875790+0000","last_fullsized":"2024-09-13T19:37:40.875790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:40.875571+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:40.875571+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.875571+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.018867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:07.628595+0000","last_change":"2024-09-13T19:38:07.628651+0000","last_active":"2024-09-13T19:38:07.628595+0000","last_peered":"2024-09-13T19:38:07.628595+0000","last_clean":"2024-09-13T19:38:07.628595+0000","last_became_active":"2024-09-13T19:33:08.335489+0000","last_became_peered":"2024-09-13T19:33:08.335489+0000","last_unstale":"2024-09-13T19:38:07.628595+0000","last_undegraded":"2024-09-13T19:38:07.628595+0000","last_fullsized":"2024-09-13T19:38:07.628595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:07.628360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:07.628360+0000","last_clean_scrub_stamp":"2024-09-13T19:38:07.628360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:10.782158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.023259+0000","last_change":"2024-09-13T19:37:48.023319+0000","last_active":"2024-09-13T19:37:48.023259+0000","last_peered":"2024-09-13T19:37:48.023259+0000","last_clean":"2024-09-13T19:37:48.023259+0000","last_became_active":"2024-09-13T19:33:00.510226+0000","last_became_peered":"2024-09-13T19:33:00.510226+0000","last_unstale":"2024-09-13T19:37:48.023259+0000","last_undegraded":"2024-09-13T19:37:48.023259+0000","last_fullsized":"2024-09-13T19:37:48.023259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:48.023063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:48.023063+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.023063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:42.107507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097720500000000009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:04.076438+0000","last_change":"2024-09-13T19:37:04.076438+0000","last_active":"2024-09-13T19:37:04.076438+0000","last_peered":"2024-09-13T19:37:04.076438+0000","last_clean":"2024-09-13T19:37:04.076438+0000","last_became_active":"2024-09-13T19:33:12.356656+0000","last_became_peered":"2024-09-13T19:33:12.356656+0000","last_unstale":"2024-09-13T19:37:04.076438+0000","last_undegraded":"2024-09-13T19:37:04.076438+0000","last_fullsized":"2024-09-13T19:37:04.076438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:04.076154+0000","last_clean_scrub_stamp":"2024-09-13T19:37:04.076154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:39.308586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.094198+0000","last_change":"2024-09-13T19:37:19.094198+0000","last_active":"2024-09-13T19:37:19.094198+0000","last_peered":"2024-09-13T19:37:19.094198+0000","last_clean":"2024-09-13T19:37:19.094198+0000","last_became_active":"2024-09-13T19:33:14.383690+0000","last_became_peered":"2024-09-13T19:33:14.383690+0000","last_unstale":"2024-09-13T19:37:19.094198+0000","last_undegraded":"2024-09-13T19:37:19.094198+0000","last_fullsized":"2024-09-13T19:37:19.094198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:19.093865+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:19.093865+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.093865+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:00.620474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.358816+0000","last_change":"2024-09-13T19:37:03.358816+0000","last_active":"2024-09-13T19:37:03.358816+0000","last_peered":"2024-09-13T19:37:03.358816+0000","last_clean":"2024-09-13T19:37:03.358816+0000","last_became_active":"2024-09-13T19:33:16.372055+0000","last_became_peered":"2024-09-13T19:33:16.372055+0000","last_unstale":"2024-09-13T19:37:03.358816+0000","last_undegraded":"2024-09-13T19:37:03.358816+0000","last_fullsized":"2024-09-13T19:37:03.358816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:03.358562+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.358562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.021089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.557231+0000","last_change":"2024-09-13T19:37:12.557231+0000","last_active":"2024-09-13T19:37:12.557231+0000","last_peered":"2024-09-13T19:37:12.557231+0000","last_clean":"2024-09-13T19:37:12.557231+0000","last_became_active":"2024-09-13T19:33:18.411255+0000","last_became_peered":"2024-09-13T19:33:18.411255+0000","last_unstale":"2024-09-13T19:37:12.557231+0000","last_undegraded":"2024-09-13T19:37:12.557231+0000","last_fullsized":"2024-09-13T19:37:12.557231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-09-13T19:37:12.556957+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.556957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.679686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.029314+0000","last_change":"2024-09-13T19:37:34.029405+0000","last_active":"2024-09-13T19:37:34.029314+0000","last_peered":"2024-09-13T19:37:34.029314+0000","last_clean":"2024-09-13T19:37:34.029314+0000","last_became_active":"2024-09-13T19:33:10.336244+0000","last_became_peered":"2024-09-13T19:33:10.336244+0000","last_unstale":"2024-09-13T19:37:34.029314+0000","last_undegraded":"2024-09-13T19:37:34.029314+0000","last_fullsized":"2024-09-13T19:37:34.029314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:34.029094+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:34.029094+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.029094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:33.604670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.451967+0000","last_change":"2024-09-13T19:37:37.452031+0000","last_active":"2024-09-13T19:37:37.451967+0000","last_peered":"2024-09-13T19:37:37.451967+0000","last_clean":"2024-09-13T19:37:37.451967+0000","last_became_active":"2024-09-13T19:33:08.353623+0000","last_became_peered":"2024-09-13T19:33:08.353623+0000","last_unstale":"2024-09-13T19:37:37.451967+0000","last_undegraded":"2024-09-13T19:37:37.451967+0000","last_fullsized":"2024-09-13T19:37:37.451967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:37.451769+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:37.451769+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.451769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:59.810756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:12.608547+0000","last_change":"2024-09-13T19:38:12.608609+0000","last_active":"2024-09-13T19:38:12.608547+0000","last_peered":"2024-09-13T19:38:12.608547+0000","last_clean":"2024-09-13T19:38:12.608547+0000","last_became_active":"2024-09-13T19:33:00.602271+0000","last_became_peered":"2024-09-13T19:33:00.602271+0000","last_unstale":"2024-09-13T19:38:12.608547+0000","last_undegraded":"2024-09-13T19:38:12.608547+0000","last_fullsized":"2024-09-13T19:38:12.608547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:12.608344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:12.608344+0000","last_clean_scrub_stamp":"2024-09-13T19:38:12.608344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:17.095849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020781969999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.142377+0000","last_change":"2024-09-13T19:37:12.142377+0000","last_active":"2024-09-13T19:37:12.142377+0000","last_peered":"2024-09-13T19:37:12.142377+0000","last_clean":"2024-09-13T19:37:12.142377+0000","last_became_active":"2024-09-13T19:33:12.347143+0000","last_became_peered":"2024-09-13T19:33:12.347143+0000","last_unstale":"2024-09-13T19:37:12.142377+0000","last_undegraded":"2024-09-13T19:37:12.142377+0000","last_fullsized":"2024-09-13T19:37:12.142377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.142129+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.142129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:18.473708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'97","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.931606+0000","last_change":"2024-09-13T19:37:05.931606+0000","last_active":"2024-09-13T19:37:05.931606+0000","last_peered":"2024-09-13T19:37:05.931606+0000","last_clean":"2024-09-13T19:37:05.931606+0000","last_became_active":"2024-09-13T19:33:14.369616+0000","last_became_peered":"2024-09-13T19:33:14.369616+0000","last_unstale":"2024-09-13T19:37:05.931606+0000","last_undegraded":"2024-09-13T19:37:05.931606+0000","last_fullsized":"2024-09-13T19:37:05.931606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-09-13T19:37:05.931238+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.931238+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:45.454573+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:06.298133+0000","last_change":"2024-09-13T19:37:06.298133+0000","last_active":"2024-09-13T19:37:06.298133+0000","last_peered":"2024-09-13T19:37:06.298133+0000","last_clean":"2024-09-13T19:37:06.298133+0000","last_became_active":"2024-09-13T19:33:16.369722+0000","last_became_peered":"2024-09-13T19:33:16.369722+0000","last_unstale":"2024-09-13T19:37:06.298133+0000","last_undegraded":"2024-09-13T19:37:06.298133+0000","last_fullsized":"2024-09-13T19:37:06.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:06.297886+0000","last_clean_scrub_stamp":"2024-09-13T19:37:06.297886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:34.808071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.951529+0000","last_change":"2024-09-13T19:37:50.951589+0000","last_active":"2024-09-13T19:37:50.951529+0000","last_peered":"2024-09-13T19:37:50.951529+0000","last_clean":"2024-09-13T19:37:50.951529+0000","last_became_active":"2024-09-13T19:33:18.416486+0000","last_became_peered":"2024-09-13T19:33:18.416486+0000","last_unstale":"2024-09-13T19:37:50.951529+0000","last_undegraded":"2024-09-13T19:37:50.951529+0000","last_fullsized":"2024-09-13T19:37:50.951529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:50.951320+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:50.951320+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.951320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:33.076198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.911889+0000","last_change":"2024-09-13T19:37:47.912039+0000","last_active":"2024-09-13T19:37:47.911889+0000","last_peered":"2024-09-13T19:37:47.911889+0000","last_clean":"2024-09-13T19:37:47.911889+0000","last_became_active":"2024-09-13T19:33:18.412620+0000","last_became_peered":"2024-09-13T19:33:18.412620+0000","last_unstale":"2024-09-13T19:37:47.911889+0000","last_undegraded":"2024-09-13T19:37:47.911889+0000","last_fullsized":"2024-09-13T19:37:47.911889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:47.911667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:47.911667+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.911667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:14.853018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.934942+0000","last_change":"2024-09-13T19:37:29.934942+0000","last_active":"2024-09-13T19:37:29.934942+0000","last_peered":"2024-09-13T19:37:29.934942+0000","last_clean":"2024-09-13T19:37:29.934942+0000","last_became_active":"2024-09-13T19:33:10.336928+0000","last_became_peered":"2024-09-13T19:33:10.336928+0000","last_unstale":"2024-09-13T19:37:29.934942+0000","last_undegraded":"2024-09-13T19:37:29.934942+0000","last_fullsized":"2024-09-13T19:37:29.934942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:29.934579+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:29.934579+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.934579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:05.520975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.691055+0000","last_change":"2024-09-13T19:37:58.691122+0000","last_active":"2024-09-13T19:37:58.691055+0000","last_peered":"2024-09-13T19:37:58.691055+0000","last_clean":"2024-09-13T19:37:58.691055+0000","last_became_active":"2024-09-13T19:33:08.353697+0000","last_became_peered":"2024-09-13T19:33:08.353697+0000","last_unstale":"2024-09-13T19:37:58.691055+0000","last_undegraded":"2024-09-13T19:37:58.691055+0000","last_fullsized":"2024-09-13T19:37:58.691055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:58.690864+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:58.690864+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.690864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:13.639132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:19.615290+0000","last_change":"2024-09-13T19:37:19.615290+0000","last_active":"2024-09-13T19:37:19.615290+0000","last_peered":"2024-09-13T19:37:19.615290+0000","last_clean":"2024-09-13T19:37:19.615290+0000","last_became_active":"2024-09-13T19:33:12.348831+0000","last_became_peered":"2024-09-13T19:33:12.348831+0000","last_unstale":"2024-09-13T19:37:19.615290+0000","last_undegraded":"2024-09-13T19:37:19.615290+0000","last_fullsized":"2024-09-13T19:37:19.615290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:19.615030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:19.615030+0000","last_clean_scrub_stamp":"2024-09-13T19:37:19.615030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:23.322720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.156055+0000","last_change":"2024-09-13T19:37:11.156055+0000","last_active":"2024-09-13T19:37:11.156055+0000","last_peered":"2024-09-13T19:37:11.156055+0000","last_clean":"2024-09-13T19:37:11.156055+0000","last_became_active":"2024-09-13T19:33:14.375571+0000","last_became_peered":"2024-09-13T19:33:14.375571+0000","last_unstale":"2024-09-13T19:37:11.156055+0000","last_undegraded":"2024-09-13T19:37:11.156055+0000","last_fullsized":"2024-09-13T19:37:11.156055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:11.155624+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.155624+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:30.748402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.008931+0000","last_change":"2024-09-13T19:37:31.008931+0000","last_active":"2024-09-13T19:37:31.008931+0000","last_peered":"2024-09-13T19:37:31.008931+0000","last_clean":"2024-09-13T19:37:31.008931+0000","last_became_active":"2024-09-13T19:33:16.403031+0000","last_became_peered":"2024-09-13T19:33:16.403031+0000","last_unstale":"2024-09-13T19:37:31.008931+0000","last_undegraded":"2024-09-13T19:37:31.008931+0000","last_fullsized":"2024-09-13T19:37:31.008931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:31.008661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:31.008661+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.008661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:00.939978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.163660+0000","last_change":"2024-09-13T19:37:25.163723+0000","last_active":"2024-09-13T19:37:25.163660+0000","last_peered":"2024-09-13T19:37:25.163660+0000","last_clean":"2024-09-13T19:37:25.163660+0000","last_became_active":"2024-09-13T19:33:18.396335+0000","last_became_peered":"2024-09-13T19:33:18.396335+0000","last_unstale":"2024-09-13T19:37:25.163660+0000","last_undegraded":"2024-09-13T19:37:25.163660+0000","last_fullsized":"2024-09-13T19:37:25.163660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-13T19:37:25.163440+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-13T19:37:25.163440+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.163440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:32.363103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.618900+0000","last_change":"2024-09-13T19:37:22.618900+0000","last_active":"2024-09-13T19:37:22.618900+0000","last_peered":"2024-09-13T19:37:22.618900+0000","last_clean":"2024-09-13T19:37:22.618900+0000","last_became_active":"2024-09-13T19:33:10.357623+0000","last_became_peered":"2024-09-13T19:33:10.357623+0000","last_unstale":"2024-09-13T19:37:22.618900+0000","last_undegraded":"2024-09-13T19:37:22.618900+0000","last_fullsized":"2024-09-13T19:37:22.618900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:22.618647+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:22.618647+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.618647+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:22.194223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:24.922798+0000","last_change":"2024-09-13T19:37:24.922798+0000","last_active":"2024-09-13T19:37:24.922798+0000","last_peered":"2024-09-13T19:37:24.922798+0000","last_clean":"2024-09-13T19:37:24.922798+0000","last_became_active":"2024-09-13T19:33:08.352663+0000","last_became_peered":"2024-09-13T19:33:08.352663+0000","last_unstale":"2024-09-13T19:37:24.922798+0000","last_undegraded":"2024-09-13T19:37:24.922798+0000","last_fullsized":"2024-09-13T19:37:24.922798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:24.922556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:24.922556+0000","last_clean_scrub_stamp":"2024-09-13T19:37:24.922556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:12.432860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:23.512119+0000","last_change":"2024-09-13T19:38:23.512175+0000","last_active":"2024-09-13T19:38:23.512119+0000","last_peered":"2024-09-13T19:38:23.512119+0000","last_clean":"2024-09-13T19:38:23.512119+0000","last_became_active":"2024-09-13T19:33:49.530223+0000","last_became_peered":"2024-09-13T19:33:49.530223+0000","last_unstale":"2024-09-13T19:38:23.512119+0000","last_undegraded":"2024-09-13T19:38:23.512119+0000","last_fullsized":"2024-09-13T19:38:23.512119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:23.511924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:23.511924+0000","last_clean_scrub_stamp":"2024-09-13T19:38:23.511924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:08.751696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:10.197029+0000","last_change":"2024-09-13T19:37:10.197029+0000","last_active":"2024-09-13T19:37:10.197029+0000","last_peered":"2024-09-13T19:37:10.197029+0000","last_clean":"2024-09-13T19:37:10.197029+0000","last_became_active":"2024-09-13T19:33:14.353510+0000","last_became_peered":"2024-09-13T19:33:14.353510+0000","last_unstale":"2024-09-13T19:37:10.197029+0000","last_undegraded":"2024-09-13T19:37:10.197029+0000","last_fullsized":"2024-09-13T19:37:10.197029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:10.196773+0000","last_clean_scrub_stamp":"2024-09-13T19:37:10.196773+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:26.963041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:00.867223+0000","last_change":"2024-09-13T19:37:00.867223+0000","last_active":"2024-09-13T19:37:00.867223+0000","last_peered":"2024-09-13T19:37:00.867223+0000","last_clean":"2024-09-13T19:37:00.867223+0000","last_became_active":"2024-09-13T19:33:16.381847+0000","last_became_peered":"2024-09-13T19:33:16.381847+0000","last_unstale":"2024-09-13T19:37:00.867223+0000","last_undegraded":"2024-09-13T19:37:00.867223+0000","last_fullsized":"2024-09-13T19:37:00.867223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:00.866964+0000","last_clean_scrub_stamp":"2024-09-13T19:37:00.866964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:18.237819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:00.200351+0000","last_change":"2024-09-13T19:38:00.200351+0000","last_active":"2024-09-13T19:38:00.200351+0000","last_peered":"2024-09-13T19:38:00.200351+0000","last_clean":"2024-09-13T19:38:00.200351+0000","last_became_active":"2024-09-13T19:33:18.414759+0000","last_became_peered":"2024-09-13T19:33:18.414759+0000","last_unstale":"2024-09-13T19:38:00.200351+0000","last_undegraded":"2024-09-13T19:38:00.200351+0000","last_fullsized":"2024-09-13T19:38:00.200351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:00.200003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:00.200003+0000","last_clean_scrub_stamp":"2024-09-13T19:38:00.200003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:00.343300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'18","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.069534+0000","last_change":"2024-09-13T19:37:41.069534+0000","last_active":"2024-09-13T19:37:41.069534+0000","last_peered":"2024-09-13T19:37:41.069534+0000","last_clean":"2024-09-13T19:37:41.069534+0000","last_became_active":"2024-09-13T19:33:10.338689+0000","last_became_peered":"2024-09-13T19:33:10.338689+0000","last_unstale":"2024-09-13T19:37:41.069534+0000","last_undegraded":"2024-09-13T19:37:41.069534+0000","last_fullsized":"2024-09-13T19:37:41.069534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-09-13T19:37:41.069170+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-09-13T19:37:41.069170+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.069170+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:18.063054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.060765+0000","last_change":"2024-09-13T19:37:37.060765+0000","last_active":"2024-09-13T19:37:37.060765+0000","last_peered":"2024-09-13T19:37:37.060765+0000","last_clean":"2024-09-13T19:37:37.060765+0000","last_became_active":"2024-09-13T19:33:08.348342+0000","last_became_peered":"2024-09-13T19:33:08.348342+0000","last_unstale":"2024-09-13T19:37:37.060765+0000","last_undegraded":"2024-09-13T19:37:37.060765+0000","last_fullsized":"2024-09-13T19:37:37.060765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:37.060494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:37.060494+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.060494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:44.260157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.795551+0000","last_change":"2024-09-13T19:37:14.795551+0000","last_active":"2024-09-13T19:37:14.795551+0000","last_peered":"2024-09-13T19:37:14.795551+0000","last_clean":"2024-09-13T19:37:14.795551+0000","last_became_active":"2024-09-13T19:33:12.354892+0000","last_became_peered":"2024-09-13T19:33:12.354892+0000","last_unstale":"2024-09-13T19:37:14.795551+0000","last_undegraded":"2024-09-13T19:37:14.795551+0000","last_fullsized":"2024-09-13T19:37:14.795551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:14.795303+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.795303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:39.429169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'48","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.298241+0000","last_change":"2024-09-13T19:37:07.298241+0000","last_active":"2024-09-13T19:37:07.298241+0000","last_peered":"2024-09-13T19:37:07.298241+0000","last_clean":"2024-09-13T19:37:07.298241+0000","last_became_active":"2024-09-13T19:33:14.360931+0000","last_became_peered":"2024-09-13T19:33:14.360931+0000","last_unstale":"2024-09-13T19:37:07.298241+0000","last_undegraded":"2024-09-13T19:37:07.298241+0000","last_fullsized":"2024-09-13T19:37:07.298241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-13T19:37:07.297980+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.297980+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.187946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:03.510102+0000","last_change":"2024-09-13T19:37:03.510102+0000","last_active":"2024-09-13T19:37:03.510102+0000","last_peered":"2024-09-13T19:37:03.510102+0000","last_clean":"2024-09-13T19:37:03.510102+0000","last_became_active":"2024-09-13T19:33:16.373751+0000","last_became_peered":"2024-09-13T19:33:16.373751+0000","last_unstale":"2024-09-13T19:37:03.510102+0000","last_undegraded":"2024-09-13T19:37:03.510102+0000","last_fullsized":"2024-09-13T19:37:03.510102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:03.509824+0000","last_clean_scrub_stamp":"2024-09-13T19:37:03.509824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.172352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:21.518442+0000","last_change":"2024-09-13T19:38:21.518497+0000","last_active":"2024-09-13T19:38:21.518442+0000","last_peered":"2024-09-13T19:38:21.518442+0000","last_clean":"2024-09-13T19:38:21.518442+0000","last_became_active":"2024-09-13T19:33:18.419327+0000","last_became_peered":"2024-09-13T19:33:18.419327+0000","last_unstale":"2024-09-13T19:38:21.518442+0000","last_undegraded":"2024-09-13T19:38:21.518442+0000","last_fullsized":"2024-09-13T19:38:21.518442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:21.518241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:21.518241+0000","last_clean_scrub_stamp":"2024-09-13T19:38:21.518241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:25.596026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'14","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:44.850067+0000","last_change":"2024-09-13T19:37:44.850067+0000","last_active":"2024-09-13T19:37:44.850067+0000","last_peered":"2024-09-13T19:37:44.850067+0000","last_clean":"2024-09-13T19:37:44.850067+0000","last_became_active":"2024-09-13T19:33:10.348552+0000","last_became_peered":"2024-09-13T19:33:10.348552+0000","last_unstale":"2024-09-13T19:37:44.850067+0000","last_undegraded":"2024-09-13T19:37:44.850067+0000","last_fullsized":"2024-09-13T19:37:44.850067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:44.849657+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:44.849657+0000","last_clean_scrub_stamp":"2024-09-13T19:37:44.849657+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:25.922372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:57.578287+0000","last_change":"2024-09-13T19:37:57.578287+0000","last_active":"2024-09-13T19:37:57.578287+0000","last_peered":"2024-09-13T19:37:57.578287+0000","last_clean":"2024-09-13T19:37:57.578287+0000","last_became_active":"2024-09-13T19:33:49.518531+0000","last_became_peered":"2024-09-13T19:33:49.518531+0000","last_unstale":"2024-09-13T19:37:57.578287+0000","last_undegraded":"2024-09-13T19:37:57.578287+0000","last_fullsized":"2024-09-13T19:37:57.578287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:57.578043+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:57.578043+0000","last_clean_scrub_stamp":"2024-09-13T19:37:57.578043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:23.544482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.122142+0000","last_change":"2024-09-13T19:37:01.122142+0000","last_active":"2024-09-13T19:37:01.122142+0000","last_peered":"2024-09-13T19:37:01.122142+0000","last_clean":"2024-09-13T19:37:01.122142+0000","last_became_active":"2024-09-13T19:33:12.357711+0000","last_became_peered":"2024-09-13T19:33:12.357711+0000","last_unstale":"2024-09-13T19:37:01.122142+0000","last_undegraded":"2024-09-13T19:37:01.122142+0000","last_fullsized":"2024-09-13T19:37:01.122142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:01.121885+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.121885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:18.346905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:09.862096+0000","last_change":"2024-09-13T19:37:09.862096+0000","last_active":"2024-09-13T19:37:09.862096+0000","last_peered":"2024-09-13T19:37:09.862096+0000","last_clean":"2024-09-13T19:37:09.862096+0000","last_became_active":"2024-09-13T19:33:14.358017+0000","last_became_peered":"2024-09-13T19:33:14.358017+0000","last_unstale":"2024-09-13T19:37:09.862096+0000","last_undegraded":"2024-09-13T19:37:09.862096+0000","last_fullsized":"2024-09-13T19:37:09.862096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-09-13T19:37:09.861787+0000","last_clean_scrub_stamp":"2024-09-13T19:37:09.861787+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:30.468598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.893029+0000","last_change":"2024-09-13T19:36:59.893029+0000","last_active":"2024-09-13T19:36:59.893029+0000","last_peered":"2024-09-13T19:36:59.893029+0000","last_clean":"2024-09-13T19:36:59.893029+0000","last_became_active":"2024-09-13T19:33:16.378201+0000","last_became_peered":"2024-09-13T19:33:16.378201+0000","last_unstale":"2024-09-13T19:36:59.893029+0000","last_undegraded":"2024-09-13T19:36:59.893029+0000","last_fullsized":"2024-09-13T19:36:59.893029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.892784+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.892784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:26.796881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.922723+0000","last_change":"2024-09-13T19:37:33.922792+0000","last_active":"2024-09-13T19:37:33.922723+0000","last_peered":"2024-09-13T19:37:33.922723+0000","last_clean":"2024-09-13T19:37:33.922723+0000","last_became_active":"2024-09-13T19:33:10.354795+0000","last_became_peered":"2024-09-13T19:33:10.354795+0000","last_unstale":"2024-09-13T19:37:33.922723+0000","last_undegraded":"2024-09-13T19:37:33.922723+0000","last_fullsized":"2024-09-13T19:37:33.922723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:33.922489+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:33.922489+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.922489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:49.484234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:01.606826+0000","last_change":"2024-09-13T19:38:01.606889+0000","last_active":"2024-09-13T19:38:01.606826+0000","last_peered":"2024-09-13T19:38:01.606826+0000","last_clean":"2024-09-13T19:38:01.606826+0000","last_became_active":"2024-09-13T19:33:08.337512+0000","last_became_peered":"2024-09-13T19:33:08.337512+0000","last_unstale":"2024-09-13T19:38:01.606826+0000","last_undegraded":"2024-09-13T19:38:01.606826+0000","last_fullsized":"2024-09-13T19:38:01.606826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:38:01.606632+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:38:01.606632+0000","last_clean_scrub_stamp":"2024-09-13T19:38:01.606632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:54.048934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.250956+0000","last_change":"2024-09-13T19:37:16.251010+0000","last_active":"2024-09-13T19:37:16.250956+0000","last_peered":"2024-09-13T19:37:16.250956+0000","last_clean":"2024-09-13T19:37:16.250956+0000","last_became_active":"2024-09-13T19:33:12.353184+0000","last_became_peered":"2024-09-13T19:33:12.353184+0000","last_unstale":"2024-09-13T19:37:16.250956+0000","last_undegraded":"2024-09-13T19:37:16.250956+0000","last_fullsized":"2024-09-13T19:37:16.250956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:16.250752+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.250752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:17.682001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'66","reported_seq":140,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.201490+0000","last_change":"2024-09-13T19:37:12.201490+0000","last_active":"2024-09-13T19:37:12.201490+0000","last_peered":"2024-09-13T19:37:12.201490+0000","last_clean":"2024-09-13T19:37:12.201490+0000","last_became_active":"2024-09-13T19:33:14.352953+0000","last_became_peered":"2024-09-13T19:33:14.352953+0000","last_unstale":"2024-09-13T19:37:12.201490+0000","last_undegraded":"2024-09-13T19:37:12.201490+0000","last_fullsized":"2024-09-13T19:37:12.201490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-13T19:37:12.201193+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.201193+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:16.321625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:11.836514+0000","last_change":"2024-09-13T19:37:11.836514+0000","last_active":"2024-09-13T19:37:11.836514+0000","last_peered":"2024-09-13T19:37:11.836514+0000","last_clean":"2024-09-13T19:37:11.836514+0000","last_became_active":"2024-09-13T19:33:16.389600+0000","last_became_peered":"2024-09-13T19:33:16.389600+0000","last_unstale":"2024-09-13T19:37:11.836514+0000","last_undegraded":"2024-09-13T19:37:11.836514+0000","last_fullsized":"2024-09-13T19:37:11.836514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:11.836187+0000","last_clean_scrub_stamp":"2024-09-13T19:37:11.836187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:55.223762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:58.222153+0000","last_change":"2024-09-13T19:37:58.222153+0000","last_active":"2024-09-13T19:37:58.222153+0000","last_peered":"2024-09-13T19:37:58.222153+0000","last_clean":"2024-09-13T19:37:58.222153+0000","last_became_active":"2024-09-13T19:33:18.414902+0000","last_became_peered":"2024-09-13T19:33:18.414902+0000","last_unstale":"2024-09-13T19:37:58.222153+0000","last_undegraded":"2024-09-13T19:37:58.222153+0000","last_fullsized":"2024-09-13T19:37:58.222153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:58.221901+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:58.221901+0000","last_clean_scrub_stamp":"2024-09-13T19:37:58.221901+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:01.482512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.164238+0000","last_change":"2024-09-13T19:37:26.164322+0000","last_active":"2024-09-13T19:37:26.164238+0000","last_peered":"2024-09-13T19:37:26.164238+0000","last_clean":"2024-09-13T19:37:26.164238+0000","last_became_active":"2024-09-13T19:33:10.347846+0000","last_became_peered":"2024-09-13T19:33:10.347846+0000","last_unstale":"2024-09-13T19:37:26.164238+0000","last_undegraded":"2024-09-13T19:37:26.164238+0000","last_fullsized":"2024-09-13T19:37:26.164238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:26.164044+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:26.164044+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.164044+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:08.108354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.551251+0000","last_change":"2024-09-13T19:37:50.551251+0000","last_active":"2024-09-13T19:37:50.551251+0000","last_peered":"2024-09-13T19:37:50.551251+0000","last_clean":"2024-09-13T19:37:50.551251+0000","last_became_active":"2024-09-13T19:33:08.336906+0000","last_became_peered":"2024-09-13T19:33:08.336906+0000","last_unstale":"2024-09-13T19:37:50.551251+0000","last_undegraded":"2024-09-13T19:37:50.551251+0000","last_fullsized":"2024-09-13T19:37:50.551251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:50.550963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:50.550963+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.550963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:20.482280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.878321+0000","last_change":"2024-09-13T19:37:18.878321+0000","last_active":"2024-09-13T19:37:18.878321+0000","last_peered":"2024-09-13T19:37:18.878321+0000","last_clean":"2024-09-13T19:37:18.878321+0000","last_became_active":"2024-09-13T19:33:12.351077+0000","last_became_peered":"2024-09-13T19:33:12.351077+0000","last_unstale":"2024-09-13T19:37:18.878321+0000","last_undegraded":"2024-09-13T19:37:18.878321+0000","last_fullsized":"2024-09-13T19:37:18.878321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.878068+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.878068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:11.266511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.006370+0000","last_change":"2024-09-13T19:37:30.006370+0000","last_active":"2024-09-13T19:37:30.006370+0000","last_peered":"2024-09-13T19:37:30.006370+0000","last_clean":"2024-09-13T19:37:30.006370+0000","last_became_active":"2024-09-13T19:33:14.385971+0000","last_became_peered":"2024-09-13T19:33:14.385971+0000","last_unstale":"2024-09-13T19:37:30.006370+0000","last_undegraded":"2024-09-13T19:37:30.006370+0000","last_fullsized":"2024-09-13T19:37:30.006370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-13T19:37:30.006093+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-13T19:37:30.006093+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.006093+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:55.908367+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.465714+0000","last_change":"2024-09-13T19:37:02.465714+0000","last_active":"2024-09-13T19:37:02.465714+0000","last_peered":"2024-09-13T19:37:02.465714+0000","last_clean":"2024-09-13T19:37:02.465714+0000","last_became_active":"2024-09-13T19:33:16.382049+0000","last_became_peered":"2024-09-13T19:33:16.382049+0000","last_unstale":"2024-09-13T19:37:02.465714+0000","last_undegraded":"2024-09-13T19:37:02.465714+0000","last_fullsized":"2024-09-13T19:37:02.465714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.465336+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.465336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.671030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.824868+0000","last_change":"2024-09-13T19:37:50.824868+0000","last_active":"2024-09-13T19:37:50.824868+0000","last_peered":"2024-09-13T19:37:50.824868+0000","last_clean":"2024-09-13T19:37:50.824868+0000","last_became_active":"2024-09-13T19:33:18.414118+0000","last_became_peered":"2024-09-13T19:33:18.414118+0000","last_unstale":"2024-09-13T19:37:50.824868+0000","last_undegraded":"2024-09-13T19:37:50.824868+0000","last_fullsized":"2024-09-13T19:37:50.824868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:50.824629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:50.824629+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.824629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:16.055391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:16.118224+0000","last_change":"2024-09-13T19:37:16.118224+0000","last_active":"2024-09-13T19:37:16.118224+0000","last_peered":"2024-09-13T19:37:16.118224+0000","last_clean":"2024-09-13T19:37:16.118224+0000","last_became_active":"2024-09-13T19:33:10.357862+0000","last_became_peered":"2024-09-13T19:33:10.357862+0000","last_unstale":"2024-09-13T19:37:16.118224+0000","last_undegraded":"2024-09-13T19:37:16.118224+0000","last_fullsized":"2024-09-13T19:37:16.118224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:16.117977+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:16.117977+0000","last_clean_scrub_stamp":"2024-09-13T19:37:16.117977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.935807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.533216+0000","last_change":"2024-09-13T19:37:49.533216+0000","last_active":"2024-09-13T19:37:49.533216+0000","last_peered":"2024-09-13T19:37:49.533216+0000","last_clean":"2024-09-13T19:37:49.533216+0000","last_became_active":"2024-09-13T19:33:08.335232+0000","last_became_peered":"2024-09-13T19:33:08.335232+0000","last_unstale":"2024-09-13T19:37:49.533216+0000","last_undegraded":"2024-09-13T19:37:49.533216+0000","last_fullsized":"2024-09-13T19:37:49.533216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:49.532974+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.532974+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.532974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:15.435248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.846985+0000","last_change":"2024-09-13T19:37:17.846985+0000","last_active":"2024-09-13T19:37:17.846985+0000","last_peered":"2024-09-13T19:37:17.846985+0000","last_clean":"2024-09-13T19:37:17.846985+0000","last_became_active":"2024-09-13T19:33:12.351330+0000","last_became_peered":"2024-09-13T19:33:12.351330+0000","last_unstale":"2024-09-13T19:37:17.846985+0000","last_undegraded":"2024-09-13T19:37:17.846985+0000","last_fullsized":"2024-09-13T19:37:17.846985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.846741+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.846741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:49.584937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:08.250550+0000","last_change":"2024-09-13T19:37:08.250550+0000","last_active":"2024-09-13T19:37:08.250550+0000","last_peered":"2024-09-13T19:37:08.250550+0000","last_clean":"2024-09-13T19:37:08.250550+0000","last_became_active":"2024-09-13T19:33:14.356032+0000","last_became_peered":"2024-09-13T19:33:14.356032+0000","last_unstale":"2024-09-13T19:37:08.250550+0000","last_undegraded":"2024-09-13T19:37:08.250550+0000","last_fullsized":"2024-09-13T19:37:08.250550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-13T19:37:08.250286+0000","last_clean_scrub_stamp":"2024-09-13T19:37:08.250286+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:19.511817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:17.299423+0000","last_change":"2024-09-13T19:37:17.299423+0000","last_active":"2024-09-13T19:37:17.299423+0000","last_peered":"2024-09-13T19:37:17.299423+0000","last_clean":"2024-09-13T19:37:17.299423+0000","last_became_active":"2024-09-13T19:33:16.391293+0000","last_became_peered":"2024-09-13T19:33:16.391293+0000","last_unstale":"2024-09-13T19:37:17.299423+0000","last_undegraded":"2024-09-13T19:37:17.299423+0000","last_fullsized":"2024-09-13T19:37:17.299423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:17.299176+0000","last_clean_scrub_stamp":"2024-09-13T19:37:17.299176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:11.887369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.867645+0000","last_change":"2024-09-13T19:37:42.867645+0000","last_active":"2024-09-13T19:37:42.867645+0000","last_peered":"2024-09-13T19:37:42.867645+0000","last_clean":"2024-09-13T19:37:42.867645+0000","last_became_active":"2024-09-13T19:33:18.413249+0000","last_became_peered":"2024-09-13T19:33:18.413249+0000","last_unstale":"2024-09-13T19:37:42.867645+0000","last_undegraded":"2024-09-13T19:37:42.867645+0000","last_fullsized":"2024-09-13T19:37:42.867645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:42.867391+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:42.867391+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.867391+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:28.444269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.170330+0000","last_change":"2024-09-13T19:37:27.170330+0000","last_active":"2024-09-13T19:37:27.170330+0000","last_peered":"2024-09-13T19:37:27.170330+0000","last_clean":"2024-09-13T19:37:27.170330+0000","last_became_active":"2024-09-13T19:33:10.346452+0000","last_became_peered":"2024-09-13T19:33:10.346452+0000","last_unstale":"2024-09-13T19:37:27.170330+0000","last_undegraded":"2024-09-13T19:37:27.170330+0000","last_fullsized":"2024-09-13T19:37:27.170330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:27.170072+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:27.170072+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.170072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:51.374174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:59.660359+0000","last_change":"2024-09-13T19:37:59.660359+0000","last_active":"2024-09-13T19:37:59.660359+0000","last_peered":"2024-09-13T19:37:59.660359+0000","last_clean":"2024-09-13T19:37:59.660359+0000","last_became_active":"2024-09-13T19:33:08.340358+0000","last_became_peered":"2024-09-13T19:33:08.340358+0000","last_unstale":"2024-09-13T19:37:59.660359+0000","last_undegraded":"2024-09-13T19:37:59.660359+0000","last_fullsized":"2024-09-13T19:37:59.660359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-13T19:37:59.660109+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-13T19:37:59.660109+0000","last_clean_scrub_stamp":"2024-09-13T19:37:59.660109+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.572890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:21.667320+0000","last_change":"2024-09-13T19:37:21.667320+0000","last_active":"2024-09-13T19:37:21.667320+0000","last_peered":"2024-09-13T19:37:21.667320+0000","last_clean":"2024-09-13T19:37:21.667320+0000","last_became_active":"2024-09-13T19:33:12.348856+0000","last_became_peered":"2024-09-13T19:33:12.348856+0000","last_unstale":"2024-09-13T19:37:21.667320+0000","last_undegraded":"2024-09-13T19:37:21.667320+0000","last_fullsized":"2024-09-13T19:37:21.667320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:21.666993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:21.666993+0000","last_clean_scrub_stamp":"2024-09-13T19:37:21.666993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:40.253116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:29.027267+0000","last_change":"2024-09-13T19:37:29.027432+0000","last_active":"2024-09-13T19:37:29.027267+0000","last_peered":"2024-09-13T19:37:29.027267+0000","last_clean":"2024-09-13T19:37:29.027267+0000","last_became_active":"2024-09-13T19:33:14.390888+0000","last_became_peered":"2024-09-13T19:33:14.390888+0000","last_unstale":"2024-09-13T19:37:29.027267+0000","last_undegraded":"2024-09-13T19:37:29.027267+0000","last_fullsized":"2024-09-13T19:37:29.027267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-13T19:37:29.027005+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-13T19:37:29.027005+0000","last_clean_scrub_stamp":"2024-09-13T19:37:29.027005+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:23.111450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":420,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:01.871065+0000","last_change":"2024-09-13T19:37:01.871065+0000","last_active":"2024-09-13T19:37:01.871065+0000","last_peered":"2024-09-13T19:37:01.871065+0000","last_clean":"2024-09-13T19:37:01.871065+0000","last_became_active":"2024-09-13T19:33:16.381688+0000","last_became_peered":"2024-09-13T19:33:16.381688+0000","last_unstale":"2024-09-13T19:37:01.871065+0000","last_undegraded":"2024-09-13T19:37:01.871065+0000","last_fullsized":"2024-09-13T19:37:01.871065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-09-13T19:37:01.870803+0000","last_clean_scrub_stamp":"2024-09-13T19:37:01.870803+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:04.118178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"30'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:19.479692+0000","last_change":"2024-09-13T19:38:19.479756+0000","last_active":"2024-09-13T19:38:19.479692+0000","last_peered":"2024-09-13T19:38:19.479692+0000","last_clean":"2024-09-13T19:38:19.479692+0000","last_became_active":"2024-09-13T19:33:18.417287+0000","last_became_peered":"2024-09-13T19:33:18.417287+0000","last_unstale":"2024-09-13T19:38:19.479692+0000","last_undegraded":"2024-09-13T19:38:19.479692+0000","last_fullsized":"2024-09-13T19:38:19.479692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:38:19.479475+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:38:19.479475+0000","last_clean_scrub_stamp":"2024-09-13T19:38:19.479475+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:15.019171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.914489+0000","last_change":"2024-09-13T19:37:25.914489+0000","last_active":"2024-09-13T19:37:25.914489+0000","last_peered":"2024-09-13T19:37:25.914489+0000","last_clean":"2024-09-13T19:37:25.914489+0000","last_became_active":"2024-09-13T19:33:10.335705+0000","last_became_peered":"2024-09-13T19:33:10.335705+0000","last_unstale":"2024-09-13T19:37:25.914489+0000","last_undegraded":"2024-09-13T19:37:25.914489+0000","last_fullsized":"2024-09-13T19:37:25.914489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:25.914351+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:25.914351+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.914351+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:13.683898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:45.472385+0000","last_change":"2024-09-13T19:37:45.472385+0000","last_active":"2024-09-13T19:37:45.472385+0000","last_peered":"2024-09-13T19:37:45.472385+0000","last_clean":"2024-09-13T19:37:45.472385+0000","last_became_active":"2024-09-13T19:33:08.337515+0000","last_became_peered":"2024-09-13T19:33:08.337515+0000","last_unstale":"2024-09-13T19:37:45.472385+0000","last_undegraded":"2024-09-13T19:37:45.472385+0000","last_fullsized":"2024-09-13T19:37:45.472385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:45.472142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:45.472142+0000","last_clean_scrub_stamp":"2024-09-13T19:37:45.472142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:11.674746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.580839+0000","last_change":"2024-09-13T19:37:18.580839+0000","last_active":"2024-09-13T19:37:18.580839+0000","last_peered":"2024-09-13T19:37:18.580839+0000","last_clean":"2024-09-13T19:37:18.580839+0000","last_became_active":"2024-09-13T19:33:12.352328+0000","last_became_peered":"2024-09-13T19:33:12.352328+0000","last_unstale":"2024-09-13T19:37:18.580839+0000","last_undegraded":"2024-09-13T19:37:18.580839+0000","last_fullsized":"2024-09-13T19:37:18.580839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:18.580585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:18.580585+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.580585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:54.166980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:07.504071+0000","last_change":"2024-09-13T19:37:07.504071+0000","last_active":"2024-09-13T19:37:07.504071+0000","last_peered":"2024-09-13T19:37:07.504071+0000","last_clean":"2024-09-13T19:37:07.504071+0000","last_became_active":"2024-09-13T19:33:14.365314+0000","last_became_peered":"2024-09-13T19:33:14.365314+0000","last_unstale":"2024-09-13T19:37:07.504071+0000","last_undegraded":"2024-09-13T19:37:07.504071+0000","last_fullsized":"2024-09-13T19:37:07.504071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-09-13T19:37:07.503821+0000","last_clean_scrub_stamp":"2024-09-13T19:37:07.503821+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:21.393786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:02.318463+0000","last_change":"2024-09-13T19:37:02.318463+0000","last_active":"2024-09-13T19:37:02.318463+0000","last_peered":"2024-09-13T19:37:02.318463+0000","last_clean":"2024-09-13T19:37:02.318463+0000","last_became_active":"2024-09-13T19:33:16.374571+0000","last_became_peered":"2024-09-13T19:33:16.374571+0000","last_unstale":"2024-09-13T19:37:02.318463+0000","last_undegraded":"2024-09-13T19:37:02.318463+0000","last_fullsized":"2024-09-13T19:37:02.318463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:02.318220+0000","last_clean_scrub_stamp":"2024-09-13T19:37:02.318220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:12.609892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:56.553453+0000","last_change":"2024-09-13T19:37:56.553453+0000","last_active":"2024-09-13T19:37:56.553453+0000","last_peered":"2024-09-13T19:37:56.553453+0000","last_clean":"2024-09-13T19:37:56.553453+0000","last_became_active":"2024-09-13T19:33:18.424655+0000","last_became_peered":"2024-09-13T19:33:18.424655+0000","last_unstale":"2024-09-13T19:37:56.553453+0000","last_undegraded":"2024-09-13T19:37:56.553453+0000","last_fullsized":"2024-09-13T19:37:56.553453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:56.553171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:56.553171+0000","last_clean_scrub_stamp":"2024-09-13T19:37:56.553171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:57.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.014422+0000","last_change":"2024-09-13T19:37:32.014422+0000","last_active":"2024-09-13T19:37:32.014422+0000","last_peered":"2024-09-13T19:37:32.014422+0000","last_clean":"2024-09-13T19:37:32.014422+0000","last_became_active":"2024-09-13T19:33:10.335759+0000","last_became_peered":"2024-09-13T19:33:10.335759+0000","last_unstale":"2024-09-13T19:37:32.014422+0000","last_undegraded":"2024-09-13T19:37:32.014422+0000","last_fullsized":"2024-09-13T19:37:32.014422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:32.014177+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:32.014177+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.014177+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.161530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.864702+0000","last_change":"2024-09-13T19:37:49.864702+0000","last_active":"2024-09-13T19:37:49.864702+0000","last_peered":"2024-09-13T19:37:49.864702+0000","last_clean":"2024-09-13T19:37:49.864702+0000","last_became_active":"2024-09-13T19:33:08.357826+0000","last_became_peered":"2024-09-13T19:33:08.357826+0000","last_unstale":"2024-09-13T19:37:49.864702+0000","last_undegraded":"2024-09-13T19:37:49.864702+0000","last_fullsized":"2024-09-13T19:37:49.864702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:49.864324+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.864324+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.864324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:22.170482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:12.865947+0000","last_change":"2024-09-13T19:37:12.865947+0000","last_active":"2024-09-13T19:37:12.865947+0000","last_peered":"2024-09-13T19:37:12.865947+0000","last_clean":"2024-09-13T19:37:12.865947+0000","last_became_active":"2024-09-13T19:33:12.357434+0000","last_became_peered":"2024-09-13T19:33:12.357434+0000","last_unstale":"2024-09-13T19:37:12.865947+0000","last_undegraded":"2024-09-13T19:37:12.865947+0000","last_fullsized":"2024-09-13T19:37:12.865947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:12.865683+0000","last_clean_scrub_stamp":"2024-09-13T19:37:12.865683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.157355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:14.252058+0000","last_change":"2024-09-13T19:37:14.252058+0000","last_active":"2024-09-13T19:37:14.252058+0000","last_peered":"2024-09-13T19:37:14.252058+0000","last_clean":"2024-09-13T19:37:14.252058+0000","last_became_active":"2024-09-13T19:33:14.352233+0000","last_became_peered":"2024-09-13T19:33:14.352233+0000","last_unstale":"2024-09-13T19:37:14.252058+0000","last_undegraded":"2024-09-13T19:37:14.252058+0000","last_fullsized":"2024-09-13T19:37:14.252058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-09-13T19:37:14.251796+0000","last_clean_scrub_stamp":"2024-09-13T19:37:14.251796+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.000429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:22.120297+0000","last_change":"2024-09-13T19:37:22.120297+0000","last_active":"2024-09-13T19:37:22.120297+0000","last_peered":"2024-09-13T19:37:22.120297+0000","last_clean":"2024-09-13T19:37:22.120297+0000","last_became_active":"2024-09-13T19:33:16.400221+0000","last_became_peered":"2024-09-13T19:33:16.400221+0000","last_unstale":"2024-09-13T19:37:22.120297+0000","last_undegraded":"2024-09-13T19:37:22.120297+0000","last_fullsized":"2024-09-13T19:37:22.120297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:22.120047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:22.120047+0000","last_clean_scrub_stamp":"2024-09-13T19:37:22.120047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:39.824427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:22.513443+0000","last_change":"2024-09-13T19:38:22.513561+0000","last_active":"2024-09-13T19:38:22.513443+0000","last_peered":"2024-09-13T19:38:22.513443+0000","last_clean":"2024-09-13T19:38:22.513443+0000","last_became_active":"2024-09-13T19:33:18.423666+0000","last_became_peered":"2024-09-13T19:33:18.423666+0000","last_unstale":"2024-09-13T19:38:22.513443+0000","last_undegraded":"2024-09-13T19:38:22.513443+0000","last_fullsized":"2024-09-13T19:38:22.513443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:22.513184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:22.513184+0000","last_clean_scrub_stamp":"2024-09-13T19:38:22.513184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:07.307350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:48.876192+0000","last_change":"2024-09-13T19:37:48.876192+0000","last_active":"2024-09-13T19:37:48.876192+0000","last_peered":"2024-09-13T19:37:48.876192+0000","last_clean":"2024-09-13T19:37:48.876192+0000","last_became_active":"2024-09-13T19:33:10.346399+0000","last_became_peered":"2024-09-13T19:33:10.346399+0000","last_unstale":"2024-09-13T19:37:48.876192+0000","last_undegraded":"2024-09-13T19:37:48.876192+0000","last_fullsized":"2024-09-13T19:37:48.876192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:48.875767+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:48.875767+0000","last_clean_scrub_stamp":"2024-09-13T19:37:48.875767+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:54.957655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:34.148982+0000","last_change":"2024-09-13T19:37:34.149044+0000","last_active":"2024-09-13T19:37:34.148982+0000","last_peered":"2024-09-13T19:37:34.148982+0000","last_clean":"2024-09-13T19:37:34.148982+0000","last_became_active":"2024-09-13T19:33:08.349011+0000","last_became_peered":"2024-09-13T19:33:08.349011+0000","last_unstale":"2024-09-13T19:37:34.148982+0000","last_undegraded":"2024-09-13T19:37:34.148982+0000","last_fullsized":"2024-09-13T19:37:34.148982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:34.148784+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:34.148784+0000","last_clean_scrub_stamp":"2024-09-13T19:37:34.148784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:52.146325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:15.541626+0000","last_change":"2024-09-13T19:37:15.541626+0000","last_active":"2024-09-13T19:37:15.541626+0000","last_peered":"2024-09-13T19:37:15.541626+0000","last_clean":"2024-09-13T19:37:15.541626+0000","last_became_active":"2024-09-13T19:33:12.359570+0000","last_became_peered":"2024-09-13T19:33:12.359570+0000","last_unstale":"2024-09-13T19:37:15.541626+0000","last_undegraded":"2024-09-13T19:37:15.541626+0000","last_fullsized":"2024-09-13T19:37:15.541626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:15.541376+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:15.541376+0000","last_clean_scrub_stamp":"2024-09-13T19:37:15.541376+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.495683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.117296+0000","last_change":"2024-09-13T19:37:13.117296+0000","last_active":"2024-09-13T19:37:13.117296+0000","last_peered":"2024-09-13T19:37:13.117296+0000","last_clean":"2024-09-13T19:37:13.117296+0000","last_became_active":"2024-09-13T19:33:14.380252+0000","last_became_peered":"2024-09-13T19:33:14.380252+0000","last_unstale":"2024-09-13T19:37:13.117296+0000","last_undegraded":"2024-09-13T19:37:13.117296+0000","last_fullsized":"2024-09-13T19:37:13.117296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-09-13T19:37:13.117012+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.117012+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:54.888683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:26.982763+0000","last_change":"2024-09-13T19:37:26.982763+0000","last_active":"2024-09-13T19:37:26.982763+0000","last_peered":"2024-09-13T19:37:26.982763+0000","last_clean":"2024-09-13T19:37:26.982763+0000","last_became_active":"2024-09-13T19:33:16.402870+0000","last_became_peered":"2024-09-13T19:33:16.402870+0000","last_unstale":"2024-09-13T19:37:26.982763+0000","last_undegraded":"2024-09-13T19:37:26.982763+0000","last_fullsized":"2024-09-13T19:37:26.982763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:26.982499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:26.982499+0000","last_clean_scrub_stamp":"2024-09-13T19:37:26.982499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:34.956774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:20.483248+0000","last_change":"2024-09-13T19:38:20.483307+0000","last_active":"2024-09-13T19:38:20.483248+0000","last_peered":"2024-09-13T19:38:20.483248+0000","last_clean":"2024-09-13T19:38:20.483248+0000","last_became_active":"2024-09-13T19:33:18.419644+0000","last_became_peered":"2024-09-13T19:33:18.419644+0000","last_unstale":"2024-09-13T19:38:20.483248+0000","last_undegraded":"2024-09-13T19:38:20.483248+0000","last_fullsized":"2024-09-13T19:38:20.483248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:38:20.483061+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:38:20.483061+0000","last_clean_scrub_stamp":"2024-09-13T19:38:20.483061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:53.948747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'14","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.942239+0000","last_change":"2024-09-13T19:37:27.942239+0000","last_active":"2024-09-13T19:37:27.942239+0000","last_peered":"2024-09-13T19:37:27.942239+0000","last_clean":"2024-09-13T19:37:27.942239+0000","last_became_active":"2024-09-13T19:33:10.336424+0000","last_became_peered":"2024-09-13T19:33:10.336424+0000","last_unstale":"2024-09-13T19:37:27.942239+0000","last_undegraded":"2024-09-13T19:37:27.942239+0000","last_fullsized":"2024-09-13T19:37:27.942239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:27.941988+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:27.941988+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.941988+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:53.406471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:47.478392+0000","last_change":"2024-09-13T19:37:47.478452+0000","last_active":"2024-09-13T19:37:47.478392+0000","last_peered":"2024-09-13T19:37:47.478392+0000","last_clean":"2024-09-13T19:37:47.478392+0000","last_became_active":"2024-09-13T19:33:08.328971+0000","last_became_peered":"2024-09-13T19:33:08.328971+0000","last_unstale":"2024-09-13T19:37:47.478392+0000","last_undegraded":"2024-09-13T19:37:47.478392+0000","last_fullsized":"2024-09-13T19:37:47.478392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:47.478174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:47.478174+0000","last_clean_scrub_stamp":"2024-09-13T19:37:47.478174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:08.475733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:13.532693+0000","last_change":"2024-09-13T19:37:13.532693+0000","last_active":"2024-09-13T19:37:13.532693+0000","last_peered":"2024-09-13T19:37:13.532693+0000","last_clean":"2024-09-13T19:37:13.532693+0000","last_became_active":"2024-09-13T19:33:12.361372+0000","last_became_peered":"2024-09-13T19:33:12.361372+0000","last_unstale":"2024-09-13T19:37:13.532693+0000","last_undegraded":"2024-09-13T19:37:13.532693+0000","last_fullsized":"2024-09-13T19:37:13.532693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:37:13.532406+0000","last_clean_scrub_stamp":"2024-09-13T19:37:13.532406+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:58.383662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:05.062437+0000","last_change":"2024-09-13T19:37:05.062437+0000","last_active":"2024-09-13T19:37:05.062437+0000","last_peered":"2024-09-13T19:37:05.062437+0000","last_clean":"2024-09-13T19:37:05.062437+0000","last_became_active":"2024-09-13T19:33:14.372303+0000","last_became_peered":"2024-09-13T19:33:14.372303+0000","last_unstale":"2024-09-13T19:37:05.062437+0000","last_undegraded":"2024-09-13T19:37:05.062437+0000","last_fullsized":"2024-09-13T19:37:05.062437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-13T19:37:05.062147+0000","last_clean_scrub_stamp":"2024-09-13T19:37:05.062147+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:44.414993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:36:59.301555+0000","last_change":"2024-09-13T19:36:59.301555+0000","last_active":"2024-09-13T19:36:59.301555+0000","last_peered":"2024-09-13T19:36:59.301555+0000","last_clean":"2024-09-13T19:36:59.301555+0000","last_became_active":"2024-09-13T19:33:16.374928+0000","last_became_peered":"2024-09-13T19:33:16.374928+0000","last_unstale":"2024-09-13T19:36:59.301555+0000","last_undegraded":"2024-09-13T19:36:59.301555+0000","last_fullsized":"2024-09-13T19:36:59.301555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:36:59.301322+0000","last_clean_scrub_stamp":"2024-09-13T19:36:59.301322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:26.231205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'4","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:18.500104+0000","last_change":"2024-09-13T19:38:18.500166+0000","last_active":"2024-09-13T19:38:18.500104+0000","last_peered":"2024-09-13T19:38:18.500104+0000","last_clean":"2024-09-13T19:38:18.500104+0000","last_became_active":"2024-09-13T19:33:18.420107+0000","last_became_peered":"2024-09-13T19:33:18.420107+0000","last_unstale":"2024-09-13T19:38:18.500104+0000","last_undegraded":"2024-09-13T19:38:18.500104+0000","last_fullsized":"2024-09-13T19:38:18.500104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:38:18.499901+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:38:18.499901+0000","last_clean_scrub_stamp":"2024-09-13T19:38:18.499901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:29.496915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"30'2","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.964064+0000","last_change":"2024-09-13T19:37:52.964064+0000","last_active":"2024-09-13T19:37:52.964064+0000","last_peered":"2024-09-13T19:37:52.964064+0000","last_clean":"2024-09-13T19:37:52.964064+0000","last_became_active":"2024-09-13T19:33:49.528408+0000","last_became_peered":"2024-09-13T19:33:49.528408+0000","last_unstale":"2024-09-13T19:37:52.964064+0000","last_undegraded":"2024-09-13T19:37:52.964064+0000","last_fullsized":"2024-09-13T19:37:52.964064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:52.963719+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:52.963719+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.963719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:29.957603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.052768+0000","last_change":"2024-09-13T19:37:40.052825+0000","last_active":"2024-09-13T19:37:40.052768+0000","last_peered":"2024-09-13T19:37:40.052768+0000","last_clean":"2024-09-13T19:37:40.052768+0000","last_became_active":"2024-09-13T19:33:08.331671+0000","last_became_peered":"2024-09-13T19:33:08.331671+0000","last_unstale":"2024-09-13T19:37:40.052768+0000","last_undegraded":"2024-09-13T19:37:40.052768+0000","last_fullsized":"2024-09-13T19:37:40.052768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:40.052581+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:40.052581+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.052581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:52.026250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.200561+0000","last_change":"2024-09-13T19:37:31.200618+0000","last_active":"2024-09-13T19:37:31.200561+0000","last_peered":"2024-09-13T19:37:31.200561+0000","last_clean":"2024-09-13T19:37:31.200561+0000","last_became_active":"2024-09-13T19:33:10.331591+0000","last_became_peered":"2024-09-13T19:33:10.331591+0000","last_unstale":"2024-09-13T19:37:31.200561+0000","last_undegraded":"2024-09-13T19:37:31.200561+0000","last_fullsized":"2024-09-13T19:37:31.200561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-13T19:37:31.200373+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-13T19:37:31.200373+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.200373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:01.945557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:50.084630+0000","last_change":"2024-09-13T19:37:50.084689+0000","last_active":"2024-09-13T19:37:50.084630+0000","last_peered":"2024-09-13T19:37:50.084630+0000","last_clean":"2024-09-13T19:37:50.084630+0000","last_became_active":"2024-09-13T19:33:08.324827+0000","last_became_peered":"2024-09-13T19:33:08.324827+0000","last_unstale":"2024-09-13T19:37:50.084630+0000","last_undegraded":"2024-09-13T19:37:50.084630+0000","last_fullsized":"2024-09-13T19:37:50.084630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:50.084429+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:50.084429+0000","last_clean_scrub_stamp":"2024-09-13T19:37:50.084429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:13.245839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:36.954921+0000","last_change":"2024-09-13T19:37:36.955053+0000","last_active":"2024-09-13T19:37:36.954921+0000","last_peered":"2024-09-13T19:37:36.954921+0000","last_clean":"2024-09-13T19:37:36.954921+0000","last_became_active":"2024-09-13T19:33:10.353134+0000","last_became_peered":"2024-09-13T19:33:10.353134+0000","last_unstale":"2024-09-13T19:37:36.954921+0000","last_undegraded":"2024-09-13T19:37:36.954921+0000","last_fullsized":"2024-09-13T19:37:36.954921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-13T19:37:36.954674+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-13T19:37:36.954674+0000","last_clean_scrub_stamp":"2024-09-13T19:37:36.954674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:38.360824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:14.550464+0000","last_change":"2024-09-13T19:38:14.550529+0000","last_active":"2024-09-13T19:38:14.550464+0000","last_peered":"2024-09-13T19:38:14.550464+0000","last_clean":"2024-09-13T19:38:14.550464+0000","last_became_active":"2024-09-13T19:33:08.334676+0000","last_became_peered":"2024-09-13T19:33:08.334676+0000","last_unstale":"2024-09-13T19:38:14.550464+0000","last_undegraded":"2024-09-13T19:38:14.550464+0000","last_fullsized":"2024-09-13T19:38:14.550464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:38:14.550263+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:38:14.550263+0000","last_clean_scrub_stamp":"2024-09-13T19:38:14.550263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:17.793700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.167479+0000","last_change":"2024-09-13T19:37:33.167544+0000","last_active":"2024-09-13T19:37:33.167479+0000","last_peered":"2024-09-13T19:37:33.167479+0000","last_clean":"2024-09-13T19:37:33.167479+0000","last_became_active":"2024-09-13T19:33:10.331970+0000","last_became_peered":"2024-09-13T19:33:10.331970+0000","last_unstale":"2024-09-13T19:37:33.167479+0000","last_undegraded":"2024-09-13T19:37:33.167479+0000","last_fullsized":"2024-09-13T19:37:33.167479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.167253+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.167253+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.167253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:45.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:54.086624+0000","last_change":"2024-09-13T19:37:54.086685+0000","last_active":"2024-09-13T19:37:54.086624+0000","last_peered":"2024-09-13T19:37:54.086624+0000","last_clean":"2024-09-13T19:37:54.086624+0000","last_became_active":"2024-09-13T19:33:08.344785+0000","last_became_peered":"2024-09-13T19:33:08.344785+0000","last_unstale":"2024-09-13T19:37:54.086624+0000","last_undegraded":"2024-09-13T19:37:54.086624+0000","last_fullsized":"2024-09-13T19:37:54.086624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:54.086427+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:54.086427+0000","last_clean_scrub_stamp":"2024-09-13T19:37:54.086427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:06.678941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.163622+0000","last_change":"2024-09-13T19:37:35.163796+0000","last_active":"2024-09-13T19:37:35.163622+0000","last_peered":"2024-09-13T19:37:35.163622+0000","last_clean":"2024-09-13T19:37:35.163622+0000","last_became_active":"2024-09-13T19:33:10.338321+0000","last_became_peered":"2024-09-13T19:33:10.338321+0000","last_unstale":"2024-09-13T19:37:35.163622+0000","last_undegraded":"2024-09-13T19:37:35.163622+0000","last_fullsized":"2024-09-13T19:37:35.163622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:35.163395+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:35.163395+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.163395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:10.385936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:49.052353+0000","last_change":"2024-09-13T19:37:49.052481+0000","last_active":"2024-09-13T19:37:49.052353+0000","last_peered":"2024-09-13T19:37:49.052353+0000","last_clean":"2024-09-13T19:37:49.052353+0000","last_became_active":"2024-09-13T19:33:08.324753+0000","last_became_peered":"2024-09-13T19:33:08.324753+0000","last_unstale":"2024-09-13T19:37:49.052353+0000","last_undegraded":"2024-09-13T19:37:49.052353+0000","last_fullsized":"2024-09-13T19:37:49.052353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:49.052106+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:49.052106+0000","last_clean_scrub_stamp":"2024-09-13T19:37:49.052106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:56.624456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:42.483093+0000","last_change":"2024-09-13T19:37:42.483164+0000","last_active":"2024-09-13T19:37:42.483093+0000","last_peered":"2024-09-13T19:37:42.483093+0000","last_clean":"2024-09-13T19:37:42.483093+0000","last_became_active":"2024-09-13T19:33:10.351761+0000","last_became_peered":"2024-09-13T19:33:10.351761+0000","last_unstale":"2024-09-13T19:37:42.483093+0000","last_undegraded":"2024-09-13T19:37:42.483093+0000","last_fullsized":"2024-09-13T19:37:42.483093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-13T19:37:42.482866+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-13T19:37:42.482866+0000","last_clean_scrub_stamp":"2024-09-13T19:37:42.482866+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:21.318908+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.483639+0000","last_change":"2024-09-13T19:37:43.483707+0000","last_active":"2024-09-13T19:37:43.483639+0000","last_peered":"2024-09-13T19:37:43.483639+0000","last_clean":"2024-09-13T19:37:43.483639+0000","last_became_active":"2024-09-13T19:33:08.338536+0000","last_became_peered":"2024-09-13T19:33:08.338536+0000","last_unstale":"2024-09-13T19:37:43.483639+0000","last_undegraded":"2024-09-13T19:37:43.483639+0000","last_fullsized":"2024-09-13T19:37:43.483639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:43.483442+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:43.483442+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.483442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:14.592719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.150134+0000","last_change":"2024-09-13T19:37:37.150197+0000","last_active":"2024-09-13T19:37:37.150134+0000","last_peered":"2024-09-13T19:37:37.150134+0000","last_clean":"2024-09-13T19:37:37.150134+0000","last_became_active":"2024-09-13T19:33:10.337592+0000","last_became_peered":"2024-09-13T19:33:10.337592+0000","last_unstale":"2024-09-13T19:37:37.150134+0000","last_undegraded":"2024-09-13T19:37:37.150134+0000","last_fullsized":"2024-09-13T19:37:37.150134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:37:37.149953+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:37:37.149953+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.149953+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.044893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:28.905881+0000","last_change":"2024-09-13T19:37:28.905881+0000","last_active":"2024-09-13T19:37:28.905881+0000","last_peered":"2024-09-13T19:37:28.905881+0000","last_clean":"2024-09-13T19:37:28.905881+0000","last_became_active":"2024-09-13T19:33:08.349729+0000","last_became_peered":"2024-09-13T19:33:08.349729+0000","last_unstale":"2024-09-13T19:37:28.905881+0000","last_undegraded":"2024-09-13T19:37:28.905881+0000","last_fullsized":"2024-09-13T19:37:28.905881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:28.905626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:28.905626+0000","last_clean_scrub_stamp":"2024-09-13T19:37:28.905626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:55.777372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:35.430872+0000","last_change":"2024-09-13T19:37:35.430941+0000","last_active":"2024-09-13T19:37:35.430872+0000","last_peered":"2024-09-13T19:37:35.430872+0000","last_clean":"2024-09-13T19:37:35.430872+0000","last_became_active":"2024-09-13T19:33:10.339191+0000","last_became_peered":"2024-09-13T19:33:10.339191+0000","last_unstale":"2024-09-13T19:37:35.430872+0000","last_undegraded":"2024-09-13T19:37:35.430872+0000","last_fullsized":"2024-09-13T19:37:35.430872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:35.430664+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:35.430664+0000","last_clean_scrub_stamp":"2024-09-13T19:37:35.430664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.672938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:51.038487+0000","last_change":"2024-09-13T19:37:51.038544+0000","last_active":"2024-09-13T19:37:51.038487+0000","last_peered":"2024-09-13T19:37:51.038487+0000","last_clean":"2024-09-13T19:37:51.038487+0000","last_became_active":"2024-09-13T19:33:08.325115+0000","last_became_peered":"2024-09-13T19:33:08.325115+0000","last_unstale":"2024-09-13T19:37:51.038487+0000","last_undegraded":"2024-09-13T19:37:51.038487+0000","last_fullsized":"2024-09-13T19:37:51.038487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:51.038289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:51.038289+0000","last_clean_scrub_stamp":"2024-09-13T19:37:51.038289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:38.835483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.512846+0000","last_change":"2024-09-13T19:37:30.512846+0000","last_active":"2024-09-13T19:37:30.512846+0000","last_peered":"2024-09-13T19:37:30.512846+0000","last_clean":"2024-09-13T19:37:30.512846+0000","last_became_active":"2024-09-13T19:33:10.347335+0000","last_became_peered":"2024-09-13T19:33:10.347335+0000","last_unstale":"2024-09-13T19:37:30.512846+0000","last_undegraded":"2024-09-13T19:37:30.512846+0000","last_fullsized":"2024-09-13T19:37:30.512846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:30.512571+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:30.512571+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.512571+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:33.379047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:13.562323+0000","last_change":"2024-09-13T19:38:13.562383+0000","last_active":"2024-09-13T19:38:13.562323+0000","last_peered":"2024-09-13T19:38:13.562323+0000","last_clean":"2024-09-13T19:38:13.562323+0000","last_became_active":"2024-09-13T19:33:08.332153+0000","last_became_peered":"2024-09-13T19:33:08.332153+0000","last_unstale":"2024-09-13T19:38:13.562323+0000","last_undegraded":"2024-09-13T19:38:13.562323+0000","last_fullsized":"2024-09-13T19:38:13.562323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:13.562124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:13.562124+0000","last_clean_scrub_stamp":"2024-09-13T19:38:13.562124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:22.708712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'14","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:18.104875+0000","last_change":"2024-09-13T19:37:18.104875+0000","last_active":"2024-09-13T19:37:18.104875+0000","last_peered":"2024-09-13T19:37:18.104875+0000","last_clean":"2024-09-13T19:37:18.104875+0000","last_became_active":"2024-09-13T19:33:10.357255+0000","last_became_peered":"2024-09-13T19:33:10.357255+0000","last_unstale":"2024-09-13T19:37:18.104875+0000","last_undegraded":"2024-09-13T19:37:18.104875+0000","last_fullsized":"2024-09-13T19:37:18.104875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-13T19:37:18.104473+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-13T19:37:18.104473+0000","last_clean_scrub_stamp":"2024-09-13T19:37:18.104473+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:20.278237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:40.025172+0000","last_change":"2024-09-13T19:37:40.025225+0000","last_active":"2024-09-13T19:37:40.025172+0000","last_peered":"2024-09-13T19:37:40.025172+0000","last_clean":"2024-09-13T19:37:40.025172+0000","last_became_active":"2024-09-13T19:33:08.344942+0000","last_became_peered":"2024-09-13T19:33:08.344942+0000","last_unstale":"2024-09-13T19:37:40.025172+0000","last_undegraded":"2024-09-13T19:37:40.025172+0000","last_fullsized":"2024-09-13T19:37:40.025172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:40.024986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:40.024986+0000","last_clean_scrub_stamp":"2024-09-13T19:37:40.024986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:45.755716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.244707+0000","last_change":"2024-09-13T19:37:30.244707+0000","last_active":"2024-09-13T19:37:30.244707+0000","last_peered":"2024-09-13T19:37:30.244707+0000","last_clean":"2024-09-13T19:37:30.244707+0000","last_became_active":"2024-09-13T19:33:10.343658+0000","last_became_peered":"2024-09-13T19:33:10.343658+0000","last_unstale":"2024-09-13T19:37:30.244707+0000","last_undegraded":"2024-09-13T19:37:30.244707+0000","last_fullsized":"2024-09-13T19:37:30.244707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:30.244451+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:30.244451+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.244451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:22.965504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:41.440228+0000","last_change":"2024-09-13T19:37:41.440287+0000","last_active":"2024-09-13T19:37:41.440228+0000","last_peered":"2024-09-13T19:37:41.440228+0000","last_clean":"2024-09-13T19:37:41.440228+0000","last_became_active":"2024-09-13T19:33:08.349445+0000","last_became_peered":"2024-09-13T19:33:08.349445+0000","last_unstale":"2024-09-13T19:37:41.440228+0000","last_undegraded":"2024-09-13T19:37:41.440228+0000","last_fullsized":"2024-09-13T19:37:41.440228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:41.440043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:41.440043+0000","last_clean_scrub_stamp":"2024-09-13T19:37:41.440043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:18.433927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:31.500426+0000","last_change":"2024-09-13T19:37:31.500426+0000","last_active":"2024-09-13T19:37:31.500426+0000","last_peered":"2024-09-13T19:37:31.500426+0000","last_clean":"2024-09-13T19:37:31.500426+0000","last_became_active":"2024-09-13T19:33:10.343400+0000","last_became_peered":"2024-09-13T19:33:10.343400+0000","last_unstale":"2024-09-13T19:37:31.500426+0000","last_undegraded":"2024-09-13T19:37:31.500426+0000","last_fullsized":"2024-09-13T19:37:31.500426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:31.500107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:31.500107+0000","last_clean_scrub_stamp":"2024-09-13T19:37:31.500107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:51.092885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:39.528643+0000","last_change":"2024-09-13T19:37:39.528643+0000","last_active":"2024-09-13T19:37:39.528643+0000","last_peered":"2024-09-13T19:37:39.528643+0000","last_clean":"2024-09-13T19:37:39.528643+0000","last_became_active":"2024-09-13T19:33:08.349576+0000","last_became_peered":"2024-09-13T19:33:08.349576+0000","last_unstale":"2024-09-13T19:37:39.528643+0000","last_undegraded":"2024-09-13T19:37:39.528643+0000","last_fullsized":"2024-09-13T19:37:39.528643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:39.528373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:39.528373+0000","last_clean_scrub_stamp":"2024-09-13T19:37:39.528373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:21.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:27.501778+0000","last_change":"2024-09-13T19:37:27.501778+0000","last_active":"2024-09-13T19:37:27.501778+0000","last_peered":"2024-09-13T19:37:27.501778+0000","last_clean":"2024-09-13T19:37:27.501778+0000","last_became_active":"2024-09-13T19:33:10.356066+0000","last_became_peered":"2024-09-13T19:33:10.356066+0000","last_unstale":"2024-09-13T19:37:27.501778+0000","last_undegraded":"2024-09-13T19:37:27.501778+0000","last_fullsized":"2024-09-13T19:37:27.501778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:27.501537+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:27.501537+0000","last_clean_scrub_stamp":"2024-09-13T19:37:27.501537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:56.956150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:52.848065+0000","last_change":"2024-09-13T19:37:52.848193+0000","last_active":"2024-09-13T19:37:52.848065+0000","last_peered":"2024-09-13T19:37:52.848065+0000","last_clean":"2024-09-13T19:37:52.848065+0000","last_became_active":"2024-09-13T19:33:08.341536+0000","last_became_peered":"2024-09-13T19:33:08.341536+0000","last_unstale":"2024-09-13T19:37:52.848065+0000","last_undegraded":"2024-09-13T19:37:52.848065+0000","last_fullsized":"2024-09-13T19:37:52.848065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:52.847823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:52.847823+0000","last_clean_scrub_stamp":"2024-09-13T19:37:52.847823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:10:54.892989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:32.493010+0000","last_change":"2024-09-13T19:37:32.493010+0000","last_active":"2024-09-13T19:37:32.493010+0000","last_peered":"2024-09-13T19:37:32.493010+0000","last_clean":"2024-09-13T19:37:32.493010+0000","last_became_active":"2024-09-13T19:33:10.350058+0000","last_became_peered":"2024-09-13T19:33:10.350058+0000","last_unstale":"2024-09-13T19:37:32.493010+0000","last_undegraded":"2024-09-13T19:37:32.493010+0000","last_fullsized":"2024-09-13T19:37:32.493010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:32.492604+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:32.492604+0000","last_clean_scrub_stamp":"2024-09-13T19:37:32.492604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:38.824183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:15.508768+0000","last_change":"2024-09-13T19:38:15.508835+0000","last_active":"2024-09-13T19:38:15.508768+0000","last_peered":"2024-09-13T19:38:15.508768+0000","last_clean":"2024-09-13T19:38:15.508768+0000","last_became_active":"2024-09-13T19:33:08.335206+0000","last_became_peered":"2024-09-13T19:33:08.335206+0000","last_unstale":"2024-09-13T19:38:15.508768+0000","last_undegraded":"2024-09-13T19:38:15.508768+0000","last_fullsized":"2024-09-13T19:38:15.508768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:38:15.508570+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:38:15.508570+0000","last_clean_scrub_stamp":"2024-09-13T19:38:15.508570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:35:59.958973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:37.937555+0000","last_change":"2024-09-13T19:37:37.937555+0000","last_active":"2024-09-13T19:37:37.937555+0000","last_peered":"2024-09-13T19:37:37.937555+0000","last_clean":"2024-09-13T19:37:37.937555+0000","last_became_active":"2024-09-13T19:33:10.353206+0000","last_became_peered":"2024-09-13T19:33:10.353206+0000","last_unstale":"2024-09-13T19:37:37.937555+0000","last_undegraded":"2024-09-13T19:37:37.937555+0000","last_fullsized":"2024-09-13T19:37:37.937555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:37.937265+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:37.937265+0000","last_clean_scrub_stamp":"2024-09-13T19:37:37.937265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:03.903704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:30.965052+0000","last_change":"2024-09-13T19:37:30.965052+0000","last_active":"2024-09-13T19:37:30.965052+0000","last_peered":"2024-09-13T19:37:30.965052+0000","last_clean":"2024-09-13T19:37:30.965052+0000","last_became_active":"2024-09-13T19:33:08.349341+0000","last_became_peered":"2024-09-13T19:33:08.349341+0000","last_unstale":"2024-09-13T19:37:30.965052+0000","last_undegraded":"2024-09-13T19:37:30.965052+0000","last_fullsized":"2024-09-13T19:37:30.965052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:30.964823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:30.964823+0000","last_clean_scrub_stamp":"2024-09-13T19:37:30.964823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:34.672513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:33.479987+0000","last_change":"2024-09-13T19:37:33.480053+0000","last_active":"2024-09-13T19:37:33.479987+0000","last_peered":"2024-09-13T19:37:33.479987+0000","last_clean":"2024-09-13T19:37:33.479987+0000","last_became_active":"2024-09-13T19:33:10.343140+0000","last_became_peered":"2024-09-13T19:33:10.343140+0000","last_unstale":"2024-09-13T19:37:33.479987+0000","last_undegraded":"2024-09-13T19:37:33.479987+0000","last_fullsized":"2024-09-13T19:37:33.479987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:37:33.479793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:37:33.479793+0000","last_clean_scrub_stamp":"2024-09-13T19:37:33.479793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:15.251464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:06.630551+0000","last_change":"2024-09-13T19:38:06.630609+0000","last_active":"2024-09-13T19:38:06.630551+0000","last_peered":"2024-09-13T19:38:06.630551+0000","last_clean":"2024-09-13T19:38:06.630551+0000","last_became_active":"2024-09-13T19:33:08.354646+0000","last_became_peered":"2024-09-13T19:33:08.354646+0000","last_unstale":"2024-09-13T19:38:06.630551+0000","last_undegraded":"2024-09-13T19:38:06.630551+0000","last_fullsized":"2024-09-13T19:38:06.630551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:06.630360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:06.630360+0000","last_clean_scrub_stamp":"2024-09-13T19:38:06.630360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:56.557373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:38:02.636122+0000","last_change":"2024-09-13T19:38:02.636181+0000","last_active":"2024-09-13T19:38:02.636122+0000","last_peered":"2024-09-13T19:38:02.636122+0000","last_clean":"2024-09-13T19:38:02.636122+0000","last_became_active":"2024-09-13T19:33:08.354131+0000","last_became_peered":"2024-09-13T19:33:08.354131+0000","last_unstale":"2024-09-13T19:38:02.636122+0000","last_undegraded":"2024-09-13T19:38:02.636122+0000","last_fullsized":"2024-09-13T19:38:02.636122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:38:02.635915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:38:02.635915+0000","last_clean_scrub_stamp":"2024-09-13T19:38:02.635915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:35.156843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:43.049275+0000","last_change":"2024-09-13T19:37:43.049275+0000","last_active":"2024-09-13T19:37:43.049275+0000","last_peered":"2024-09-13T19:37:43.049275+0000","last_clean":"2024-09-13T19:37:43.049275+0000","last_became_active":"2024-09-13T19:33:10.337939+0000","last_became_peered":"2024-09-13T19:33:10.337939+0000","last_unstale":"2024-09-13T19:37:43.049275+0000","last_undegraded":"2024-09-13T19:37:43.049275+0000","last_fullsized":"2024-09-13T19:37:43.049275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-13T19:37:43.049024+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-13T19:37:43.049024+0000","last_clean_scrub_stamp":"2024-09-13T19:37:43.049024+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:14.158302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:38.117918+0000","last_change":"2024-09-13T19:37:38.117918+0000","last_active":"2024-09-13T19:37:38.117918+0000","last_peered":"2024-09-13T19:37:38.117918+0000","last_clean":"2024-09-13T19:37:38.117918+0000","last_became_active":"2024-09-13T19:33:08.348328+0000","last_became_peered":"2024-09-13T19:33:08.348328+0000","last_unstale":"2024-09-13T19:37:38.117918+0000","last_undegraded":"2024-09-13T19:37:38.117918+0000","last_fullsized":"2024-09-13T19:37:38.117918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:37:38.117676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:37:38.117676+0000","last_clean_scrub_stamp":"2024-09-13T19:37:38.117676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:38.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T19:37:25.574599+0000","last_change":"2024-09-13T19:37:25.574599+0000","last_active":"2024-09-13T19:37:25.574599+0000","last_peered":"2024-09-13T19:37:25.574599+0000","last_clean":"2024-09-13T19:37:25.574599+0000","last_became_active":"2024-09-13T19:33:10.357448+0000","last_became_peered":"2024-09-13T19:33:10.357448+0000","last_unstale":"2024-09-13T19:37:25.574599+0000","last_undegraded":"2024-09-13T19:37:25.574599+0000","last_fullsized":"2024-09-13T19:37:25.574599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-13T19:37:25.574184+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-13T19:37:25.574184+0000","last_clean_scrub_stamp":"2024-09-13T19:37:25.574184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:32.773848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1527,"ondisk_log_size":1527,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1621,"num_read_kb":1511,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673032,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673033,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40460,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331380,"statfs":{"total":96636764160,"available":96595333120,"internally_reserved":0,"allocated":978944,"data_stored":724012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673032,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1015808,"data_stored":726198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":135923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:38:42.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T19:38:42.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f82a14e3640 1 Processor -- start 2024-09-13T19:38:42.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f82a14e3640 1 -- start start 2024-09-13T19:38:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f82a14e3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f829c12e6f0 0x7f829c12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f82a14e3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829c098d50 con 0x7f829c12f1c0 2024-09-13T19:38:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f82a14e3640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f829c06eba0 con 0x7f829c12e6f0 2024-09-13T19:38:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f829affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f829c12e6f0 0x7f829c12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f829a7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f829c12f1c0 0x7f829c12b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60920/0 (socket says 172.21.15.18:60920) 2024-09-13T19:38:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f829a7fc640 1 -- 172.21.15.18:0/848619852 learned_addr learned my addr 172.21.15.18:0/848619852 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-13T19:38:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f829affd640 1 -- 172.21.15.18:0/848619852 >> v1:172.21.15.18:6789/0 conn(0x7f829c12f1c0 legacy=0x7f829c12b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f8299ffb640 1 -- 172.21.15.18:0/848619852 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929072450 0 0) 0x7f8290001120 con 0x7f829c12f1c0 2024-09-13T19:38:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.976+0000 7f829affd640 1 -- 172.21.15.18:0/848619852 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c06ed60 con 0x7f829c12e6f0 2024-09-13T19:38:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f829affd640 1 --2- 172.21.15.18:0/848619852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c12ec80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f828c009740 tx=0x7f828c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691520742fb9369 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f8299ffb640 1 -- 172.21.15.18:0/848619852 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f828c0b0070 con 0x7f829c12e6f0 2024-09-13T19:38:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f8299ffb640 1 -- 172.21.15.18:0/848619852 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c0ab530 con 0x7f829c12e6f0 2024-09-13T19:38:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f8299ffb640 1 -- 172.21.15.18:0/848619852 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f828c0ab830 con 0x7f829c12e6f0 2024-09-13T19:38:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- 172.21.15.18:0/848619852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 msgr2=0x7f829c12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 --2- 172.21.15.18:0/848619852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c12ec80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f828c009740 tx=0x7f828c01c370 comp rx=0 tx=0).stop 2024-09-13T19:38:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- 172.21.15.18:0/848619852 shutdown_connections 2024-09-13T19:38:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 --2- 172.21.15.18:0/848619852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c12ec80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- 172.21.15.18:0/848619852 >> 172.21.15.18:0/848619852 conn(0x7f829c0a1030 msgr2=0x7f829c0a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:38:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- 172.21.15.18:0/848619852 shutdown_connections 2024-09-13T19:38:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- 172.21.15.18:0/848619852 wait complete. 2024-09-13T19:38:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 Processor -- start 2024-09-13T19:38:42.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- start start 2024-09-13T19:38:42.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c130c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:42.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f829c137610 con 0x7f829c12e6f0 2024-09-13T19:38:42.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f829affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c130c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:42.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f829affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c130c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36016/0 (socket says 172.21.15.18:36016) 2024-09-13T19:38:42.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f829affd640 1 -- 172.21.15.18:0/3059617553 learned_addr learned my addr 172.21.15.18:0/3059617553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-13T19:38:42.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f829affd640 1 -- 172.21.15.18:0/3059617553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c132b10 con 0x7f829c12e6f0 2024-09-13T19:38:42.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f829affd640 1 --2- 172.21.15.18:0/3059617553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c130c20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f828c019fa0 tx=0x7f828c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:42.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82837fe640 1 -- 172.21.15.18:0/3059617553 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f828c0bb070 con 0x7f829c12e6f0 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82837fe640 1 -- 172.21.15.18:0/3059617553 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c004150 con 0x7f829c12e6f0 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c1343f0 con 0x7f829c12e6f0 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82837fe640 1 -- 172.21.15.18:0/3059617553 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f828c0b0040 con 0x7f829c12e6f0 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.980+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c131160 con 0x7f829c12e6f0 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.984+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829c12ec80 con 0x7f829c12e6f0 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.984+0000 7f82837fe640 1 -- 172.21.15.18:0/3059617553 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f828c003620 con 0x7f829c12e6f0 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.984+0000 7f82837fe640 1 --2- 172.21.15.18:0/3059617553 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288035db0 0x7f8288038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.984+0000 7f82837fe640 1 -- 172.21.15.18:0/3059617553 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f828c0e3950 con 0x7f829c12e6f0 2024-09-13T19:38:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.984+0000 7f829a7fc640 1 --2- 172.21.15.18:0/3059617553 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288035db0 0x7f8288038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:38:42.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.984+0000 7f829a7fc640 1 --2- 172.21.15.18:0/3059617553 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288035db0 0x7f8288038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8290000c10 tx=0x7f8290001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:38:42.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:42.988+0000 7f82837fe640 1 -- 172.21.15.18:0/3059617553 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f828c015ff0 con 0x7f829c12e6f0 2024-09-13T19:38:43.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.148+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f829c131d90 con 0x7f829c12e6f0 2024-09-13T19:38:43.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82837fe640 1 -- 172.21.15.18:0/3059617553 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f828c0b7420 con 0x7f829c12e6f0 2024-09-13T19:38:43.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82837fe640 1 -- 172.21.15.18:0/3059617553 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f828c0e9080 con 0x7f829c12e6f0 2024-09-13T19:38:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288035db0 msgr2=0x7f8288038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 --2- 172.21.15.18:0/3059617553 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288035db0 0x7f8288038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8290000c10 tx=0x7f8290001320 comp rx=0 tx=0).stop 2024-09-13T19:38:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 msgr2=0x7f829c130c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:38:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 --2- 172.21.15.18:0/3059617553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c130c20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f828c019fa0 tx=0x7f828c01abb0 comp rx=0 tx=0).stop 2024-09-13T19:38:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 shutdown_connections 2024-09-13T19:38:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 --2- 172.21.15.18:0/3059617553 >> [v2:172.21.15.144:6824/4073212006,v1:172.21.15.144:6825/4073212006] conn(0x7f8288035db0 0x7f8288038270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:43.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 --2- 172.21.15.18:0/3059617553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829c12e6f0 0x7f829c130c20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:38:43.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 >> 172.21.15.18:0/3059617553 conn(0x7f829c0a1030 msgr2=0x7f829c09b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:38:43.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 shutdown_connections 2024-09-13T19:38:43.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-13T19:38:43.156+0000 7f82a14e3640 1 -- 172.21.15.18:0/3059617553 wait complete. 2024-09-13T19:38:43.181 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T19:38:43.181 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T19:38:43.182 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T19:38:43.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:38:43.255 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T19:38:43.256 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T19:38:43.256 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:38:43.342 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T19:38:43.342 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T19:38:43.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:38:43.428 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T19:38:43.429 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T19:38:43.429 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:38:48.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T19:38:49.531 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T19:38:49.531 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T19:38:49.531 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T19:38:49.531 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:38:49.561 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T19:38:49.562 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T19:38:49.562 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T19:38:49.562 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:38:49.585 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T19:38:49.585 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T19:38:49.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-13T19:38:49.646 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T19:38:49.646 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T19:38:49.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:38:49.871 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T19:38:50.100 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:38:50.100 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T19:38:50.265 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:38:50.265 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T19:38:50.432 INFO:tasks.ceph:Archiving mon data... 2024-09-13T19:38:50.433 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078/data/mon.a.tgz 2024-09-13T19:38:50.433 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-13T19:38:50.439 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.Rml6DjSvCh 2024-09-13T19:38:50.439 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Rml6DjSvCh 2024-09-13T19:38:50.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.Rml6DjSvCh 2024-09-13T19:38:50.629 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.Rml6DjSvCh is 278KB 2024-09-13T19:38:50.691 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.Rml6DjSvCh 2024-09-13T19:38:50.696 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T19:38:50.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T19:38:50.742 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T19:38:50.802 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T19:38:50.807 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T19:38:50.807 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T19:38:50.809 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078/remote/smithi018/crash 2024-09-13T19:38:50.810 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T19:38:50.858 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078/remote/smithi144/crash 2024-09-13T19:38:50.859 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T19:38:50.871 INFO:tasks.ceph:Compressing logs... 2024-09-13T19:38:50.871 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T19:38:50.906 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T19:38:50.931 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23805.log 2024-09-13T19:38:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23940.log 2024-09-13T19:38:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.23805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24385.log 2024-09-13T19:38:50.933 INFO:teuthology.orchestra.run.smithi018.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23805.log.gz 2024-09-13T19:38:50.933 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.23940.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T19:38:50.933 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23940.log.gz 2024-09-13T19:38:50.934 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23902.log 2024-09-13T19:38:50.934 INFO:teuthology.orchestra.run.smithi018.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24385.log.gz 2024-09-13T19:38:50.934 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23939.log 2024-09-13T19:38:50.934 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.23902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24437.log 2024-09-13T19:38:50.935 INFO:teuthology.orchestra.run.smithi018.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23902.log.gz 2024-09-13T19:38:50.935 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.23939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23938.log 2024-09-13T19:38:50.935 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23939.log.gz 2024-09-13T19:38:50.935 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24701.log 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24437.log: /var/log/ceph/ceph-client.admin.23938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24136.log 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24437.log.gz 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23938.log.gz 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24543.log 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24701.log.gz 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.24136.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24621.log 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24543.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.24136.log.gz 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23850.log 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24543.log.gz 2024-09-13T19:38:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24569.log 2024-09-13T19:38:50.939 INFO:teuthology.orchestra.run.smithi018.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24621.log.gz 2024-09-13T19:38:50.939 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.23850.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-13T19:38:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24569.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23850.log.gz 2024-09-13T19:38:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24140.log 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24569.log.gz 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24673.log 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22696.log 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24140.log.gz 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24359.log 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.22696.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24673.log.gz 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.22696.log.gz 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24463.log 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24147.log 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24359.log: /var/log/ceph/ceph-client.admin.24463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24292.log 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24463.log.gz 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24359.log.gz 2024-09-13T19:38:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21432.log 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24147.log: /var/log/ceph/ceph-client.admin.24292.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.24147.log.gz 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24292.log.gz 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24040.log 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24727.log 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.tmp-client.admin.21432.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21432.log.gz 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24753.log 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24040.log.gz 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23664.log 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24727.log.gz 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24517.log 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24753.log.gz 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.23664.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23664.log.gz 2024-09-13T19:38:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24595.log 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24517.log.gz 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24779.log 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24647.log 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24595.log.gz 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24411.log 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24779.log.gz 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24333.log 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24647.log.gz 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23876.log 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24411.log.gz 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24333.log: /var/log/ceph/ceph-client.admin.23876.log: gzip -5 --verbose -- 85.6% /var/log/ceph/ceph-client.admin.24490.log 2024-09-13T19:38:50.963 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24333.log.gz 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23876.log.gz 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24148.log 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23935.log 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23830.log 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24490.log.gz 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24148.log: /var/log/ceph/ceph-client.admin.23935.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24148.log.gz 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23778.log 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23935.log.gz 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.23830.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24032.log 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.23778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24803.log 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.23830.log.gz 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23778.log.gz 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22808.log 2024-09-13T19:38:50.964 INFO:teuthology.orchestra.run.smithi018.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24032.log.gz 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24039.log 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24803.log.gz 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.22808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22767.log 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24039.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.22808.log.gz 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24039.log.gz 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24240.log 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24062.log 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.22767.log: /var/log/ceph/ceph-client.admin.24240.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.22767.log.gz 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24266.log 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24240.log.gz 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24062.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24062.log.gz 2024-09-13T19:38:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.24266.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24266.log.gz 2024-09-13T19:38:50.975 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37827.log 2024-09-13T19:38:50.975 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-13T19:38:50.975 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.37827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80870.log 2024-09-13T19:38:50.975 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55527.log 2024-09-13T19:38:50.975 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64967.log 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.37827.log.gz 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.80870.log: /var/log/ceph/ceph-client.0.55527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58477.log 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.64967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25155.log 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.58477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36057.log 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.25155.log: gzip -5 --verbose -- 91.4% 91.3% /var/log/ceph/ceph-client.0.44907.log 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.0.80870.log.gz 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25155.log.gz 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.0.55527.log.gz/var/log/ceph/ceph-client.0.36057.log: 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53167.log 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.44907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66737.log 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.36057.log.gz 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58477.log.gz 2024-09-13T19:38:50.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.53167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37237.log 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.66737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41957.log 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64967.log.gz 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44907.log.gz 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.37237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60247.log 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73227.log 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.41957.log: /var/log/ceph/ceph-client.0.60247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72637.log 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.53167.log.gz 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.73227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85590.log 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% 91.6% -- replaced with /var/log/ceph/ceph-client.0.37237.log.gz 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.0.66737.log.gz 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.41957.log.gz 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.72637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59067.log 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51987.log 2024-09-13T19:38:50.977 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.85590.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60247.log.gz 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.59067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81460.log 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25131.log 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.73227.log.gz 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.72637.log.gz 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.51987.log: /var/log/ceph/ceph-client.0.81460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62607.log 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.25131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51397.log 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.25131.log.gz 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85590.log.gz 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.59067.log.gz 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.62607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25107.log 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.51397.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81460.log.gz 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51987.log.gz 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32523.log 2024-09-13T19:38:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.25107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69097.log 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25107.log.gz 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.32523.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.69097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50807.log 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51397.log.gz 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84410.log 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.62607.log.gz 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.50807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40777.log 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.32523.log.gz 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.84410.log: 91.6%gzip -- replaced with /var/log/ceph/ceph-client.0.69097.log.gz 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.57887.log 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.40777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45497.log 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.57887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83820.log 2024-09-13T19:38:50.979 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50807.log.gz 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.45497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70277.log 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.84410.log.gz 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.83820.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40777.log.gzgzip 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.63197.log 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.70277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79112.log 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74407.log 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57887.log.gz 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3%/var/log/ceph/ceph-client.0.63197.log: -- replaced with /var/log/ceph/ceph-client.0.45497.log.gz/var/log/ceph/ceph-client.0.79112.log: 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44317.log 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83820.log.gz 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.74407.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.79112.log.gz 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.70277.log.gz 2024-09-13T19:38:50.980 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.63197.log.gz 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52577.log 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.44317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71457.log 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.52577.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.74407.log.gz 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.71457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87950.log 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77360.log 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.44317.log.gz/var/log/ceph/ceph-client.0.87950.log: 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75000.log 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52577.log.gz 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.77360.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43137.log 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.0.71457.log.gz 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.75000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63787.log 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.77360.log.gz 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.0.87950.log.gz 2024-09-13T19:38:50.981 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.80280.log 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.43137.log: /var/log/ceph/ceph-client.0.63787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76180.log 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.80280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29446.log 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75000.log.gz 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.76180.log: 91.3%/var/log/ceph/ceph-client.admin.29446.log: -- replaced with /var/log/ceph/ceph-client.0.43137.log.gz 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63787.log.gz 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29446.log.gz 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31343.log 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80280.log.gz 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29494.log 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.31343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69687.log 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.29494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48447.log 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29494.log.gz 2024-09-13T19:38:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.69687.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76180.log.gz 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31343.log.gz 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69687.log.gz 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61427.log 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.48447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33697.log 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.61427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39007.log 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.33697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41367.log 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.39007.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48447.log.gz 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39007.log.gz 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.33697.log.gzgzip 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.47857.log 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61427.log.gz 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.41367.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T19:38:50.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.47857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77944.log 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38417.log 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.77944.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41367.log.gz 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.47857.log.gz 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.77944.log.gz 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33113.log 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.38417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70867.log 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.33113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56707.log 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.70867.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.33113.log.gz 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38417.log.gz 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68507.log 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.56707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54347.log 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.68507.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70867.log.gz 2024-09-13T19:38:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56117.log 2024-09-13T19:38:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.54347.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56707.log.gz 2024-09-13T19:38:50.991 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68507.log.gz 2024-09-13T19:38:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64377.log 2024-09-13T19:38:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.56117.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.54347.log.gz 2024-09-13T19:38:50.991 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.56117.log.gz 2024-09-13T19:38:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75590.log 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29422.log 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.64377.log: /var/log/ceph/ceph-client.0.75590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86770.log 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.29422.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29422.log.gz 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64377.log.gz 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34287.log 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75590.log.gz/var/log/ceph/ceph-client.0.86770.log: 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86770.log.gz 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53757.log 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.34287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31933.log 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36647.log 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.53757.log: /var/log/ceph/ceph-client.0.31933.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.34287.log.gz 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53757.log.gz 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47267.log 2024-09-13T19:38:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.36647.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31933.log.gz 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39597.log 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62017.log 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.47267.log: /var/log/ceph/ceph-client.0.39597.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36647.log.gz 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47267.log.gz 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.39597.log.gz 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42547.log 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.62017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59657.log 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.42547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79696.log 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.59657.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.42547.log.gz 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.59657.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.30163.log 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.79696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67917.log 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.62017.log.gz 2024-09-13T19:38:50.993 INFO:teuthology.orchestra.run.smithi144.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.79696.log.gz 2024-09-13T19:38:50.998 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.30163.log: 92.3% -- replaced with /var/log/ceph/ceph-client.0.30163.log.gz 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.67917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67327.log 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50217.log 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.67327.log: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.67917.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.86180.log 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.50217.log: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67327.log.gz 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87360.log 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.86180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88545.log 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.87360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43727.log 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.50217.log.gz 2024-09-13T19:38:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.88545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60837.log 2024-09-13T19:38:51.000 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.43727.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86180.log.gz 2024-09-13T19:38:51.000 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87360.log.gz 2024-09-13T19:38:51.000 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49037.log 2024-09-13T19:38:51.000 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.60837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54937.log 2024-09-13T19:38:51.000 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.43727.log.gz 2024-09-13T19:38:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83230.log 2024-09-13T19:38:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.49037.log: /var/log/ceph/ceph-client.0.54937.log: 93.4% -- replaced with /var/log/ceph/ceph-client.0.88545.log.gz 91.3% -- replaced with /var/log/ceph/ceph-client.0.60837.log.gz 2024-09-13T19:38:51.001 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-13T19:38:51.001 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49037.log.gz 2024-09-13T19:38:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35467.log 2024-09-13T19:38:51.001 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54937.log.gz 2024-09-13T19:38:51.002 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.83230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78528.log 2024-09-13T19:38:51.002 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72047.log 2024-09-13T19:38:51.003 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.35467.log: /var/log/ceph/ceph-client.0.78528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82050.log 2024-09-13T19:38:51.003 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.72047.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78528.log.gz 2024-09-13T19:38:51.003 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83230.log.gz 2024-09-13T19:38:51.004 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35467.log.gz 2024-09-13T19:38:51.005 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.72047.log.gz 2024-09-13T19:38:51.005 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25083.log 2024-09-13T19:38:51.005 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.82050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65557.log 2024-09-13T19:38:51.006 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.25083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82640.log 2024-09-13T19:38:51.007 INFO:teuthology.orchestra.run.smithi144.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.25083.log.gz 2024-09-13T19:38:51.007 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.65557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29470.log 2024-09-13T19:38:51.007 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85000.log 2024-09-13T19:38:51.008 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.82640.log: /var/log/ceph/ceph-client.admin.29470.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82050.log.gz 2024-09-13T19:38:51.008 INFO:teuthology.orchestra.run.smithi144.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29470.log.gz 2024-09-13T19:38:51.009 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- 91.3% /var/log/ceph/ceph-client.0.46677.log 2024-09-13T19:38:51.009 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.0.65557.log.gz 2024-09-13T19:38:51.009 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.85000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40187.log 2024-09-13T19:38:51.009 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76770.log 2024-09-13T19:38:51.009 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82640.log.gz 2024-09-13T19:38:51.010 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.40187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73817.log 2024-09-13T19:38:51.010 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.76770.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85000.log.gz 2024-09-13T19:38:51.011 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46677.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.66147.log 2024-09-13T19:38:51.011 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-13T19:38:51.011 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.73817.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40187.log.gz 2024-09-13T19:38:51.011 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.76770.log.gz 2024-09-13T19:38:51.011 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34877.log 2024-09-13T19:38:51.012 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46087.log 2024-09-13T19:38:51.013 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.66147.log: /var/log/ceph/ceph-client.0.34877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49627.log 2024-09-13T19:38:51.013 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.46087.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73817.log.gz 2024-09-13T19:38:51.014 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57297.log 2024-09-13T19:38:51.014 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.49627.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.66147.log.gz 2024-09-13T19:38:51.014 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.34877.log.gz 2024-09-13T19:38:51.014 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46087.log.gz 2024-09-13T19:38:51.014 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30753.log 2024-09-13T19:38:51.015 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.57297.log: /var/log/ceph/ceph-client.0.30753.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.49627.log.gz 2024-09-13T19:38:51.016 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30753.log.gz 2024-09-13T19:38:51.016 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.57297.log.gz 2024-09-13T19:38:51.039 INFO:teuthology.orchestra.run.smithi144.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T19:38:51.147 INFO:teuthology.orchestra.run.smithi018.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T19:38:51.776 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T19:38:51.902 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T19:38:51.932 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T19:38:51.933 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-13T19:38:51.933 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m1.016s 2024-09-13T19:38:51.933 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m2.971s 2024-09-13T19:38:51.933 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m0.171s 2024-09-13T19:38:51.936 INFO:teuthology.orchestra.run.smithi018.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T19:38:51.937 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-13T19:38:51.937 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m1.029s 2024-09-13T19:38:51.937 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m1.228s 2024-09-13T19:38:51.937 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.069s 2024-09-13T19:38:51.938 INFO:tasks.ceph:Archiving logs... 2024-09-13T19:38:51.938 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078/remote/smithi018/log 2024-09-13T19:38:51.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T19:38:52.200 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078/remote/smithi144/log 2024-09-13T19:38:52.201 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T19:38:52.661 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T19:38:52.672 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T19:38:52.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T19:38:52.675 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T19:38:52.758 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T19:38:52.836 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T19:38:52.836 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:38:52.838 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:38:52.849 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T19:38:52.849 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2024-09-13T19:38:52.850 INFO:teuthology.orchestra.run.smithi018.stdout:*hv01.front.sepi 67.205.162.81 3 u 45 64 377 0.125 +1.034 1.977 2024-09-13T19:38:52.850 INFO:teuthology.orchestra.run.smithi018.stdout:+hv02.front.sepi 96.245.170.99 3 u 39 64 377 0.075 -3.750 2.303 2024-09-13T19:38:52.850 INFO:teuthology.orchestra.run.smithi018.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.098 +1.369 1.882 2024-09-13T19:38:52.850 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:38:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T19:38:52.851 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================== 2024-09-13T19:38:52.852 INFO:teuthology.orchestra.run.smithi144.stdout:+hv01.front.sepi 67.205.162.81 3 u 42 64 377 0.091 +0.241 1.050 2024-09-13T19:38:52.852 INFO:teuthology.orchestra.run.smithi144.stdout:+hv02.front.sepi 96.245.170.99 3 u 39 64 377 0.073 -3.987 0.978 2024-09-13T19:38:52.852 INFO:teuthology.orchestra.run.smithi144.stdout:*hv03.front.sepi 74.6.168.72 3 u 43 64 377 0.100 -1.098 1.283 2024-09-13T19:38:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:38:52.853 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T19:38:52.939 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T19:38:52.940 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T19:38:52.972 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T19:38:53.061 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T19:38:53.072 INFO:teuthology.task.internal:Duration was 970.414952 seconds 2024-09-13T19:38:53.072 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T19:38:53.082 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T19:38:53.082 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T19:38:53.085 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T19:38:53.122 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T19:38:53.122 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-13T19:38:53.122 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T19:38:53.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-13T19:38:53.175 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T19:38:53.185 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T19:38:53.185 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:38:53.222 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:38:53.251 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T19:38:53.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T19:38:53.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T19:38:53.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T19:38:53.358 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T19:38:53.359 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T19:38:53.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T19:38:53.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T19:38:53.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:38:53.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:38:53.428 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-13T19:38:53.434 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-13T19:38:53.540 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:38:53.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:38:53.545 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:38:53.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:38:53.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T19:38:53.597 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T19:38:53.597 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078/remote/smithi018 2024-09-13T19:38:53.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T19:38:53.618 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904078/remote/smithi144 2024-09-13T19:38:53.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T19:38:53.654 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T19:38:53.654 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T19:38:53.662 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T19:38:53.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T19:38:53.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T19:38:53.708 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T19:38:53.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T19:38:53.794 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T19:38:53.794 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T19:38:53.797 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T19:38:53.801 INFO:teuthology.orchestra.run.smithi018.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 19:38 /home/ubuntu/cephtest 2024-09-13T19:38:53.803 INFO:teuthology.orchestra.run.smithi144.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 19:38 /home/ubuntu/cephtest 2024-09-13T19:38:53.804 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T19:38:53.918 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T19:38:54.015 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} duration: 970.4149518013 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-13T19:38:54.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T19:38:54.105 INFO:teuthology.run:pass